-- Logs begin at Sun 2022-08-21 00:10:35 UTC, end at Sun 2022-08-21 03:03:33 UTC. -- Aug 21 00:50:31.023581 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Aug 21 00:50:31.032194 n-d-master-1 devstack@keystone.service[81871]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 21 00:50:31.034786 n-d-master-1 devstack@keystone.service[81871]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 21 00:50:31 2022] *** Aug 21 00:50:31.034914 n-d-master-1 devstack@keystone.service[81871]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 21 00:50:31.035033 n-d-master-1 devstack@keystone.service[81871]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 21 00:50:31.035135 n-d-master-1 devstack@keystone.service[81871]: nodename: n-d-master-1 Aug 21 00:50:31.035235 n-d-master-1 devstack@keystone.service[81871]: machine: x86_64 Aug 21 00:50:31.035335 n-d-master-1 devstack@keystone.service[81871]: clock source: unix Aug 21 00:50:31.035432 n-d-master-1 devstack@keystone.service[81871]: pcre jit disabled Aug 21 00:50:31.035529 n-d-master-1 devstack@keystone.service[81871]: detected number of CPU cores: 4 Aug 21 00:50:31.035632 n-d-master-1 devstack@keystone.service[81871]: current working directory: / Aug 21 00:50:31.035724 n-d-master-1 devstack@keystone.service[81871]: detected binary path: /usr/bin/uwsgi-core Aug 21 00:50:31.035827 n-d-master-1 devstack@keystone.service[81871]: your processes number limit is 47680 Aug 21 00:50:31.035927 n-d-master-1 devstack@keystone.service[81871]: your memory page size is 4096 bytes Aug 21 00:50:31.036029 n-d-master-1 devstack@keystone.service[81871]: detected max file descriptor number: 2048 Aug 21 00:50:31.036135 n-d-master-1 devstack@keystone.service[81871]: lock engine: pthread robust mutexes Aug 21 00:50:31.036391 n-d-master-1 devstack@keystone.service[81871]: thunder lock: enabled Aug 21 00:50:31.036680 n-d-master-1 devstack@keystone.service[81871]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 21 00:50:31.036878 n-d-master-1 devstack@keystone.service[81871]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 21 00:50:31.076144 n-d-master-1 devstack@keystone.service[81871]: Python main interpreter initialized at 0x55d81374c9c0 Aug 21 00:50:31.076144 n-d-master-1 devstack@keystone.service[81871]: python threads support enabled Aug 21 00:50:31.076144 n-d-master-1 devstack@keystone.service[81871]: your server socket listen backlog is limited to 100 connections Aug 21 00:50:31.076144 n-d-master-1 devstack@keystone.service[81871]: your mercy for graceful operations on workers is 90 seconds Aug 21 00:50:31.076515 n-d-master-1 devstack@keystone.service[81871]: mapped 403077 bytes (393 KB) for 2 cores Aug 21 00:50:31.076515 n-d-master-1 devstack@keystone.service[81871]: *** Operational MODE: preforking *** Aug 21 00:50:31.076864 n-d-master-1 devstack@keystone.service[81871]: *** uWSGI is running in multiple interpreter mode *** Aug 21 00:50:31.076864 n-d-master-1 devstack@keystone.service[81871]: spawned uWSGI master process (pid: 81871) Aug 21 00:50:31.077068 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Aug 21 00:50:31.077586 n-d-master-1 devstack@keystone.service[81871]: spawned uWSGI worker 1 (pid: 81885, cores: 1) Aug 21 00:50:31.077928 n-d-master-1 devstack@keystone.service[81871]: spawned uWSGI worker 2 (pid: 81886, cores: 1) Aug 21 00:50:31.078078 n-d-master-1 devstack@keystone.service[81871]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 21 00:50:35.302879 n-d-master-1 devstack@keystone.service[81886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:35.302879 n-d-master-1 devstack@keystone.service[81886]: from cryptography.utils import int_from_bytes Aug 21 00:50:35.303698 n-d-master-1 devstack@keystone.service[81886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:35.303698 n-d-master-1 devstack@keystone.service[81886]: from cryptography.utils import int_from_bytes Aug 21 00:50:35.309835 n-d-master-1 devstack@keystone.service[81885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:35.309835 n-d-master-1 devstack@keystone.service[81885]: from cryptography.utils import int_from_bytes Aug 21 00:50:35.310311 n-d-master-1 devstack@keystone.service[81885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:35.310311 n-d-master-1 devstack@keystone.service[81885]: from cryptography.utils import int_from_bytes Aug 21 00:50:35.352681 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:50:35.352893 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:50:35.353029 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] command line args: [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:50:35.353324 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:50:35.353456 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ================================================================================ {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:50:35.353736 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] admin_token = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.353974 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] config_dir = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.354179 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.354359 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] config_source = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.354571 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] debug = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.354690 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.355070 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.355520 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.355784 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.356027 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.356226 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] list_limit = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.356425 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] log_config_append = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.356589 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.356709 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] log_dir = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.356974 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] log_file = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.357169 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.357407 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.357540 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:50:35.357635 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.357769 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:50:35.357853 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] command line args: [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:50:35.357968 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358051 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358176 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:50:35.358252 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358375 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ================================================================================ {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:50:35.358456 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358575 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] admin_token = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358649 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358767 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] config_dir = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358850 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.358963 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359043 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] config_source = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359155 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359236 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] debug = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359355 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359430 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359577 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359653 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359777 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359858 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.359934 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360052 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360152 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360236 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360457 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] list_limit = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360633 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] log_config_append = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360715 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360816 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360911 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] publish_errors = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.360992 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] log_dir = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361072 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361198 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] log_file = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361281 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361353 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361475 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361615 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361694 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361772 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.361848 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362042 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362182 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] standard_threads = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362263 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362330 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362406 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362511 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362601 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362682 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362835 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.362958 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] use_journal = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363047 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363121 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] use_json = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363370 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] use_stderr = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363475 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363551 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] use_syslog = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363617 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363695 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363767 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.363923 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.364019 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.364153 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.364242 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.364406 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.364634 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.364980 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.365104 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.365175 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.365423 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.365563 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.365737 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.365907 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] publish_errors = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.365995 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.366238 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.366379 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.366630 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.366794 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.366794 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.367080 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.367174 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.367311 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.367387 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.367511 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.367587 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] standard_threads = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.367699 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.367699 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.367904 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.367978 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.368053 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.368296 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.368407 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.368543 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.368774 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.368858 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.369004 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] use_journal = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.369084 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.369154 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] use_json = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.369268 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.369362 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] use_stderr = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.369505 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] use_syslog = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.369586 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.369738 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:35.369819 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.369967 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370059 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370191 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370279 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370409 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370496 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370638 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370729 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370873 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.370961 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371111 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371194 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371331 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371492 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371565 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371676 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371761 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.371832 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372002 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372093 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372230 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372312 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372467 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372557 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372696 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372810 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.372944 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373026 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373159 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373238 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373384 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373463 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373607 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373684 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373831 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.373910 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374056 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374134 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374286 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374363 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374527 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374603 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374752 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374830 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.374981 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375065 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375205 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375290 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375433 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375511 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375661 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375739 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375899 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.375975 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.376121 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.376205 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.376378 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.376506 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.376588 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.376679 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.376923 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377002 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377072 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377142 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377237 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377315 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377459 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377545 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377698 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377781 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.377924 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378003 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378154 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378232 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378377 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378463 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378607 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378689 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378841 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.378924 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379064 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379141 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379288 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379369 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379513 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379590 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379736 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379844 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.379969 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380048 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380212 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380292 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380438 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380516 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380668 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380751 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.380916 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381001 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381145 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381233 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381372 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381457 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381649 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381870 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.381870 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382107 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382253 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382355 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382355 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382494 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382567 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382723 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382803 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.382958 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383036 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383182 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383261 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383409 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383485 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383652 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383728 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383881 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.383959 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384108 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384185 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384333 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384417 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384559 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384637 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384800 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.384884 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385031 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385111 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385252 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385365 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385472 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385568 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385683 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385784 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.385910 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386020 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386115 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386208 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386349 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386429 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386578 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386695 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386817 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.386921 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387033 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387108 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387278 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387360 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387524 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387640 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387754 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.387871 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388023 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] auth.external = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388148 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388230 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388302 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388420 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388503 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388694 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388876 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.388956 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389016 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] auth.password = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389128 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] auth.token = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389202 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389334 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389423 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389561 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389641 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389798 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.389885 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390026 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390114 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390260 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390344 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390494 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390572 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390714 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390799 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.390941 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391017 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] credential.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391166 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391245 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391392 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391499 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391618 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391706 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391842 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.391919 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392064 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392144 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392292 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392380 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392518 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392596 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392760 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.392860 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393011 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393101 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393259 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393339 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393517 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393595 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393753 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393839 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.393982 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] auth.external = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394062 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394207 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394337 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394495 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394587 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394723 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394803 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.394949 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] auth.password = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395028 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395175 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] auth.token = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395262 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395408 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395487 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395639 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395719 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395879 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.395967 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396106 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396184 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396346 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396431 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396573 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396659 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396820 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.396907 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.397052 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] credential.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.397131 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.397326 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.397469 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.397571 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.397814 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.397891 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398046 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398131 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398287 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398367 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398517 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398595 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398781 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.398869 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399023 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399100 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399248 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399326 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399478 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399564 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399720 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399805 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.399969 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400049 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400197 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400284 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400422 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400501 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400647 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400725 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.400911 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401003 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401154 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401233 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401394 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401473 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401635 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401789 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401866 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.401981 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402092 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402172 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402324 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402411 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402560 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402639 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402785 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.402864 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403015 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403101 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403238 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403317 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403465 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403543 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403697 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403783 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.403930 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404008 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404174 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404286 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404379 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404465 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404623 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404713 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404885 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.404973 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405112 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405212 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405344 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405439 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405579 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405665 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405801 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.405897 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406033 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406120 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406252 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406340 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406479 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406575 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406707 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406793 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.406941 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407029 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407171 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407267 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407397 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407484 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407636 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407724 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407873 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.407970 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408097 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408185 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408321 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408409 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408559 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408653 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408809 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.408915 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409038 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409117 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409267 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409347 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409490 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409574 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409714 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409799 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.409950 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410030 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410176 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410315 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410420 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410545 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410661 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410788 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.410892 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411030 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411134 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411271 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411377 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411501 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411606 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411725 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411840 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.411954 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412066 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412182 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412299 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412411 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412533 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412634 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412825 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.412949 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413062 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413196 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413329 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413433 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413526 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413672 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413752 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413910 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.413990 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414134 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414221 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414374 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414453 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414603 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414682 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414833 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.414920 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415062 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415148 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415290 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415370 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415519 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415604 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415754 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415831 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.415982 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416060 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416221 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416305 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416440 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416518 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416675 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416753 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.416933 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417025 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417163 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417241 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417391 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417468 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417619 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417704 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417851 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.417929 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418073 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418196 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418301 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418429 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418532 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418676 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418774 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.418919 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419017 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419162 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419242 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419405 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419483 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419647 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419725 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419874 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.419955 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420116 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420195 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420348 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420426 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420580 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420660 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420825 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] role.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.420907 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421056 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421134 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] role.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421277 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421356 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421518 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421596 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421748 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421825 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.421984 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422108 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422211 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422288 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422454 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422548 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422675 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422752 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422904 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.422982 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423135 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423221 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423356 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423434 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423593 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423671 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423819 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.423966 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424043 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424114 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424275 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424354 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424520 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424661 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424775 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.424926 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425005 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425169 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425247 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425484 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425565 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425714 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425793 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.425956 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426034 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426190 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426271 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426424 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426508 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426654 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] role.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426733 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426885 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.426964 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] role.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427111 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427189 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427335 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427413 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427559 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427640 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427801 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.427879 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428040 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428117 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428277 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428386 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428521 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428634 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428748 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.428864 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429021 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429102 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429249 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429336 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429493 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429574 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429734 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429815 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.429973 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430052 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430217 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430304 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430456 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430606 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430686 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430843 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.430922 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431093 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431173 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431343 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431421 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431568 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431646 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431799 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.431879 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432027 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432105 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432264 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432342 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432505 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432585 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432728 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432827 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.432981 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433059 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433209 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433291 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433443 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433522 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.connection = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433693 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433781 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.433943 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434030 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434177 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434255 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434407 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434484 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434634 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434719 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434859 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.434936 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435085 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435163 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435313 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435400 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435551 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435630 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435780 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.435859 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436016 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436103 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436242 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436322 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436478 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436555 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436704 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436862 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.436967 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437048 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437192 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437272 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437427 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437514 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437654 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437734 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.437806 n-d-master-1 devstack@keystone.service[81886]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:50:35.437877 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.438109 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.438352 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.438579 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.438816 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.439101 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.439356 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.connection = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.439597 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.439839 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.440072 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.440308 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.440540 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.440787 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.441022 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.441255 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.441496 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.441730 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.441969 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.442201 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.442445 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.442676 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.442916 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.443150 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.443386 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.443618 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:35.443785 n-d-master-1 devstack@keystone.service[81885]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:50:35.467321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.467549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.467773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.468374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.468606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.468858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.476708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.477262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.504910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.505134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.505335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.505571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.557481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.557996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.605743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.605983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.607181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.607418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.763496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.763761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.763903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.763985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.764960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.787387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.787525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.787682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.787782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.788423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.788519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.788668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.788837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.788933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.788999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.789060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.789133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.789195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.789264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.799681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.800041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.812491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.812695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.812975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81886) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.813833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.814002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.814217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:35.830447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.830672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:35.830808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.830939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.831079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:35.831225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:35.831353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.831481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.831606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:35.831730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.831863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.831990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.832115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.832405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.832584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.832731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.841799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.842077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.842344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.842525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.842663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.842810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.842939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.843261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.849714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.850255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.852742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.853052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.853178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.853329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.853459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.853583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.853729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.853875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.854037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.854129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.854297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.854399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.854537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.854671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.854794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.855008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.855507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.855650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.855779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.855905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.856029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.856308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.878353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.878880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.879803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.880079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.880338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.880623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.884744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.885072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.885352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.885478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.885640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.885888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.891770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.892052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.892259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.892530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.896120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.896409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.896595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.896742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.896913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.897027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.897228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.897302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.897538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.897665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.897877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.898002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.898111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.898186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.898421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.898701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.915846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.916125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.917456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.917743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.920004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.921629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.923245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.923530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.924815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.925121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.927738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.929572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.930936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.933081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.935010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.935314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.935603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.935893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.936174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.936299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.936467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.936619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.936844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.937138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.937421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.937691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.952244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.952547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.952849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.953120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.953483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.953781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.954050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.954315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.960025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.961491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.961687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.961846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.962997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.963273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.964476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.964795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.965057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.965381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.965661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.965918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.966193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.966478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.966768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.967041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.976963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.977225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.977518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.977797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.978076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.978343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.978539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.978646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.978785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.978949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.979151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.979435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.979711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.979949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:35.994404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.995777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.997442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:35.998813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.000330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.001700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.001826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.003129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.003329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.003499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.003821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.004701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.005008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.005274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.010541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.011741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.011994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.013214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.014968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.015200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.015498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.015780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.016074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.016370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.016658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.016966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.023767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.024055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.024330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.025362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.025652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.025929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.031243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.031527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.031809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.032082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.032367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.032643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.032793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81886) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:36.032991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.033995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.034116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.034248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.034332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.034500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.034649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.034791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.034934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.035224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.035493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.035777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.036050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.036310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81886) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:36.068652 n-d-master-1 devstack@keystone.service[81885]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d81374c9c0 pid: 81885 (default app) Aug 21 00:50:36.070323 n-d-master-1 devstack@keystone.service[81886]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d81374c9c0 pid: 81886 (default app) Aug 21 00:50:36.072225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6344-c3d1-452c-9ff7-35d661b97133 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:36.072513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6344-c3d1-452c-9ff7-35d661b97133 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:36.072798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6344-c3d1-452c-9ff7-35d661b97133 None None] PATH_INFO: `/v3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:36.076958 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Sun Aug 21 00:50:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:42.734624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b29bd-30b7-4dfc-9ad5-ee63b02ddfe5 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:42.735151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b29bd-30b7-4dfc-9ad5-ee63b02ddfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:42.735232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b29bd-30b7-4dfc-9ad5-ee63b02ddfe5 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:42.742024 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:42.752544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:42.753289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:42.753372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:42.832867 n-d-master-1 devstack@keystone.service[81885]: INFO dbcounter [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] Registered counter for database keystone Aug 21 00:50:42.853564 n-d-master-1 devstack@keystone.service[81885]: DEBUG oslo_db.sqlalchemy.engines [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:50:42.864587 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writer thread running {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:50:43.054135 n-d-master-1 devstack@keystone.service[81885]: DEBUG passlib.handlers.bcrypt [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81885) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 21 00:50:43.054554 n-d-master-1 devstack@keystone.service[81885]: DEBUG passlib.handlers.bcrypt [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81885) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 21 00:50:43.110906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:43.112504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:43.255683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 21 00:50:43.551938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b29bd-30b7-4dfc-9ad5-ee63b02ddfe5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:43.620963 n-d-master-1 devstack@keystone.service[81886]: INFO dbcounter [None req-c05b29bd-30b7-4dfc-9ad5-ee63b02ddfe5 None None] Registered counter for database keystone Aug 21 00:50:43.645904 n-d-master-1 devstack@keystone.service[81886]: DEBUG oslo_db.sqlalchemy.engines [None req-c05b29bd-30b7-4dfc-9ad5-ee63b02ddfe5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:50:43.653825 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writer thread running {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:50:43.772945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b29bd-30b7-4dfc-9ad5-ee63b02ddfe5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:43.778446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79069c-26bf-44d4-a720-9b903fc9d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:43.779080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79069c-26bf-44d4-a720-9b903fc9d8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.779361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79069c-26bf-44d4-a720-9b903fc9d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.779633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79069c-26bf-44d4-a720-9b903fc9d8d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.788910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79069c-26bf-44d4-a720-9b903fc9d8d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:43.840740 n-d-master-1 devstack@keystone.service[81886]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af79069c-26bf-44d4-a720-9b903fc9d8d8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 00:50:43.841045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79069c-26bf-44d4-a720-9b903fc9d8d8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:43.851522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Sun Aug 21 00:50:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 00:50:43.862315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:43.885761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a6011-c3ac-4d52-a21a-38f222b88611 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:43.891937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa4ca-f9a9-491e-bb37-33d6926d2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:43.893104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa4ca-f9a9-491e-bb37-33d6926d2a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.893387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa4ca-f9a9-491e-bb37-33d6926d2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.893661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa4ca-f9a9-491e-bb37-33d6926d2a57 admin admin] PATH_INFO: `/v3/projects/e256165a7ff4427f88213eb7acbe8301` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.895360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa4ca-f9a9-491e-bb37-33d6926d2a57 admin admin] RBAC: Authorizing `identity:get_project(project_id=e256165a7ff4427f88213eb7acbe8301)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:43.949120 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec8aa4ca-f9a9-491e-bb37-33d6926d2a57 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 00:50:43.949458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa4ca-f9a9-491e-bb37-33d6926d2a57 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:43.954024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Sun Aug 21 00:50:43 2022] GET /identity/v3/projects/e256165a7ff4427f88213eb7acbe8301 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:45.852672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124977b-b358-480d-8c5c-e4f0561b6f6f None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:45.853568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124977b-b358-480d-8c5c-e4f0561b6f6f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:45.853568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124977b-b358-480d-8c5c-e4f0561b6f6f None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:45.858309 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:45.865043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5385e-7637-4f0a-9014-87d8ba8ca013 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:45.865495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5385e-7637-4f0a-9014-87d8ba8ca013 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:45.865583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5385e-7637-4f0a-9014-87d8ba8ca013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:45.891668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-48a5385e-7637-4f0a-9014-87d8ba8ca013 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:45.893216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-48a5385e-7637-4f0a-9014-87d8ba8ca013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:45.902531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 21 00:50:46.169415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124977b-b358-480d-8c5c-e4f0561b6f6f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:46.189424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124977b-b358-480d-8c5c-e4f0561b6f6f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:46.196419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cd3a-71eb-4991-ab72-2a12222d4964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:46.197026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cd3a-71eb-4991-ab72-2a12222d4964 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:46.197331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cd3a-71eb-4991-ab72-2a12222d4964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:46.197599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cd3a-71eb-4991-ab72-2a12222d4964 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:46.206465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09cd3a-71eb-4991-ab72-2a12222d4964 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:46.208249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09cd3a-71eb-4991-ab72-2a12222d4964 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:46.221387 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Sun Aug 21 00:50:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 00:50:46.229965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5385e-7637-4f0a-9014-87d8ba8ca013 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:46.243471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5385e-7637-4f0a-9014-87d8ba8ca013 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:46.248302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578dc23-e096-4a9b-b460-1ff418b85181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:46.249015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578dc23-e096-4a9b-b460-1ff418b85181 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:46.249321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578dc23-e096-4a9b-b460-1ff418b85181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:46.249617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578dc23-e096-4a9b-b460-1ff418b85181 admin admin] PATH_INFO: `/v3/users/d3c40350199043a89e4162ff1c7c88f4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:46.250999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578dc23-e096-4a9b-b460-1ff418b85181 admin admin] RBAC: Authorizing `identity:get_user(user_id=d3c40350199043a89e4162ff1c7c88f4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:46.252966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578dc23-e096-4a9b-b460-1ff418b85181 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:46.254670 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Sun Aug 21 00:50:46 2022] GET /identity/v3/users/d3c40350199043a89e4162ff1c7c88f4 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:48.259980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602dc0f-b57a-4c7e-9971-383e02581025 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:48.260550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602dc0f-b57a-4c7e-9971-383e02581025 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:48.260550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602dc0f-b57a-4c7e-9971-383e02581025 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:48.262031 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:48.267615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce307d1-4e37-4b6a-b4cf-470590d45832 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:48.268033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce307d1-4e37-4b6a-b4cf-470590d45832 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:48.268233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce307d1-4e37-4b6a-b4cf-470590d45832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:48.275255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3cc43-6358-4816-8c1e-e50f3ef8f20b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:48.275536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3cc43-6358-4816-8c1e-e50f3ef8f20b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:48.275811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3cc43-6358-4816-8c1e-e50f3ef8f20b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:48.277141 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:48.282158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:48.282441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:48.282718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:48.287134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3ce307d1-4e37-4b6a-b4cf-470590d45832 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:48.288601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3ce307d1-4e37-4b6a-b4cf-470590d45832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:48.326100 n-d-master-1 devstack@keystone.service[81886]: DEBUG passlib.handlers.bcrypt [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81886) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 21 00:50:48.326517 n-d-master-1 devstack@keystone.service[81886]: DEBUG passlib.handlers.bcrypt [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81886) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 21 00:50:48.372357 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:48.372645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:48.374246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:48.478248 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:48.637940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce307d1-4e37-4b6a-b4cf-470590d45832 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:48.662576 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:48.742417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:48.748381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce307d1-4e37-4b6a-b4cf-470590d45832 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:48.784066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:48.784679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:48.785008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:48.785309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:48.847187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d7d91-4d24-48ff-a8a5-73370da37fe5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:48.849486 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:48.854352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:48.856166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:48.879518 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:48.885272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:48.886405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:48.886683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:48.886949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:48.898649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:48.906920 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:48.907819 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:50:48.908653 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 8/14] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:50:48.914634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:48.956998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 7/15] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:50:48.962753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:49.014544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f1105-f819-4cf7-9528-e33217d65b8b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:49.047513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:49.048123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:49.048402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:49.048671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:49.049368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:49.049671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:49.051127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:49.059110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a454b40-3263-4d81-83f7-d0133e4363fa None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:49.062903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 9/16] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:49.068811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:49.081871 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:49.095601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:49.096241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:49.096519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:49.096812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:49.103251 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:49.108063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:49.109596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:50:49.128745 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:49.129753 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:50:49.130543 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:50:49.130543 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:49.130543 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:50:49.132917 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 8/17] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:49.135722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:49.178320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b18f8b-73f9-40e2-9d40-7f9583c91c9a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:49.212374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:49.213037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:49.213317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:49.213591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] PATH_INFO: `/v3/users/d3c40350199043a89e4162ff1c7c88f4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:49.215081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c40350199043a89e4162ff1c7c88f4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:49.216539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:49.218188 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 10/18] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:49 2022] GET /identity/v3/users/d3c40350199043a89e4162ff1c7c88f4 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:49.224049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:49.238344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e599fb-4350-439c-91ab-ffcad4c24cd8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:49.271746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:49.272478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:49.272635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:49.272934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:49.273576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:49.273873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:49.275260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:49.292944 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 9/19] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:49.318921 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:49.327089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b14f76-5de6-443f-82eb-2147b2520aa2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:49.367666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53658f-1308-44c9-be07-9c117570b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:49.368316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53658f-1308-44c9-be07-9c117570b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:49.368595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53658f-1308-44c9-be07-9c117570b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:49.368894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53658f-1308-44c9-be07-9c117570b8f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:49.370163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53658f-1308-44c9-be07-9c117570b8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:49.371659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53658f-1308-44c9-be07-9c117570b8f4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:49.373374 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 11/20] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:49.379704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:49.419227 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:49.490430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145fe2-69df-4287-831b-b9a629545321 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:49.526428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664e25-7602-4926-b9f1-f2c3e10892ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:49.527008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664e25-7602-4926-b9f1-f2c3e10892ea None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:49.527281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664e25-7602-4926-b9f1-f2c3e10892ea None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:49.527549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664e25-7602-4926-b9f1-f2c3e10892ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:49.528276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67664e25-7602-4926-b9f1-f2c3e10892ea None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.domain.id=default, user.id=d3c40350199043a89e4162ff1c7c88f4) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:49.528576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67664e25-7602-4926-b9f1-f2c3e10892ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:49.530057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67664e25-7602-4926-b9f1-f2c3e10892ea None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:49.537438 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 10/21] 10.222.0.46 () {56 vars in 1322 bytes} [Sun Aug 21 00:50:49 2022] GET /identity/v3/role_assignments?user.id=d3c40350199043a89e4162ff1c7c88f4&scope.domain.id=default&role.id=fd13fde432a246499375976d02e43d56 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:51.452843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae880e-8acb-4be2-9046-cac524d5ffc7 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.453338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae880e-8acb-4be2-9046-cac524d5ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.453338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae880e-8acb-4be2-9046-cac524d5ffc7 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.454955 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 12/22] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:51.460752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43485864-86d0-4a19-9aa3-39d541ab04da None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.461194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43485864-86d0-4a19-9aa3-39d541ab04da None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.461363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43485864-86d0-4a19-9aa3-39d541ab04da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.485765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-43485864-86d0-4a19-9aa3-39d541ab04da None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:51.486983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-43485864-86d0-4a19-9aa3-39d541ab04da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:51.582092 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:51.929827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae880e-8acb-4be2-9046-cac524d5ffc7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.040720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab4fa-ae85-417d-8637-5bc758235701 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.041462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab4fa-ae85-417d-8637-5bc758235701 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.041936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab4fa-ae85-417d-8637-5bc758235701 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.043470 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:52.055769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae880e-8acb-4be2-9046-cac524d5ffc7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.058450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71a46-fa9a-4f42-b8d7-ea7b9f3b08d8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.058960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71a46-fa9a-4f42-b8d7-ea7b9f3b08d8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.059436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71a46-fa9a-4f42-b8d7-ea7b9f3b08d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.095438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-09a71a46-fa9a-4f42-b8d7-ea7b9f3b08d8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:52.099089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-09a71a46-fa9a-4f42-b8d7-ea7b9f3b08d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:52.144088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76520ea-f464-46d8-9e4e-e6c60bf43822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.146424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76520ea-f464-46d8-9e4e-e6c60bf43822 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.146905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76520ea-f464-46d8-9e4e-e6c60bf43822 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.147644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76520ea-f464-46d8-9e4e-e6c60bf43822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.167965 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.172061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76520ea-f464-46d8-9e4e-e6c60bf43822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.174176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76520ea-f464-46d8-9e4e-e6c60bf43822 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a76520ea-f464-46d8-9e4e-e6c60bf43822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:50:52.192206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:52.193098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:50:52.194034 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:50:52.194034 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:52.194034 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:50:52.194034 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 13/25] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:52.194741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94b6e6-286b-4820-b706-5374a19b0c2e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.195105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94b6e6-286b-4820-b706-5374a19b0c2e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.195513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94b6e6-286b-4820-b706-5374a19b0c2e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.204191 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 14/26] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:52.206664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1fdd-9fa4-43d6-8ad3-ca7319a0464e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.206947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1fdd-9fa4-43d6-8ad3-ca7319a0464e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.207216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1fdd-9fa4-43d6-8ad3-ca7319a0464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.229839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-872a1fdd-9fa4-43d6-8ad3-ca7319a0464e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:52.231622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-872a1fdd-9fa4-43d6-8ad3-ca7319a0464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:52.244231 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.245884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:52.249695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71a46-fa9a-4f42-b8d7-ea7b9f3b08d8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.328039 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:52.329860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2740c7-7a89-4e6e-8242-f7cc334e63c4 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.330332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2740c7-7a89-4e6e-8242-f7cc334e63c4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.330788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2740c7-7a89-4e6e-8242-f7cc334e63c4 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.332796 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 16/29] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:52.350526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b4f9e-c066-4ae7-86eb-09e329324f86 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.351188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b4f9e-c066-4ae7-86eb-09e329324f86 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.351653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b4f9e-c066-4ae7-86eb-09e329324f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.382164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d86b4f9e-c066-4ae7-86eb-09e329324f86 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:52.383731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d86b4f9e-c066-4ae7-86eb-09e329324f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:52.486717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71a46-fa9a-4f42-b8d7-ea7b9f3b08d8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.529879 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 17/30] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:52.548425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.549062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.549339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.549609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.550265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:52.550572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.551964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.567685 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 14/31] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:52.572959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b4f9e-c066-4ae7-86eb-09e329324f86 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.622365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.652582 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.744127 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.807410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b4f9e-c066-4ae7-86eb-09e329324f86 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.847533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd48e7-f92c-4730-85e4-e206e3122fa9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.879022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.879644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.879920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.880186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.880865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.882888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.916158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.916877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.917164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.917440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.918172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.919646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.024570 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 18/32] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:50:52 2022] POST /identity/v3/projects => generated 301 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:53.025928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.048877 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 15/33] 10.222.0.46 () {60 vars in 1131 bytes} [Sun Aug 21 00:50:52 2022] POST /identity/v3/roles => generated 225 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:50:53.049922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.148373 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.153825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48e346-e8bd-40d0-97d9-bcb413a8ade2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.184370 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.185049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864487a-6d9c-4f48-aed7-463e75d152be None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.196200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc85572-0f37-44bf-8361-870f9f879fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.196937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc85572-0f37-44bf-8361-870f9f879fc9 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.197278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc85572-0f37-44bf-8361-870f9f879fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.197621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc85572-0f37-44bf-8361-870f9f879fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.198315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc85572-0f37-44bf-8361-870f9f879fc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.199947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc85572-0f37-44bf-8361-870f9f879fc9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.225275 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 19/34] 10.222.0.46 () {60 vars in 1131 bytes} [Sun Aug 21 00:50:53 2022] POST /identity/v3/roles => generated 219 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:53.231934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738703d-3378-4720-8e33-aaf636af57fa None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.233035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738703d-3378-4720-8e33-aaf636af57fa None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.233995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738703d-3378-4720-8e33-aaf636af57fa None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.236585 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 20/35] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:53.240069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0ab3-e62f-4466-ad98-55321959f623 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.240350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0ab3-e62f-4466-ad98-55321959f623 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.240637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0ab3-e62f-4466-ad98-55321959f623 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.242517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 21/36] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:53.243732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607717c-370c-4e98-a0eb-20187f846446 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.244016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607717c-370c-4e98-a0eb-20187f846446 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.244291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607717c-370c-4e98-a0eb-20187f846446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.251019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965979b-228e-42af-a8fe-8129aabe1da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.252106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965979b-228e-42af-a8fe-8129aabe1da0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.252609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965979b-228e-42af-a8fe-8129aabe1da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.253161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965979b-228e-42af-a8fe-8129aabe1da0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.269878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965979b-228e-42af-a8fe-8129aabe1da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:53.276255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0607717c-370c-4e98-a0eb-20187f846446 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:53.277873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0607717c-370c-4e98-a0eb-20187f846446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8965979b-228e-42af-a8fe-8129aabe1da0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:53.278261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:53.279073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:53.279877 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:50:53.282348 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 16/37] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:53.284621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f21b-1c7d-427d-a4c1-9c327181254d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.285236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f21b-1c7d-427d-a4c1-9c327181254d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.285721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f21b-1c7d-427d-a4c1-9c327181254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.308092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7a39f21b-1c7d-427d-a4c1-9c327181254d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:53.309690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7a39f21b-1c7d-427d-a4c1-9c327181254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:53.363180 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 22/38] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:53.364125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607717c-370c-4e98-a0eb-20187f846446 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.398790 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 17/39] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:53.485373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607717c-370c-4e98-a0eb-20187f846446 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.503712 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.524019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.524641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.524962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.525234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.525907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:53.526312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.527662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.536421 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 23/40] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:53.543114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f21b-1c7d-427d-a4c1-9c327181254d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.614809 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.650307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f21b-1c7d-427d-a4c1-9c327181254d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.672300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.685857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.686501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.686785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.687056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] PATH_INFO: `/v3/users/d3c40350199043a89e4162ff1c7c88f4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.688207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] RBAC: Authorizing `identity:get_user(user_id=d3c40350199043a89e4162ff1c7c88f4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.689820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.691420 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 18/41] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/users/d3c40350199043a89e4162ff1c7c88f4 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:53.692170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.774584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0016-cec0-4ff8-9c17-0f053600883a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.793165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23383df7-9507-4c8d-b269-f370baeff04d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.806890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.807503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.807782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.808228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.808747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.810165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.825070 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 24/42] 10.222.0.46 () {60 vars in 1131 bytes} [Sun Aug 21 00:50:53 2022] POST /identity/v3/roles => generated 223 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:50:53.825881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.832535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.833234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.833512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.833784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.835493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.837122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.838848 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 19/43] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:53.844897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.849412 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.886914 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.966282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fbaa8-16fd-4afc-a5af-fea581547428 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.973281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d996c9c-dc07-4f08-8f41-5e7978ec0430 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.015331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.016635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.016635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.016635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.019628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.019628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.021068 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 25/44] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:54.027423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:54.111231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d826c-1fd1-40ba-add1-b8a2b4919680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.111741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d826c-1fd1-40ba-add1-b8a2b4919680 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.112013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d826c-1fd1-40ba-add1-b8a2b4919680 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.112282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d826c-1fd1-40ba-add1-b8a2b4919680 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.113073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d826c-1fd1-40ba-add1-b8a2b4919680 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.114518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d826c-1fd1-40ba-add1-b8a2b4919680 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.129415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfb75-65e4-4324-9c2e-9d637a00b2c9 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.138323 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:54.147329 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 20/45] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:50:53 2022] POST /identity/v3/projects => generated 312 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:54.166105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427abdd7-e5c7-45c7-865a-564df67ee71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.166794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abdd7-e5c7-45c7-865a-564df67ee71c None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.167073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abdd7-e5c7-45c7-865a-564df67ee71c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.167349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abdd7-e5c7-45c7-865a-564df67ee71c None admin] PATH_INFO: `/v3/domains/default/users/d3c40350199043a89e4162ff1c7c88f4/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.169406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427abdd7-e5c7-45c7-865a-564df67ee71c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d3c40350199043a89e4162ff1c7c88f4, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.170879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427abdd7-e5c7-45c7-865a-564df67ee71c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.187055 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 26/46] 10.222.0.46 () {58 vars in 1361 bytes} [Sun Aug 21 00:50:54 2022] PUT /identity/v3/domains/default/users/d3c40350199043a89e4162ff1c7c88f4/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:50:56.063901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682225f0-eea9-4982-9fb5-625a21ec323a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.064441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682225f0-eea9-4982-9fb5-625a21ec323a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.064441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682225f0-eea9-4982-9fb5-625a21ec323a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.065810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 21/47] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:56.070524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321d28-d0ac-4bee-a090-3a4bfe3b8165 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.070956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321d28-d0ac-4bee-a090-3a4bfe3b8165 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.071036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e615c4-9fd5-4acd-b24a-2da061dd0125 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.071123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321d28-d0ac-4bee-a090-3a4bfe3b8165 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.071304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e615c4-9fd5-4acd-b24a-2da061dd0125 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.071594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e615c4-9fd5-4acd-b24a-2da061dd0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.072424 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 27/48] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:56.077551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf781fa-a7de-458f-bc9a-450120df9ac9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.078068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf781fa-a7de-458f-bc9a-450120df9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.078068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf781fa-a7de-458f-bc9a-450120df9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.089911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-63e615c4-9fd5-4acd-b24a-2da061dd0125 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:56.091123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63e615c4-9fd5-4acd-b24a-2da061dd0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:56.097074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-faf781fa-a7de-458f-bc9a-450120df9ac9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:56.098243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-faf781fa-a7de-458f-bc9a-450120df9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:56.141891 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:56.160220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 22/49] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:56.172661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 28/50] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:56.439585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e615c4-9fd5-4acd-b24a-2da061dd0125 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:56.450587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf781fa-a7de-458f-bc9a-450120df9ac9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:56.540566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e615c4-9fd5-4acd-b24a-2da061dd0125 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:56.552564 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:56.559406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf781fa-a7de-458f-bc9a-450120df9ac9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:56.574005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:56.574642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.574926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.575206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.585862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:56.590633 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:56.591474 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:50:56.592216 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 23/51] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:56.595262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:56.595905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.596185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.596557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.597603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:56.597900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:56.599377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:56.601048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 29/52] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:56.606616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:56.646256 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:56.701049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6af059-15ca-4301-8691-77c0ab6449d8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:56.707523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1278f-631a-4687-bf04-668c0c591fa0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:56.735445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:56.736172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.736518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.736892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.737567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:56.737871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:56.739272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:56.741016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:56.741620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.741897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.742166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.742810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:56.744229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:56.752244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 24/53] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:56.758208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:56.775202 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 30/54] 10.222.0.46 () {60 vars in 1140 bytes} [Sun Aug 21 00:50:56 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:56.869268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdbf36-7256-433d-93ec-f3c617ec3ec9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:56.880643 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:56.909385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:56.910038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.910319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.910594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] PATH_INFO: `/v3/users/d3c40350199043a89e4162ff1c7c88f4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.911838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c40350199043a89e4162ff1c7c88f4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:56.914146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:56.915777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 25/55] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:56 2022] GET /identity/v3/users/d3c40350199043a89e4162ff1c7c88f4 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:56.921685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:56.941976 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:57.029867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f2a7-3d94-492d-9efb-66840afdb6bd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:57.063983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a61e5-10f8-4ccb-b5a7-8fc5080a53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:57.064592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a61e5-10f8-4ccb-b5a7-8fc5080a53f1 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:57.064899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a61e5-10f8-4ccb-b5a7-8fc5080a53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:57.065299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a61e5-10f8-4ccb-b5a7-8fc5080a53f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:57.066401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a61e5-10f8-4ccb-b5a7-8fc5080a53f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:57.067851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a61e5-10f8-4ccb-b5a7-8fc5080a53f1 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:57.069565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 31/56] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:57.075575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:57.180476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ba9b4-140c-4a23-8a99-15076f5d4f63 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:57.214793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff869b-a867-4b7f-aaff-470f9dfe2608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:57.215399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff869b-a867-4b7f-aaff-470f9dfe2608 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:57.215679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff869b-a867-4b7f-aaff-470f9dfe2608 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:57.215951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff869b-a867-4b7f-aaff-470f9dfe2608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:57.216676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff869b-a867-4b7f-aaff-470f9dfe2608 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.domain.id=default, user.id=d3c40350199043a89e4162ff1c7c88f4) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:57.216999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff869b-a867-4b7f-aaff-470f9dfe2608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:57.218438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff869b-a867-4b7f-aaff-470f9dfe2608 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:57.224247 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 26/57] 10.222.0.46 () {56 vars in 1322 bytes} [Sun Aug 21 00:50:57 2022] GET /identity/v3/role_assignments?user.id=d3c40350199043a89e4162ff1c7c88f4&scope.domain.id=default&role.id=fd13fde432a246499375976d02e43d56 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:58.696486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40441e9-4b5c-459d-878f-52e2016d9ce0 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:58.697035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40441e9-4b5c-459d-878f-52e2016d9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:58.697120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40441e9-4b5c-459d-878f-52e2016d9ce0 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:58.699105 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 32/58] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:58.707827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ead10-f3b7-49f3-83b6-992d821c019f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:58.708220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ead10-f3b7-49f3-83b6-992d821c019f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:58.708471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ead10-f3b7-49f3-83b6-992d821c019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:58.735315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7d8ead10-f3b7-49f3-83b6-992d821c019f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:58.736542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d8ead10-f3b7-49f3-83b6-992d821c019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:58.773556 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:58.809860 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 27/59] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:59.077074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40441e9-4b5c-459d-878f-52e2016d9ce0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:59.188485 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:59.208207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40441e9-4b5c-459d-878f-52e2016d9ce0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:59.244079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c4f4-2612-456b-917d-408a63080e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:59.244699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c4f4-2612-456b-917d-408a63080e3d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.245066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c4f4-2612-456b-917d-408a63080e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.245353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c4f4-2612-456b-917d-408a63080e3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.246513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c4f4-2612-456b-917d-408a63080e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:59.247967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c4f4-2612-456b-917d-408a63080e3d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:59.249608 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 33/60] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:59.258683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ead10-f3b7-49f3-83b6-992d821c019f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:59.373894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ead10-f3b7-49f3-83b6-992d821c019f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:59.413968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fee357-b502-474e-a7b4-05c0d8eb44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:59.414564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee357-b502-474e-a7b4-05c0d8eb44de None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.414836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee357-b502-474e-a7b4-05c0d8eb44de None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.415122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee357-b502-474e-a7b4-05c0d8eb44de None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.415743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fee357-b502-474e-a7b4-05c0d8eb44de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:59.417207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fee357-b502-474e-a7b4-05c0d8eb44de None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:59.447790 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 28/61] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:50:59 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:02.636727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e1d9-1d05-4b25-a4d4-2774c29a04c9 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.637285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e1d9-1d05-4b25-a4d4-2774c29a04c9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.637285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e1d9-1d05-4b25-a4d4-2774c29a04c9 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.638888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 34/62] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:02.644254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6adc-4246-4c74-bc9f-70a409cc4b58 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.644667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6adc-4246-4c74-bc9f-70a409cc4b58 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.644913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6adc-4246-4c74-bc9f-70a409cc4b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.672979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2ebe6adc-4246-4c74-bc9f-70a409cc4b58 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:02.674206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ebe6adc-4246-4c74-bc9f-70a409cc4b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:02.707066 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:02.776516 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 29/63] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:02.827797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744f35-062d-4199-9dcc-0cb46ac86d86 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.827797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744f35-062d-4199-9dcc-0cb46ac86d86 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.827797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744f35-062d-4199-9dcc-0cb46ac86d86 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.827797 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 35/64] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:02.833878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241b2d-d66b-4258-a3ce-e879f39e52b8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.834513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241b2d-d66b-4258-a3ce-e879f39e52b8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.834983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241b2d-d66b-4258-a3ce-e879f39e52b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.853998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-29241b2d-d66b-4258-a3ce-e879f39e52b8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:02.855817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-29241b2d-d66b-4258-a3ce-e879f39e52b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:02.933369 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 30/65] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:03.041551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150adf6-30d6-4542-a5b4-aac5939d587e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.042202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150adf6-30d6-4542-a5b4-aac5939d587e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.042675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150adf6-30d6-4542-a5b4-aac5939d587e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.044248 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 36/66] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:03.049723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e613d7-a27a-485f-b4c7-89db7b177cc7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.050222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e613d7-a27a-485f-b4c7-89db7b177cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.050748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e613d7-a27a-485f-b4c7-89db7b177cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.071110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-49e613d7-a27a-485f-b4c7-89db7b177cc7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:03.072655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-49e613d7-a27a-485f-b4c7-89db7b177cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:03.094751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860893-64ea-4b0a-9eb0-b61e9cba9e08 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.095355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860893-64ea-4b0a-9eb0-b61e9cba9e08 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.095833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860893-64ea-4b0a-9eb0-b61e9cba9e08 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.097399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 37/67] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:03.102640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a321f88-d5e8-42ff-83d3-b7d2fc300ae2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.103225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a321f88-d5e8-42ff-83d3-b7d2fc300ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.103689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a321f88-d5e8-42ff-83d3-b7d2fc300ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.135424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3a321f88-d5e8-42ff-83d3-b7d2fc300ae2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:03.136972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a321f88-d5e8-42ff-83d3-b7d2fc300ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:03.186248 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 31/68] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:03.187037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e613d7-a27a-485f-b4c7-89db7b177cc7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.222131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.251815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 38/69] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:03.310371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a321f88-d5e8-42ff-83d3-b7d2fc300ae2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.354707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e613d7-a27a-485f-b4c7-89db7b177cc7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.391087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c426fc-21a1-4557-ae9d-72e64290b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.391729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c426fc-21a1-4557-ae9d-72e64290b945 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.392000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c426fc-21a1-4557-ae9d-72e64290b945 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.392272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c426fc-21a1-4557-ae9d-72e64290b945 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.402842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c426fc-21a1-4557-ae9d-72e64290b945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d4c426fc-21a1-4557-ae9d-72e64290b945 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:03.407653 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:03.408463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:03.409659 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 32/70] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:03.410489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa172a5-d3c6-4e03-b82f-0a314f2bfab4 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.410734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa172a5-d3c6-4e03-b82f-0a314f2bfab4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.411007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa172a5-d3c6-4e03-b82f-0a314f2bfab4 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.412262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 33/71] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:03.418038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa172a5-d3c6-4e03-b82f-0a314f2bfab4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.431454 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.451213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a321f88-d5e8-42ff-83d3-b7d2fc300ae2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.489864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6e20b-c152-4191-a886-917cd6d30581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.490941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e20b-c152-4191-a886-917cd6d30581 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.491369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e20b-c152-4191-a886-917cd6d30581 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.491864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e20b-c152-4191-a886-917cd6d30581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.502739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6e20b-c152-4191-a886-917cd6d30581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:03.507732 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-03d6e20b-c152-4191-a886-917cd6d30581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:03.509084 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:03.510380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:03.511113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:03.513231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 39/72] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:03.517945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7461-ea42-46f5-874f-7433e94ebf6b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.517945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7461-ea42-46f5-874f-7433e94ebf6b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.517945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7461-ea42-46f5-874f-7433e94ebf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.533932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-576e7461-ea42-46f5-874f-7433e94ebf6b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:03.535117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-576e7461-ea42-46f5-874f-7433e94ebf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:03.536547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa172a5-d3c6-4e03-b82f-0a314f2bfab4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.571427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.572041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.572323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.572598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.573302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:03.573605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:03.575007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:03.583069 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 34/73] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:03.583853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.604259 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 40/74] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:03.605445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7461-ea42-46f5-874f-7433e94ebf6b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.687401 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.695432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1249-c417-4f7a-8535-1969c91aff59 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.719404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7461-ea42-46f5-874f-7433e94ebf6b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.732487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.733150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.733433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.733703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.741722 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.746552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:03.751914 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:03.753022 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:03.753911 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 35/75] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:03.754710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.762933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.763563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.764265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.764546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.765269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:03.765575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:03.767657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:03.777703 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 41/76] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:03.778520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.868391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6c912-446a-4df2-8acc-30f29ab008f0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.880841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1f3c-b3c8-4b11-b467-f16316d57856 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.902215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.902857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.903142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.903415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.913953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:03.914851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.915484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.915764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.916036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.918019 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:03.919988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:03.920866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:03.921635 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 36/77] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:03.922278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.937709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:03.939178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:03.940979 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 42/78] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:03.941696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.980250 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.024012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b510e05-80f6-4f16-b75a-9d71c0cca6cf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.040223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c170-e087-433e-82f2-e651bdbfeeee None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.058552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.059157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.059425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.059695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.060357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:04.060657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.062087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.070014 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 37/79] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.070790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.073024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.073663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.073941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.074214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] PATH_INFO: `/v3/users/d3c40350199043a89e4162ff1c7c88f4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.075347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c40350199043a89e4162ff1c7c88f4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.076792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.078520 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 43/80] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/users/d3c40350199043a89e4162ff1c7c88f4 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.079113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.139460 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.176775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242ab5-2c8a-4b2c-8aef-d9569a10cd35 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.177082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8e0c-f1ee-4a3e-991c-b5b13e1a59f5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.197064 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.210912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.211521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.211800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.212073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.212591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.212733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:04.213059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.213257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.213536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.213815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.214443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.214941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.216375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.217972 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 38/81] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.218726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.224464 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 44/82] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.225595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.324460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606f36-6e63-4262-adfb-36cfa2e4bd27 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.326814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a4d92-9796-4cbc-b66a-015082586352 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.354481 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.358110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.358814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.359099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.359379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.367412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.368011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.368290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.368561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.369727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.371178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.372794 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 45/83] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.373593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.416559 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.430318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.431784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.474577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c7c8-ae03-489b-b4b9-403eae4f5cd6 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.518224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.518836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.519122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.519398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.532371 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 39/84] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:04.533235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.579876 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.590943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.592534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.620339 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.632487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee026-2abd-43f4-88ca-0df2f9c64f23 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.666833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.667545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.667902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.668281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.669048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.670653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.690882 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 46/85] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:04.691638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.695547 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 40/86] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:04 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:04.696391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.809063 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.820240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81414c2-dd57-4da1-96b0-e6ac7067bd47 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.821617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef28a-2ee3-46e8-9863-2696ecaaf696 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.868490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.869064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.869346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.869687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.889385 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.964465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.967203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.972509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.973188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.973466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.973737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.976417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.977928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.979794 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 47/87] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.980664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.106459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b7c5-e116-4dd4-a44c-7b20f63cfd65 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.127265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 41/88] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:05.131448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.151457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.152108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.152388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.152660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.153869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.155453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.162210 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 48/89] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:05.163140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.192649 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.204036 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.269022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fed9d2-1996-4018-8537-3e5ed4e58f1b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.275766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b67c10-5f99-41c9-8908-7e868230add0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.303750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.304577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.304899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.305169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.323708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.324353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.324631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.324942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.326820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.328282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.329962 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 42/90] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:05.330799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.399219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.401690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.441164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38701d4-2225-4546-85f1-9be6a7842cb4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.455843 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.469226 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.480410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.481320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.481737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.482212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.483528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.485330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.487182 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 43/91] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:05.488338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.539877 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 49/92] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:05.540746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.610116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f42b62-ef5a-453a-9669-3923e55e9be4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.643855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c11b4a-4c5a-4afa-aad3-e972b4ce8d0a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.652713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.653306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.653590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.654197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.654955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=1fc6c732aa6743328b8eda20a790b5ee) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:05.655264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.657197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.668798 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 44/93] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/role_assignments?user.id=1fc6c732aa6743328b8eda20a790b5ee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:05.668798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.689159 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.713990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.715490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.715987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.716449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.717508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=d3c40350199043a89e4162ff1c7c88f4) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:05.718009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.719652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.728798 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.740210 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 50/94] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/role_assignments?user.id=d3c40350199043a89e4162ff1c7c88f4&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:05.741644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.792653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09511e39-6e01-48a9-b6b0-302e1faf8b57 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.838660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.839446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.839832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.844158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.844158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] RBAC: Adding query filter params (role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=1fc6c732aa6743328b8eda20a790b5ee) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:05.844158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.844158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.851521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 45/95] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/role_assignments?user.id=1fc6c732aa6743328b8eda20a790b5ee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=01f130b1020f40bf97184ccb199975bb => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:05.934023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd9b4-304d-4477-850e-ac1606e39443 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.989293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd278-59ac-4c7c-899d-15f370dea98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.989944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd278-59ac-4c7c-899d-15f370dea98f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.990222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd278-59ac-4c7c-899d-15f370dea98f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.990689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd278-59ac-4c7c-899d-15f370dea98f None admin] PATH_INFO: `/v3/projects/a270d1e1afb3463e80042be6809b7530` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.991847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dd278-59ac-4c7c-899d-15f370dea98f None admin] RBAC: Authorizing `identity:get_project(project_id=a270d1e1afb3463e80042be6809b7530)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.993332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dd278-59ac-4c7c-899d-15f370dea98f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.995017 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 51/96] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/projects/a270d1e1afb3463e80042be6809b7530 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:06.000947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:06.114439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bf4de-0bb3-4475-961b-0d4d45bcef06 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:06.124179 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:06.160911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c61a0-2b77-4220-a779-8c9c7bc3bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:06.161535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c61a0-2b77-4220-a779-8c9c7bc3bb0b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:06.161821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c61a0-2b77-4220-a779-8c9c7bc3bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:06.162095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c61a0-2b77-4220-a779-8c9c7bc3bb0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:06.163264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c61a0-2b77-4220-a779-8c9c7bc3bb0b None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=a270d1e1afb3463e80042be6809b7530, user.id=1fc6c732aa6743328b8eda20a790b5ee) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:06.163572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c61a0-2b77-4220-a779-8c9c7bc3bb0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:06.165050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c61a0-2b77-4220-a779-8c9c7bc3bb0b None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:06.175146 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 46/97] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:05 2022] GET /identity/v3/role_assignments?user.id=1fc6c732aa6743328b8eda20a790b5ee&scope.project.id=a270d1e1afb3463e80042be6809b7530&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:07.006547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a467f-9df6-405b-a8cf-d1ac78f222c6 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.007290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a467f-9df6-405b-a8cf-d1ac78f222c6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.007290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a467f-9df6-405b-a8cf-d1ac78f222c6 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.008533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 52/98] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:07.017301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408a535-b740-4891-b0d4-50b0801a1fad None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.017736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408a535-b740-4891-b0d4-50b0801a1fad None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.017909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408a535-b740-4891-b0d4-50b0801a1fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.043625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8408a535-b740-4891-b0d4-50b0801a1fad None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:07.044880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8408a535-b740-4891-b0d4-50b0801a1fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:07.126800 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 47/99] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:07.446154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a467f-9df6-405b-a8cf-d1ac78f222c6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:07.529735 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:07.581393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a467f-9df6-405b-a8cf-d1ac78f222c6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:07.586844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fab8d-8097-4aec-b79a-66cf5006ae7e None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.587130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fab8d-8097-4aec-b79a-66cf5006ae7e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.587406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fab8d-8097-4aec-b79a-66cf5006ae7e None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.588777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 48/100] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:07.594892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d90fc-c7d5-4c01-b842-a25eb761635e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.595172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d90fc-c7d5-4c01-b842-a25eb761635e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.595446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d90fc-c7d5-4c01-b842-a25eb761635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.623648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-971d90fc-c7d5-4c01-b842-a25eb761635e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:07.624866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-971d90fc-c7d5-4c01-b842-a25eb761635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:07.670841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:07.671488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.671766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.672039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.692058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:07.705472 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:07.706318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:07.707102 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 53/101] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:07.713794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:07.737200 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 49/102] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:07.856299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ba80-63c6-4e1f-93ee-3cd6fe4337e1 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:07.874284 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:07.897688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:07.898308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.898588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.898864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.899536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:07.899838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:07.905296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:07.914027 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 54/103] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:07.919863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d90fc-c7d5-4c01-b842-a25eb761635e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:07.970464 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.064329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d90fc-c7d5-4c01-b842-a25eb761635e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:08.105848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:08.106496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.106775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.107047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] PATH_INFO: `/v3/users/705c40cb075a4d0f8ece79c95c79fbe4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.121158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] RBAC: Authorizing `identity:get_user(user_id=705c40cb075a4d0f8ece79c95c79fbe4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:08.122631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:08.124316 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 50/104] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:07 2022] GET /identity/v3/users/705c40cb075a4d0f8ece79c95c79fbe4 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:08.132828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.258866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afaad6-5c9d-43bb-9308-d1d7e4fed7dc None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:08.293182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:08.293804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.294087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.294360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.302804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.351862 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.399798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:08.401819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:08.515544 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.543233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4a1e-9e0a-4776-bba2-463dcc4b1250 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:08.612917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98c551-bf89-489a-bc4c-cf60717b47f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:08.614130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c551-bf89-489a-bc4c-cf60717b47f5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.617199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c551-bf89-489a-bc4c-cf60717b47f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.617481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c551-bf89-489a-bc4c-cf60717b47f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.621534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98c551-bf89-489a-bc4c-cf60717b47f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:08.623022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98c551-bf89-489a-bc4c-cf60717b47f5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:08.624647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 51/105] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:08.625905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232259-9606-44d6-b3cc-36b710b31dbc None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.626195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232259-9606-44d6-b3cc-36b710b31dbc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.626471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232259-9606-44d6-b3cc-36b710b31dbc None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.627798 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 52/106] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:08.638061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc26c1-a59d-439a-b83e-443f63992dc7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.638343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc26c1-a59d-439a-b83e-443f63992dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.638620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc26c1-a59d-439a-b83e-443f63992dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.641030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 55/107] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:08.642071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.672374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bffc26c1-a59d-439a-b83e-443f63992dc7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:08.674131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bffc26c1-a59d-439a-b83e-443f63992dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:08.785391 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.791853 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 53/108] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:08.793281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc26c1-a59d-439a-b83e-443f63992dc7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.811069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d712a-ee2b-4cf2-bb2e-a6e87daf6dcf None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:08.878455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135c29e-a668-404d-8b92-41eb819b58e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:08.879130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135c29e-a668-404d-8b92-41eb819b58e2 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.879414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135c29e-a668-404d-8b92-41eb819b58e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.879688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135c29e-a668-404d-8b92-41eb819b58e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.880344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135c29e-a668-404d-8b92-41eb819b58e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:08.882714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135c29e-a668-404d-8b92-41eb819b58e2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:08.915347 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 56/109] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:51:08 2022] POST /identity/v3/projects => generated 302 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:08.916884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e9f9-305c-421d-b2ac-9dc14d59215e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.917415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e9f9-305c-421d-b2ac-9dc14d59215e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.917723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e9f9-305c-421d-b2ac-9dc14d59215e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.919585 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 57/110] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:08.925279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ee086-c742-40d1-9499-0e0d14a14bc3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.925567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ee086-c742-40d1-9499-0e0d14a14bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.925892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ee086-c742-40d1-9499-0e0d14a14bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.949156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-424ee086-c742-40d1-9499-0e0d14a14bc3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:08.950520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-424ee086-c742-40d1-9499-0e0d14a14bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:08.979025 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.994068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc26c1-a59d-439a-b83e-443f63992dc7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.033562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbecef5-9fe7-4f0e-b621-8db50835a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.034214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbecef5-9fe7-4f0e-b621-8db50835a767 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.034657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbecef5-9fe7-4f0e-b621-8db50835a767 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.034930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbecef5-9fe7-4f0e-b621-8db50835a767 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.036195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbecef5-9fe7-4f0e-b621-8db50835a767 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.037818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbecef5-9fe7-4f0e-b621-8db50835a767 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.038365 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 58/111] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:09.039848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0dba0-af56-4919-8546-393518b37374 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.040487 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 54/112] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:08 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.041924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eedde-ffff-470b-b366-7c761da55e3f None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.042213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eedde-ffff-470b-b366-7c761da55e3f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.042488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eedde-ffff-470b-b366-7c761da55e3f None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.043743 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 55/113] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:09.045349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0dba0-af56-4919-8546-393518b37374 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.045686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0dba0-af56-4919-8546-393518b37374 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.047264 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 59/114] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:09.049060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eedde-ffff-470b-b366-7c761da55e3f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.051149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65ba1d-f1ce-4ca5-a6e6-11b3bb16efee None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.051439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65ba1d-f1ce-4ca5-a6e6-11b3bb16efee None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.051712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65ba1d-f1ce-4ca5-a6e6-11b3bb16efee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.076703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bc65ba1d-f1ce-4ca5-a6e6-11b3bb16efee None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:09.078109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bc65ba1d-f1ce-4ca5-a6e6-11b3bb16efee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:09.147831 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.165155 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 60/115] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:09.166429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956cdb3-4cdf-4138-90f4-1d9a240b4029 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.166716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956cdb3-4cdf-4138-90f4-1d9a240b4029 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.166991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956cdb3-4cdf-4138-90f4-1d9a240b4029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.173414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eedde-ffff-470b-b366-7c761da55e3f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.187678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b956cdb3-4cdf-4138-90f4-1d9a240b4029 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:09.189480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b956cdb3-4cdf-4138-90f4-1d9a240b4029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:09.212720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.213361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.213638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.214351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.215243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] RBAC: Adding query filter params (role.id=31c94e6b112946db990eec7311cd3e27, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=705c40cb075a4d0f8ece79c95c79fbe4) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:09.215721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.217938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.225818 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 56/116] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/role_assignments?user.id=705c40cb075a4d0f8ece79c95c79fbe4&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=31c94e6b112946db990eec7311cd3e27 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.226751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.265149 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.304903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 61/117] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:09.385270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956cdb3-4cdf-4138-90f4-1d9a240b4029 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.427324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcad2a3-a7ce-491a-ae64-b6eb33bc9961 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.496072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.496719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.497023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.497300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.519770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:09.533336 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:09.534192 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:09.534953 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 57/118] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:09.536122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.546165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956cdb3-4cdf-4138-90f4-1d9a240b4029 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.572937 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.586808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.587653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.587933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.588253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.600099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:09.605944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:09.607842 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 62/119] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:09.609661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.713764 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.727056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afd2b2-739c-49d0-9434-d7819b955c52 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.736726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05d6f5-6245-47a7-9def-f63507d45ab0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.776932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.777129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.777699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.777981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.778261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.778733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.779005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:09.779309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.779593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.780050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.780855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.791572 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 63/120] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.792334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.792582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:09.798563 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:09.799387 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:09.800203 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:09.807642 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 58/121] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:09.808936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.844220 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.907078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e7e69-4b2e-4a6c-acbd-9e0de7bd43ec None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.935055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde190a-7266-4daa-8771-1deae2dfe7a7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.942742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.943625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.944121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.944590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.945458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:09.945947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.947523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.955934 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 64/122] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.961613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.969689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.970327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.970604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.970873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.982374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:09.987862 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:09.988802 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:09.989558 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 59/123] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:09.990174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.996177 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.077042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed496-6f4b-40fd-b850-44ba4baa5700 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.085073 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.101282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd2aff-d5a8-4880-84ed-68d55880fa12 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.114650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.115401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.115821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.116320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.117695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.119241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.121496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 65/124] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.122450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.147934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.148869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.149289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.149705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.150530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:10.150973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.152801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.161889 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 60/125] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.163119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.228060 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.236725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a855308-11e8-49ee-9528-b5962b72f5a0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.271747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8d83-9e76-4141-a154-2fa978ce9b16 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.273091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.273890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.274257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.274596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] PATH_INFO: `/v3/users/d3c40350199043a89e4162ff1c7c88f4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.276474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c40350199043a89e4162ff1c7c88f4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.278008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.279722 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 66/126] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/users/d3c40350199043a89e4162ff1c7c88f4 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.285010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.309870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.310793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.311242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.311685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.312543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:10.313166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.314916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.326103 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 61/127] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.327380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.339919 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.401543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcb821-56de-43a0-91a0-f5a46bc0fe39 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.436670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.437611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.437957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.438300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.439487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.441020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.441293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee72e6-badf-464b-8bb0-8ee53f8ee68f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.442902 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 67/128] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.443870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.468876 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.483700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.484685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.485215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.485795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.487958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.489664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.492017 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 62/129] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.497683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.565029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a676d-3eb4-4197-a5b1-047f05b365ae None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.576759 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.602933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.603699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.604067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.604430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.606161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.607709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.609868 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 68/130] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.615212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.616405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfb8fb-f79d-4993-a3aa-78d69d1baf90 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.657472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.658388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.658905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.659319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.660725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.662511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.664511 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 63/131] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.665644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.724297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a28e0-e4e7-4cf1-94ba-38d7d344adb1 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.732348 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.762517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.763338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.763707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.764065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/1fc6c732aa6743328b8eda20a790b5ee/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.766205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5edddd120f64e8c8756e4940755f7b4, user_id=1fc6c732aa6743328b8eda20a790b5ee, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.767781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.779862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099fcf7-45a6-4945-bfd6-6f1f5b83839a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.785627 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 69/132] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:10 2022] PUT /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/1fc6c732aa6743328b8eda20a790b5ee/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:10.786639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.820228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.821262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.821725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.822232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] PATH_INFO: `/v3/projects/a270d1e1afb3463e80042be6809b7530` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.823796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] RBAC: Authorizing `identity:get_project(project_id=a270d1e1afb3463e80042be6809b7530)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.825614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.827870 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 64/133] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/projects/a270d1e1afb3463e80042be6809b7530 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.828893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.840669 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.910712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129b7c4-f40c-41c2-89f7-eb67be026773 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.947135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e8c8-2604-4a1c-82c1-21c192768d51 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.948318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.949255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.949594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.949961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/d3c40350199043a89e4162ff1c7c88f4/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.952665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5edddd120f64e8c8756e4940755f7b4, user_id=d3c40350199043a89e4162ff1c7c88f4, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.954311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.980873 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.983233 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 70/134] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:10 2022] PUT /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/d3c40350199043a89e4162ff1c7c88f4/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:10.983846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.999966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.001184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.001648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.002098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.005809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.008048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.010379 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 65/135] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:11.020060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.145790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40e249-5e97-4609-ac63-6e5de4eeb4ef None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.185768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be01154-f6f7-4745-89ec-92568cab6a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.186848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be01154-f6f7-4745-89ec-92568cab6a32 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.187302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be01154-f6f7-4745-89ec-92568cab6a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.187747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be01154-f6f7-4745-89ec-92568cab6a32 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/1fc6c732aa6743328b8eda20a790b5ee/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.190262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be01154-f6f7-4745-89ec-92568cab6a32 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5edddd120f64e8c8756e4940755f7b4, user_id=1fc6c732aa6743328b8eda20a790b5ee, role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.192005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be01154-f6f7-4745-89ec-92568cab6a32 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.212445 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:11.216395 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 66/136] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:11 2022] PUT /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/1fc6c732aa6743328b8eda20a790b5ee/roles/01f130b1020f40bf97184ccb199975bb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:51:11.218446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0bb1-27c4-4a0d-b6a1-21e400c5dd34 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.269973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fc305-62a6-4d9a-9f5e-55ea1d93e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.270699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fc305-62a6-4d9a-9f5e-55ea1d93e148 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.270982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fc305-62a6-4d9a-9f5e-55ea1d93e148 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.271298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fc305-62a6-4d9a-9f5e-55ea1d93e148 None admin] PATH_INFO: `/v3/projects/a270d1e1afb3463e80042be6809b7530/users/1fc6c732aa6743328b8eda20a790b5ee/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.273633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fc305-62a6-4d9a-9f5e-55ea1d93e148 None admin] RBAC: Authorizing `identity:create_grant(project_id=a270d1e1afb3463e80042be6809b7530, user_id=1fc6c732aa6743328b8eda20a790b5ee, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.275163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fc305-62a6-4d9a-9f5e-55ea1d93e148 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.297838 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 71/137] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:10 2022] PUT /identity/v3/projects/a270d1e1afb3463e80042be6809b7530/users/1fc6c732aa6743328b8eda20a790b5ee/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:11.321141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388da4b6-0015-463e-b633-ae3156274241 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.321647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388da4b6-0015-463e-b633-ae3156274241 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.321718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388da4b6-0015-463e-b633-ae3156274241 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.323170 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 67/138] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:11.331110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6a52d-535d-4e18-9f33-749b58001210 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.331398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6a52d-535d-4e18-9f33-749b58001210 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.331672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6a52d-535d-4e18-9f33-749b58001210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.352219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-39e6a52d-535d-4e18-9f33-749b58001210 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:11.353525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-39e6a52d-535d-4e18-9f33-749b58001210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:11.433976 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 72/139] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:11.584822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee2ee-8c9b-4f2c-96f6-500733fd7b60 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.585219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee2ee-8c9b-4f2c-96f6-500733fd7b60 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.585416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee2ee-8c9b-4f2c-96f6-500733fd7b60 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.586734 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 68/140] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:11.592361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df398-49d4-4fac-b543-e098aa20e095 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.592649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df398-49d4-4fac-b543-e098aa20e095 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.592954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df398-49d4-4fac-b543-e098aa20e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.612382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ee0df398-49d4-4fac-b543-e098aa20e095 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:11.613612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ee0df398-49d4-4fac-b543-e098aa20e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:11.686190 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 73/141] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:11.745914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ee2ee-8c9b-4f2c-96f6-500733fd7b60 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.827492 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:11.884626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ee2ee-8c9b-4f2c-96f6-500733fd7b60 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.927064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.927705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.928091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.928454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.933472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.934951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.936749 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 69/142] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:11.942310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0df398-49d4-4fac-b543-e098aa20e095 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.973434 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.028225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.113825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0df398-49d4-4fac-b543-e098aa20e095 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.182728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.183359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.183638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.183910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.184572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.186042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.217832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2858f9-e567-4997-b1f0-e97f908f346b None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.240579 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 74/143] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:11 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:12.273255 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.277708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.278355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.278731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.279004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.302782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:12.308379 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:12.309260 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:12.309995 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 70/144] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:12.315805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.403480 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.446852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffab0ee-ac57-428a-8f16-7f79762d1206 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.484400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.485060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.485340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.485609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.486292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:12.486605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.488146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.497749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 75/145] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:12.503854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.627479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3626-a978-4086-900e-5e5250bfc64a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.662510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.663539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.663826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.664103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] PATH_INFO: `/v3/users/705c40cb075a4d0f8ece79c95c79fbe4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.665290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] RBAC: Authorizing `identity:get_user(user_id=705c40cb075a4d0f8ece79c95c79fbe4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.666754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.668518 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 71/146] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/users/705c40cb075a4d0f8ece79c95c79fbe4 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:12.674193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.782164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a8b70-6359-47dc-bcad-6b08bd7e85a5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.817287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8a5a2-39ab-4b43-8116-f49380e7fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.818010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a5a2-39ab-4b43-8116-f49380e7fb71 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.818286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a5a2-39ab-4b43-8116-f49380e7fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.819097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a5a2-39ab-4b43-8116-f49380e7fb71 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.820540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8a5a2-39ab-4b43-8116-f49380e7fb71 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.821580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8a5a2-39ab-4b43-8116-f49380e7fb71 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.823313 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 76/147] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:12.829305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.897319 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.952301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a38c4-10ec-4ee1-ad20-9c0cdb474f2c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.990215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd931b8d-363c-4243-9750-2ea3cc3aa6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.990921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931b8d-363c-4243-9750-2ea3cc3aa6b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.991196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931b8d-363c-4243-9750-2ea3cc3aa6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.991476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931b8d-363c-4243-9750-2ea3cc3aa6b3 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/705c40cb075a4d0f8ece79c95c79fbe4/roles/31c94e6b112946db990eec7311cd3e27` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.993653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd931b8d-363c-4243-9750-2ea3cc3aa6b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5edddd120f64e8c8756e4940755f7b4, user_id=705c40cb075a4d0f8ece79c95c79fbe4, role_id=31c94e6b112946db990eec7311cd3e27)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.995244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd931b8d-363c-4243-9750-2ea3cc3aa6b3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:13.012156 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 72/148] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:12 2022] PUT /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4/users/705c40cb075a4d0f8ece79c95c79fbe4/roles/31c94e6b112946db990eec7311cd3e27 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:13.685579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a30ea-df06-43fc-adda-fafc78eb9600 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.686096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a30ea-df06-43fc-adda-fafc78eb9600 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.686417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a30ea-df06-43fc-adda-fafc78eb9600 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.687881 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 77/149] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:13.693768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f622dd-1103-401a-bfba-7e61b52c2130 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.694313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f622dd-1103-401a-bfba-7e61b52c2130 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.694524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f622dd-1103-401a-bfba-7e61b52c2130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.720048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b6f622dd-1103-401a-bfba-7e61b52c2130 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:13.721349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6f622dd-1103-401a-bfba-7e61b52c2130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:13.795985 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 73/150] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:14.012668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ab798-f862-4532-9be1-f09bd383c95a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.013032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ab798-f862-4532-9be1-f09bd383c95a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.013200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ab798-f862-4532-9be1-f09bd383c95a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.014527 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 78/151] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:14.020154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02802f0b-f18a-4ad4-a569-532637324813 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.020437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02802f0b-f18a-4ad4-a569-532637324813 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.020707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02802f0b-f18a-4ad4-a569-532637324813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.043854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-02802f0b-f18a-4ad4-a569-532637324813 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:14.045078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-02802f0b-f18a-4ad4-a569-532637324813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:14.089663 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.127808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 74/152] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:14.200857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3653-9867-4f17-80a5-16041ad0d64c None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.201154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3653-9867-4f17-80a5-16041ad0d64c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.201413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3653-9867-4f17-80a5-16041ad0d64c None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.202774 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 79/153] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:14.208259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c95114-3e2f-4a4f-8b7e-12e7346c82a1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.208549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c95114-3e2f-4a4f-8b7e-12e7346c82a1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.208851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c95114-3e2f-4a4f-8b7e-12e7346c82a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.228559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c3653-9867-4f17-80a5-16041ad0d64c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.229451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-60c95114-3e2f-4a4f-8b7e-12e7346c82a1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:14.230974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-60c95114-3e2f-4a4f-8b7e-12e7346c82a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:14.237937 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.310418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 75/154] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:14.429373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c3653-9867-4f17-80a5-16041ad0d64c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.480633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.481664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.482232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.482690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.499329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:14.505167 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:14.506219 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:14.507450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:14.509822 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 80/155] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:14.517882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c95114-3e2f-4a4f-8b7e-12e7346c82a1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.650398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c95114-3e2f-4a4f-8b7e-12e7346c82a1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.653113 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.688147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.688761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.689058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.689330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.690005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:14.690309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.691700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.701232 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 76/156] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:14.702538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.706585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.857121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480d5e-6b6e-421a-ad51-fc2a8d23d743 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.868913 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.893325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.894342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.894810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.895266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] PATH_INFO: `/v3/users/d3c40350199043a89e4162ff1c7c88f4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.896986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c40350199043a89e4162ff1c7c88f4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.898886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.901025 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 77/157] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/users/d3c40350199043a89e4162ff1c7c88f4 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:14.902130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.933446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10cbe3-cae8-4777-9f02-21b3f9919b48 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.947801 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.991992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.992675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.992979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.993255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.023297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:15.028111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:15.029162 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:15.029999 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:15.033386 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 81/158] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:15.034224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:15.056481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d280-fe0b-452e-8359-7073aedc3681 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:15.091700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:15.092340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.092693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.092903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.103951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:15.109992 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:15.110843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:15.111619 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 78/159] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:15.112341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:15.233247 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:15.244243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e504-ebdb-4f2a-95e6-b140a643fecf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:15.286784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:15.287472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.287818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.288099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.288803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:15.289116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:15.291093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:15.300785 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 79/160] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:15.301927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:15.356541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b89b75-1566-4209-b85a-0eb2c30a05e9 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:15.393760 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:15.422762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:15.423431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.423708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.423970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.583013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64957-1ba1-46c6-978b-bb535431f75d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:15.586898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:15.588434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:15.679561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7da03f-036a-480b-9383-59254237695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:15.680195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7da03f-036a-480b-9383-59254237695b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.680478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7da03f-036a-480b-9383-59254237695b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.680750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7da03f-036a-480b-9383-59254237695b None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.681454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7da03f-036a-480b-9383-59254237695b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:15.681756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7da03f-036a-480b-9383-59254237695b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:15.683145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7da03f-036a-480b-9383-59254237695b None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:15.702936 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 80/161] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:15.704203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4166988-97ce-490e-afa9-2a750757df59 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.704487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4166988-97ce-490e-afa9-2a750757df59 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.704776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4166988-97ce-490e-afa9-2a750757df59 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.706253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 81/162] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:15.706957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4166988-97ce-490e-afa9-2a750757df59 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:15.772907 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:15.848653 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 82/163] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:15.849469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:15.905130 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.015644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4166988-97ce-490e-afa9-2a750757df59 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.057044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b172b-5829-490b-b670-28d77cff0b9f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.121605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87291b94-60ff-4a34-8520-d65435d6dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:16.122186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87291b94-60ff-4a34-8520-d65435d6dffd None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.122468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87291b94-60ff-4a34-8520-d65435d6dffd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.122749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87291b94-60ff-4a34-8520-d65435d6dffd None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.123960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87291b94-60ff-4a34-8520-d65435d6dffd None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:16.130679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87291b94-60ff-4a34-8520-d65435d6dffd None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:16.133508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 82/164] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:16.139955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3472c-35e4-4bc8-9112-7f786c296779 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.140446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3472c-35e4-4bc8-9112-7f786c296779 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.140996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3472c-35e4-4bc8-9112-7f786c296779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.150058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:16.150814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.151168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.151460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.157457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:16.158997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:16.160714 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 83/165] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:16.161570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:16.177785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a0a3472c-35e4-4bc8-9112-7f786c296779 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:16.179945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a0a3472c-35e4-4bc8-9112-7f786c296779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:16.340693 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 83/166] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:16.341580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3472c-35e4-4bc8-9112-7f786c296779 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:16.369151 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.373904 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.390600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777024-7fca-4279-94c8-24b68c23e1fd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.448137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:16.448798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.449085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.449358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.452758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:16.454237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:16.455896 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 84/167] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:16 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:16.456660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:16.529061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3472c-35e4-4bc8-9112-7f786c296779 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.596201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26f51-a548-4501-99be-532b210d9211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:16.597207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26f51-a548-4501-99be-532b210d9211 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.597683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26f51-a548-4501-99be-532b210d9211 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.598172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26f51-a548-4501-99be-532b210d9211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.632694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784881-08ef-4274-b80d-ea2c874f4e3e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.677430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a5cd-632d-4f17-b961-398e109fa3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:16.678993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a5cd-632d-4f17-b961-398e109fa3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.679287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a5cd-632d-4f17-b961-398e109fa3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.679565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a5cd-632d-4f17-b961-398e109fa3e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.713974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a26f51-a548-4501-99be-532b210d9211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:16.715170 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.715435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a26f51-a548-4501-99be-532b210d9211 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:16.730972 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.760709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a5cd-632d-4f17-b961-398e109fa3e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:16.762205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a5cd-632d-4f17-b961-398e109fa3e8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:16.821458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 84/168] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:16.827262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c12c2-f0e3-46c4-a845-08f14b88d413 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.827551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c12c2-f0e3-46c4-a845-08f14b88d413 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.827815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c12c2-f0e3-46c4-a845-08f14b88d413 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.829250 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 85/169] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:16.834206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e43bf-d0cc-4e40-b301-60559b9a6d44 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.834571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e43bf-d0cc-4e40-b301-60559b9a6d44 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.834904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e43bf-d0cc-4e40-b301-60559b9a6d44 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.836140 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 86/170] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:16.836884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e43bf-d0cc-4e40-b301-60559b9a6d44 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:16.870171 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 85/171] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:16.870171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062680b-2dd7-4639-bf1a-c7fc2d85a3b5 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.870171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062680b-2dd7-4639-bf1a-c7fc2d85a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.870171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062680b-2dd7-4639-bf1a-c7fc2d85a3b5 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.870171 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 86/172] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:16.877978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062680b-2dd7-4639-bf1a-c7fc2d85a3b5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:16.941492 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.946748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e43bf-d0cc-4e40-b301-60559b9a6d44 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.963305 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.987433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:16.988308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.988590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.988895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.989630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=d3c40350199043a89e4162ff1c7c88f4) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:16.989939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:16.991062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062680b-2dd7-4639-bf1a-c7fc2d85a3b5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.991449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:16.998991 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 87/173] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:16 2022] GET /identity/v3/role_assignments?user.id=d3c40350199043a89e4162ff1c7c88f4&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:16.999613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.046657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c730d-9e23-4930-a58c-0fbb5f0738f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.047727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c730d-9e23-4930-a58c-0fbb5f0738f6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.048459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c730d-9e23-4930-a58c-0fbb5f0738f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.049997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c730d-9e23-4930-a58c-0fbb5f0738f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.067595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c730d-9e23-4930-a58c-0fbb5f0738f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-ba6c730d-9e23-4930-a58c-0fbb5f0738f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:17.074979 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:17.076042 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:17.077090 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:17.079170 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 87/174] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:17.085541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5937-bc2c-4d74-8bee-7de609b8522b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.085818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5937-bc2c-4d74-8bee-7de609b8522b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.086084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5937-bc2c-4d74-8bee-7de609b8522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.106803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f27d5937-bc2c-4d74-8bee-7de609b8522b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:17.108037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f27d5937-bc2c-4d74-8bee-7de609b8522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:17.123728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed7a1-1fee-41c2-bf7e-afeddb8eaac4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.168105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd896ca-5b50-4b03-9860-c46606a4c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.169591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd896ca-5b50-4b03-9860-c46606a4c240 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.169591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd896ca-5b50-4b03-9860-c46606a4c240 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.169591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd896ca-5b50-4b03-9860-c46606a4c240 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.170395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd896ca-5b50-4b03-9860-c46606a4c240 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:17.171845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd896ca-5b50-4b03-9860-c46606a4c240 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:17.173852 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 88/175] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:16 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:17.175563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a2900-ad6d-474c-b8f4-2e0e78192809 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.175844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a2900-ad6d-474c-b8f4-2e0e78192809 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.176101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a2900-ad6d-474c-b8f4-2e0e78192809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.195635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2a6a2900-ad6d-474c-b8f4-2e0e78192809 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:17.195999 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 88/176] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:17.196885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2a6a2900-ad6d-474c-b8f4-2e0e78192809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:17.197232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5937-bc2c-4d74-8bee-7de609b8522b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.243790 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.264101 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.270499 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 89/177] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:17.272053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9806b-fea0-4a30-9a8f-27e516bccfa9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.272404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9806b-fea0-4a30-9a8f-27e516bccfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.272717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9806b-fea0-4a30-9a8f-27e516bccfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.295285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8ab9806b-fea0-4a30-9a8f-27e516bccfa9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:17.296471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8ab9806b-fea0-4a30-9a8f-27e516bccfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:17.325474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5937-bc2c-4d74-8bee-7de609b8522b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.362317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0650a0d-aac4-4dd9-9d6f-5100df60be00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.363352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650a0d-aac4-4dd9-9d6f-5100df60be00 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.363816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650a0d-aac4-4dd9-9d6f-5100df60be00 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.364295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650a0d-aac4-4dd9-9d6f-5100df60be00 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.365676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0650a0d-aac4-4dd9-9d6f-5100df60be00 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:17.367374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0650a0d-aac4-4dd9-9d6f-5100df60be00 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:17.369074 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 89/178] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:17.370169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f56f-e8b3-433a-831f-e6ce6ccad567 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.370441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f56f-e8b3-433a-831f-e6ce6ccad567 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.370708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f56f-e8b3-433a-831f-e6ce6ccad567 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.372098 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 90/179] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:17.376999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f56f-e8b3-433a-831f-e6ce6ccad567 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.393218 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 90/180] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:17.394673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9806b-fea0-4a30-9a8f-27e516bccfa9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.512954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f56f-e8b3-433a-831f-e6ce6ccad567 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.526514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9806b-fea0-4a30-9a8f-27e516bccfa9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.534807 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.558739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727d71f-12ee-4a6e-ae86-924dec5ce6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.559361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d71f-12ee-4a6e-ae86-924dec5ce6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.559778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d71f-12ee-4a6e-ae86-924dec5ce6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.560055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d71f-12ee-4a6e-ae86-924dec5ce6d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.561319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d71f-12ee-4a6e-ae86-924dec5ce6d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:17.561760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d71f-12ee-4a6e-ae86-924dec5ce6d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:17.561991 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.563153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d71f-12ee-4a6e-ae86-924dec5ce6d1 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:17.569097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.569962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.570254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.570536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.571293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=1fc6c732aa6743328b8eda20a790b5ee) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:17.571855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:17.572471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 91/181] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:17.573727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:17.573835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95020a1-62a5-4fd8-8665-ed882ff234db None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.574005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95020a1-62a5-4fd8-8665-ed882ff234db None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.574277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95020a1-62a5-4fd8-8665-ed882ff234db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.580600 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 91/182] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/role_assignments?user.id=1fc6c732aa6743328b8eda20a790b5ee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:17.585717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.600293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e95020a1-62a5-4fd8-8665-ed882ff234db None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:17.601546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e95020a1-62a5-4fd8-8665-ed882ff234db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:17.686755 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 92/183] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:17.687774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95020a1-62a5-4fd8-8665-ed882ff234db None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.715231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b787-1722-41de-8b41-c79af3d51a87 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.754582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.755302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.755590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.755892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.756801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] RBAC: Adding query filter params (role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=1fc6c732aa6743328b8eda20a790b5ee) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:17.757120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:17.759283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:17.767403 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 92/184] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/role_assignments?user.id=1fc6c732aa6743328b8eda20a790b5ee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=01f130b1020f40bf97184ccb199975bb => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:17.770077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.817693 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.826282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95020a1-62a5-4fd8-8665-ed882ff234db None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.853185 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.885331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.885976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.886239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.886501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.899381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:17.907206 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:17.908172 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 93/185] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:17.910565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.922341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68988a84-9f4d-4543-8994-fb42e6d5b035 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.965614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.966268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.966551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.966819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.978625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:17.984179 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:17.985252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:17.986415 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 93/186] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:17.987197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.043073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5590-3286-4f84-92ef-cc36d34565cf None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.078305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.079208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.079486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.079759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] PATH_INFO: `/v3/users/1fc6c732aa6743328b8eda20a790b5ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.080962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc6c732aa6743328b8eda20a790b5ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.082419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.084035 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 94/187] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/users/1fc6c732aa6743328b8eda20a790b5ee => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.084962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.088445 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.095692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03daa2a4-ed24-4b71-b288-b9f81e793157 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.124743 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.132612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.133280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.133558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.133829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.145095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:18.150346 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:18.151224 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 94/188] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:18.153683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.184080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c786204-70ed-4b9d-ae11-389be31be649 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.217649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.218253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.218534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.218823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.219469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:18.219800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.221274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.229921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 95/189] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.230713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.258617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de5e6-6940-4a2a-9491-d1e5cecb102e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.293806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.294322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.294590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.294853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.295507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:18.295804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.297228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.307987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 95/190] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.311198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.326695 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.329685 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.333287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2438a-6bb9-48ba-8584-2d9570d7e9d5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.367089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.367720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.367998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.368268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.369390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.370854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.372809 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 96/191] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.373208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.407171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b89a8-f0c1-421f-ad3e-04cc288dd983 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.442249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.442855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.443126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.443456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.474386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b497a-a6c0-44db-b2f7-fa2b9c10e08c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.508244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.508882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.509180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.509430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.509603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.510092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:18.510390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.511077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.511737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.519887 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 97/192] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.520681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.530074 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.550433 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.613034 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 96/193] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:18.614097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.621901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc1b0f-ca94-44ae-b6db-e8678d1792b9 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.663043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.663707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.663983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.664256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] PATH_INFO: `/v3/users/705c40cb075a4d0f8ece79c95c79fbe4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.665475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] RBAC: Authorizing `identity:get_user(user_id=705c40cb075a4d0f8ece79c95c79fbe4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.666915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.668561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 98/194] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/users/705c40cb075a4d0f8ece79c95c79fbe4 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.669394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.720362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84178-57a0-46c1-9154-593ebb6fc94e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.737785 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.758769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.759638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.759916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.760187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] PATH_INFO: `/v3/users/3fdfe5b7783843d880ce234069471c8f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.765883 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.769941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f342ab7-a4c2-4eb7-aef7-1be03509b77e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.774110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfe5b7783843d880ce234069471c8f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.775577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.777294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 97/195] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/users/3fdfe5b7783843d880ce234069471c8f => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.782698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.803791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.804376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.804656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.804964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.805613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.807081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.827749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 99/196] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:18 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:18.828650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.906107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc5cd-86cc-44fe-8ab4-5a74af7aafaf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.944910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.945742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.946022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.946670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] PATH_INFO: `/v3/users/3fdfe5b7783843d880ce234069471c8f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.947849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfe5b7783843d880ce234069471c8f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.949419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.951207 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 98/197] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/users/3fdfe5b7783843d880ce234069471c8f => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.952056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadb38e-4d54-4c34-b59d-765c1996d3bb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.956854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.992145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.992145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.992472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.992472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] PATH_INFO: `/v3/projects/a270d1e1afb3463e80042be6809b7530` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.994992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] RBAC: Authorizing `identity:get_project(project_id=a270d1e1afb3463e80042be6809b7530)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.995939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.997646 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 100/198] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/projects/a270d1e1afb3463e80042be6809b7530 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.998422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.007406 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.032861 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.081715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6244f2-7c55-4897-adc4-39239be73ea6 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.137502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.138379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.138552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.139391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.144437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9e808-41df-4540-9327-83724c169a67 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.188004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.189247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.189624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.189993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.223773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.225917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.277668 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.282928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.285436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.316624 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.345181 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 99/199] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:19.350596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.405598 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 101/200] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:19.410499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.482326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d52ba9-d448-4b29-b5d8-b1fc6e92733a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.519824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.520424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.520700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.521005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.532199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c47fe-78e7-4835-bba8-90f7103ffd51 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.536433 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.558297 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.575237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.576510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.577192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.577630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.578628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=a270d1e1afb3463e80042be6809b7530, user.id=1fc6c732aa6743328b8eda20a790b5ee) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:19.579076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.581309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.588642 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 102/201] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/role_assignments?user.id=1fc6c732aa6743328b8eda20a790b5ee&scope.project.id=a270d1e1afb3463e80042be6809b7530&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:19.597004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.622490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.624890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.791696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f13ec-4d99-468a-8c17-7431d91d71db None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.804924 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 100/202] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:19.805627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.829395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.830370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.830844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.831315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.833401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.835704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.837889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 103/203] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:19.838852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.855088 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.901445 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.919137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf92344-a468-49f4-b15b-6de9a4880f0a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.962841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.963835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.964319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.964809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.967076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.968760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.970929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 101/204] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:19.971238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0e39-4aec-46fa-ae64-7002f3045f3a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.972625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:20.021627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.022329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.022610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.022886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.024134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.025639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.028852 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 104/205] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:20.029691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:20.103115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a40a41-4428-42f9-831d-4ea79fe38afb None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.116806 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:20.145796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.146522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.146834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.147183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.148026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] RBAC: Adding query filter params (role.id=31c94e6b112946db990eec7311cd3e27, scope.project.id=d5edddd120f64e8c8756e4940755f7b4, user.id=705c40cb075a4d0f8ece79c95c79fbe4) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:20.148334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.149822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.150074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2aa6f-5d6a-42ca-8fae-862c83b004bb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.156740 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 102/206] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/role_assignments?user.id=705c40cb075a4d0f8ece79c95c79fbe4&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=31c94e6b112946db990eec7311cd3e27 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:20.157793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:20.175445 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:20.191508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8753e1d-9c09-4a09-9115-bbeac37aa906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.191817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8753e1d-9c09-4a09-9115-bbeac37aa906 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.192097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8753e1d-9c09-4a09-9115-bbeac37aa906 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.192366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8753e1d-9c09-4a09-9115-bbeac37aa906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.193172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8753e1d-9c09-4a09-9115-bbeac37aa906 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=3fdfe5b7783843d880ce234069471c8f) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:20.193567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8753e1d-9c09-4a09-9115-bbeac37aa906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.195783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8753e1d-9c09-4a09-9115-bbeac37aa906 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.202239 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 105/207] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:20 2022] GET /identity/v3/role_assignments?user.id=3fdfe5b7783843d880ce234069471c8f&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:20.318878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d9c4-57b9-4feb-a5ce-6038cdaf1905 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.365007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb1758-1ad7-48fe-b8f8-857fba68b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.366115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb1758-1ad7-48fe-b8f8-857fba68b038 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.366697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb1758-1ad7-48fe-b8f8-857fba68b038 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.367184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb1758-1ad7-48fe-b8f8-857fba68b038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.368122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb1758-1ad7-48fe-b8f8-857fba68b038 None admin] RBAC: Adding query filter params (role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=3fdfe5b7783843d880ce234069471c8f) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:20.368616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb1758-1ad7-48fe-b8f8-857fba68b038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.370313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb1758-1ad7-48fe-b8f8-857fba68b038 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.376512 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 103/208] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:20 2022] GET /identity/v3/role_assignments?user.id=3fdfe5b7783843d880ce234069471c8f&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=01f130b1020f40bf97184ccb199975bb => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:21.001435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab86d3d-3803-4ca4-8d11-99e01eb27175 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.002495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab86d3d-3803-4ca4-8d11-99e01eb27175 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.002970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab86d3d-3803-4ca4-8d11-99e01eb27175 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.004575 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 106/209] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:21.010247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900336-4835-43ea-a6ac-8b4ab2548ecb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.011033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900336-4835-43ea-a6ac-8b4ab2548ecb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.011516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900336-4835-43ea-a6ac-8b4ab2548ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.030305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0b900336-4835-43ea-a6ac-8b4ab2548ecb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:21.031801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b900336-4835-43ea-a6ac-8b4ab2548ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:21.063296 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:21.102472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 104/210] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:21.214717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661b0f-5492-458d-92af-ebebcf41480a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.215047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661b0f-5492-458d-92af-ebebcf41480a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.215271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661b0f-5492-458d-92af-ebebcf41480a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.216654 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 107/211] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:21.222152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4054b-fdd6-4a4e-9346-805776f15bc4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.222698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4054b-fdd6-4a4e-9346-805776f15bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.223167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4054b-fdd6-4a4e-9346-805776f15bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.246720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9ba4054b-fdd6-4a4e-9346-805776f15bc4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:21.248267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ba4054b-fdd6-4a4e-9346-805776f15bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:21.325845 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 105/212] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:21.394200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8661b0f-5492-458d-92af-ebebcf41480a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:21.507422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8661b0f-5492-458d-92af-ebebcf41480a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:21.548072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:21.549110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.549589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.550131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.563286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:21.569531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:21.570449 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:21.571243 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:21.573921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 108/213] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:21.579590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4054b-fdd6-4a4e-9346-805776f15bc4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:21.630454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:21.687221 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:21.687816 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:21.691884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4054b-fdd6-4a4e-9346-805776f15bc4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:21.729971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:21.730624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.730949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.731155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.731823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:21.732119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:21.733630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:21.742653 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 106/214] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:21.748061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:21.753584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e35a2-db47-4aef-bdd8-2e0248d7b232 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:21.795404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be42630-32c9-4977-8293-81124065136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:21.796418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be42630-32c9-4977-8293-81124065136b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.796927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be42630-32c9-4977-8293-81124065136b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.797454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be42630-32c9-4977-8293-81124065136b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.798907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be42630-32c9-4977-8293-81124065136b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:21.800558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be42630-32c9-4977-8293-81124065136b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:21.802603 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 109/215] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:21.808189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be42630-32c9-4977-8293-81124065136b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:21.872708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345086-9e6f-42ab-b77c-87b5dd52b5e0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:21.921458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:21.922599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.923087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.923633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] PATH_INFO: `/v3/users/5a70a4c5117d4758a70c3644ad878e2f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.931055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be42630-32c9-4977-8293-81124065136b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:21.941722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] RBAC: Authorizing `identity:get_user(user_id=5a70a4c5117d4758a70c3644ad878e2f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:21.944525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:21.947038 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 107/216] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:21 2022] GET /identity/v3/users/5a70a4c5117d4758a70c3644ad878e2f => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:21.953249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:21.955709 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:21.980435 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:21.987291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e760388-9834-4136-a8ac-416af08aa3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:21.989513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760388-9834-4136-a8ac-416af08aa3b5 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:21.989998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760388-9834-4136-a8ac-416af08aa3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:21.991844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760388-9834-4136-a8ac-416af08aa3b5 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:21.993223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e760388-9834-4136-a8ac-416af08aa3b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:21.995763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e760388-9834-4136-a8ac-416af08aa3b5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:22.025454 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 110/217] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:21 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:51:22.086003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18154367-01e7-40ba-aab1-1b884d614490 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:22.129496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895650d-8c7d-4a52-aabe-da688dadaa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:22.130485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895650d-8c7d-4a52-aabe-da688dadaa85 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.132283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895650d-8c7d-4a52-aabe-da688dadaa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.132883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895650d-8c7d-4a52-aabe-da688dadaa85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.177869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b6f6-5cde-4fc7-ab57-405cf928cd48 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.178192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b6f6-5cde-4fc7-ab57-405cf928cd48 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.178462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b6f6-5cde-4fc7-ab57-405cf928cd48 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.179987 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 111/218] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:22.185026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e4b22-ad0f-4eb8-903f-ee8397e0ba4b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.185532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e4b22-ad0f-4eb8-903f-ee8397e0ba4b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.186037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e4b22-ad0f-4eb8-903f-ee8397e0ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.211421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-323e4b22-ad0f-4eb8-903f-ee8397e0ba4b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:22.213460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-323e4b22-ad0f-4eb8-903f-ee8397e0ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:22.226938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895650d-8c7d-4a52-aabe-da688dadaa85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:22.229172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895650d-8c7d-4a52-aabe-da688dadaa85 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:22.250808 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:22.314100 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 112/219] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:22.357384 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 108/220] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:51:22.363348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e4b22-ad0f-4eb8-903f-ee8397e0ba4b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:22.367804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733538-f39c-40eb-8d38-572fd25aede0 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.368089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733538-f39c-40eb-8d38-572fd25aede0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.368368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733538-f39c-40eb-8d38-572fd25aede0 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.370075 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 109/221] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:22.375599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236ed9-cf6f-49ce-9447-3a9c5ae248e3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.375883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236ed9-cf6f-49ce-9447-3a9c5ae248e3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.376158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236ed9-cf6f-49ce-9447-3a9c5ae248e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.396335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-87236ed9-cf6f-49ce-9447-3a9c5ae248e3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:22.398293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-87236ed9-cf6f-49ce-9447-3a9c5ae248e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:22.475795 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:22.479013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e4b22-ad0f-4eb8-903f-ee8397e0ba4b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:22.487738 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 110/222] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:22.521549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:22.522205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.522560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.522845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.523981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:22.525581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:22.527292 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 113/223] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:22 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:22.533459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236ed9-cf6f-49ce-9447-3a9c5ae248e3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:22.584106 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:22.614762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:22.657984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236ed9-cf6f-49ce-9447-3a9c5ae248e3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:22.753455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:22.754413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.754883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.756249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.757198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=5a70a4c5117d4758a70c3644ad878e2f) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:22.757677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:22.759913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:22.768882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 111/224] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:22 2022] GET /identity/v3/role_assignments?user.id=5a70a4c5117d4758a70c3644ad878e2f&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:22.806093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:22.807348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387843d-9f3b-4a2b-bcd6-268414778df1 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:22.870588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:22.871237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.871510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.871775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.894657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:22.902428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:22.903393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:22.904154 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 114/225] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:22.914740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:22.964655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b3e32-8172-435c-9fa2-0740d61d2ca5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:22.970902 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:22.979886 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.002332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.003508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.004044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.004524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.016926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:23.023005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:23.023875 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:23.024663 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:23.027040 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 112/226] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:23.034492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.132244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9505-9aea-4265-8732-83cf40881c4b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.206169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f11f-8362-4696-a7b8-a2adbb852663 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.219151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.219770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.220050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.220322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.221029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:23.221329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.222815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.244855 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 115/227] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:23.245781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.250902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.251450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.251916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.253024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:23.253520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.255098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.262570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.264832 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 113/228] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:23.270936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.313421 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.385823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cb7a5-62f9-459c-ab6f-7421a550bc43 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.421156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.422160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.422721 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.423169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.423936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] PATH_INFO: `/v3/users/3fdfe5b7783843d880ce234069471c8f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.425444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfe5b7783843d880ce234069471c8f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.427124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.429661 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 114/229] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/users/3fdfe5b7783843d880ce234069471c8f => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:23.434297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced66c5e-c24d-4cea-8807-5d7488d8fbee None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.435819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.487719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.488283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.488556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.488881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] PATH_INFO: `/v3/users/3fdfe5b7783843d880ce234069471c8f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.493448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfe5b7783843d880ce234069471c8f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.494910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.500794 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 116/230] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/users/3fdfe5b7783843d880ce234069471c8f => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:23.510396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.548836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f10b6-ea83-467c-b42c-3383c4693ac8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.576704 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.586612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.587637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.588111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.588575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.590597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.592428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.598446 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 115/231] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:23.605897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.672597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74144a-79ee-4003-ba0d-17f4a3ec797a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.710701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.711699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.712246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.712711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.714536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.716179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.718788 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 117/232] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:23.725236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.757795 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.835687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36eb71-cf5d-40ec-9fd0-4e372954ea81 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.886263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad1e2-b6c5-4b84-a9f6-53445d5225a3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.904924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc3daa-11d6-40f8-8234-957c007d2ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.905941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3daa-11d6-40f8-8234-957c007d2ad2 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.906990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3daa-11d6-40f8-8234-957c007d2ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.907449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3daa-11d6-40f8-8234-957c007d2ad2 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/3fdfe5b7783843d880ce234069471c8f/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.911320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc3daa-11d6-40f8-8234-957c007d2ad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=10443dd3305e4d5b90198fe78a334da2, user_id=3fdfe5b7783843d880ce234069471c8f, role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.914720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc3daa-11d6-40f8-8234-957c007d2ad2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.940506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a6b33-d49b-48fe-9b7c-004d2c44651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.941392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a6b33-d49b-48fe-9b7c-004d2c44651a None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.941668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a6b33-d49b-48fe-9b7c-004d2c44651a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.941934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a6b33-d49b-48fe-9b7c-004d2c44651a None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/3fdfe5b7783843d880ce234069471c8f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.942944 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 116/233] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:23 2022] PUT /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/3fdfe5b7783843d880ce234069471c8f/roles/01f130b1020f40bf97184ccb199975bb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:23.949830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a6b33-d49b-48fe-9b7c-004d2c44651a None admin] RBAC: Authorizing `identity:create_grant(project_id=10443dd3305e4d5b90198fe78a334da2, user_id=3fdfe5b7783843d880ce234069471c8f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.951358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a6b33-d49b-48fe-9b7c-004d2c44651a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.979108 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 118/234] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:23 2022] PUT /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/3fdfe5b7783843d880ce234069471c8f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:24.365482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8728-a086-44be-8a4e-73e2fc4986cb None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.366032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8728-a086-44be-8a4e-73e2fc4986cb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.366032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8728-a086-44be-8a4e-73e2fc4986cb None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.367700 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 117/235] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:24.373214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fd4c7-0ad7-464f-99d5-e980021bfad6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.373652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fd4c7-0ad7-464f-99d5-e980021bfad6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.373822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fd4c7-0ad7-464f-99d5-e980021bfad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.392407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8d9fd4c7-0ad7-464f-99d5-e980021bfad6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:24.393552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8d9fd4c7-0ad7-464f-99d5-e980021bfad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:24.491197 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 119/236] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:24.729364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae545-39f1-40a8-aacd-51cbdc1f0d5a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.730018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae545-39f1-40a8-aacd-51cbdc1f0d5a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.730186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae545-39f1-40a8-aacd-51cbdc1f0d5a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.731497 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 118/237] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:24.737258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9d42-16f9-40a5-ab12-ae2a02a341f8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.737540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9d42-16f9-40a5-ab12-ae2a02a341f8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.737812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9d42-16f9-40a5-ab12-ae2a02a341f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.760099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-88ea9d42-16f9-40a5-ab12-ae2a02a341f8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:24.761314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-88ea9d42-16f9-40a5-ab12-ae2a02a341f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:24.774723 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:24.851378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae545-39f1-40a8-aacd-51cbdc1f0d5a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:24.853582 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 120/238] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:24.903400 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.002615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae545-39f1-40a8-aacd-51cbdc1f0d5a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.052425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.053167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.053389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.053631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.066030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:25.071618 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:25.072494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:25.073341 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 119/239] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:25.079862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea9d42-16f9-40a5-ab12-ae2a02a341f8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.147859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.213406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea9d42-16f9-40a5-ab12-ae2a02a341f8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.250503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a8326-c86a-4cb5-85b1-1b3fd8d3a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.251798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a8326-c86a-4cb5-85b1-1b3fd8d3a31b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.252450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a8326-c86a-4cb5-85b1-1b3fd8d3a31b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.253009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a8326-c86a-4cb5-85b1-1b3fd8d3a31b None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.254020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a8326-c86a-4cb5-85b1-1b3fd8d3a31b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:25.254746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a8326-c86a-4cb5-85b1-1b3fd8d3a31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.256319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a8326-c86a-4cb5-85b1-1b3fd8d3a31b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.267346 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 121/240] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:25.269091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141eac4-396b-4400-b5c3-7bd3ce7dc13c None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.269579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141eac4-396b-4400-b5c3-7bd3ce7dc13c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.270041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141eac4-396b-4400-b5c3-7bd3ce7dc13c None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.271502 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 122/241] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:25.277685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141eac4-396b-4400-b5c3-7bd3ce7dc13c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.278874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606fcb-7091-484c-8c6c-800638543c56 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.290482 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.293013 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.327306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d188d9d-7466-4c47-ae17-2b4fe2850a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.328218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d188d9d-7466-4c47-ae17-2b4fe2850a5e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.328630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d188d9d-7466-4c47-ae17-2b4fe2850a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.329070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d188d9d-7466-4c47-ae17-2b4fe2850a5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.330318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d188d9d-7466-4c47-ae17-2b4fe2850a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.332897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d188d9d-7466-4c47-ae17-2b4fe2850a5e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.335731 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 120/242] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:25.337470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d371b-d689-4ed5-9095-7d9d26a3df37 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.338439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d371b-d689-4ed5-9095-7d9d26a3df37 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.338906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d371b-d689-4ed5-9095-7d9d26a3df37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.362410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1d2d371b-d689-4ed5-9095-7d9d26a3df37 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:25.364638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d2d371b-d689-4ed5-9095-7d9d26a3df37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:25.406225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141eac4-396b-4400-b5c3-7bd3ce7dc13c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.450694 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 121/243] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:25.451533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d371b-d689-4ed5-9095-7d9d26a3df37 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.456081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.460805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.460805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.460805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] PATH_INFO: `/v3/users/0cc6e74a860e42c5b2f6234b48f195c5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.489814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] RBAC: Authorizing `identity:get_user(user_id=0cc6e74a860e42c5b2f6234b48f195c5)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.491764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.494357 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 123/244] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/users/0cc6e74a860e42c5b2f6234b48f195c5 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:25.500287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.602040 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.614697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d371b-d689-4ed5-9095-7d9d26a3df37 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.619725 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.675082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.675689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.675959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.676223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.676885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.678542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.691878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9e5ce-3f98-4385-8910-8ecc3e9d95fd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.712356 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 122/245] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:25 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:25.749909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.750786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.751227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.751631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.774750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.888464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.890066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.935938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f013ed9-8fd2-4b45-88d4-b76ba5aef0df None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.963688 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.991048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.992096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.993092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.993566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.007996 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 124/246] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:26.013405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:26.017833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:26.018956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:26.019853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:26.020650 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 123/247] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:26.031950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.035458 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.163986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331506d1-3fda-47e6-a1ea-3258f3e11736 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.179997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d693f1-5594-4a24-9895-0f25e5772ce9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.205810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.206353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.206698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.207055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.208474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.212392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.214328 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 125/248] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:26.221174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.227416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.228292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.228742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.229212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.230364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:26.230835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.232975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.244417 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 124/249] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:26.249823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.271922 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.347598 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.363119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b040c7-5b9d-4d87-93ac-0c87120872c2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.389444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774385c1-4b10-4c3b-a109-8952fa095976 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.398445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675c3ef-dd9c-4241-84f3-ffa440897518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.398986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c3ef-dd9c-4241-84f3-ffa440897518 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.399261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c3ef-dd9c-4241-84f3-ffa440897518 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.399529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c3ef-dd9c-4241-84f3-ffa440897518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.400263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c3ef-dd9c-4241-84f3-ffa440897518 None admin] RBAC: Adding query filter params (role.id=31c94e6b112946db990eec7311cd3e27, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=0cc6e74a860e42c5b2f6234b48f195c5) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:26.400566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c3ef-dd9c-4241-84f3-ffa440897518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.402037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c3ef-dd9c-4241-84f3-ffa440897518 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.408032 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 126/250] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/role_assignments?user.id=0cc6e74a860e42c5b2f6234b48f195c5&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=31c94e6b112946db990eec7311cd3e27 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:26.444835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f95f1-415e-49dc-b37e-cced995ae678 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.445496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f95f1-415e-49dc-b37e-cced995ae678 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.445990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f95f1-415e-49dc-b37e-cced995ae678 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.447573 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 127/251] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:26.451812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.451812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.451812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.451812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] PATH_INFO: `/v3/users/5a70a4c5117d4758a70c3644ad878e2f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.452506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=5a70a4c5117d4758a70c3644ad878e2f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.452506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.453426 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 125/252] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/users/5a70a4c5117d4758a70c3644ad878e2f => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:26.454426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575a1b1-e2ad-4286-bc43-c1dd673f1b3d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.454709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575a1b1-e2ad-4286-bc43-c1dd673f1b3d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.454981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575a1b1-e2ad-4286-bc43-c1dd673f1b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.463083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.479370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5575a1b1-e2ad-4286-bc43-c1dd673f1b3d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:26.481325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5575a1b1-e2ad-4286-bc43-c1dd673f1b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:26.584668 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 128/253] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:26.586914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64226ee-94fe-447f-a17f-88693b89328b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.589730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64226ee-94fe-447f-a17f-88693b89328b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.590002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64226ee-94fe-447f-a17f-88693b89328b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.591330 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 129/254] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:26.597045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30ad08-6060-4031-9a0b-43774a08a890 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.597385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30ad08-6060-4031-9a0b-43774a08a890 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.597694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30ad08-6060-4031-9a0b-43774a08a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.627397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4f30ad08-6060-4031-9a0b-43774a08a890 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:26.630039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4f30ad08-6060-4031-9a0b-43774a08a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:26.654552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba5c7a-a829-45cd-a834-96dc3f47f4c7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.671318 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.725110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 130/255] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:26.753992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.754655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.754931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.755199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.756564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.758261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.760299 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 126/256] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:26.766111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30ad08-6060-4031-9a0b-43774a08a890 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.880348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30ad08-6060-4031-9a0b-43774a08a890 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.930662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.931651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.932114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.932588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/5a70a4c5117d4758a70c3644ad878e2f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.934684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=10443dd3305e4d5b90198fe78a334da2, user_id=5a70a4c5117d4758a70c3644ad878e2f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.936438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.960669 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 131/257] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:26 2022] PUT /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/5a70a4c5117d4758a70c3644ad878e2f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:27.027282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.030271 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.180302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c83799-f53a-4257-8f7b-2cf31a3c15c2 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.185751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.211141 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.251361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.252012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.252287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.252556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.265537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:27.270969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:27.271871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:27.272796 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:27.273865 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 127/258] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:27.281822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.304849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a1a0b-0449-4623-8187-4f6deb824a39 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.339905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.340577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.340887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.341199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.352635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:27.357918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:27.358785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:27.359570 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 132/259] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:27.365186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.401115 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.453354 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.473804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899f237-5dbc-48a5-926a-9d4dc44759c4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.511271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.511984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.512331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.512670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.513513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:27.513934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:27.515954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:27.519181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8347e15-dfab-4864-a7f5-fb0726acbedf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.526695 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 133/260] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:27.532071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.597654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.598371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.598647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.598917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.599656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:27.599957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:27.601382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:27.625458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 128/261] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:27.630987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.668970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2066-2911-41f6-b81c-ce16639f5aae None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.744047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.745827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.746107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.747191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] PATH_INFO: `/v3/users/3fdfe5b7783843d880ce234069471c8f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.754514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfe5b7783843d880ce234069471c8f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:27.758070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:27.759805 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 134/262] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/users/3fdfe5b7783843d880ce234069471c8f => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:27.770393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.797150 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.843255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad930896-dde3-4707-a409-5a1cd1fae6c6 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.874753 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.888566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.889437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.889806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.890080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] PATH_INFO: `/v3/users/3fdfe5b7783843d880ce234069471c8f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.891271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfe5b7783843d880ce234069471c8f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:27.892791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:27.894512 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 129/263] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/users/3fdfe5b7783843d880ce234069471c8f => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:27.901809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.975152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871da3d9-9c58-4fc8-b1f8-cf571ca896fc None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.033158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.033777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.034048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.034317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.052988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d045ed-7fce-4d74-a684-f206676a5134 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.100955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.101569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.101847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.102118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.171348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.175432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.205112 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.230525 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.242877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.244790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.408023 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 135/264] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:28.413534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.477957 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 130/265] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:28.483762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.624586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166e043-91d4-4dde-b866-06bfc489c86f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.653138 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.669620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.670205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.670487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.670762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.672017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.673529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.675189 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 136/266] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:28.681666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.717958 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.762846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bacee9-3e64-44e6-9ad7-f161936fdf2e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.807495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0dda-3139-4fd2-a0f4-cc4b15b3a7da None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.842829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.843437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.843715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.843987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.844720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] RBAC: Adding query filter params (role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=3fdfe5b7783843d880ce234069471c8f) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:28.845073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.846515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.853339 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 137/267] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/role_assignments?user.id=3fdfe5b7783843d880ce234069471c8f&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=01f130b1020f40bf97184ccb199975bb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:28.856993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c699c-dc52-4ae5-a3ec-828de57f0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.857647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c699c-dc52-4ae5-a3ec-828de57f0881 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.857916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c699c-dc52-4ae5-a3ec-828de57f0881 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.858181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c699c-dc52-4ae5-a3ec-828de57f0881 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.859352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c699c-dc52-4ae5-a3ec-828de57f0881 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.860877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c699c-dc52-4ae5-a3ec-828de57f0881 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.863189 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 131/268] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:28.869599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.923059 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.987615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7513a2-51a5-4275-b933-db765cf3c64e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:29.026474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046c48b-302e-42c4-94b4-3233d95dac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:29.027096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046c48b-302e-42c4-94b4-3233d95dac1c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.027377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046c48b-302e-42c4-94b4-3233d95dac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.027657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046c48b-302e-42c4-94b4-3233d95dac1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.028400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046c48b-302e-42c4-94b4-3233d95dac1c None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=3fdfe5b7783843d880ce234069471c8f) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:29.028711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046c48b-302e-42c4-94b4-3233d95dac1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:29.030199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046c48b-302e-42c4-94b4-3233d95dac1c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:29.036893 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 138/269] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/role_assignments?user.id=3fdfe5b7783843d880ce234069471c8f&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:29.073264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4b8ac-3941-4566-b96f-c9c47e8a598e None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.073554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4b8ac-3941-4566-b96f-c9c47e8a598e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.073815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4b8ac-3941-4566-b96f-c9c47e8a598e None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.075536 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 132/270] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:29.081063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb349-0a40-4bfe-a150-e45b46fdf132 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.081370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb349-0a40-4bfe-a150-e45b46fdf132 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.081620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb349-0a40-4bfe-a150-e45b46fdf132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.110746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fc3cb349-0a40-4bfe-a150-e45b46fdf132 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:29.111968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc3cb349-0a40-4bfe-a150-e45b46fdf132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:29.194972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 139/271] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:29.283804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdffb2-a015-4fb6-af17-9d4c92299366 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.284316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdffb2-a015-4fb6-af17-9d4c92299366 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.284857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdffb2-a015-4fb6-af17-9d4c92299366 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.286421 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 133/272] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:29.292132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cce2f-b7e3-4816-a725-f98cc4810bec None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.292420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cce2f-b7e3-4816-a725-f98cc4810bec None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.292699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cce2f-b7e3-4816-a725-f98cc4810bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.317550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c40cce2f-b7e3-4816-a725-f98cc4810bec None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:29.318923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c40cce2f-b7e3-4816-a725-f98cc4810bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:29.351891 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:29.398890 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 140/273] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:29.492140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4366e0-0b65-45f3-9585-cef387046545 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.492431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4366e0-0b65-45f3-9585-cef387046545 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.492619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4366e0-0b65-45f3-9585-cef387046545 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.493998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 134/274] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:29.501300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e83dd-669e-477b-9026-f91d1bedc79c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.501576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e83dd-669e-477b-9026-f91d1bedc79c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.501847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e83dd-669e-477b-9026-f91d1bedc79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.522704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-609e83dd-669e-477b-9026-f91d1bedc79c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:29.523890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-609e83dd-669e-477b-9026-f91d1bedc79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:29.581904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4366e0-0b65-45f3-9585-cef387046545 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:29.615752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 141/275] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:29.682688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e83dd-669e-477b-9026-f91d1bedc79c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:29.700552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4366e0-0b65-45f3-9585-cef387046545 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:29.737239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed4c2b-fa6b-44c9-84c3-8e916582baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:29.737856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed4c2b-fa6b-44c9-84c3-8e916582baac None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.738134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed4c2b-fa6b-44c9-84c3-8e916582baac None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.738405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed4c2b-fa6b-44c9-84c3-8e916582baac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.749098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed4c2b-fa6b-44c9-84c3-8e916582baac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-94ed4c2b-fa6b-44c9-84c3-8e916582baac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:29.753811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:29.754687 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:29.755502 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:29.759907 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 135/276] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:29.761241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dfa23-1fd5-4074-bd77-3e426a7ba77b None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.761443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dfa23-1fd5-4074-bd77-3e426a7ba77b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.761655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dfa23-1fd5-4074-bd77-3e426a7ba77b None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.762939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 136/277] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:29.763695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dfa23-1fd5-4074-bd77-3e426a7ba77b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:29.786475 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:29.791665 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:29.799846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e83dd-669e-477b-9026-f91d1bedc79c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:29.834862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa995c90-4493-4dbc-b489-f3202b2bc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:29.835966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa995c90-4493-4dbc-b489-f3202b2bc3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.836301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa995c90-4493-4dbc-b489-f3202b2bc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.836748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa995c90-4493-4dbc-b489-f3202b2bc3d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.847926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa995c90-4493-4dbc-b489-f3202b2bc3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-fa995c90-4493-4dbc-b489-f3202b2bc3d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:29.853107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:29.853978 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:29.855103 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 142/278] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:29.855742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe410-b6f0-4965-b0e5-ed8ff50a45d7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.855806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe410-b6f0-4965-b0e5-ed8ff50a45d7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.856370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe410-b6f0-4965-b0e5-ed8ff50a45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.874882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3b7fe410-b6f0-4965-b0e5-ed8ff50a45d7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:29.875870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dfa23-1fd5-4074-bd77-3e426a7ba77b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:29.876045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3b7fe410-b6f0-4965-b0e5-ed8ff50a45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:29.911982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:29.912594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.912894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.913311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.913987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:29.914285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:29.915714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:29.924357 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 137/279] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:29.925196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:29.953946 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 143/280] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:29.954777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fe410-b6f0-4965-b0e5-ed8ff50a45d7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.013624 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.034490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899dd88-12dd-4df3-b24d-19ac2d2022c5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.045557 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.062985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fe410-b6f0-4965-b0e5-ed8ff50a45d7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.073437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.074431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.074670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.074892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.075567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:30.075873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.077322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.086632 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 138/281] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.086632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.102321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.102988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.103274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.103545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.104970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.106408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.108093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 144/282] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.108745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.199736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df8a0-b105-4815-8866-2da150833452 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.217394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26f6f1-606e-4f0d-a48d-604c0e574686 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.235964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.236601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.236910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.237168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] PATH_INFO: `/v3/users/0cc6e74a860e42c5b2f6234b48f195c5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.238303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] RBAC: Authorizing `identity:get_user(user_id=0cc6e74a860e42c5b2f6234b48f195c5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.239743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.241492 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 139/283] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/users/0cc6e74a860e42c5b2f6234b48f195c5 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.242219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.251524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.252159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.252438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.252726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] PATH_INFO: `/v3/users/0aad9feabb2144158fff9f4f62542470` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.257042 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.267048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] RBAC: Authorizing `identity:get_user(user_id=0aad9feabb2144158fff9f4f62542470)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.268462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.270153 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 145/284] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/users/0aad9feabb2144158fff9f4f62542470 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.270913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.286013 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.354765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a3005-eca9-4d9c-9910-4e0d3c5ee53d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.388517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.389193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.389369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf9a6e-3816-4e6b-8566-2091d2ba4c22 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.389534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.389691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.390329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.391783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.414125 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 140/285] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:30 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:30.417778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.427257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.427921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.428197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.428463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.440218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:30.445234 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:30.446218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:30.447000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 146/286] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:30.448120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.503264 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.527049 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.546494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f22a9d-4cbe-4e6f-8fda-5dcd1c159616 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.562682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200dc78-507f-42e4-8be7-3cffd8d43de7 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.590243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.591258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.591543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.591813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.592980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.594580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.596121 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 141/287] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.600799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.604237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.605198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.605471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.605737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.606478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, user.id=0aad9feabb2144158fff9f4f62542470, scope.system=all) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:30.606783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.608260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.613923 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 147/288] 10.222.0.46 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/role_assignments?user.id=0aad9feabb2144158fff9f4f62542470&scope.system=all&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.614696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.746098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bdd77-baa0-4bd5-ad23-e8dc8c842e81 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.763724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b77e6-a7ff-4f0d-8c0d-1e51aa089065 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.798390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.799238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.799685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.800096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.800954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:30.801394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.803363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.808024 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.810864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.811533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.811799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.812070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/0cc6e74a860e42c5b2f6234b48f195c5/roles/31c94e6b112946db990eec7311cd3e27` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.814013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] RBAC: Authorizing `identity:create_grant(project_id=10443dd3305e4d5b90198fe78a334da2, user_id=0cc6e74a860e42c5b2f6234b48f195c5, role_id=31c94e6b112946db990eec7311cd3e27)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.815464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.816602 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 142/289] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.821033 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.823658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.831657 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 148/290] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:30 2022] PUT /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2/users/0cc6e74a860e42c5b2f6234b48f195c5/roles/31c94e6b112946db990eec7311cd3e27 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:30.936235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2d76-294d-4325-a944-45e666a0b12f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.973804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.974517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.974795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.975066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] PATH_INFO: `/v3/users/5a70a4c5117d4758a70c3644ad878e2f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.976330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] RBAC: Authorizing `identity:get_user(user_id=5a70a4c5117d4758a70c3644ad878e2f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.977827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.979942 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 143/291] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/users/5a70a4c5117d4758a70c3644ad878e2f => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.989109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:31.112015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e25d-e36e-428f-bb85-cce2477d715f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.151931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.152554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.152953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.153230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.230100 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:31.241672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.243336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.366519 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 149/292] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:31.372118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:31.456344 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:31.502355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510949-1796-4a90-8bb0-35c1b4ca3b76 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.553914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94664f0d-faf1-45b4-b071-99844405b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.554560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664f0d-faf1-45b4-b071-99844405b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.554835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664f0d-faf1-45b4-b071-99844405b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.555105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664f0d-faf1-45b4-b071-99844405b6c8 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.556244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94664f0d-faf1-45b4-b071-99844405b6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.557732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94664f0d-faf1-45b4-b071-99844405b6c8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.559692 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 144/293] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:31 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:31.565514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:31.718542 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:31.725634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1dc49-b6dc-419e-94b4-95fb01957296 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.772062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c08197-1144-4bb0-84f0-c4124fd49d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.773461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08197-1144-4bb0-84f0-c4124fd49d59 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.773928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08197-1144-4bb0-84f0-c4124fd49d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.774404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08197-1144-4bb0-84f0-c4124fd49d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.775331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c08197-1144-4bb0-84f0-c4124fd49d59 None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=5a70a4c5117d4758a70c3644ad878e2f) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:31.775824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c08197-1144-4bb0-84f0-c4124fd49d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.777464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c08197-1144-4bb0-84f0-c4124fd49d59 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.789220 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 150/294] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:31 2022] GET /identity/v3/role_assignments?user.id=5a70a4c5117d4758a70c3644ad878e2f&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:32.713498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365504a-e60d-4e0b-a063-09271ffe97bf None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.714016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365504a-e60d-4e0b-a063-09271ffe97bf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.714016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365504a-e60d-4e0b-a063-09271ffe97bf None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.715503 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 145/295] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:32.720743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37f5e-9887-4473-9492-52106b9afb54 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.721054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37f5e-9887-4473-9492-52106b9afb54 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.721328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37f5e-9887-4473-9492-52106b9afb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.739866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6ab37f5e-9887-4473-9492-52106b9afb54 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:32.741163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6ab37f5e-9887-4473-9492-52106b9afb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:32.815937 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 151/296] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:32.896214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5e36-6832-4fca-ab88-2ed5be977f8a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.896642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5e36-6832-4fca-ab88-2ed5be977f8a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.896956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5e36-6832-4fca-ab88-2ed5be977f8a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.898567 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 146/297] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:32.903876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafec68-24d9-4bb0-9eac-19b67f4b0860 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.904157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafec68-24d9-4bb0-9eac-19b67f4b0860 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.904430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafec68-24d9-4bb0-9eac-19b67f4b0860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.927382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bdafec68-24d9-4bb0-9eac-19b67f4b0860 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:32.928748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bdafec68-24d9-4bb0-9eac-19b67f4b0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:32.999765 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 152/298] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:33.015117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef32df-1bc6-497a-b48c-5868dceb6051 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.015408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef32df-1bc6-497a-b48c-5868dceb6051 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.015665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef32df-1bc6-497a-b48c-5868dceb6051 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.017381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 147/299] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:33.022635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735fe3-8c1c-45b0-b24b-78837c888d86 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.022917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735fe3-8c1c-45b0-b24b-78837c888d86 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.023190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735fe3-8c1c-45b0-b24b-78837c888d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.041742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-af735fe3-8c1c-45b0-b24b-78837c888d86 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:33.042928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-af735fe3-8c1c-45b0-b24b-78837c888d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:33.056729 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.091621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef32df-1bc6-497a-b48c-5868dceb6051 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.117189 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 153/300] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:33.170553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561dab-fe38-4ebd-8a0f-2c1457893109 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.170857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561dab-fe38-4ebd-8a0f-2c1457893109 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.171113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561dab-fe38-4ebd-8a0f-2c1457893109 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.172690 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 154/301] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:33.177932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d000d-24e7-49c1-9501-026c52cac9ce None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.178522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d000d-24e7-49c1-9501-026c52cac9ce None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.178809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d000d-24e7-49c1-9501-026c52cac9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.201335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-477d000d-24e7-49c1-9501-026c52cac9ce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:33.202545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-477d000d-24e7-49c1-9501-026c52cac9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:33.219515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef32df-1bc6-497a-b48c-5868dceb6051 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.264043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.265413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.266154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.266584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.269075 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.280312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:33.285073 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:33.285954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:33.293883 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:33.294511 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 155/302] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:33.294590 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 148/303] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:33.294655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d000d-24e7-49c1-9501-026c52cac9ce None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.294719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.380381 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.404327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d000d-24e7-49c1-9501-026c52cac9ce None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.417089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0266e-414e-4c2b-a5f4-2c06dc41e901 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.439972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.440679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.440983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.441255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.452151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:33.452581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.453205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.453479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.453743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.454398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:33.454692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.456053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:33.456845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:33.457668 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:33.458447 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:33.459234 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 156/304] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:33.459865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.470597 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 149/305] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:33.471562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.537693 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.571164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8123e-7f59-4ff9-8570-7493ea1d1bcd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.583218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80539588-9b4c-4179-af2f-80f4396600f0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.603713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.604654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.604956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.605224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.606337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.607769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.609497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 157/306] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.610161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.617326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.617934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.618206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.618485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.618770 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.619602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:33.619872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.621679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.630254 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 150/307] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.631241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.710840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532617a-00d6-4fe7-a9bf-afc81a75d2f3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.731244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bcb25-8835-4ee1-8db2-fcb06bf8191d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.743733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.744366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.744643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.744981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] PATH_INFO: `/v3/users/0aad9feabb2144158fff9f4f62542470` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.746094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] RBAC: Authorizing `identity:get_user(user_id=0aad9feabb2144158fff9f4f62542470)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.747532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.748098 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.749134 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 158/308] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/users/0aad9feabb2144158fff9f4f62542470 => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.754723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.765364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.765992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.766261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.766523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.776621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:33.781763 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:33.782638 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 151/309] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:33.785929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.829696 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.854999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec338-d7c6-4135-bf62-0d925dcaf82e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.882609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418371a-73b8-46b6-b851-bd8ae6ca8191 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.887180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.887785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.888060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.888328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.888980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.890409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.906173 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 159/310] 10.222.0.46 () {60 vars in 1134 bytes} [Sun Aug 21 00:51:33 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:33.906955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.917030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.917683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.917959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.918229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] PATH_INFO: `/v3/users/c91a7dd9cac447dabe10e00e6f951569` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.938091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] RBAC: Authorizing `identity:get_user(user_id=c91a7dd9cac447dabe10e00e6f951569)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.939716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.946969 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 152/311] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/users/c91a7dd9cac447dabe10e00e6f951569 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.946969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.986516 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.047379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b15e3-6793-476d-9b02-7eafd17f9b4e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.063817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2048dd-8cd7-4228-a671-517a1c8725ec None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.090482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.091062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.091337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.091872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] PATH_INFO: `/v3/system/users/0aad9feabb2144158fff9f4f62542470/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.093032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0aad9feabb2144158fff9f4f62542470, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.094425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.098344 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.103788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.104687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.104993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.105179 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 160/312] 10.222.0.46 () {58 vars in 1334 bytes} [Sun Aug 21 00:51:33 2022] PUT /identity/v3/system/users/0aad9feabb2144158fff9f4f62542470/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:34.105329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.106006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:34.106300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.106818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.107738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.121756 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 153/313] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:34.127885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.256655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c558-0899-4f06-85dc-87d0975e88f4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.261226 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.267607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb82f-9183-4a59-8674-fd4781a4f8d1 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.295690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.296298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.296571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.296860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.297573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] RBAC: Adding query filter params (role.id=31c94e6b112946db990eec7311cd3e27, user.id=c91a7dd9cac447dabe10e00e6f951569, scope.system=all) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:34.297875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.299302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.304814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 161/314] 10.222.0.46 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/role_assignments?user.id=c91a7dd9cac447dabe10e00e6f951569&scope.system=all&role.id=31c94e6b112946db990eec7311cd3e27 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:34.317481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.318742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.319224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.319859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] PATH_INFO: `/v3/users/0cc6e74a860e42c5b2f6234b48f195c5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.321447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=0cc6e74a860e42c5b2f6234b48f195c5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.323202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.325751 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 154/315] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/users/0cc6e74a860e42c5b2f6234b48f195c5 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:34.332906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.409252 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.456819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726e12c-119a-43b9-b1e3-97af4a7bd57b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.496071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.496693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.496996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.497269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.580105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.581608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.643834 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.690532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 162/316] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:34.696960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.878993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75404566-8dd8-4813-b455-11cc2bd8a4a1 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.942561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeaffa-e996-4f4d-b9bd-d62fb35f44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.943358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeaffa-e996-4f4d-b9bd-d62fb35f44c2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.944092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeaffa-e996-4f4d-b9bd-d62fb35f44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.944373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeaffa-e996-4f4d-b9bd-d62fb35f44c2 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.945656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeaffa-e996-4f4d-b9bd-d62fb35f44c2 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.947128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeaffa-e996-4f4d-b9bd-d62fb35f44c2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.949292 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 155/317] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:34.956806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:35.073139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fa2b6-d07e-4c16-adfc-1745036f14aa None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:35.109032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80c941-a44d-4e1f-b17e-1e96d7968fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:35.109648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c941-a44d-4e1f-b17e-1e96d7968fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:35.109924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c941-a44d-4e1f-b17e-1e96d7968fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:35.110193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c941-a44d-4e1f-b17e-1e96d7968fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:35.110921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80c941-a44d-4e1f-b17e-1e96d7968fa7 None admin] RBAC: Adding query filter params (role.id=31c94e6b112946db990eec7311cd3e27, scope.project.id=10443dd3305e4d5b90198fe78a334da2, user.id=0cc6e74a860e42c5b2f6234b48f195c5) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:35.111227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80c941-a44d-4e1f-b17e-1e96d7968fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:35.112669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80c941-a44d-4e1f-b17e-1e96d7968fa7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:35.119444 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 163/318] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/role_assignments?user.id=0cc6e74a860e42c5b2f6234b48f195c5&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=31c94e6b112946db990eec7311cd3e27 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:36.001035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d056a4-0707-4db7-b6a9-05420d681c0c None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.001552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d056a4-0707-4db7-b6a9-05420d681c0c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.001552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d056a4-0707-4db7-b6a9-05420d681c0c None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.003093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 156/319] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:36.009145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036068b9-1f9e-4204-8a22-6a4059957c96 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.009627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036068b9-1f9e-4204-8a22-6a4059957c96 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.009698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036068b9-1f9e-4204-8a22-6a4059957c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.028543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-036068b9-1f9e-4204-8a22-6a4059957c96 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:36.029750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-036068b9-1f9e-4204-8a22-6a4059957c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:36.051021 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:36.104697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 164/320] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:36.155706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b652e-81af-4f05-b411-73eef9acdddf None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.155967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b652e-81af-4f05-b411-73eef9acdddf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.156265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b652e-81af-4f05-b411-73eef9acdddf None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.157821 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 157/321] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:36.162950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744efcd-8168-4d71-8385-a379c9cf41e2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.163215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744efcd-8168-4d71-8385-a379c9cf41e2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.163519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744efcd-8168-4d71-8385-a379c9cf41e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.183416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7744efcd-8168-4d71-8385-a379c9cf41e2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:36.184620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7744efcd-8168-4d71-8385-a379c9cf41e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:36.253831 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 165/322] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:36.329948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d013-74a1-4fe8-bf8a-c3e6a141eb54 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.330294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d013-74a1-4fe8-bf8a-c3e6a141eb54 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.330472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d013-74a1-4fe8-bf8a-c3e6a141eb54 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.332003 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 158/323] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:36.337628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189b9a-2e48-4171-9fdf-a6ec59be1edf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.337910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189b9a-2e48-4171-9fdf-a6ec59be1edf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.338184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189b9a-2e48-4171-9fdf-a6ec59be1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.357374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-52189b9a-2e48-4171-9fdf-a6ec59be1edf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:36.358570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-52189b9a-2e48-4171-9fdf-a6ec59be1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:36.369692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441d013-74a1-4fe8-bf8a-c3e6a141eb54 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.406485 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:36.434396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 166/324] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:36.475659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441d013-74a1-4fe8-bf8a-c3e6a141eb54 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:36.510321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:36.510890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.511164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.511433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.512573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:36.514082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:36.514459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189b9a-2e48-4171-9fdf-a6ec59be1edf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.517080 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 159/325] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:36.520845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.533223 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:36.619752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189b9a-2e48-4171-9fdf-a6ec59be1edf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:36.623795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96b572-328f-4dfd-8479-87b26c8928ec None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:36.625457 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:36.658748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:36.658940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:36.659379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.659502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.659654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.659744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.659918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.660008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] PATH_INFO: `/v3/groups` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.660581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:36.662172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:36.670551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:36.675581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:36.676528 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:36.677708 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 167/326] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:36.682592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.693531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 160/327] 10.222.0.46 () {60 vars in 1134 bytes} [Sun Aug 21 00:51:36 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:51:36.709086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.773632 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:36.801756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f9c9e-0061-4aae-b81d-32acb18a48e6 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:36.834339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf4274-0711-4de2-a847-8bcdd42c7018 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:36.855418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:36.856785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.857223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.857973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.858454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:36.858756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:36.862177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:36.870551 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 168/328] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:36.871867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:36.872506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.872791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.873083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.876036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.884753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:36.890020 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:36.890903 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:36.892087 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 161/329] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:36.897111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.924203 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:37.009084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a374865-b8ba-405e-87a5-bc67a54352b7 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.031940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff261-2a36-48ea-8043-27467d860f3f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.059633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.059633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.059633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.060283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] PATH_INFO: `/v3/users/0aad9feabb2144158fff9f4f62542470` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.060858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=0aad9feabb2144158fff9f4f62542470)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.062362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.064000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 169/330] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/users/0aad9feabb2144158fff9f4f62542470 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:37.072605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.079807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.080456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.080732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.081482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.082181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:37.082479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.084857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.098952 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 162/331] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:37.105058 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:37.105949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.220426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782b2a5-6152-469f-9a11-3a732426e6f5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.229907 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:37.253352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb4fa-5199-49d1-9b5c-a7eec4788b50 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.260811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.261737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.262228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.262700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.263645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] RBAC: Adding query filter params (role.id=a11e5ddd599243b983e4f4e44fe1bd85, user.id=0aad9feabb2144158fff9f4f62542470, scope.system=all) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:37.264138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.265781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.279477 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 170/332] 10.222.0.46 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:37 2022] GET /identity/v3/role_assignments?user.id=0aad9feabb2144158fff9f4f62542470&scope.system=all&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:37.305296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62df700-a5c1-4447-ac42-a4657c816102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.306345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62df700-a5c1-4447-ac42-a4657c816102 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.306849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62df700-a5c1-4447-ac42-a4657c816102 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.307316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62df700-a5c1-4447-ac42-a4657c816102 None admin] PATH_INFO: `/v3/users/c91a7dd9cac447dabe10e00e6f951569` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.308905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62df700-a5c1-4447-ac42-a4657c816102 None admin] RBAC: Authorizing `identity:get_user(user_id=c91a7dd9cac447dabe10e00e6f951569)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.310618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62df700-a5c1-4447-ac42-a4657c816102 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.312871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 163/333] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:37 2022] GET /identity/v3/users/c91a7dd9cac447dabe10e00e6f951569 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:37.318688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.402280 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:37.449295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfcc3e-6685-432f-b0de-af942d536f05 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.491858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b5d21-bf0e-402c-9bc0-74cfb39b8ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.492666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5d21-bf0e-402c-9bc0-74cfb39b8ae8 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.492967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5d21-bf0e-402c-9bc0-74cfb39b8ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.493340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5d21-bf0e-402c-9bc0-74cfb39b8ae8 None admin] PATH_INFO: `/v3/system/users/c91a7dd9cac447dabe10e00e6f951569/roles/31c94e6b112946db990eec7311cd3e27` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.494789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b5d21-bf0e-402c-9bc0-74cfb39b8ae8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c91a7dd9cac447dabe10e00e6f951569, role_id=31c94e6b112946db990eec7311cd3e27)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.496232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b5d21-bf0e-402c-9bc0-74cfb39b8ae8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.505636 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 171/334] 10.222.0.46 () {58 vars in 1334 bytes} [Sun Aug 21 00:51:37 2022] PUT /identity/v3/system/users/c91a7dd9cac447dabe10e00e6f951569/roles/31c94e6b112946db990eec7311cd3e27 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:38.853411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cd5f-aea8-41b2-abc4-f2c993bb5789 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:38.853954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cd5f-aea8-41b2-abc4-f2c993bb5789 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:38.853954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cd5f-aea8-41b2-abc4-f2c993bb5789 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:38.855821 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 164/335] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:38.861520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6c169-3069-4b97-ace5-d20b61f68901 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:38.861955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6c169-3069-4b97-ace5-d20b61f68901 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:38.862047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6c169-3069-4b97-ace5-d20b61f68901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:38.883873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-66d6c169-3069-4b97-ace5-d20b61f68901 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:38.885101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66d6c169-3069-4b97-ace5-d20b61f68901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:38.966136 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 172/336] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:39.151296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f531ca-9630-4357-8d97-906b029c137f None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:39.151818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f531ca-9630-4357-8d97-906b029c137f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:39.152228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f531ca-9630-4357-8d97-906b029c137f None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:39.153991 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 165/337] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:39.159163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48977d-0d57-4da3-a5ca-49a7e8d98e89 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:39.159634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48977d-0d57-4da3-a5ca-49a7e8d98e89 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:39.160061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48977d-0d57-4da3-a5ca-49a7e8d98e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:39.183865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8c48977d-0d57-4da3-a5ca-49a7e8d98e89 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:39.185373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8c48977d-0d57-4da3-a5ca-49a7e8d98e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:39.253699 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:39.269638 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 173/338] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:39.351675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f531ca-9630-4357-8d97-906b029c137f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:39.474192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f531ca-9630-4357-8d97-906b029c137f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:39.519788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:39.520679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:39.521170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:39.521602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:39.535294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:39.540886 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:39.541954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:39.542928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:39.545210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 166/339] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:39.551326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48977d-0d57-4da3-a5ca-49a7e8d98e89 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:39.677727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48977d-0d57-4da3-a5ca-49a7e8d98e89 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:39.720850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:39.721574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:39.721846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:39.722111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:39.722779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:39.723073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:39.724539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:39.733680 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 174/340] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:39.739665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:39.767505 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:39.819874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:39.884631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c00bb-8e20-433a-898d-6945d4a5f5fd None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:39.929889 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:39.932177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:39.932939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:39.933213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:39.933467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.031097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:40.032594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:40.061338 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:40.063592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2de1-0094-4f5a-961d-5af027a060ab None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:40.165083 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 167/341] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:40.171163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:40.177663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:40.179122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.179611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.180082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.223377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:40.228940 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:40.230126 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:40.230914 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:40.231500 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 175/342] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:40.236495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:40.325068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc339f-8aac-493c-9d99-bf039f1ab8a1 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:40.342602 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:40.368144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1838-0c21-42b1-91b3-98652e092aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:40.369287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1838-0c21-42b1-91b3-98652e092aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.369786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1838-0c21-42b1-91b3-98652e092aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.370258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1838-0c21-42b1-91b3-98652e092aa7 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.371652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb1838-0c21-42b1-91b3-98652e092aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:40.373423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb1838-0c21-42b1-91b3-98652e092aa7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:40.375850 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 168/343] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:40 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:40.377881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f736-7bfc-408d-8493-0808f8823d7c None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.378388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f736-7bfc-408d-8493-0808f8823d7c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.378853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f736-7bfc-408d-8493-0808f8823d7c None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.380481 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 169/344] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:40.389606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3c5f-f6be-4b89-9430-2c9e8f907959 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.390186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3c5f-f6be-4b89-9430-2c9e8f907959 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.390704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3c5f-f6be-4b89-9430-2c9e8f907959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.412311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7ace3c5f-f6be-4b89-9430-2c9e8f907959 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:40.414066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7ace3c5f-f6be-4b89-9430-2c9e8f907959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:40.432034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978aae-6642-4409-8dd9-39dfb2cd1488 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:40.445770 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:40.477176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6347f3-77cc-4b7f-ac8d-0ef2fd4d758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:40.477786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6347f3-77cc-4b7f-ac8d-0ef2fd4d758a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.478115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6347f3-77cc-4b7f-ac8d-0ef2fd4d758a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.478383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6347f3-77cc-4b7f-ac8d-0ef2fd4d758a None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.479066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6347f3-77cc-4b7f-ac8d-0ef2fd4d758a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:40.479692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6347f3-77cc-4b7f-ac8d-0ef2fd4d758a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:40.481083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6347f3-77cc-4b7f-ac8d-0ef2fd4d758a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:40.491517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 176/345] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:40.492920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb4a5-917d-4847-8466-39c5129ed9fc None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.493146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb4a5-917d-4847-8466-39c5129ed9fc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.493416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb4a5-917d-4847-8466-39c5129ed9fc None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.494628 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 177/346] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:40.495351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb4a5-917d-4847-8466-39c5129ed9fc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:40.505120 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 170/347] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:40.507177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3c5f-f6be-4b89-9430-2c9e8f907959 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:40.608183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb4a5-917d-4847-8466-39c5129ed9fc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:40.625600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3c5f-f6be-4b89-9430-2c9e8f907959 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:40.638412 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:40.645051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2d1f-d2e7-4f2f-a16b-b477b8daae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:40.645822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2d1f-d2e7-4f2f-a16b-b477b8daae08 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.646124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2d1f-d2e7-4f2f-a16b-b477b8daae08 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.646419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2d1f-d2e7-4f2f-a16b-b477b8daae08 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.654147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2d1f-d2e7-4f2f-a16b-b477b8daae08 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:40.655628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2d1f-d2e7-4f2f-a16b-b477b8daae08 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:40.658250 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 178/348] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:40 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:40.659636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d84d3-66a5-4083-9b4a-a7d7d9415f8b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.659916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d84d3-66a5-4083-9b4a-a7d7d9415f8b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.660183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d84d3-66a5-4083-9b4a-a7d7d9415f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.672685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042e944-8d1e-4948-ac57-adeab46c2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:40.673691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042e944-8d1e-4948-ac57-adeab46c2d0e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.674038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042e944-8d1e-4948-ac57-adeab46c2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.674322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042e944-8d1e-4948-ac57-adeab46c2d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.679020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-810d84d3-66a5-4083-9b4a-a7d7d9415f8b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:40.680208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-810d84d3-66a5-4083-9b4a-a7d7d9415f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:40.713519 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:40.761400 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 179/349] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:40.762396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042e944-8d1e-4948-ac57-adeab46c2d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:40.762886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f4a8f-6da8-4718-9802-dd90000b321e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.763169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f4a8f-6da8-4718-9802-dd90000b321e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.763503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f4a8f-6da8-4718-9802-dd90000b321e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.763907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042e944-8d1e-4948-ac57-adeab46c2d0e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:40.765064 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 180/350] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:40.765923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f4a8f-6da8-4718-9802-dd90000b321e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:40.918124 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 171/351] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:40.919407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa967d5c-5fa4-4a56-bcd8-ab83dc6de1a7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.919723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa967d5c-5fa4-4a56-bcd8-ab83dc6de1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.920001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa967d5c-5fa4-4a56-bcd8-ab83dc6de1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.929114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f4a8f-6da8-4718-9802-dd90000b321e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:40.941018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-aa967d5c-5fa4-4a56-bcd8-ab83dc6de1a7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:40.942220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aa967d5c-5fa4-4a56-bcd8-ab83dc6de1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:40.954161 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:40.972613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:40.973406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.973693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.974218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.975205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=d5edddd120f64e8c8756e4940755f7b4) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:40.975514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:40.977571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:40.984848 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 181/352] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:40 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:40.985947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.026248 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.045882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 172/353] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:41.046781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa967d5c-5fa4-4a56-bcd8-ab83dc6de1a7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.153486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbd0c2-529b-4312-8029-bface0041b83 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.210854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.211439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.211718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.211996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.239516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:41.245117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:41.246039 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:41.246821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 182/354] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:41.255519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.285025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa967d5c-5fa4-4a56-bcd8-ab83dc6de1a7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.355958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.356614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.356918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.357189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.359035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:41.360500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:41.362195 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 173/355] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:41.362968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.386990 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.436449 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.448353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407d03-edd3-4efe-a42e-66c70f036700 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.495083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.495945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.496374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.496800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.497609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:41.498100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:41.499617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:41.512549 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 183/356] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:41.513789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.531699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6ec01-74f1-4927-bf85-56030889a3d4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.572156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.573169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.573667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.574134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.588148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:41.593264 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:41.594132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:41.594929 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:41.598056 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 174/357] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:41.599197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.642716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123746-3741-495d-bf21-83f31edaa30f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.676852 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.681446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.682100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.682379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.682658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.683824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:41.685338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:41.686941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 184/358] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:41.687770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.714389 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.716492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083fe85-873b-4b94-ac45-721f25eacd2b None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.756363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.757075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.757348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.757613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.769047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:41.774329 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:41.775212 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:41.776077 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 175/359] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:41.777280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.803164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f0bc3-c461-4ec5-903c-a7de74aa8152 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.843908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.844522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.844814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.845083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.913554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94f7c6-369d-4dc5-92ee-ff97c8639c0c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.934627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:41.936107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:41.951238 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.962583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.963360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.963475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.963729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.964393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:41.964691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:41.965789 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.966147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:41.975446 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 176/360] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:41.976267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.080122 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 185/361] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:42.083238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.112689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838b297-e2ad-45bc-b22f-ecb6afbd3562 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.156056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbc357-f899-493e-b120-831be4466f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.156670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbc357-f899-493e-b120-831be4466f3e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.156985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbc357-f899-493e-b120-831be4466f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.157258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbc357-f899-493e-b120-831be4466f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.157988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbc357-f899-493e-b120-831be4466f3e None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=d5edddd120f64e8c8756e4940755f7b4) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:42.158297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbc357-f899-493e-b120-831be4466f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.159749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbc357-f899-493e-b120-831be4466f3e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.166035 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 177/362] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=01f130b1020f40bf97184ccb199975bb => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.167215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0cf2-c3bb-469e-a851-07cc30afdfcd None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.167499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0cf2-c3bb-469e-a851-07cc30afdfcd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.167770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0cf2-c3bb-469e-a851-07cc30afdfcd None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.169133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 178/363] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:42.169677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e0cf2-c3bb-469e-a851-07cc30afdfcd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.221596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0db19-2657-4d4e-b1e1-e30812e64971 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.247563 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.251357 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.276253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.277249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.277766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.278106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.278865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:42.279236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.280834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.292519 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 186/364] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.293728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.322394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e0cf2-c3bb-469e-a851-07cc30afdfcd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.374820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe789a-fa35-473c-b2e4-5311d1b29636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.375824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe789a-fa35-473c-b2e4-5311d1b29636 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.376301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe789a-fa35-473c-b2e4-5311d1b29636 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.376786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe789a-fa35-473c-b2e4-5311d1b29636 None admin] PATH_INFO: `/v3/users/c91a7dd9cac447dabe10e00e6f951569` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.378245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe789a-fa35-473c-b2e4-5311d1b29636 None admin] RBAC: Authorizing `identity:get_user(user_id=c91a7dd9cac447dabe10e00e6f951569)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.379902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe789a-fa35-473c-b2e4-5311d1b29636 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.382311 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 179/365] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/users/c91a7dd9cac447dabe10e00e6f951569 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.383681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11358-2913-4341-b53d-5d64c30e2432 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.384155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11358-2913-4341-b53d-5d64c30e2432 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.384616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11358-2913-4341-b53d-5d64c30e2432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.405599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-26b11358-2913-4341-b53d-5d64c30e2432 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:42.407232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-26b11358-2913-4341-b53d-5d64c30e2432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:42.416859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9d67-558f-494d-9632-1561205cefcc None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.462837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.463864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.464336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.464820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.466163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.467837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.470120 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 187/366] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.471078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.490499 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 180/367] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:42.491481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11358-2913-4341-b53d-5d64c30e2432 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.530547 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.546826 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.583888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea6db-3c96-405d-b146-e396db2d5958 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.598654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11358-2913-4341-b53d-5d64c30e2432 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.621244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.622222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.622693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.623223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.647058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.647599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.647878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.648150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.649017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] RBAC: Adding query filter params (role.id=31c94e6b112946db990eec7311cd3e27, user.id=c91a7dd9cac447dabe10e00e6f951569, scope.system=all) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:42.649209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.650700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.672021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 181/368] 10.222.0.46 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/role_assignments?user.id=c91a7dd9cac447dabe10e00e6f951569&scope.system=all&role.id=31c94e6b112946db990eec7311cd3e27 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.672899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.706207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.708355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.785205 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.825366 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 188/369] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:42.826081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb847bd-338c-4b0d-bdd0-ecebcf32b41d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.833943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.845483 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.886906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.887553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.887824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.888091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.889234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.890667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.892684 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 182/370] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.893399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.966039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b06d8-d51b-4867-8f0f-6360869ff540 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.026684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.027351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.027619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.027883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.029367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.031091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.033773 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 189/371] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:43.034538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.034810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df253d-e8ef-4c66-80be-f53bb1be3eaa None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.063407 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.083553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.084199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.084474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.084744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.095726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:43.102775 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:43.103681 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:43.104817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 183/372] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:43.105538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.164716 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.190456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc7cab-4b35-4f81-a86b-5dd0bcd4c7a8 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.232783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.233366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.233642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.233911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.234811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=10443dd3305e4d5b90198fe78a334da2) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:43.235118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.236602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.237917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6b7c-ce00-4bae-8377-283f30a06e85 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.242851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 190/373] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:43.243677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.278961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.280124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.280597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.281114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.282532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.284395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.286716 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 184/374] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:43.293251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.412564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6852c-6bf2-477d-aca2-d70cb2704eaf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.418107 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.423971 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.456176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.456978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.457263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.457533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.458282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=10443dd3305e4d5b90198fe78a334da2) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:43.458641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.460109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.466753 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 185/375] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=01f130b1020f40bf97184ccb199975bb => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:43.468648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f13dd-396e-4509-b1af-2b579f692329 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.527178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0bbe4-c491-4e51-b365-d54b1a5dee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.527812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bbe4-c491-4e51-b365-d54b1a5dee65 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.528086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bbe4-c491-4e51-b365-d54b1a5dee65 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.528397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bbe4-c491-4e51-b365-d54b1a5dee65 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.529109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0bbe4-c491-4e51-b365-d54b1a5dee65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:43.529505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0bbe4-c491-4e51-b365-d54b1a5dee65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.530903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0bbe4-c491-4e51-b365-d54b1a5dee65 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.545072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 191/376] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:43.551023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.692370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046fab5-8dc2-4da5-a62c-6917bc7b8536 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.692708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046fab5-8dc2-4da5-a62c-6917bc7b8536 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.693177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046fab5-8dc2-4da5-a62c-6917bc7b8536 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.694230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdc8b3-ca92-4c73-8047-4c4afcd7ff88 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.694830 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 192/377] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:43.700170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7d07c-ccaa-41de-8883-ccfd7d97b420 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.700452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7d07c-ccaa-41de-8883-ccfd7d97b420 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.700727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7d07c-ccaa-41de-8883-ccfd7d97b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.730067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8aa7d07c-ccaa-41de-8883-ccfd7d97b420 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:43.731150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8aa7d07c-ccaa-41de-8883-ccfd7d97b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:43.733447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.734326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.734769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.735188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.787573 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.846280 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 193/378] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:43.846980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.848546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.953005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 186/379] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:43.958825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7d07c-ccaa-41de-8883-ccfd7d97b420 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.081591 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.112572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7d07c-ccaa-41de-8883-ccfd7d97b420 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.168264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.169291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.169822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.170285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] PATH_INFO: `/v3/projects/e256165a7ff4427f88213eb7acbe8301` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.174106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=e256165a7ff4427f88213eb7acbe8301)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.175889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.178309 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 194/380] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/projects/e256165a7ff4427f88213eb7acbe8301 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.183620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.193452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.310367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b6f1-f12d-46bf-8d6b-fab6d4f3e9b3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.318836 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.355579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.356128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.356399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.356724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.368979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:44.373981 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:44.374845 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:44.375626 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:44.380721 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 195/381] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:44.382547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.387088 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.390891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e864-89a7-459c-8a1e-d2927c7fd846 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.462358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.462997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.463266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.463532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] PATH_INFO: `/v3/groups/86ab9e0a370c44cbb2ccdc6040374cfd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.471879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] RBAC: Authorizing `identity:get_group(group_id=86ab9e0a370c44cbb2ccdc6040374cfd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.473362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.475236 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 187/382] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/groups/86ab9e0a370c44cbb2ccdc6040374cfd => generated 229 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.485359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.522512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9013b-2beb-4efa-9fb4-ca6494be1e00 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.565978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.566599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.566874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.567141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.567898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:44.568227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.569640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.586777 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 196/383] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.592063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.657508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f183-2e78-4455-846d-6499c2182884 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.666835 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.699465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.700618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.701118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.701625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.702636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] RBAC: Adding query filter params (group.id=86ab9e0a370c44cbb2ccdc6040374cfd, role.id=fd13fde432a246499375976d02e43d56, scope.project.id=e256165a7ff4427f88213eb7acbe8301) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:44.703250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.705023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.706465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083efdb-d20a-4011-87f4-5d04bc8c8f31 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.707343 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.715246 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 188/384] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/role_assignments?group.id=86ab9e0a370c44cbb2ccdc6040374cfd&scope.project.id=e256165a7ff4427f88213eb7acbe8301&role.id=fd13fde432a246499375976d02e43d56 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.771382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.772125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.772406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.772683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.777667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.779149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.781116 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 197/385] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.787711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.942848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0c275-a860-44ec-ae7d-fb7eb337898d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.978585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba195e8-6296-4ab1-975a-aeeaa087a3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.979536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba195e8-6296-4ab1-975a-aeeaa087a3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.979814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba195e8-6296-4ab1-975a-aeeaa087a3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.980084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba195e8-6296-4ab1-975a-aeeaa087a3f1 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.981245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba195e8-6296-4ab1-975a-aeeaa087a3f1 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.982692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba195e8-6296-4ab1-975a-aeeaa087a3f1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.984633 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 189/386] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.991336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.081098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99eeb3-1f1d-4d78-8085-3403614bf1ef None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.081436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99eeb3-1f1d-4d78-8085-3403614bf1ef None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.081644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99eeb3-1f1d-4d78-8085-3403614bf1ef None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.083233 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 190/387] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:45.088596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268a47-4220-4af0-bee1-7fb308e0a8c3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.088969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268a47-4220-4af0-bee1-7fb308e0a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.089245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268a47-4220-4af0-bee1-7fb308e0a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.119842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3e268a47-4220-4af0-bee1-7fb308e0a8c3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:45.121127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3e268a47-4220-4af0-bee1-7fb308e0a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:45.153082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf001c-611b-4a0a-a0c1-689669223aa0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.210036 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:45.216506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.217422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.217825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.218206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4/groups/ec00294a1837478791d72fede6789dee/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.220972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] RBAC: Authorizing `identity:create_grant(project_id=d5edddd120f64e8c8756e4940755f7b4, group_id=ec00294a1837478791d72fede6789dee, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:45.223091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:45.244329 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 198/388] 10.222.0.46 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:44 2022] PUT /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4/groups/ec00294a1837478791d72fede6789dee/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:45.266716 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:45.283245 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 191/389] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:45.627541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.753578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eb2fb-0f0c-47d4-9770-a1453616493c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.793103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d312c-a7d0-482f-856f-b7b03baee1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.793753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d312c-a7d0-482f-856f-b7b03baee1ac None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.794036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d312c-a7d0-482f-856f-b7b03baee1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.794305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d312c-a7d0-482f-856f-b7b03baee1ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.805446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d312c-a7d0-482f-856f-b7b03baee1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-6f7d312c-a7d0-482f-856f-b7b03baee1ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:45.811018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:45.811878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:45.812780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 199/390] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:45.820268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268a47-4220-4af0-bee1-7fb308e0a8c3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.894486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a1534-3ce6-4683-bcd1-f7be0b41cc11 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.894672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a1534-3ce6-4683-bcd1-f7be0b41cc11 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.894930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a1534-3ce6-4683-bcd1-f7be0b41cc11 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.897779 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 200/391] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:45.906623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6650570-9aee-4467-b701-9045acb916e7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.906949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6650570-9aee-4467-b701-9045acb916e7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.907254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6650570-9aee-4467-b701-9045acb916e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.932512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268a47-4220-4af0-bee1-7fb308e0a8c3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.941868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b6650570-9aee-4467-b701-9045acb916e7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:45.943233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b6650570-9aee-4467-b701-9045acb916e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:45.978431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.979362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.979672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.979907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.980584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:45.980913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:45.982295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:45.993504 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 192/392] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:46.001952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.004519 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.036290 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 201/393] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:46.077220 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.119865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beb1ea-e4ce-4a95-ae18-5013dfed3ea6 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.166981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d62ca6-f028-447e-8ea8-e102bdb15d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.167555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d62ca6-f028-447e-8ea8-e102bdb15d03 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.167838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d62ca6-f028-447e-8ea8-e102bdb15d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.168118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d62ca6-f028-447e-8ea8-e102bdb15d03 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.169315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d62ca6-f028-447e-8ea8-e102bdb15d03 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.170873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d62ca6-f028-447e-8ea8-e102bdb15d03 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.172761 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 193/394] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:46.178314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6650570-9aee-4467-b701-9045acb916e7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.281804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6650570-9aee-4467-b701-9045acb916e7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.309531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4d54b-dd1f-4342-b32c-0c62554210a2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.310030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4d54b-dd1f-4342-b32c-0c62554210a2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.310101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4d54b-dd1f-4342-b32c-0c62554210a2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.311727 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 194/395] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:46.316952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aed88-58c2-435d-b809-03496976fb63 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.317236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aed88-58c2-435d-b809-03496976fb63 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.317512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aed88-58c2-435d-b809-03496976fb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.321988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.322630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.322905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.323172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.324293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.325764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.327676 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 202/396] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:46.333080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.357343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7a9aed88-58c2-435d-b809-03496976fb63 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:46.358557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7a9aed88-58c2-435d-b809-03496976fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:46.426128 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.456346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 195/397] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:46.457283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aed88-58c2-435d-b809-03496976fb63 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.481720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfde89-b3e8-4d9e-a682-d7e27d9c1b0c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.533141 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.538898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.539627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.539905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.540175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4/groups/ec00294a1837478791d72fede6789dee/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.543107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5edddd120f64e8c8756e4940755f7b4, group_id=ec00294a1837478791d72fede6789dee, role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.544863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.560040 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 203/398] 10.222.0.46 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:46 2022] PUT /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4/groups/ec00294a1837478791d72fede6789dee/roles/01f130b1020f40bf97184ccb199975bb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:46.627038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aed88-58c2-435d-b809-03496976fb63 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.673437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.674104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.674389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.674652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.688172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:46.693132 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:46.694044 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:46.694842 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:46.695428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 196/399] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:46.701022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.840434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48db6-89cb-4e0f-b578-ccbd0a169836 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.854306 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.864511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.884586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.885699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.886124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.886405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.888405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:46.888722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.900097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.913511 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 204/400] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:46.919125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.025391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68eb66-74c9-4f8c-8e20-a32280a7798f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.043626 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.051742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7e27-2ba8-442d-8f8a-056d694676d0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.063358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.064418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.065020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.065652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.079431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:47.085395 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:47.086292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:47.087076 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:47.093096 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 197/401] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:47.093304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.093933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.094224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.094499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.095714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.096830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.097168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.100843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 205/402] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:47.105985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.155904 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.231007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143e10e-e6f4-4326-84ab-b18eb9b6368b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.241534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf995e82-ae46-4bf3-b84d-0c7314059492 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.289590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1483e7-96dc-4f26-9739-4550ef7cfbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.290632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1483e7-96dc-4f26-9739-4550ef7cfbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.291097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1483e7-96dc-4f26-9739-4550ef7cfbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.291604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1483e7-96dc-4f26-9739-4550ef7cfbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.292472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1483e7-96dc-4f26-9739-4550ef7cfbc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:47.292789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1483e7-96dc-4f26-9739-4550ef7cfbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.294187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1483e7-96dc-4f26-9739-4550ef7cfbc0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.303499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b2e86-ee53-459f-98db-b4d1901d3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.304294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 198/403] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:47.305047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2e86-ee53-459f-98db-b4d1901d3843 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.305560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2e86-ee53-459f-98db-b4d1901d3843 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.306044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2e86-ee53-459f-98db-b4d1901d3843 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.307466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b2e86-ee53-459f-98db-b4d1901d3843 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.309357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b2e86-ee53-459f-98db-b4d1901d3843 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.309721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645d23-8805-44ca-9456-9db1396ef63d None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.310106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645d23-8805-44ca-9456-9db1396ef63d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.310277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645d23-8805-44ca-9456-9db1396ef63d None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.311502 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 199/404] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:47.312577 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 206/405] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:47.312751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf645d23-8805-44ca-9456-9db1396ef63d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.319275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c98a2-3953-4b4d-b807-d9de482c5b01 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.319275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c98a2-3953-4b4d-b807-d9de482c5b01 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.319275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c98a2-3953-4b4d-b807-d9de482c5b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.339528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fe0c98a2-3953-4b4d-b807-d9de482c5b01 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:47.340718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe0c98a2-3953-4b4d-b807-d9de482c5b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:47.367520 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.433654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf645d23-8805-44ca-9456-9db1396ef63d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.438321 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 207/406] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:47.439291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c98a2-3953-4b4d-b807-d9de482c5b01 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.484925 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.507975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.508671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.508982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.509254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.512530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.514199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.516135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 200/407] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:47.522802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.561257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c98a2-3953-4b4d-b807-d9de482c5b01 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.600887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.602638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.603055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.603483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2/groups/ec00294a1837478791d72fede6789dee/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.606135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=10443dd3305e4d5b90198fe78a334da2, group_id=ec00294a1837478791d72fede6789dee, role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.607706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.624434 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 208/408] 10.222.0.46 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:47 2022] PUT /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2/groups/ec00294a1837478791d72fede6789dee/roles/01f130b1020f40bf97184ccb199975bb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:47.693924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799737e3-305b-4cac-b954-3b87053e7c53 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.701853 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.733351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf1d6a-e530-4141-a56a-c35c8e934b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.733987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1d6a-e530-4141-a56a-c35c8e934b75 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.734264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1d6a-e530-4141-a56a-c35c8e934b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.734619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1d6a-e530-4141-a56a-c35c8e934b75 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.735751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf1d6a-e530-4141-a56a-c35c8e934b75 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.737220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf1d6a-e530-4141-a56a-c35c8e934b75 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.739238 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 201/409] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:47.745196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.793305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d934-da3b-4438-bf00-83ce9fed2609 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.793666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d934-da3b-4438-bf00-83ce9fed2609 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.793844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d934-da3b-4438-bf00-83ce9fed2609 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.795623 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 202/410] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:47.812418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec93cb-1ac9-4be0-89d8-72b53189e13c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.812759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec93cb-1ac9-4be0-89d8-72b53189e13c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.813198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec93cb-1ac9-4be0-89d8-72b53189e13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.834794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8dec93cb-1ac9-4be0-89d8-72b53189e13c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:47.836217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8dec93cb-1ac9-4be0-89d8-72b53189e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:47.889147 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.892002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312ecc-34a8-4f10-9788-61a34b0d5eb4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.914747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 203/411] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:47.915606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec93cb-1ac9-4be0-89d8-72b53189e13c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.951506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.952174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.952447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.952712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2/groups/ec00294a1837478791d72fede6789dee/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.955669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=10443dd3305e4d5b90198fe78a334da2, group_id=ec00294a1837478791d72fede6789dee, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.957215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.978587 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 209/412] 10.222.0.46 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:47 2022] PUT /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2/groups/ec00294a1837478791d72fede6789dee/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:48.074376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec93cb-1ac9-4be0-89d8-72b53189e13c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.077455 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.115012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.115705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.116171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.116443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.128922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:48.134184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:48.135116 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:48.135889 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 204/413] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:48.146064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.265968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda813d0-dddf-4a4a-a3cb-49acf025f8e3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.277296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.309702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.310994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.312184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.313311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.314187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:48.314863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:48.317522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:48.337094 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 210/414] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:48.342398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.380997 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.445180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048eed-1f7e-461b-8272-49eeafef3fc4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.510075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.511129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.511616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.512145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.521323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4be1c-b767-48c1-a154-5430232365ce None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.533542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:48.540461 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:48.541445 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:48.542284 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:48.545751 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 205/415] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:48.554030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.584870 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.593598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.595346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.596483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.597182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] PATH_INFO: `/v3/groups/86ab9e0a370c44cbb2ccdc6040374cfd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.600405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] RBAC: Authorizing `identity:get_group(group_id=86ab9e0a370c44cbb2ccdc6040374cfd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:48.602880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:48.608197 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 211/416] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/groups/86ab9e0a370c44cbb2ccdc6040374cfd => generated 229 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:48.613534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.714842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669384-b2b8-4dc6-9efd-b51afe57ef0b None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.777540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.778146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.778416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.778679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.779344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] RBAC: Adding query filter params (name=member) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:48.779636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:48.781300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:48.793112 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.813621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 206/417] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:48.814605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.815715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60692e4b-497f-4c33-903d-501545205b96 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.889282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.891885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.892163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.892430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] PATH_INFO: `/v3/projects/e256165a7ff4427f88213eb7acbe8301` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.893629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=e256165a7ff4427f88213eb7acbe8301)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:48.895069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:48.897380 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 212/418] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/projects/e256165a7ff4427f88213eb7acbe8301 => generated 344 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:48.908456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.960297 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.975603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0ef7-b4b5-4f5d-91a5-b8e7a69c7059 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.037366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.042964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.043268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.043686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.121894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e3e4a-7c01-45b2-97b5-3ac54eba8bb2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.172848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.174328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.200465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4286d3-d329-415d-beeb-f7d2b6f850ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.201167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4286d3-d329-415d-beeb-f7d2b6f850ac None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.201446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4286d3-d329-415d-beeb-f7d2b6f850ac None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.201720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4286d3-d329-415d-beeb-f7d2b6f850ac None admin] PATH_INFO: `/v3/projects/e256165a7ff4427f88213eb7acbe8301/groups/86ab9e0a370c44cbb2ccdc6040374cfd/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.205471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4286d3-d329-415d-beeb-f7d2b6f850ac None admin] RBAC: Authorizing `identity:create_grant(project_id=e256165a7ff4427f88213eb7acbe8301, group_id=86ab9e0a370c44cbb2ccdc6040374cfd, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.207797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4286d3-d329-415d-beeb-f7d2b6f850ac None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.233607 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 213/419] 10.222.0.46 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:48 2022] PUT /identity/v3/projects/e256165a7ff4427f88213eb7acbe8301/groups/86ab9e0a370c44cbb2ccdc6040374cfd/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:49.242083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190bf9-2c6c-40f1-b546-7088e1bc47f1 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.242403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190bf9-2c6c-40f1-b546-7088e1bc47f1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.242636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190bf9-2c6c-40f1-b546-7088e1bc47f1 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.244002 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 214/420] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:49.250572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a9ce-f2f5-4f96-8484-3db633cde6a3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.250915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a9ce-f2f5-4f96-8484-3db633cde6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.251197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a9ce-f2f5-4f96-8484-3db633cde6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.284309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fb88a9ce-f2f5-4f96-8484-3db633cde6a3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:49.288235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fb88a9ce-f2f5-4f96-8484-3db633cde6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:49.311724 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.329604 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.367755 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 207/421] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:49.373440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.388287 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 215/422] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:49.512931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a346af-f1b4-4ad6-9a63-6cc0e491866f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.549865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.550513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.550786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.551055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.552219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.553724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.555673 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 208/423] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:49 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:49.560999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a9ce-f2f5-4f96-8484-3db633cde6a3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.677747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.699982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a9ce-f2f5-4f96-8484-3db633cde6a3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.773362 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.776653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.777552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.778036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.778567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.779919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.781579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.789225 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 216/424] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:49 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:49.794565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.819494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e70b-88c9-4441-9aca-54c99c3c6041 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.839745 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.874833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.875531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.875815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.876077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.901863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:49.910635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:49.911560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:49.912334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 209/425] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:49.917759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.981363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d416e-bbe1-4a5b-b185-9fc712132a72 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.026623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861a906-f744-403a-82ae-a9102d6558b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.027343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861a906-f744-403a-82ae-a9102d6558b7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.027619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861a906-f744-403a-82ae-a9102d6558b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.027888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861a906-f744-403a-82ae-a9102d6558b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.028627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861a906-f744-403a-82ae-a9102d6558b7 None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=d5edddd120f64e8c8756e4940755f7b4) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:50.028959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861a906-f744-403a-82ae-a9102d6558b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:50.030516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861a906-f744-403a-82ae-a9102d6558b7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:50.038387 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 217/426] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:49 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:50.039904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5b2c6-2e34-4314-b0b7-6679ab891c05 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.040290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5b2c6-2e34-4314-b0b7-6679ab891c05 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.040566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5b2c6-2e34-4314-b0b7-6679ab891c05 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.041987 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 218/427] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:50.048254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734437-db19-46d1-a6d3-4b918eb02621 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.048597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734437-db19-46d1-a6d3-4b918eb02621 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.048836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734437-db19-46d1-a6d3-4b918eb02621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.065016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e98e6-47bc-4072-90dc-b9094befc1af None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.071582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0b734437-db19-46d1-a6d3-4b918eb02621 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:50.072724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b734437-db19-46d1-a6d3-4b918eb02621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:50.086253 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:50.108705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.109548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.109894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.110306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.111062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:50.111429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:50.112967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:50.122980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 210/428] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:50.132001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.196573 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 219/429] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:50.233736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5a95-6715-4d1b-a994-2ef9a2c66f8e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.234331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5a95-6715-4d1b-a994-2ef9a2c66f8e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.234780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5a95-6715-4d1b-a994-2ef9a2c66f8e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.236635 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 220/430] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:50.242084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a317f-99f5-41cf-96f5-8f6b6f4faca7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.242679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a317f-99f5-41cf-96f5-8f6b6f4faca7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.243145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a317f-99f5-41cf-96f5-8f6b6f4faca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.278652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7c3a317f-99f5-41cf-96f5-8f6b6f4faca7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:50.280242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c3a317f-99f5-41cf-96f5-8f6b6f4faca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:50.283049 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:50.315123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802adce-2181-4407-84f6-35abb5da799e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.359648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.360266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.360605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.360944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.371739 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 221/431] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 21 00:51:50.410342 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:50.434939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:50.436727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:50.535071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a317f-99f5-41cf-96f5-8f6b6f4faca7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.540931 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 211/432] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:50.547162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.647315 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:50.676424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a317f-99f5-41cf-96f5-8f6b6f4faca7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.682031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2da692-0ed1-42bb-895f-09a1202a4c0e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.724062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.725549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.725903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.726175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.729549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.730184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.730461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.730726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] PATH_INFO: `/v3/projects/d5edddd120f64e8c8756e4940755f7b4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.731860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5edddd120f64e8c8756e4940755f7b4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:50.734407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:50.734973 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:50.739406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:50.740938 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 212/433] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/projects/d5edddd120f64e8c8756e4940755f7b4 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:50.741941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:50.747094 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:50.748031 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:50.748874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:50.755106 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 222/434] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:50.755106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.874372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca1c7b-7666-4eaf-986d-9dc3b845b664 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.876801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbb8b2-12ed-4ee0-8add-3533141b20c9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.909840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.910478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.910762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.911030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.912550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:50.914049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:50.915983 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 223/435] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:50.916753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.922928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.923900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.924329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.924755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.942578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:50.950969 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:50.951844 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:50.952636 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 213/436] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:50.954139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.963903 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.009905 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.049142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c6a17-617b-44ca-983a-6eeef11382e5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.070439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bddc58-550c-42ff-9f17-7e14ecd758aa None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.086531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.087127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.087396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.087663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.088323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:51.088642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.090004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.103183 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 224/437] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:51.103183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.113333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.114284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.115672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.115672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.116166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=d5edddd120f64e8c8756e4940755f7b4) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:51.116348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.117965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.133310 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 214/438] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=d5edddd120f64e8c8756e4940755f7b4&role.id=01f130b1020f40bf97184ccb199975bb => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:51.134245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.236625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddf57b-5bd6-4e00-9611-35407854c539 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.244460 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.273210 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.285022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.285649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.285925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.286194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.286589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a29a6-9e62-49ed-8899-b54be1cb35c7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.287178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] RBAC: Adding query filter params (name=member) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:51.287466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.289050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.300056 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 225/439] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:51.306095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.325993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02166f07-a460-4bf4-9c3c-e5f215b8c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.326617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166f07-a460-4bf4-9c3c-e5f215b8c922 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.326884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166f07-a460-4bf4-9c3c-e5f215b8c922 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.327156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166f07-a460-4bf4-9c3c-e5f215b8c922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.404615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02166f07-a460-4bf4-9c3c-e5f215b8c922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.406062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02166f07-a460-4bf4-9c3c-e5f215b8c922 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.425736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95f2b-76c5-4c1f-a80a-b7093c2f3134 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.471507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05da689-f6d2-441a-bfcb-a326d23040a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.472112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05da689-f6d2-441a-bfcb-a326d23040a8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.472384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05da689-f6d2-441a-bfcb-a326d23040a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.472649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05da689-f6d2-441a-bfcb-a326d23040a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.489091 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.536457 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 215/440] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:51.543186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb67ae-a72f-4a11-8402-d70a78e37d96 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.543775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb67ae-a72f-4a11-8402-d70a78e37d96 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.543775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb67ae-a72f-4a11-8402-d70a78e37d96 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.544397 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.546791 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 216/441] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:51.547692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb67ae-a72f-4a11-8402-d70a78e37d96 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.559910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05da689-f6d2-441a-bfcb-a326d23040a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.561476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05da689-f6d2-441a-bfcb-a326d23040a8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.660760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb67ae-a72f-4a11-8402-d70a78e37d96 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.668474 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 226/442] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:51.669723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da93f4-118b-4fa8-bd6d-49987a9c818d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.670397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da93f4-118b-4fa8-bd6d-49987a9c818d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.670397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da93f4-118b-4fa8-bd6d-49987a9c818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.688573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c8da93f4-118b-4fa8-bd6d-49987a9c818d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:51.689787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c8da93f4-118b-4fa8-bd6d-49987a9c818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:51.695014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.695636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.695916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.696181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.697301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.698725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.700336 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 217/443] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:51.701106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.735628 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.758587 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 227/444] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:51.759428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da93f4-118b-4fa8-bd6d-49987a9c818d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.784154 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.808230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d90a9-e3b4-425f-9202-3ddaa74d53e9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.845788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.846747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.847082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.847452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] PATH_INFO: `/v3/projects/10443dd3305e4d5b90198fe78a334da2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.848596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=10443dd3305e4d5b90198fe78a334da2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.850444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.852083 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 218/445] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/projects/10443dd3305e4d5b90198fe78a334da2 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:51.857944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.867057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da93f4-118b-4fa8-bd6d-49987a9c818d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.905535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.906173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.906481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.906716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.908150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.909779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.916110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 228/446] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:51.917156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.972164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e469836-e42b-49b2-81a9-2175602c7ac5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.975796 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.012069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.012690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.013040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.013309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] PATH_INFO: `/v3/groups/ec00294a1837478791d72fede6789dee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.014816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] RBAC: Authorizing `identity:get_group(group_id=ec00294a1837478791d72fede6789dee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.015265 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.016017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.017518 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 219/447] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/groups/ec00294a1837478791d72fede6789dee => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:52.024354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.033332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02042fd0-f82e-45ed-8b70-ca99fbf755d7 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.067038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.067680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.067954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.068391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.069156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=10443dd3305e4d5b90198fe78a334da2) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:52.069458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.070878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.076822 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 229/448] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=01f130b1020f40bf97184ccb199975bb => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:52.077436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.137794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976a49-108f-425c-b2e9-0d54206d4fb6 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.187653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.188467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.188744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.189041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.189955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] RBAC: Adding query filter params (group.id=ec00294a1837478791d72fede6789dee, role.id=a11e5ddd599243b983e4f4e44fe1bd85, scope.project.id=10443dd3305e4d5b90198fe78a334da2) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:52.190259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.192185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.208815 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 220/449] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/role_assignments?group.id=ec00294a1837478791d72fede6789dee&scope.project.id=10443dd3305e4d5b90198fe78a334da2&role.id=a11e5ddd599243b983e4f4e44fe1bd85 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:52.210018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3bbc-8c30-40a5-9e50-700f0a64e6a0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.252384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.253197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.253478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.253750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.267240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:52.272724 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:52.273949 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:52.274838 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 230/450] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:52.279963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.319882 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.386895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2f3d7-8276-40c5-9739-202e668fcb13 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.421353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.421958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.422231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.422498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.423159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:52.423454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.424855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.433854 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 221/451] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:52.439514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.456631 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.546839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8195407-f38a-4a77-b936-77ccd8cca7aa None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.582813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.583447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.583726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.584121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.651714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.653225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.667764 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.763118 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 231/452] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:52.772395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.883813 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.887544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6962-3054-4e4c-a78d-fe48c2fccd3f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.923335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.923951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.924230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.924506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] PATH_INFO: `/v3/projects/e256165a7ff4427f88213eb7acbe8301` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.925717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] RBAC: Authorizing `identity:get_project(project_id=e256165a7ff4427f88213eb7acbe8301)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.927425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.929591 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 222/453] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/projects/e256165a7ff4427f88213eb7acbe8301 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:52.936581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.050411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c0174-9b26-460a-b2ae-883e80aca1df None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.064788 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:53.088601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772b184-ff3a-451e-9b60-f3eafd3713fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.089251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772b184-ff3a-451e-9b60-f3eafd3713fa None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.089523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772b184-ff3a-451e-9b60-f3eafd3713fa None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.089783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772b184-ff3a-451e-9b60-f3eafd3713fa None admin] PATH_INFO: `/v3/groups/86ab9e0a370c44cbb2ccdc6040374cfd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.090979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772b184-ff3a-451e-9b60-f3eafd3713fa None admin] RBAC: Authorizing `identity:get_group(group_id=86ab9e0a370c44cbb2ccdc6040374cfd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.092403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772b184-ff3a-451e-9b60-f3eafd3713fa None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.093984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 232/454] 10.222.0.46 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/groups/86ab9e0a370c44cbb2ccdc6040374cfd => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:53.101166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.223909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78ea12-1a4e-4873-8774-718a56611a25 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.263288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e76bc-0bab-423d-803e-19fceef84c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.263878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e76bc-0bab-423d-803e-19fceef84c77 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.264158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e76bc-0bab-423d-803e-19fceef84c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.264423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e76bc-0bab-423d-803e-19fceef84c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.265181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e76bc-0bab-423d-803e-19fceef84c77 None admin] RBAC: Adding query filter params (group.id=86ab9e0a370c44cbb2ccdc6040374cfd, role.id=fd13fde432a246499375976d02e43d56, scope.project.id=e256165a7ff4427f88213eb7acbe8301) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:53.265484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e76bc-0bab-423d-803e-19fceef84c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.266937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e76bc-0bab-423d-803e-19fceef84c77 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.272793 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 223/455] 10.222.0.46 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:53 2022] GET /identity/v3/role_assignments?group.id=86ab9e0a370c44cbb2ccdc6040374cfd&scope.project.id=e256165a7ff4427f88213eb7acbe8301&role.id=fd13fde432a246499375976d02e43d56 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:55.589905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a6ed5-8cf7-410c-b459-dd29a3ea9199 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.590418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a6ed5-8cf7-410c-b459-dd29a3ea9199 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.590493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a6ed5-8cf7-410c-b459-dd29a3ea9199 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.592048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 233/456] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:55.597345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bb24d-21f1-4e22-b2b9-b8e1dc943e04 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.597816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bb24d-21f1-4e22-b2b9-b8e1dc943e04 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.597899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bb24d-21f1-4e22-b2b9-b8e1dc943e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.622956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-212bb24d-21f1-4e22-b2b9-b8e1dc943e04 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:55.624155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-212bb24d-21f1-4e22-b2b9-b8e1dc943e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:55.657764 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:55.720572 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 224/457] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:55.881222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d717-6d7e-4ecf-a8f6-02768cd88170 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.881829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d717-6d7e-4ecf-a8f6-02768cd88170 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.882299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d717-6d7e-4ecf-a8f6-02768cd88170 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.884102 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 234/458] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:55.889069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa202-791c-401a-bc13-75cc4bc9480d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.889356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa202-791c-401a-bc13-75cc4bc9480d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.889631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa202-791c-401a-bc13-75cc4bc9480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.917892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-85baa202-791c-401a-bc13-75cc4bc9480d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:55.919118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-85baa202-791c-401a-bc13-75cc4bc9480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:55.975134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434faa2-d6ab-4c83-a3d8-b00be1273c9d None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.975485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434faa2-d6ab-4c83-a3d8-b00be1273c9d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.975684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434faa2-d6ab-4c83-a3d8-b00be1273c9d None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.977285 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 235/459] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:55.999862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877fd64-2688-490f-aa05-dd77d1a6add1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.000159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877fd64-2688-490f-aa05-dd77d1a6add1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.000420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877fd64-2688-490f-aa05-dd77d1a6add1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.012844 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 225/460] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:56.021535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0877fd64-2688-490f-aa05-dd77d1a6add1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:56.022745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0877fd64-2688-490f-aa05-dd77d1a6add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:56.098000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 236/461] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:56.108919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baa202-791c-401a-bc13-75cc4bc9480d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.247464 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.258821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baa202-791c-401a-bc13-75cc4bc9480d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.311135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.311774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.312047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.312311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.324902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.326363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:51:56.348906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:56.349881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:51:56.350710 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:51:56.350710 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:56.350710 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:56.350710 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 226/462] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:56.356753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877fd64-2688-490f-aa05-dd77d1a6add1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.374789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.510798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877fd64-2688-490f-aa05-dd77d1a6add1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.522566 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.523129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a98a7-b1f5-4663-aa00-fd5324da00bd None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.548526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.549170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.549446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.549719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.550393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:56.550718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.552586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.560864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab4be7-7679-4d26-b322-34ae6da5113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.561723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab4be7-7679-4d26-b322-34ae6da5113a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.562193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab4be7-7679-4d26-b322-34ae6da5113a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.562655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab4be7-7679-4d26-b322-34ae6da5113a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.570800 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 237/463] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:56.571573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.575003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab4be7-7679-4d26-b322-34ae6da5113a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.576797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab4be7-7679-4d26-b322-34ae6da5113a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.579682 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-12ab4be7-7679-4d26-b322-34ae6da5113a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:51:56.594532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:56.595572 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:51:56.597054 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:51:56.597054 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:56.597054 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:56.597054 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 227/464] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:56.597273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4808e9-876e-4def-96c3-7028c23fa348 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.597478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4808e9-876e-4def-96c3-7028c23fa348 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.597986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4808e9-876e-4def-96c3-7028c23fa348 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.599626 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 228/465] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:56.601686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4808e9-876e-4def-96c3-7028c23fa348 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.689248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4cf0e-5a56-4e21-a049-885c6f5e1325 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.715940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4808e9-876e-4def-96c3-7028c23fa348 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.726096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.726738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.727324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.727622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.738472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.740494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.753103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14e5e0-aa6f-4fa3-b6eb-17abb65a6c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.753740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14e5e0-aa6f-4fa3-b6eb-17abb65a6c2e None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.754018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14e5e0-aa6f-4fa3-b6eb-17abb65a6c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.754286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14e5e0-aa6f-4fa3-b6eb-17abb65a6c2e None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.754976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14e5e0-aa6f-4fa3-b6eb-17abb65a6c2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:51:56.755534 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:56.756347 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:51:56.757574 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:51:56.757574 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:56.757574 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:51:56.757574 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 238/466] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:56.757810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14e5e0-aa6f-4fa3-b6eb-17abb65a6c2e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.761693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.788750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 229/467] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:56 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:56.788750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31520e7-210a-44ac-8a96-bd8f345e2238 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.788750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31520e7-210a-44ac-8a96-bd8f345e2238 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.788750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31520e7-210a-44ac-8a96-bd8f345e2238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.805960 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.807548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f31520e7-210a-44ac-8a96-bd8f345e2238 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:56.809609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f31520e7-210a-44ac-8a96-bd8f345e2238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:56.867597 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.901368 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 230/468] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:56.902432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31520e7-210a-44ac-8a96-bd8f345e2238 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.917850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd4d0-82f8-41e9-9298-facde58701f9 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.956848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.957553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.957835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.958160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.959508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:56.959811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.961731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.979342 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 239/469] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:56.986001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.062303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31520e7-210a-44ac-8a96-bd8f345e2238 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.089412 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.108441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7feb-456e-4b49-ad52-7247ad0a5192 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.108748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.109298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.109629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.109941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.110598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:57.110989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.112384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.127652 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 231/470] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:57.134197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.145632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219dfa0-8fce-409d-80cf-54bd19552d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.146465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219dfa0-8fce-409d-80cf-54bd19552d40 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.146747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219dfa0-8fce-409d-80cf-54bd19552d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.147019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219dfa0-8fce-409d-80cf-54bd19552d40 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.147668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219dfa0-8fce-409d-80cf-54bd19552d40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.149856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219dfa0-8fce-409d-80cf-54bd19552d40 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.186169 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 240/471] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:56 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:51:57.193701 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.242349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023576ef-d575-4982-b4d5-96dcd587c506 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.242657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023576ef-d575-4982-b4d5-96dcd587c506 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.242963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023576ef-d575-4982-b4d5-96dcd587c506 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.244652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 241/472] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:57.254855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d73b9-3861-414e-ac87-df5a12402500 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.255439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d73b9-3861-414e-ac87-df5a12402500 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.256193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d73b9-3861-414e-ac87-df5a12402500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.277934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-297d73b9-3861-414e-ac87-df5a12402500 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:57.279154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-297d73b9-3861-414e-ac87-df5a12402500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:57.280492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bf2c6-181b-4fa5-9f88-0324674f14ac None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.327919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.328462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.328740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.329060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.329782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.331287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.360485 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 232/473] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:57 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:57.388726 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 242/474] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:57.419690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.534235 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.540961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082d9ec-d465-40b6-b8d0-d9e4687fe80f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.579666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.580235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.580505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.580816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.592655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.594221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:51:57.609950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:57.612098 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:51:57.614009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:51:57.614009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:51:57.614009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:57.614009 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 233/475] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:57.620356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d73b9-3861-414e-ac87-df5a12402500 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.693743 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.711611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.733009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d73b9-3861-414e-ac87-df5a12402500 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.769804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.770417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.770810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.771080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.771726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:57.772114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.773507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.786355 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 243/476] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:57.792108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.830974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54f05-75ef-4594-ad74-2f74dacf4f7e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.882748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.883361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.883631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.883895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.884563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.887938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.901927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.sql.core [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:51:57.901927 n-d-master-1 devstack@keystone.service[81885]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 21 00:51:57.901927 n-d-master-1 devstack@keystone.service[81885]: [parameters: {'id': '07d2ff68aa4b435bbda0e095cc25dedc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 21 00:51:57.901927 n-d-master-1 devstack@keystone.service[81885]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81885) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result.read() Aug 21 00:51:57.930843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return ref.to_dict() Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:51:57.931847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application yield resource Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise self.value Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application session.commit() Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:51:57.933365 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:51:57.936488 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:51:57.938623 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result.read() Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:51:57.940498 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [parameters: {'id': '07d2ff68aa4b435bbda0e095cc25dedc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:57.942550 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 21 00:51:57.950643 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:57.952598 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 234/477] 10.222.0.46 () {60 vars in 1131 bytes} [Sun Aug 21 00:51:57 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:57.952776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f180-68aa-4d35-aeb4-918483a396b5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.952944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.976625 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.991872 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:58.011400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.012020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.012292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.012561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.013236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:58.014673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:58.058517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 244/478] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:57 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:58.126425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b82cfc-b5d8-4c1f-b4d0-031ad8282f63 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:58.166213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e912ee-a49e-410e-b720-856a3835d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.166881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e912ee-a49e-410e-b720-856a3835d590 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.167150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e912ee-a49e-410e-b720-856a3835d590 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.167423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e912ee-a49e-410e-b720-856a3835d590 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.179531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e912ee-a49e-410e-b720-856a3835d590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-b1e912ee-a49e-410e-b720-856a3835d590 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:58.184739 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:58.186859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:58.188525 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 235/479] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:58.195180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:58.323684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d9e2-f533-420a-837d-eb56d2a1b36c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:58.361252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed645f2-1c27-4989-b37f-c345663f09d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.361873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed645f2-1c27-4989-b37f-c345663f09d2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.362151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed645f2-1c27-4989-b37f-c345663f09d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.362428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed645f2-1c27-4989-b37f-c345663f09d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.363100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed645f2-1c27-4989-b37f-c345663f09d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:58.363403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed645f2-1c27-4989-b37f-c345663f09d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:58.365515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed645f2-1c27-4989-b37f-c345663f09d2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:58.374503 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 245/480] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:59.195732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806238-1b74-4269-aa7c-ccb2cac4cad5 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:59.196417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806238-1b74-4269-aa7c-ccb2cac4cad5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:59.196417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806238-1b74-4269-aa7c-ccb2cac4cad5 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:59.198238 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 236/481] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:59.203195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86e62-3d99-4ef1-aed5-0313403d21f1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:59.203750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86e62-3d99-4ef1-aed5-0313403d21f1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:59.203750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86e62-3d99-4ef1-aed5-0313403d21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:59.229894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c9f86e62-3d99-4ef1-aed5-0313403d21f1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:59.231143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c9f86e62-3d99-4ef1-aed5-0313403d21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:59.286532 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:59.321858 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 246/482] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:59.690755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f806238-1b74-4269-aa7c-ccb2cac4cad5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:59.738120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1488a-b711-45d2-80ca-6e5497c82de0 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:59.738120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1488a-b711-45d2-80ca-6e5497c82de0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:59.738120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1488a-b711-45d2-80ca-6e5497c82de0 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:59.738120 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 247/483] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:59.744334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb868d7-3b5e-40f5-8d9c-d30f830e4d6a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:59.744619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb868d7-3b5e-40f5-8d9c-d30f830e4d6a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:59.744937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb868d7-3b5e-40f5-8d9c-d30f830e4d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:59.777776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5fb868d7-3b5e-40f5-8d9c-d30f830e4d6a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:59.778996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5fb868d7-3b5e-40f5-8d9c-d30f830e4d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:59.785019 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:59.838383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f806238-1b74-4269-aa7c-ccb2cac4cad5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:59.877602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:59.878560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:59.878979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:59.879371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:59.886037 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 248/484] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:59.887443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d90be0-c82d-4a9f-be0c-0024b9bba41b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:59.887820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d90be0-c82d-4a9f-be0c-0024b9bba41b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:59.888187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d90be0-c82d-4a9f-be0c-0024b9bba41b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:59.889821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 249/485] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:59.898529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e940-6df8-4491-a5c4-5fa9de0ea424 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:59.898967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e940-6df8-4491-a5c4-5fa9de0ea424 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:59.899333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e940-6df8-4491-a5c4-5fa9de0ea424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:59.902696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:59.908481 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:59.909518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:51:59.910279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:51:59.914569 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 237/486] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:59.921139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:59.924303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cfb9e940-6df8-4491-a5c4-5fa9de0ea424 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:59.925703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cfb9e940-6df8-4491-a5c4-5fa9de0ea424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:00.067986 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 250/487] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:00.091920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7567327-bab2-4cb2-aef5-1bac11be5ec9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.122798 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:00.145514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.146143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.146408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.146672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.147352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:00.147644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:00.149050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:00.157732 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 238/488] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:00.163786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9e940-6df8-4491-a5c4-5fa9de0ea424 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.199394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.224891 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:00.355063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9e940-6df8-4491-a5c4-5fa9de0ea424 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.361743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c653b8-7ab6-48f3-a5f9-11dc021e14bf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.419983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.420659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.420974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.421192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.421304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.422327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.423037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.423500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.433289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:00.437872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:00.439683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:00.441349 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:00.442208 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:00.443645 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 239/489] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:00.444980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:00.466800 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:00.467793 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:00.468635 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:00.468635 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:00.468635 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:00.478096 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 251/490] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:00.478096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.526673 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:00.568952 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:00.581533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e80a1-1494-4244-8975-fc22aa192a36 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.582598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417cd44-b0dd-4658-a45b-6d0118754127 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.619520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.620050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.620329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.620595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.621295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:00.621598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:00.622276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd652bf-85ba-458b-8273-8fd665c862dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.622971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:00.623214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd652bf-85ba-458b-8273-8fd665c862dc None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.623625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd652bf-85ba-458b-8273-8fd665c862dc None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.624040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd652bf-85ba-458b-8273-8fd665c862dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.631519 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 252/491] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:00.632185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.636367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd652bf-85ba-458b-8273-8fd665c862dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-1fd652bf-85ba-458b-8273-8fd665c862dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:00.641917 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:00.642859 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:00.643741 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:00.649412 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 240/492] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:00.649412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3f9df-5269-4033-8aff-79554baf6d56 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.649412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3f9df-5269-4033-8aff-79554baf6d56 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.649412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3f9df-5269-4033-8aff-79554baf6d56 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.652893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 241/493] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:00.653872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3f9df-5269-4033-8aff-79554baf6d56 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.743869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbaba-7cbf-45c1-87b9-c963ea58439a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.762637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3f9df-5269-4033-8aff-79554baf6d56 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.778506 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:00.779677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.780462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.780810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.781102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.781729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:00.782026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:00.783415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:00.797222 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 253/494] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:00.798326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.807382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fa45e-a233-4564-9048-b66014441b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.808077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fa45e-a233-4564-9048-b66014441b5e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.808303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fa45e-a233-4564-9048-b66014441b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.808577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fa45e-a233-4564-9048-b66014441b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.812246 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:00.819870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fa45e-a233-4564-9048-b66014441b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:00.821371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fa45e-a233-4564-9048-b66014441b5e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-677fa45e-a233-4564-9048-b66014441b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:00.836560 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:00.837648 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:00.838467 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:00.838467 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:00.838467 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:00.838467 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 242/495] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:00.839134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a918a-4677-4433-9c5b-e2c09ae900a4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.839411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a918a-4677-4433-9c5b-e2c09ae900a4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.839678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a918a-4677-4433-9c5b-e2c09ae900a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.862187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-db7a918a-4677-4433-9c5b-e2c09ae900a4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:00.864040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-db7a918a-4677-4433-9c5b-e2c09ae900a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:00.920865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c798a05-ab11-4c1b-8f90-d00b7b573472 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:00.937980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 243/496] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:00.938661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a918a-4677-4433-9c5b-e2c09ae900a4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:00.965788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:00.966398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.966678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.966947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.967611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:00.967910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:00.969404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:00.977960 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 254/497] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:00.983335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.041864 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.048247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a918a-4677-4433-9c5b-e2c09ae900a4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.060429 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.089308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883150d-4657-4d04-aea0-911bf8eddb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.089937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883150d-4657-4d04-aea0-911bf8eddb46 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.090204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883150d-4657-4d04-aea0-911bf8eddb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.090470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883150d-4657-4d04-aea0-911bf8eddb46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.093731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181eec9-78a6-45a5-9df7-1df179137118 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.097634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883150d-4657-4d04-aea0-911bf8eddb46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.099132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883150d-4657-4d04-aea0-911bf8eddb46 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-b883150d-4657-4d04-aea0-911bf8eddb46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:01.112008 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:01.112941 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:01.113811 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 244/498] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:01.114935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674934ed-59fc-41aa-9f9a-0499a3d154ba None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.115182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674934ed-59fc-41aa-9f9a-0499a3d154ba None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.115454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674934ed-59fc-41aa-9f9a-0499a3d154ba None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.121647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 245/499] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:01.121647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674934ed-59fc-41aa-9f9a-0499a3d154ba None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.139242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3d740-4ace-4f81-97e0-aa2ea8687676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.140067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d740-4ace-4f81-97e0-aa2ea8687676 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.140346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d740-4ace-4f81-97e0-aa2ea8687676 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.140613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d740-4ace-4f81-97e0-aa2ea8687676 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.141340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3d740-4ace-4f81-97e0-aa2ea8687676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:01.141644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3d740-4ace-4f81-97e0-aa2ea8687676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.143123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3d740-4ace-4f81-97e0-aa2ea8687676 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.160104 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 255/500] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:01.160104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18a0d-d67a-47f6-84d4-3e8f4f210b8c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.160104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18a0d-d67a-47f6-84d4-3e8f4f210b8c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.160104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18a0d-d67a-47f6-84d4-3e8f4f210b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.174517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f7b18a0d-d67a-47f6-84d4-3e8f4f210b8c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:01.176382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f7b18a0d-d67a-47f6-84d4-3e8f4f210b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:01.237082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674934ed-59fc-41aa-9f9a-0499a3d154ba None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.244614 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 256/501] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:01.245480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b18a0d-d67a-47f6-84d4-3e8f4f210b8c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.273622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.274247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.274520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.274790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.285965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.287487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:01.301829 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:01.303127 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:01.304600 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:01.304600 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:01.304600 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:01.304600 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 246/502] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:01.304600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.314123 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.319749 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.358838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b18a0d-d67a-47f6-84d4-3e8f4f210b8c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.395042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.395738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.396031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.396303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.397079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:01.397385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.398930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.409445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4138bb-c585-4a4f-9827-fdb0a9d7e856 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.443581 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 257/503] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:01.443581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.449947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.450578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.450818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.451119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.459072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.460854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:01.472305 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:01.473245 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 247/504] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:01.474350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.544801 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.556635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4e9a3-f275-40a1-b578-3e78bfa958bb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.576255 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.578654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d65e-23b9-4bfb-b7ba-096c2640e068 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.592054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.592760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.593121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.593452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.603852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:01.608599 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:01.609665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:01.610450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 258/505] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:01.611098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.614885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.615499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.615770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.616036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.616671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:01.617001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.618366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.630621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 248/506] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:01.631417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.711353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe6a10-045a-4443-b969-efee19d2d1fb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.733276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9fe17-b70c-4948-a37c-47b4cf2c61d5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.748229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.748871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.749150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.749421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.760227 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.768341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.769097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.769489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.769886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.770974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:01.771415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.772892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.797640 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.810182 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 249/507] 10.222.0.46 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:01.811073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.824447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.825948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.914998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0bfe-f99d-4eef-adc1-6e2d3e887f82 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.929058 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 259/508] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:01.929888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.949396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.950044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.950315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.950584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.960944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.962487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:01.977030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:01.978051 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:01.979323 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:01.979323 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:01.979323 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:01.979323 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 250/509] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:01.979323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.014529 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.018001 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.034001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bf6c-af3d-4786-92ad-21c2879a09c5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.068392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.069109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.069377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.069639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.070316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:02.070599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.071965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.077324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853802b-d7e9-43ea-b526-1456bbf30829 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.079546 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 260/510] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:02.080426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.111462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.112093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.112373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.112644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.120038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.121520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:02.133309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:02.134428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 251/511] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:02.135304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.185381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78d2a-c057-4e67-bc85-8746bda77105 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.220438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.220987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.221268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.221534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.234026 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.234854 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.238044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea8a0e-deb1-49d4-b210-2a179fef9bfc None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.272015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.272641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.272951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.273224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.283607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.285106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.291029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.292478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:02.299247 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:02.300125 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:02.301005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:02.301005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.301005 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:02.301005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 252/512] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:02.301219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.390129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 261/513] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:02.391194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.402818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38733f2-c202-412c-b468-72c92ed67a4d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.433505 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.436040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.436637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.436940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.437208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.437844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:02.438138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.439611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.452711 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 253/514] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:02.453632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.465241 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.494674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e471-c6fa-470a-8ba8-c6f5639a9767 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.527951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.528580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.528884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.529159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.539407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.540909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.553630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3d25-27fd-4171-aebb-8264a3d282f2 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:02.558828 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:02.559833 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:02.560660 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:02.560660 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.560660 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:02.560660 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 262/515] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:02.560905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.593663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.594271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.594546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.594812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.595545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:02.595846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.597342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.615310 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 254/516] 10.222.0.46 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:02.616229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.653714 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.660360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448a53-b3d9-464d-b7bc-a7e319e64053 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.682918 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.695317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.695915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.696215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.696482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.697155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:02.697454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.698812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.710226 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 263/517] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:02.710990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.717498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964666-f6a4-4729-80c1-5dc564913aa0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.751280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.751831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.752101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.752364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.762846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.764302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:02.778881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:02.779957 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:02.781012 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:02.781012 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.781012 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:02.781012 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 255/518] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:02.781012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.813190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afced9-f782-4749-8bdb-9051a9c0ed24 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.846586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.847206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.847486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.847759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.848402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.850306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.872693 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 264/519] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:02 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:02.873653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.888252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eef0f-8f79-476d-9976-361400343bbc None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.898482 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.912666 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.932009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.932727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.933095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.933432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.934550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:02.934550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.935880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.950536 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 256/520] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:02.951535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.010267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4fc63-db01-4c14-9ef7-bfa8ccb15792 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.053281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.054039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.054921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.054921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.079571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204463-8842-4dd8-be73-26a648d54ecd None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.116848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.117476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.117857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.118030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.124956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.128006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.135796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.137541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:03.139544 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:03.140521 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:03.141444 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 257/521] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:03.141924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.154811 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.187886 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.253037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be1c4c-08cc-4be7-a864-0901a8878d61 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.253663 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 265/522] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:03.254608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.295287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.296040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.296944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.297366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.298118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:03.298937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.301120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.319205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 258/523] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:03.320066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.376552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9e26d-90fd-4985-98a1-41b7730e7f51 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.389323 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.416148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.416892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.417227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.417558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.424841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.426274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.434789 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.438418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90447ac-ced9-48cd-ad43-9cdf266462f6 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:03.439312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:03.440413 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:03.441995 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:03.445192 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 266/524] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:03.446055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.480754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75984b8-c106-4594-9667-03553ff592be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.481389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75984b8-c106-4594-9667-03553ff592be None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.481661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75984b8-c106-4594-9667-03553ff592be None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.481925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75984b8-c106-4594-9667-03553ff592be None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.482627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75984b8-c106-4594-9667-03553ff592be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:03.482920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75984b8-c106-4594-9667-03553ff592be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.484351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75984b8-c106-4594-9667-03553ff592be None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.506029 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 259/525] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:03.506029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75984b8-c106-4594-9667-03553ff592be None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.565654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754d018-1947-4b40-bacb-db2ef00d43b7 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.610487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.611032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.611338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.611592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.623943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.625470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.628541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75984b8-c106-4594-9667-03553ff592be None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:03.644159 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:03.645412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:03.646441 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:03.646441 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:03.646441 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:03.646441 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 267/526] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:03.646441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.676022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.676700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.677093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.677808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.682266 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.689517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.691334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:03.704657 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:03.705803 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:03.706858 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:03.711111 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 260/527] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:03.712351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.742873 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.779434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697976fe-45d3-4300-9958-ab1a61b83137 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.820927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.821774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.822221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.822641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.823514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:03.823959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.825593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.843884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa41ef-fa8b-4059-85da-e87376635f9e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.850742 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 268/528] 10.222.0.46 () {56 vars in 1139 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:03.851732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.893792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.894413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.894696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.894966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.895741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=0ffef7873ae44899a84aa7376be7b8b8) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:03.896047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.897645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.903630 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 261/529] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/role_assignments?user.id=0ffef7873ae44899a84aa7376be7b8b8&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:03.904445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.975431 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.004225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a6bfd-2e97-43ef-9803-ac30e47c1be2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.049509 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.056471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.057715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.058317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.059353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.060758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:04.061631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.064809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.071121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dc13d-6022-4899-a116-ee5f3e11c773 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.087791 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 269/530] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:04.089385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.139582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.140130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.141164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.141164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.141922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:04.142417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.144149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.164062 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 262/531] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:04.165741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.223482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3560e0-9615-425a-95fc-8f64c8d3c7cc None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.264912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.265888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.266366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.267098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.283288 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.295677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85f26-916e-47dd-8bd3-ed8e7b9bb409 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.339415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.339973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.340296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.340499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.348874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.350600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.361360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.363225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:04.363446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:04.364559 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 263/532] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:04.366199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.370398 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.493959 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 270/533] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:04.499681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.507224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726ad2-ec5e-450b-895b-3d3a594bef8a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.545076 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.551400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.552955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.553442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.553908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.554979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=9fff798abd7e4970977c2465aaed01b9) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:04.555771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.557445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.570129 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 264/534] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/role_assignments?user.id=9fff798abd7e4970977c2465aaed01b9&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:04.570129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.657863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbee171-15d1-419e-b7f3-e2f6e2a305d3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.719133 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.730925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.731926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.732555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.733046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.733983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:04.734481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.736217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.772391 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 271/535] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:04.783246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4a906-50b8-4286-9084-44ef6196450f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.790280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.837635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.838643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.839170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.839633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.862908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.864795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:04.894631 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:04.895689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:04.896532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:04.896532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:04.896532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:04.896698 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.898616 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 265/536] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:04.905240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467f043-eab8-4c5a-812d-559c8906bc36 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.906557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.946308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d4bb4-5a85-4c9b-9389-ddc4f9ddb8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.947284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4bb4-5a85-4c9b-9389-ddc4f9ddb8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.947857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4bb4-5a85-4c9b-9389-ddc4f9ddb8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.949269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4bb4-5a85-4c9b-9389-ddc4f9ddb8a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.952832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d4bb4-5a85-4c9b-9389-ddc4f9ddb8a9 None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=1c9c0901260e44a789d750c2032bfbd7) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:04.953323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d4bb4-5a85-4c9b-9389-ddc4f9ddb8a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.955062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d4bb4-5a85-4c9b-9389-ddc4f9ddb8a9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.967948 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 272/537] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/role_assignments?user.id=1c9c0901260e44a789d750c2032bfbd7&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:05.023679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de860b-ec9a-472e-b2f6-d6a94e93ad38 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.023948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de860b-ec9a-472e-b2f6-d6a94e93ad38 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.024221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de860b-ec9a-472e-b2f6-d6a94e93ad38 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.026602 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 273/538] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:05.031588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21f59-5fbf-42ca-a6b5-04f7c7b2de34 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.031863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21f59-5fbf-42ca-a6b5-04f7c7b2de34 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.032133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21f59-5fbf-42ca-a6b5-04f7c7b2de34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.051065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-33a21f59-5fbf-42ca-a6b5-04f7c7b2de34 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:05.052421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33a21f59-5fbf-42ca-a6b5-04f7c7b2de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:05.105607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9006-abbe-462b-a415-bbb63658c65d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.136490 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:05.148744 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 274/539] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:05.164032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.165094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.165548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.166006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.166826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:05.167297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:05.169147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:05.183939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 266/540] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:05.189106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a21f59-5fbf-42ca-a6b5-04f7c7b2de34 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.302801 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:05.311227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a21f59-5fbf-42ca-a6b5-04f7c7b2de34 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.360440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210908-f642-408b-917d-174248560639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.361109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210908-f642-408b-917d-174248560639 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.361384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210908-f642-408b-917d-174248560639 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.361653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210908-f642-408b-917d-174248560639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.373965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a210908-f642-408b-917d-174248560639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:05.375476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a210908-f642-408b-917d-174248560639 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0a210908-f642-408b-917d-174248560639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:05.391020 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:05.391875 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:05.392697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 275/541] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:05.399663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.415390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210908-f642-408b-917d-174248560639 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.590212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf94c5-16b5-40b9-988b-afd8773aba0e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.595004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210908-f642-408b-917d-174248560639 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.669979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.671470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.671746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.672018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.672721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:05.673047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:05.674559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:05.678085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.678733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.679009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.679276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.688293 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 267/542] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:05.700560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:05.701932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:05.711410 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:05.712507 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:05.713531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:05.722499 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 276/543] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:05.729508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.763008 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:05.790336 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:05.876531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a2c8-2c99-42ec-ab78-4fe3f964775f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.889011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d470fee-5df9-4463-8901-483bdb1036f3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.911426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.912034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.912490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.912783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.913561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:05.913866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:05.915264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:05.928792 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 277/544] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:05.929334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.950601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.951521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.952017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.952514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.953486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=887449bfd1b64d408d74e60f556b081a) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:05.953989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:05.955606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:05.961655 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 268/545] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/role_assignments?user.id=887449bfd1b64d408d74e60f556b081a&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:06.056876 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:06.080448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dada6-fdc3-4380-8d6a-b603305832a0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:06.124265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1c45-237a-46ad-a45d-daae89f48fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:06.124948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1c45-237a-46ad-a45d-daae89f48fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.125229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1c45-237a-46ad-a45d-daae89f48fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.125504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1c45-237a-46ad-a45d-daae89f48fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.144406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e1c45-237a-46ad-a45d-daae89f48fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:06.146103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e1c45-237a-46ad-a45d-daae89f48fb0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-296e1c45-237a-46ad-a45d-daae89f48fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:06.169618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:06.170578 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:06.171391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:06.171391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:06.171391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:06.171391 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 278/546] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:06.178104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:06.287026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdbc33-fb7f-4395-b15a-21ac49a7b7f3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:06.289473 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:06.311103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e175a3-7732-482b-83c2-7be44ca50531 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.311445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e175a3-7732-482b-83c2-7be44ca50531 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.311642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e175a3-7732-482b-83c2-7be44ca50531 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.313548 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 279/547] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:06.320168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f383f-9bf0-4520-9b79-b239ec82ad9a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.320437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f383f-9bf0-4520-9b79-b239ec82ad9a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.320712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f383f-9bf0-4520-9b79-b239ec82ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.337402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:06.338335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.338781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.339234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.340055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:06.340533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:06.341814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-539f383f-9bf0-4520-9b79-b239ec82ad9a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:06.342276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:06.343149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-539f383f-9bf0-4520-9b79-b239ec82ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:06.366606 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 269/548] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:06.372724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:06.421129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 280/549] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:06.536931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef4795-8225-4ddf-be47-3187d2c55dca None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:06.590349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c29080-af27-47e2-bf3a-a7ed410c16e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:06.591309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c29080-af27-47e2-bf3a-a7ed410c16e9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.591751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c29080-af27-47e2-bf3a-a7ed410c16e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.592181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c29080-af27-47e2-bf3a-a7ed410c16e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.601427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c29080-af27-47e2-bf3a-a7ed410c16e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:06.602888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c29080-af27-47e2-bf3a-a7ed410c16e9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-16c29080-af27-47e2-bf3a-a7ed410c16e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:06.617137 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:06.618489 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:06.619605 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 270/550] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:06.626135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f383f-9bf0-4520-9b79-b239ec82ad9a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:06.653484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126433ed-a5d1-472f-86af-fb0b1f9f74cc None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.653844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126433ed-a5d1-472f-86af-fb0b1f9f74cc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.654226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126433ed-a5d1-472f-86af-fb0b1f9f74cc None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.655933 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 271/551] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:06.663269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c943f-8490-41bd-8eae-501a2e9eaf01 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.663547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c943f-8490-41bd-8eae-501a2e9eaf01 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.663818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c943f-8490-41bd-8eae-501a2e9eaf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.694333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ff4c943f-8490-41bd-8eae-501a2e9eaf01 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:06.695470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ff4c943f-8490-41bd-8eae-501a2e9eaf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:06.716451 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:06.756347 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:06.793807 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 272/552] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:06.795066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c943f-8490-41bd-8eae-501a2e9eaf01 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:06.816130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f383f-9bf0-4520-9b79-b239ec82ad9a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:06.865330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:06.866080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.866360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.866628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.867370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:06.867673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:06.870318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:06.895889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 281/553] 10.222.0.46 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:06.902705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:06.906261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c943f-8490-41bd-8eae-501a2e9eaf01 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:06.971219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:06.972197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.972680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.973155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.995486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:07.000950 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:07.002055 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:07.002932 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:07.008846 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 273/554] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:07.013731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.042448 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.098047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d2ce-e699-4f0e-b2e7-3649d6d6caa3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.118726 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.150515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.151353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.151775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.152186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.175355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a97835-e59f-4821-b559-3e23d449c586 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.223044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.223843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.224727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.224727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.225369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:07.225765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:07.228081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:07.230397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:07.232022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:07.239085 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 274/555] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:07.240156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.328084 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.342464 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 282/556] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:52:07.343591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.359098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776e2e-86c9-4d90-abbb-8b4c70065fcf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.365443 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.397845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.398636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.399148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.399488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.411122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:07.417113 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:07.418251 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:07.419292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:07.421757 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 275/557] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:07.422713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.464675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffef3-533a-4110-87c5-5a35f21d9614 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.500329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.500961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.501244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.501512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.512897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:07.514560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:07.531618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:07.538451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:07.539354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:07.539354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:07.539354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:07.539354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 283/558] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:07.539576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752d11-3815-4c59-b46d-ad1ab28065bb None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.539982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.572532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83180d95-4f82-4368-ad2c-8585851a1205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.573190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83180d95-4f82-4368-ad2c-8585851a1205 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.573467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83180d95-4f82-4368-ad2c-8585851a1205 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.573738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83180d95-4f82-4368-ad2c-8585851a1205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.576614 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.585069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83180d95-4f82-4368-ad2c-8585851a1205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:07.586553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83180d95-4f82-4368-ad2c-8585851a1205 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-83180d95-4f82-4368-ad2c-8585851a1205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:07.600658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:07.601712 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:07.602804 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:07.602804 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:07.602804 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:07.606692 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 276/559] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:07.607789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102602c8-9681-496c-a7e6-b4707c4f70ef None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.608073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102602c8-9681-496c-a7e6-b4707c4f70ef None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.608343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102602c8-9681-496c-a7e6-b4707c4f70ef None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.613514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 277/560] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:07.613514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102602c8-9681-496c-a7e6-b4707c4f70ef None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.621382 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.658528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb6b5e-72ee-4abc-ad23-981da706677a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.696911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.697522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.697794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.698404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.699074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:07.699660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:07.701072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:07.709340 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 284/561] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:07.710140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.727132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102602c8-9681-496c-a7e6-b4707c4f70ef None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.762523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8ff70-ce2c-40bd-aff3-cdcffe60cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.763090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8ff70-ce2c-40bd-aff3-cdcffe60cef7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.763289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8ff70-ce2c-40bd-aff3-cdcffe60cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.763623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8ff70-ce2c-40bd-aff3-cdcffe60cef7 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.764246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8ff70-ce2c-40bd-aff3-cdcffe60cef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:07.764558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8ff70-ce2c-40bd-aff3-cdcffe60cef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:07.765962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8ff70-ce2c-40bd-aff3-cdcffe60cef7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:07.780091 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 278/562] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:07.781438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683400aa-6d18-4aff-82f6-933b1a60cb37 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.781721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683400aa-6d18-4aff-82f6-933b1a60cb37 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.781995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683400aa-6d18-4aff-82f6-933b1a60cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.802351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-683400aa-6d18-4aff-82f6-933b1a60cb37 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:07.804121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-683400aa-6d18-4aff-82f6-933b1a60cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:07.825367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc03ab6-6860-4680-a2cc-890084fc424f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.850610 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.860108 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.866087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.866720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.866998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.867267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.867911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:07.868209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:07.869761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:07.884804 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 279/563] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:07.884804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683400aa-6d18-4aff-82f6-933b1a60cb37 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.885082 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 285/564] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:07.885082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.988868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfce76-1ad2-4e1c-baba-6811fa0d593d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.008579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683400aa-6d18-4aff-82f6-933b1a60cb37 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.027498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.028201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.028475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.028745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.036858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.038354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.048197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.049148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.049625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.050092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:08.050621 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.051582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:08.052588 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 286/565] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.053204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.064485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.066336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:08.082271 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.083248 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:08.084108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:08.084108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:08.084108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:08.086428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 280/566] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.087402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.105852 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.121957 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.173887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b180-7cee-429a-8925-7ff0b16b1409 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.198780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820249f-5346-42cf-979c-5530f9ec184b None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.208784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.209673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.209673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.209945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.216712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.218191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:08.229643 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.230547 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:08.231422 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 287/567] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.231895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.240385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.241317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.241773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.242216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.243271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.243761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.245517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.269696 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 281/568] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.269696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.333043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a36830-0acb-4788-9fb1-81cee8b8ed11 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.343219 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.357385 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.368114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.368719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.369023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.369292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.369928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.370226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.370558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b9f7-3d21-4a48-a26b-bc3a65ba6dcd None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.371592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.383839 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 288/569] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.384650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.407897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19dff2-d336-496d-8e80-08492ce7ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.408533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19dff2-d336-496d-8e80-08492ce7ee1a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.408839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19dff2-d336-496d-8e80-08492ce7ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.409111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19dff2-d336-496d-8e80-08492ce7ee1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.420842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19dff2-d336-496d-8e80-08492ce7ee1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-fc19dff2-d336-496d-8e80-08492ce7ee1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:08.425423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.426321 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:08.427270 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 282/570] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.428308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f17f1-6f74-42d8-abc5-163615b1d9c4 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.428308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f17f1-6f74-42d8-abc5-163615b1d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.428428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f17f1-6f74-42d8-abc5-163615b1d9c4 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.429773 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 283/571] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:08.432043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f17f1-6f74-42d8-abc5-163615b1d9c4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.488051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449a2e9-010c-4074-80df-b3b1b414033e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.522418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.523022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.523281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.523548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.524242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.524584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.526011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.534468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f17f1-6f74-42d8-abc5-163615b1d9c4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.537371 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 289/572] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.538140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.568408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.569065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.569343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.569471 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.569633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.580002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.581490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.589931 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:08.596452 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.597591 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:08.598523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:08.598523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:08.598523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:08.598523 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 284/573] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.598744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.642371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23bef7-ae56-428e-997a-96e665a5caca None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.675082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d33a9-12cc-4607-97f4-f69edffe6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.675714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d33a9-12cc-4607-97f4-f69edffe6640 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.675996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d33a9-12cc-4607-97f4-f69edffe6640 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.676275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d33a9-12cc-4607-97f4-f69edffe6640 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.684122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d33a9-12cc-4607-97f4-f69edffe6640 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.685595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d33a9-12cc-4607-97f4-f69edffe6640 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.694759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a829-e71d-4fff-a914-d146e4878cd9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-149d33a9-12cc-4607-97f4-f69edffe6640 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:08.696575 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.697570 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:08.698518 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 290/574] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.699105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19748f-a031-42f2-af25-712671e01b08 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.699105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19748f-a031-42f2-af25-712671e01b08 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.699709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19748f-a031-42f2-af25-712671e01b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.717296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-aa19748f-a031-42f2-af25-712671e01b08 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:08.718468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aa19748f-a031-42f2-af25-712671e01b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:08.728061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.729000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.729280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.729550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.730200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.730503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.731859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.739892 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 285/575] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.740523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.792205 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 291/576] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:08.793121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19748f-a031-42f2-af25-712671e01b08 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.806705 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.828332 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.850045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507102-6d7a-468c-bf11-83e3fa526919 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.888237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.888881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.889161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.889432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.890608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=1eadc3e155df4f5a9f40ae75ee27733f) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.890966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.893115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.909139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 286/577] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/role_assignments?user.id=1eadc3e155df4f5a9f40ae75ee27733f&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.909139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.914174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19748f-a031-42f2-af25-712671e01b08 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.958574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.959458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.959458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.959735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.960407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.960813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.962249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.981314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 292/578] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.982240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.063149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2a01-7df7-4d8e-a272-6ac85748ff42 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.077854 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.094401 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.100252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77bc4-770f-4a83-a64a-71d84fe79a2c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.105141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.105761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.106034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.106298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.107055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.107353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.108817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.135381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 287/579] 10.222.0.46 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.138032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.149996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.150667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.151101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.151380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.165108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.167058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:09.185497 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.186525 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:09.187448 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:09.187448 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.187448 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:09.187448 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 293/580] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.191868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.246318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4760a5-672d-45b7-9817-ced7bba1d1b9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.281949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.282596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.282866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.283130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.289778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.291230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.299506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ca41c-d54f-4365-b494-c01ca15e327d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:09.302750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.303837 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:09.305007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:09.305439 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 288/581] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.306073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.340958 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.347893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.348534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.348836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.349176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.356374 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.362956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:09.368928 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.369874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:09.370696 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 294/582] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.371929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.415890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f262285-7b93-44ce-8c04-27e1893f4dec None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.449469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.450091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.450362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.450622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.461118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.462525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.475925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fd778-2958-4824-9c92-9550dc1f3d8a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:09.476968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.477869 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:09.479030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:09.479030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.479030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:09.479030 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 289/583] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.479258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.516250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.516888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.517159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.517421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.518062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.518354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.519704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.532061 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 295/584] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.532894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.583799 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.593164 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.601128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2672980-36ea-490f-8cb7-53047f0d64b1 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.632001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec548-dd10-4913-8bb3-aa2029a24058 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.640208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.640819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.641095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.641362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.642209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.642751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.644192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.656088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 290/585] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.656895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.675382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.676943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.677645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.678090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.679079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.679555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.681145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.691378 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 296/586] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.692563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.769485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122c2e-923e-4718-a235-3f8b1a9a8463 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.802288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eeb32-5162-47fd-950d-00ee6186cc43 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.805089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.805707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.805981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.806246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.806874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.807229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.808593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.816657 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.825687 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 291/587] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.825687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.842418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.843044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.843317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.843579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.844374 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.852294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.854081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:09.865359 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.866286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:09.867231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:09.871282 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 297/588] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.872112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.934095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab024b-67f2-4e2c-8772-a6f9d0bd45fc None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.968526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.969259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.969533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.969803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/0ffef7873ae44899a84aa7376be7b8b8/roles/04b947d4d06d4c7080930518a54559c4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.975478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c60dba-7962-44c2-b3cd-24fa946cac82 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.990493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=0ffef7873ae44899a84aa7376be7b8b8, role_id=04b947d4d06d4c7080930518a54559c4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.992191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.009665 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 292/589] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:09 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/0ffef7873ae44899a84aa7376be7b8b8/roles/04b947d4d06d4c7080930518a54559c4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:10.011072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.020603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.021290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.021563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.021838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.033767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.035231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:10.051011 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:10.052335 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:10.053423 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:10.053423 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.053423 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:10.057344 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 298/590] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:10.058299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.092170 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.125142 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.158781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be882e1-74d5-472e-a3a8-aac9c93d6074 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.193699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a4ca-8614-48f7-b137-0d40582bd671 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.208124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.209213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.209498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.209773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.217255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.218760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:10.233888 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:10.234838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:10.235749 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 293/591] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:10.236248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.247458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.248388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.248897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.249327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.250729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.251177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.253410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.276063 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 299/592] 10.222.0.46 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:10.277023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.365837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742094cb-f8c8-4470-8220-9553b4afc970 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.393506 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.403137 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.404464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d265f8c-bd7a-4b5d-a308-17ce92914889 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.414891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.415509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.415845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.416120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.416784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.417116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.418664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.432994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 294/593] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:10.433660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.444595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.445557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.446029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.446493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.447381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.447891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.449550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.462119 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 300/594] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:10.463242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.554577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44ae8c-e788-4278-a26a-3a38a163f7e3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.566515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8469d-5d37-48f5-a733-7d622289cb54 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.593026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.593667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.594203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.594203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.603965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.604902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.605370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.605825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.606923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.608502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.614608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.616535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:10.624568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:10.625537 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:10.626399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:10.626399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.626399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:10.626399 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 295/595] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:10.627038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:10.631309 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:10.632214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:10.633176 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:10.635579 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 301/596] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:10.636605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.640798 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.674699 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.742628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df148e8d-adec-4a7f-9a42-c3aff2dcee90 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.747018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fd1d4-adf0-4f79-b623-99313f78b9ad None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.777358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.778157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.778515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.778831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.779577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.779992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.781489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.790554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.791349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.791723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.792093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/9fff798abd7e4970977c2465aaed01b9/roles/04b947d4d06d4c7080930518a54559c4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.796069 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 302/597] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:10.797997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.810737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=9fff798abd7e4970977c2465aaed01b9, role_id=04b947d4d06d4c7080930518a54559c4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.812719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.836904 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 296/598] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:10 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/9fff798abd7e4970977c2465aaed01b9/roles/04b947d4d06d4c7080930518a54559c4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:10.838156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.877576 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.928829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9141fe-5181-43ef-b1d4-3a8ce4c86b98 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.961288 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.972659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86bbb-4550-471b-b378-1a22ed2c1c45 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.975173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c36ce-25f6-47e5-937b-0e13ab40f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.976952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c36ce-25f6-47e5-937b-0e13ab40f45b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.977392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c36ce-25f6-47e5-937b-0e13ab40f45b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.977805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c36ce-25f6-47e5-937b-0e13ab40f45b None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.979091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c36ce-25f6-47e5-937b-0e13ab40f45b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.979557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c36ce-25f6-47e5-937b-0e13ab40f45b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.981252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c36ce-25f6-47e5-937b-0e13ab40f45b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.007115 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 303/599] 10.222.0.46 () {56 vars in 1139 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:11.008323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf68a-c103-4c02-b344-0ebe4c7d224c None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.008610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf68a-c103-4c02-b344-0ebe4c7d224c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.008983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf68a-c103-4c02-b344-0ebe4c7d224c None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.010446 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 304/600] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:11.012238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caf68a-c103-4c02-b344-0ebe4c7d224c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.023557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f616-1069-404b-84f6-4493cf9d9df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.024468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f616-1069-404b-84f6-4493cf9d9df4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.025107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f616-1069-404b-84f6-4493cf9d9df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.025381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f616-1069-404b-84f6-4493cf9d9df4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.032728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f616-1069-404b-84f6-4493cf9d9df4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.034917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f616-1069-404b-84f6-4493cf9d9df4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-5284f616-1069-404b-84f6-4493cf9d9df4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:11.055707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:11.056677 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:11.057597 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 297/601] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:11.058580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3421b0f-5762-4ce7-939a-22a33c9b4d21 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.058678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3421b0f-5762-4ce7-939a-22a33c9b4d21 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.060845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3421b0f-5762-4ce7-939a-22a33c9b4d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.078232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e3421b0f-5762-4ce7-939a-22a33c9b4d21 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:11.079450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3421b0f-5762-4ce7-939a-22a33c9b4d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:11.145063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caf68a-c103-4c02-b344-0ebe4c7d224c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.167399 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 298/602] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:11.168337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3421b0f-5762-4ce7-939a-22a33c9b4d21 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.184922 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.213599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.214244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.214709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.215814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.241370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.242842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:11.272915 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:11.273858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:11.274726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:11.274726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:11.274726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:11.276528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 305/603] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:11.279600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.318294 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.370620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3421b0f-5762-4ce7-939a-22a33c9b4d21 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.425498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b80be-8942-4b24-b4a7-ec14ffd1c04e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.440068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.440993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.441525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.442005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.443409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:11.443894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.445535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.459391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 299/604] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:11.467053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.504800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.504800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.504800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.504800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.505296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:11.505296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.506474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.521330 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 306/605] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:11.526656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.561036 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.603629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69329-1750-4494-8e56-6eb76ce88956 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.643901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3ed8-37a3-4a35-817f-a7f89bfc199d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.644717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.647465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.647937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.648391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/1c9c0901260e44a789d750c2032bfbd7/roles/04b947d4d06d4c7080930518a54559c4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.660317 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.672384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=1c9c0901260e44a789d750c2032bfbd7, role_id=04b947d4d06d4c7080930518a54559c4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.674865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.681520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.682192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.682627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.682914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.694800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:11.695379 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 300/606] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:11 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/1c9c0901260e44a789d750c2032bfbd7/roles/04b947d4d06d4c7080930518a54559c4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:11.696459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:11.700040 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:11.701071 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:11.701897 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:11.704974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 307/607] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:11.707969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.816886 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.826847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948df6-74df-452e-b0bc-7c50dc0398ba None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.845358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2175c5-1fa2-4caf-b5dc-d7d997bb5210 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.874190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.874935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.875610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.875610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.876526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:11.876928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.878385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.891450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 308/608] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:11.892681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.893366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.893647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.893920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.897038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.903166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.904831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:11.918689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:11.919773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:11.920644 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 301/609] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:11.926613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.986042 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.051152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553053-6424-43bd-8288-8a198bbe49e5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.052742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2f1cd-56a5-4924-8303-ad807e4fe746 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.090311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.090905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.091185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.091457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.092155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:12.092458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.093951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.097905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.099175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.099458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.099731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.107403 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 302/610] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:12.113003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.113212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.115353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:12.134740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:12.135721 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:12.136594 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:12.136594 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:12.136594 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:12.136761 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 309/611] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:12.146144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.164831 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.285962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b4b5-9da2-41d2-890b-ceb07c20082c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.298452 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.322719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09af2-e416-4e33-a5fa-0f457adbda77 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.330952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33c87d-9704-4c84-9e9a-aa10738c7cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.331742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c87d-9704-4c84-9e9a-aa10738c7cfd None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.332116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c87d-9704-4c84-9e9a-aa10738c7cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.332484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c87d-9704-4c84-9e9a-aa10738c7cfd None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/887449bfd1b64d408d74e60f556b081a/roles/04b947d4d06d4c7080930518a54559c4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.348453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33c87d-9704-4c84-9e9a-aa10738c7cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=887449bfd1b64d408d74e60f556b081a, role_id=04b947d4d06d4c7080930518a54559c4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.350094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33c87d-9704-4c84-9e9a-aa10738c7cfd None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.361162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.361792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.362206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.362486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.363140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:12.363444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.365609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.367178 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 303/612] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:12 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/887449bfd1b64d408d74e60f556b081a/roles/04b947d4d06d4c7080930518a54559c4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:52:12.369954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c05df-4542-41d8-aa22-8aa67a7aeecf None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.370329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c05df-4542-41d8-aa22-8aa67a7aeecf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.370698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c05df-4542-41d8-aa22-8aa67a7aeecf None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.372207 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 304/613] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:12.382131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ec708-540e-495b-b0f4-ba9d8114589c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.382461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ec708-540e-495b-b0f4-ba9d8114589c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.384026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ec708-540e-495b-b0f4-ba9d8114589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.397472 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 310/614] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:12.401791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.420628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7a4ec708-540e-495b-b0f4-ba9d8114589c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:12.422128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7a4ec708-540e-495b-b0f4-ba9d8114589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:12.499212 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.534267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0649-bd72-4f21-af8b-e263fa628fc0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.568728 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 305/615] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:12.577590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.578262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.578541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.578802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.587615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.589110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:12.607565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:12.609675 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:12.611792 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 311/616] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:12.614899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ec708-540e-495b-b0f4-ba9d8114589c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.744956 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.764451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ec708-540e-495b-b0f4-ba9d8114589c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.813233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.814211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.814688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.815164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.816112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:12.816606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.818480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.840319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 306/617] 10.222.0.46 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:12.845342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.889820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.020948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c6ee-9a25-4ec3-a778-7fca37dbca03 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.069882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c204-7794-4614-a238-b48ab7e9234f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.080835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c5aef-2731-4b23-bb88-f27ff5247207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.081785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5aef-2731-4b23-bb88-f27ff5247207 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.082335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5aef-2731-4b23-bb88-f27ff5247207 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.082849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5aef-2731-4b23-bb88-f27ff5247207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.094031 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.101808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c5aef-2731-4b23-bb88-f27ff5247207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.105346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c5aef-2731-4b23-bb88-f27ff5247207 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.109391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73705a8-9515-4ed5-ae68-48fbc799efe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.110029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73705a8-9515-4ed5-ae68-48fbc799efe1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.110302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73705a8-9515-4ed5-ae68-48fbc799efe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.110565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73705a8-9515-4ed5-ae68-48fbc799efe1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.121529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73705a8-9515-4ed5-ae68-48fbc799efe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-cd3c5aef-2731-4b23-bb88-f27ff5247207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:13.125531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:13.126455 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:13.127325 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:13.127325 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:13.127325 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a73705a8-9515-4ed5-ae68-48fbc799efe1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:13.127493 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:13.128396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 307/618] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:13.137414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7029-5abb-44f7-9003-cc794a7c2f80 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.138325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7029-5abb-44f7-9003-cc794a7c2f80 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.138325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7029-5abb-44f7-9003-cc794a7c2f80 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.138325 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 308/619] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:13.139932 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 312/620] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:13.146820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc292475-a715-44d0-9b2c-a5c5182e092d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.147241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc292475-a715-44d0-9b2c-a5c5182e092d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.147644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc292475-a715-44d0-9b2c-a5c5182e092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.149851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7029-5abb-44f7-9003-cc794a7c2f80 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.162177 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.179063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bc292475-a715-44d0-9b2c-a5c5182e092d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:13.180983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bc292475-a715-44d0-9b2c-a5c5182e092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:13.270532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 313/621] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:13.270532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc292475-a715-44d0-9b2c-a5c5182e092d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.272872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7029-5abb-44f7-9003-cc794a7c2f80 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.337501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.338139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.338421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.338691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.339361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:13.339660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.345715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.359272 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 309/622] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:13.365025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.450158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc292475-a715-44d0-9b2c-a5c5182e092d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.470702 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.491581 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.517518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.518134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.518412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.518682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.519345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:13.519706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.521234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.546093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 314/623] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:13.560979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd512e-025e-441b-a609-ea543be1c259 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.566269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.625927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.627709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.628486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.628998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.644363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.647822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:13.666813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:13.668508 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:13.669439 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:13.669439 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:13.669439 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:13.672419 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 310/624] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:13.672419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.687495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d979cc-996c-421b-af7a-27e15d85e6ed None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.732839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.733879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.734479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.735014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.743638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.745628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:13.758592 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:13.759553 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:13.760464 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:13.764126 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 315/625] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:13.765263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.786356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01126ae-78d2-4492-a22f-ce5145c0e6ea None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.799459 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.806463 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.821204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.821843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.822121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.822393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.833308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:13.838446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:13.839344 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:13.840184 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 311/626] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:13.845788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.895189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eccea9-1f5b-4caf-97a0-6fc6bf69fc81 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.938006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.938625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.938902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.939174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.939824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:13.940132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.941538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.959454 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 316/627] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:13.960533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.988440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707336-05fa-4866-9a3e-5fcc34835c1c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.028030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138f55-e759-405d-b357-02f039f61289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.028693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138f55-e759-405d-b357-02f039f61289 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.029493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138f55-e759-405d-b357-02f039f61289 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.029772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138f55-e759-405d-b357-02f039f61289 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.030585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36138f55-e759-405d-b357-02f039f61289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.030895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36138f55-e759-405d-b357-02f039f61289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.032356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36138f55-e759-405d-b357-02f039f61289 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.045051 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 312/628] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.045875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138f55-e759-405d-b357-02f039f61289 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.081835 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.091064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7396c0-8741-460c-ac76-37d1de068ca2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.097187 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.142174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33e861-f343-4b2f-b85f-acab4b7ee27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.143073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33e861-f343-4b2f-b85f-acab4b7ee27b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.143354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33e861-f343-4b2f-b85f-acab4b7ee27b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.143623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33e861-f343-4b2f-b85f-acab4b7ee27b None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.144454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33e861-f343-4b2f-b85f-acab4b7ee27b None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.144739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33e861-f343-4b2f-b85f-acab4b7ee27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.146672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33e861-f343-4b2f-b85f-acab4b7ee27b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.160035 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 317/629] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.160035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b66ba-8cc2-40bc-bc57-3d3f79421bbb None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.160035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b66ba-8cc2-40bc-bc57-3d3f79421bbb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.160035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b66ba-8cc2-40bc-bc57-3d3f79421bbb None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.160035 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 318/630] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:14.160035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b66ba-8cc2-40bc-bc57-3d3f79421bbb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.171797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138f55-e759-405d-b357-02f039f61289 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.207242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.207907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.208181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.208453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.216072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.217565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:14.230105 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:14.231075 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:14.231989 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 313/631] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:14.232604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.279681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b66ba-8cc2-40bc-bc57-3d3f79421bbb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.317046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189ffc2-9cad-4b36-9a6f-a9ecabdf3c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.317708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189ffc2-9cad-4b36-9a6f-a9ecabdf3c33 None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.317974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189ffc2-9cad-4b36-9a6f-a9ecabdf3c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.318246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189ffc2-9cad-4b36-9a6f-a9ecabdf3c33 None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/1eadc3e155df4f5a9f40ae75ee27733f/roles/04b947d4d06d4c7080930518a54559c4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.334087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189ffc2-9cad-4b36-9a6f-a9ecabdf3c33 None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=1eadc3e155df4f5a9f40ae75ee27733f, role_id=04b947d4d06d4c7080930518a54559c4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.335536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189ffc2-9cad-4b36-9a6f-a9ecabdf3c33 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.342756 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.346094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8b35-58cb-41b7-8671-85ab474f32f5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.350736 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 319/632] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:14 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/1eadc3e155df4f5a9f40ae75ee27733f/roles/04b947d4d06d4c7080930518a54559c4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:14.352142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d22ee-f66d-428b-8f1d-ada644c2bbb9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.352554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d22ee-f66d-428b-8f1d-ada644c2bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.353027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d22ee-f66d-428b-8f1d-ada644c2bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.359828 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.375113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a36d22ee-f66d-428b-8f1d-ada644c2bbb9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:14.376523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a36d22ee-f66d-428b-8f1d-ada644c2bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:14.394818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.396226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.396678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.397119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.410047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.412149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:14.430882 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:14.432102 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:14.433172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:14.433172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:14.433172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:14.435275 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 314/633] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:14.436286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.477254 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 320/634] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:14.478855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d22ee-f66d-428b-8f1d-ada644c2bbb9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.560861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81c35b-8142-42aa-8a25-fe725df5ba9e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.606414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761da69-439d-46ac-a4e4-643e979d0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.607024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761da69-439d-46ac-a4e4-643e979d0d04 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.607303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761da69-439d-46ac-a4e4-643e979d0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.607573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761da69-439d-46ac-a4e4-643e979d0d04 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.608413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761da69-439d-46ac-a4e4-643e979d0d04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.608726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761da69-439d-46ac-a4e4-643e979d0d04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.610350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761da69-439d-46ac-a4e4-643e979d0d04 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.615661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d22ee-f66d-428b-8f1d-ada644c2bbb9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.631351 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 315/635] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.632697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f349-2fe6-434c-b5b2-8f6799422de2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.633013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f349-2fe6-434c-b5b2-8f6799422de2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.633293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f349-2fe6-434c-b5b2-8f6799422de2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.639019 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 316/636] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:14.639793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f349-2fe6-434c-b5b2-8f6799422de2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.647916 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.653309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512c41-ca40-4767-9ffb-714270480bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.654140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512c41-ca40-4767-9ffb-714270480bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.654561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512c41-ca40-4767-9ffb-714270480bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.654971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512c41-ca40-4767-9ffb-714270480bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.655219 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.655920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512c41-ca40-4767-9ffb-714270480bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.656376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512c41-ca40-4767-9ffb-714270480bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.657919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512c41-ca40-4767-9ffb-714270480bb8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.670291 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 321/637] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.671791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47b371-77db-45c8-b2d6-cf875f2d5501 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.672221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47b371-77db-45c8-b2d6-cf875f2d5501 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.672662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47b371-77db-45c8-b2d6-cf875f2d5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.691112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ce47b371-77db-45c8-b2d6-cf875f2d5501 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:14.692571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ce47b371-77db-45c8-b2d6-cf875f2d5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:14.762152 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 322/638] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:14.763240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47b371-77db-45c8-b2d6-cf875f2d5501 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.779009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f349-2fe6-434c-b5b2-8f6799422de2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.821890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.822766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.823188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.823604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.869574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47b371-77db-45c8-b2d6-cf875f2d5501 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.895501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.897349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.901137 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.909812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.910499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.910887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.911158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] PATH_INFO: `/v3/users/glance` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.912326 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.921353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.922794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:14.935753 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:14.936976 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:14.938192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:14.941624 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 323/639] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:14.942500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.008281 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 317/640] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:15.009598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.050383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfa387-cc25-44b6-b4c9-6d24cbb916be None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.096112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.097017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.097454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.097885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.113487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:15.122264 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:15.123192 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:15.124012 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 324/641] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:15.126537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.150139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238e2f-6c76-4064-bf40-8536047dc7d7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.163945 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.184265 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.193002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.193705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.194046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.194381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.195167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:15.195527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.197057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.214461 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 318/642] 10.222.0.46 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:15.215417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.252535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9beb2d9-4e39-467a-a198-3658e2c413c4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.286615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.287248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.287529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.287799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.298321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.299773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:15.314097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:15.315106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:15.315987 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:15.315987 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:15.315987 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:15.315987 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 325/643] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:15.315987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.328759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31033dd-d718-4175-8131-2bce78473495 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.366623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.367165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.367437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.367704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.378263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:15.383350 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:15.384267 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:15.385186 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 319/644] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:15.385979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.414721 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.420729 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.430274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb866-c72c-446a-976c-385233fd2920 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.466040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.466647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.466921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.467192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.467859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:15.468157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.469536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.485238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 326/645] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:15.485238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.501647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56714e-3cd5-4391-9aeb-f22f670c3843 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.544746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.545403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.545677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.545945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.594476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c566-12b0-471d-9aae-5371c3f7b3ad None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.620094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.621406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.629174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.629874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.630150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.630443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.631085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:15.631377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.632730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.644420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 327/646] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:15.644420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.655389 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.665964 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.735257 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 320/647] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:15.735257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.756962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d50df-ff79-4857-a6dc-56788bf9eff8 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.793460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228863b-002d-41fd-9370-9c908706703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.794355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228863b-002d-41fd-9370-9c908706703b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.794636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228863b-002d-41fd-9370-9c908706703b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.794908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228863b-002d-41fd-9370-9c908706703b None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.795578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228863b-002d-41fd-9370-9c908706703b None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:15.795876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228863b-002d-41fd-9370-9c908706703b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.797276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228863b-002d-41fd-9370-9c908706703b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.805295 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 328/648] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:15.806102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228863b-002d-41fd-9370-9c908706703b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.845677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51598d58-3043-47d8-8f76-dfe6cc94aac3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.878680 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.888548 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.888875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.890145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.890458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.890730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.901798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.903238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.913755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228863b-002d-41fd-9370-9c908706703b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:15.918375 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:15.919266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:15.925060 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:15.925060 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:15.925060 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:15.925060 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 321/649] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:15.925060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.955635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.956272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.956549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.956852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.963892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.965400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:15.976983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:15.978012 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 329/650] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:15.979235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.037908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd2b71-ef8f-46c9-a1d4-934f4fa1df2c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.073548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.074561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.075026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.075434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.080549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef80ddc-0403-4142-8d41-3bc54f796f3e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.090478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.093285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:16.109689 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:16.110751 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:16.111801 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:16.111801 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:16.111801 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:16.113307 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 322/651] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:16.114399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.120884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.121511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.121789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.122057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.132271 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.137286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.138644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:16.154959 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:16.156086 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:16.162191 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:16.162191 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:16.162191 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:16.162191 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 330/652] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:16.162191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.166359 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.238234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9aa8-79dd-4014-a353-a4d579f097ab None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.262249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93015c9-a858-4f33-9fbe-fd8f2714c150 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.275230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.275842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.276118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.276464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.277486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:16.277486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.278899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.295694 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 323/653] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:16.296521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.298205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.298809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.299089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.299359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.300053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:16.300352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.301844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.320193 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 331/654] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:16.320193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.372986 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.391339 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.400542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a844f3-0703-42b6-a62f-8f580d20a511 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.423474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9210518-fcff-479f-9473-ab338cc30d63 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.435543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.436155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.436421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.436697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.437371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:16.437677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.439083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.454606 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 324/655] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:16.454606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.456834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.457459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.457749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.458014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.458655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:16.458949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.460302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.471878 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 332/656] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:16.472895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.554273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf11fe-f041-4331-9457-1921a74e43ba None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.574340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee09fb-27ca-4e2a-8cbf-dc667739d8b6 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.584659 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.587728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfbcf4-292a-40a0-ab14-5c9bd219c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.588363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfbcf4-292a-40a0-ab14-5c9bd219c258 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.588634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfbcf4-292a-40a0-ab14-5c9bd219c258 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.588935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfbcf4-292a-40a0-ab14-5c9bd219c258 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.596469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfbcf4-292a-40a0-ab14-5c9bd219c258 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.597951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfbcf4-292a-40a0-ab14-5c9bd219c258 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-dcdfbcf4-292a-40a0-ab14-5c9bd219c258 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:16.609576 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:16.610683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:16.611624 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:16.612164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.612164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.612306 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 325/657] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:16.612372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.612372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.612506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3f14-260a-4ac3-9068-e5cea8c942b3 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.612574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=0ffef7873ae44899a84aa7376be7b8b8) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:16.612641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3f14-260a-4ac3-9068-e5cea8c942b3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.612706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.612866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3f14-260a-4ac3-9068-e5cea8c942b3 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.613985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.614427 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 326/658] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:16.615121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3f14-260a-4ac3-9068-e5cea8c942b3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.623133 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 333/659] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/role_assignments?user.id=0ffef7873ae44899a84aa7376be7b8b8&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:16.624134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.644506 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.734604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138881-344f-468e-a101-8de77ad8d42e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.749707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3f14-260a-4ac3-9068-e5cea8c942b3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.772357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.773054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.773331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.773596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.782439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.783876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.790879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa1dd-baad-47e7-990b-d12c98bd8f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.791504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa1dd-baad-47e7-990b-d12c98bd8f8d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.791781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa1dd-baad-47e7-990b-d12c98bd8f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.792042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa1dd-baad-47e7-990b-d12c98bd8f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:16.795508 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:16.796625 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 334/660] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:16.797851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.809599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa1dd-baad-47e7-990b-d12c98bd8f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.811117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa1dd-baad-47e7-990b-d12c98bd8f8d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0d1fa1dd-baad-47e7-990b-d12c98bd8f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:16.823669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:16.824608 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:16.825773 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 327/661] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:16.826316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1823e32-869e-4c7b-87b3-a95471fa304d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.826316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1823e32-869e-4c7b-87b3-a95471fa304d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.826448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1823e32-869e-4c7b-87b3-a95471fa304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.846851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a1823e32-869e-4c7b-87b3-a95471fa304d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:16.848503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a1823e32-869e-4c7b-87b3-a95471fa304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:16.849474 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.918876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0757b9-dcdb-4842-ac18-c5b5f1e672d4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:16.922033 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 328/662] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:16.922903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1823e32-869e-4c7b-87b3-a95471fa304d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:16.925392 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:16.977606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:16.978908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.979885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.980294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.981478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:16.981990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:16.984544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.004544 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 335/663] 10.222.0.46 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:17.005491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.044629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1823e32-869e-4c7b-87b3-a95471fa304d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.092939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.094079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.094504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.095294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.096176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:17.096638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.098886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.102588 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.113398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91359-df44-4b04-b048-dbcf0a3dad55 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.125241 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 329/664] 10.222.0.46 () {56 vars in 1139 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:17.126986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.159194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.159999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.160402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.161110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.161895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:17.163057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.168497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.190724 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 336/665] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:17.191785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.208949 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.252189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e97837-d62c-4257-89c8-36948b217172 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.289312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.289915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.290184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.290448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.298062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7ddc1-1ebc-4252-ac1d-c7ab0e778b00 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.334655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.335563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.335847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.336151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.360035 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.361938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.363660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.407830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.409319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.424969 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.475664 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 330/666] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:17.477135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.520917 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 337/667] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:17.520917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.578908 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.583205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b7986-0476-439b-8597-f3f30f0c7d98 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.618142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.618861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.619132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.619399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.627061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd5f05-e17a-4b2b-8fde-c00fda742942 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.632272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:17.636991 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:17.637915 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:17.638749 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 331/668] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:17.641430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.665804 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.667997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.668608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.669488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.669488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.669893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=9fff798abd7e4970977c2465aaed01b9) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:17.670261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.671705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.684801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 338/669] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/role_assignments?user.id=9fff798abd7e4970977c2465aaed01b9&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:17.684801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.767183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc0a7-0e80-490c-8fc2-dcefe96e59cf None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.810238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.810878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.811151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.811419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.826598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.828501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.831568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564dc0-296e-41df-9504-0da8cf31cd80 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:17.845424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:17.846582 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:17.847635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:17.847635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:17.847635 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:17.849595 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 332/670] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:17.850662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.856820 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.880372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.881330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.881609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.881883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.899126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.899126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:17.914723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:17.915881 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:17.917029 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:17.917029 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:17.917029 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:17.917739 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 339/671] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:17.920964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.940412 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.979702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b911c-9680-4aa9-92b6-d1cebbb3afe0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.025603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.026565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.027251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.027663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.028482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.028949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.030892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.042640 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 333/672] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.043714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0428f-b9df-44ce-8399-09631c1c9603 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.044014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.083674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.084535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.084980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.085389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.086191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.086782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.088286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.101363 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 340/673] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.102408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.140531 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.165426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bafc6-cb9c-4cb1-86a8-f66787068fa4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.204492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.205375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.205823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.206280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.207156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.207847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.209505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.211259 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.216499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab5b4-7f4d-4987-8111-f9b34513d2ef None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.229171 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 334/674] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.230350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.252160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.252817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.253090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.253359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.263807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.265271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:18.280711 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:18.281870 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:18.282812 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:18.282812 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:18.282812 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:18.282812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 341/675] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:18.283048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.354695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61a37-9f99-46be-b44d-4e4a29285167 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.375188 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.398953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.399838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.400253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.400406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098c8d-d258-432d-b262-cf008f28c9bc None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.400865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.409869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.412259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:18.427846 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:18.428906 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:18.429945 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:18.430366 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 335/676] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:18.431060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.441060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.441749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.442028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.442722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.451227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.452986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:18.468745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:18.469916 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:18.470984 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:18.474955 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 342/677] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:18.475826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.503238 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.567053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3154bc-28e3-4760-9d77-bd8bd0d92424 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.597887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4032e39-0982-48e4-ac5e-0722dbf14706 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.611484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.612548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.613006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.613695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.615021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.615472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.617475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.633360 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 336/678] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.634516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.637095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58af3d-fe1e-465c-b40b-579d3a7a398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.637871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58af3d-fe1e-465c-b40b-579d3a7a398a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.638154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58af3d-fe1e-465c-b40b-579d3a7a398a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.638416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58af3d-fe1e-465c-b40b-579d3a7a398a None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.639943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58af3d-fe1e-465c-b40b-579d3a7a398a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.640252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58af3d-fe1e-465c-b40b-579d3a7a398a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.641726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58af3d-fe1e-465c-b40b-579d3a7a398a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.654035 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.658402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 343/679] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.659972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3bd0a-19b9-498d-b0da-03ec50d0f19f None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.660246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3bd0a-19b9-498d-b0da-03ec50d0f19f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.660686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3bd0a-19b9-498d-b0da-03ec50d0f19f None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.664810 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 344/680] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:18.664810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3bd0a-19b9-498d-b0da-03ec50d0f19f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.745371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8baffe-07b9-4645-8e7a-c561e4a09704 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.761454 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.770336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3bd0a-19b9-498d-b0da-03ec50d0f19f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.783876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.784635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.784942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.785216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.786432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.786878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.788318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.805813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 337/681] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.805813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.813389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712ebd-13c5-4882-807d-3a9535a3c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.814138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712ebd-13c5-4882-807d-3a9535a3c036 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.814572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712ebd-13c5-4882-807d-3a9535a3c036 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.814935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712ebd-13c5-4882-807d-3a9535a3c036 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.824235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7712ebd-13c5-4882-807d-3a9535a3c036 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.825767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7712ebd-13c5-4882-807d-3a9535a3c036 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-c7712ebd-13c5-4882-807d-3a9535a3c036 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:18.839358 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:18.840636 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:18.841841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:18.842522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 345/682] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:18.843551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a217f-eb88-4d52-a903-0c6190ac4ce5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.843826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a217f-eb88-4d52-a903-0c6190ac4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.844087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a217f-eb88-4d52-a903-0c6190ac4ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.863419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-112a217f-eb88-4d52-a903-0c6190ac4ce5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:18.864901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-112a217f-eb88-4d52-a903-0c6190ac4ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:18.914292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f500-68b2-42c7-aa99-4a8888b06d6f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.932023 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.947860 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 346/683] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:18.949029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a217f-eb88-4d52-a903-0c6190ac4ce5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.970593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.971983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.972676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.973146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.974257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=1c9c0901260e44a789d750c2032bfbd7) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.974736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.977174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.992807 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 338/684] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/role_assignments?user.id=1c9c0901260e44a789d750c2032bfbd7&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.992807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.068106 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.121944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a217f-eb88-4d52-a903-0c6190ac4ce5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.190967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520384a-b1ce-4ede-b575-3c0abddeacb5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.200268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.201482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.201779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.202038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.202744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=887449bfd1b64d408d74e60f556b081a) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:19.203042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.204463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.211801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 347/685] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/role_assignments?user.id=887449bfd1b64d408d74e60f556b081a&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:19.247149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.247785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.248058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.248329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.249121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:19.249424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.250987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.271253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.276057 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 339/686] 10.222.0.46 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:19.285278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.339729 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.402761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063071-a3c4-40e2-944f-d560734c40ff None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.422709 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.431167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4bb1-b612-4f2e-bb39-46dc48a4e882 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.445569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.446259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.446538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.446810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.461278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:19.466960 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:19.467982 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:19.468936 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 348/687] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:19.474973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.478973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.480805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.481294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.481756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.560624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.562219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.595977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031c236-30ed-480c-a8e4-5db467d65226 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.612252 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.637926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.638635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.638977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.639315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.640051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:19.640417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.642104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.652238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 349/688] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:19.657960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.695762 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.711846 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 340/689] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:19.718008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.762213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a956a03-b314-420f-b819-d16c2a36d11d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.805930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863c77-e4d9-46ff-9e22-3e0ccfab012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.806767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863c77-e4d9-46ff-9e22-3e0ccfab012c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.807053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863c77-e4d9-46ff-9e22-3e0ccfab012c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.807325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863c77-e4d9-46ff-9e22-3e0ccfab012c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.818602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863c77-e4d9-46ff-9e22-3e0ccfab012c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.821664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863c77-e4d9-46ff-9e22-3e0ccfab012c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-40863c77-e4d9-46ff-9e22-3e0ccfab012c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:19.835065 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:19.836081 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:19.837030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:19.837030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:19.837030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:19.837030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 350/690] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:19.837723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439c4e-1f1e-40c5-9248-8af5d02b7f7a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.840789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439c4e-1f1e-40c5-9248-8af5d02b7f7a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.840789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439c4e-1f1e-40c5-9248-8af5d02b7f7a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.840789 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 351/691] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:19.843722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439c4e-1f1e-40c5-9248-8af5d02b7f7a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.881294 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.882965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f26b93-833f-4d72-9c0c-692fe6052d6e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.920060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5c570-8e7f-48f8-b3e5-a907755c3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.920612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5c570-8e7f-48f8-b3e5-a907755c3225 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.920964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5c570-8e7f-48f8-b3e5-a907755c3225 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.921237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5c570-8e7f-48f8-b3e5-a907755c3225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.932499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5c570-8e7f-48f8-b3e5-a907755c3225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.933834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5c570-8e7f-48f8-b3e5-a907755c3225 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e7d5c570-8e7f-48f8-b3e5-a907755c3225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:19.949707 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:19.950700 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:19.951667 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:19.951667 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:19.951667 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:19.951667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 341/692] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:19.952315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b457d91-8725-401e-94b9-1fc60906e648 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.952562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b457d91-8725-401e-94b9-1fc60906e648 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.957433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b457d91-8725-401e-94b9-1fc60906e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.978746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8b457d91-8725-401e-94b9-1fc60906e648 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:19.980975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8b457d91-8725-401e-94b9-1fc60906e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:19.984140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439c4e-1f1e-40c5-9248-8af5d02b7f7a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.023686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.024305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.024580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.024877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.025575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:20.025881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.027294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.041278 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.044606 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 352/693] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:20.045669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.084722 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 342/694] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:20.085739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b457d91-8725-401e-94b9-1fc60906e648 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.157266 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.174139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921877f3-58fa-46d2-b39a-96c77aa4f45c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.216830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b457d91-8725-401e-94b9-1fc60906e648 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.221068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.221779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.222151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.222514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.223312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:20.223707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.225716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.241974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 353/695] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:20.248241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.265022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.265761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.266041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.266308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.282516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.284053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:20.305853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:20.307069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:20.308309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 343/696] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:20.314580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.394121 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.453728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35907-1012-4483-bb0e-d40540de5c71 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.460789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636ee7-efac-492b-a952-c70e9ea23eb3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.492674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.493579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.493956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.494362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.496189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.496940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.497313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.497586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.498314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:20.498616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.500180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.501519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.503168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:20.515694 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:20.516922 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 354/697] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:20.518067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.524307 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 344/698] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:20.525253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.534266 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.643700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9a05d-5cb8-4850-96b7-1166229ff90f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.644192 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.652742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0c00-8189-443b-9b3b-ae5c9c9cdde5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.686634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.687566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.687844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.688188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.694236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.694853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.695131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.695406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.696107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:20.696955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.698874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.700038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.702164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.715210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 345/699] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:20.715997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:20.725834 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:20.728376 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:20.729980 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:20.729980 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.729980 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:20.729980 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 355/700] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:20.729980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.816066 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.840472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24067d66-329d-473c-8f81-48a6204f5cd8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.873860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1b7b-31b0-4703-9e8a-3876565e9766 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.877824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.878448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.878772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.879181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.908454 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.918397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.919013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.919288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.919563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.920554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=1eadc3e155df4f5a9f40ae75ee27733f) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:20.921012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.922490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.937114 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 356/701] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/role_assignments?user.id=1eadc3e155df4f5a9f40ae75ee27733f&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:20.939022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.984731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.986169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.146967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a2f9f-0681-4420-ad1e-b6cd7508c3ce None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.157420 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 346/702] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:21.165904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.178094 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.192693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.195017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.195204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.195456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.196063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:21.196370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.198054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.227446 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 357/703] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:21.237207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.254815 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.312463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072e5d6-0d4e-4670-8722-6bfba981c4d8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.349775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594316d-914a-481a-841a-c93b7af11172 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.353711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9afb9-51c5-46bc-8f52-ee7699d8a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.354425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9afb9-51c5-46bc-8f52-ee7699d8a43a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.354770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9afb9-51c5-46bc-8f52-ee7699d8a43a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.355107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9afb9-51c5-46bc-8f52-ee7699d8a43a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.366948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9afb9-51c5-46bc-8f52-ee7699d8a43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.368442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9afb9-51c5-46bc-8f52-ee7699d8a43a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-58b9afb9-51c5-46bc-8f52-ee7699d8a43a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:21.384540 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:21.385773 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:21.386853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:21.386853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:21.386853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:21.389801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd9c1d-0fa5-47ab-a4e3-4275cc8f85b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.390503 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 347/704] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:21.391003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9c1d-0fa5-47ab-a4e3-4275cc8f85b0 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.391560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9c1d-0fa5-47ab-a4e3-4275cc8f85b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.392099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9c1d-0fa5-47ab-a4e3-4275cc8f85b0 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.392449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bbe06-4ee8-4f6d-9f03-a04f5d7e03a2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.392903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bbe06-4ee8-4f6d-9f03-a04f5d7e03a2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.393269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd9c1d-0fa5-47ab-a4e3-4275cc8f85b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.393490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bbe06-4ee8-4f6d-9f03-a04f5d7e03a2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.395022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd9c1d-0fa5-47ab-a4e3-4275cc8f85b0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.395340 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 348/705] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:21.400943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bbe06-4ee8-4f6d-9f03-a04f5d7e03a2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.422456 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 358/706] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:21 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:21.424056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7067db-5529-4ef2-b9c3-179e6eb71ead None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.424426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7067db-5529-4ef2-b9c3-179e6eb71ead None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.424832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7067db-5529-4ef2-b9c3-179e6eb71ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.444532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3a7067db-5529-4ef2-b9c3-179e6eb71ead None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:21.445911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a7067db-5529-4ef2-b9c3-179e6eb71ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:21.483859 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.522376 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 359/707] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:21.533201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bbe06-4ee8-4f6d-9f03-a04f5d7e03a2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.543388 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.572069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e1144-1f47-4950-8793-0a563f426b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.573032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1144-1f47-4950-8793-0a563f426b56 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.573453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1144-1f47-4950-8793-0a563f426b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.573891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1144-1f47-4950-8793-0a563f426b56 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.574705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1144-1f47-4950-8793-0a563f426b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:21.575148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1144-1f47-4950-8793-0a563f426b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.576785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1144-1f47-4950-8793-0a563f426b56 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.590681 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 349/708] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:21.596640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7067db-5529-4ef2-b9c3-179e6eb71ead None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.724371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a077a0-db32-4ec0-825b-5e0306ce0dde None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.724738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a077a0-db32-4ec0-825b-5e0306ce0dde None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.724942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a077a0-db32-4ec0-825b-5e0306ce0dde None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.726486 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 350/709] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:21.732946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562591-b99b-4548-9add-390ead7acfde None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.732946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562591-b99b-4548-9add-390ead7acfde None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.732946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562591-b99b-4548-9add-390ead7acfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.753473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7067db-5529-4ef2-b9c3-179e6eb71ead None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.757525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-20562591-b99b-4548-9add-390ead7acfde None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:21.758055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-20562591-b99b-4548-9add-390ead7acfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:21.796472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.797648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.798177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.798646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.807076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.808925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:21.821822 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:21.822748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:21.823628 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:21.826066 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 360/710] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:21.833855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.856875 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 351/711] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:21.866345 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.930564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562591-b99b-4548-9add-390ead7acfde None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.984503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6660a-364b-4e45-a986-0af343df6dc8 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.051207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.051747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.052014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.052278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.053010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.053313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.054759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.058499 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.062552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562591-b99b-4548-9add-390ead7acfde None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.073029 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 361/712] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.074820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.145532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.146185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.146469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.146739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.147328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.148731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:22.159515 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:22.160617 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:22.161485 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 352/713] 10.222.0.46 () {56 vars in 1129 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:22.162378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.183855 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.195442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3501-3362-42d7-b61c-8b9d8654a08d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.232508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.233247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.233674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.233943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.234698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=0ffef7873ae44899a84aa7376be7b8b8) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.235000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.236702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.248877 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 362/714] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/role_assignments?user.id=0ffef7873ae44899a84aa7376be7b8b8&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:22.249896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.287337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ee39-f22a-43c8-873b-c447661a9c24 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.333016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.333682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.338645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.339059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] PATH_INFO: `/v3/services/network` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.339791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.341559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:22.354457 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:22.356750 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:22.358719 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:22.360423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 353/715] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:22.364790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.399330 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.497679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2247cc-cb8e-4840-9e1a-9d0a82ba7bad None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.499860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8641df-7e8c-4ca7-a6ad-7aafc4fb9185 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.537377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.537987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.538263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.538530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.539165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.539464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.540853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.545524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.546136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.546403 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 363/716] 10.222.0.46 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.546577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.546759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.547503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] RBAC: Adding query filter params (name=network) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.547809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.549213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.551961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.560878 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 354/717] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.562903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.582311 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.732790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234203-4c78-4d45-8aa8-d65f1a0173ea None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.737359 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.754405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15c055-6190-405c-a474-74e6474a15fb None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.796146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57406-ba19-489b-87cb-2ef8b5d9a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.796748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57406-ba19-489b-87cb-2ef8b5d9a934 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.797044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57406-ba19-489b-87cb-2ef8b5d9a934 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.797314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57406-ba19-489b-87cb-2ef8b5d9a934 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.797947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57406-ba19-489b-87cb-2ef8b5d9a934 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.798244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57406-ba19-489b-87cb-2ef8b5d9a934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.799608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57406-ba19-489b-87cb-2ef8b5d9a934 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.810807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 364/718] 10.222.0.46 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:22.831207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22c00d-5f37-4a65-8490-c432dd0efaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.831849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c00d-5f37-4a65-8490-c432dd0efaea None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.832233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c00d-5f37-4a65-8490-c432dd0efaea None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.832449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c00d-5f37-4a65-8490-c432dd0efaea None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.833139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22c00d-5f37-4a65-8490-c432dd0efaea None admin] RBAC: Adding query filter params (type=network) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.833542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22c00d-5f37-4a65-8490-c432dd0efaea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.834972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22c00d-5f37-4a65-8490-c432dd0efaea None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.848183 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 355/719] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:23.482630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cea57-38ae-46e9-ba83-3f9ee105ccbc None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.483265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cea57-38ae-46e9-ba83-3f9ee105ccbc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.483265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cea57-38ae-46e9-ba83-3f9ee105ccbc None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.484843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 365/720] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:23.490567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a96a-96aa-4bbc-b233-1454435b62fb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.491080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a96a-96aa-4bbc-b233-1454435b62fb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.491237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a96a-96aa-4bbc-b233-1454435b62fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.516946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2ce2a96a-96aa-4bbc-b233-1454435b62fb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:23.518153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ce2a96a-96aa-4bbc-b233-1454435b62fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:23.608293 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 356/721] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:23.818979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d30cb-eb0e-471a-8746-2094923fe07a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.819259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d30cb-eb0e-471a-8746-2094923fe07a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.819714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d30cb-eb0e-471a-8746-2094923fe07a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.821544 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 366/722] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:23.826570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeea9a-438b-498f-866a-09368ec82b9f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.827014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeea9a-438b-498f-866a-09368ec82b9f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.827437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeea9a-438b-498f-866a-09368ec82b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.854066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-abeeea9a-438b-498f-866a-09368ec82b9f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:23.855513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-abeeea9a-438b-498f-866a-09368ec82b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:23.947201 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 357/723] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:23.971541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d30cb-eb0e-471a-8746-2094923fe07a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.122002 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.150625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d30cb-eb0e-471a-8746-2094923fe07a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.212496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.213467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.213884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.214156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.235246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:24.240451 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:24.241394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:24.242224 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:24.244306 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 367/724] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:24.249319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeea9a-438b-498f-866a-09368ec82b9f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.283966 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.316637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.380807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeea9a-438b-498f-866a-09368ec82b9f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.415896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.416527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.416824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.417095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.417789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:24.418087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.419514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.430015 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 358/725] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:24.435465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.505656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba461f7-da47-4b4c-bd42-9a6b375db043 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.542139 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.565604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63d57b-11fe-42a9-911b-1978b0318a95 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.577484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.578131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.578412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.578690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.600666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.601340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.601614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.601880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.609729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:24.613004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.614693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:24.615225 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:24.616145 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:24.617038 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 368/726] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:24.623922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:24.629587 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:24.630562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:24.631533 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:24.631533 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:24.631533 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:24.631533 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 359/727] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:24.632450 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.638646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.741402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809ea32-b06b-431f-8742-c941bf64d5b5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.769107 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.778094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df143dd-4b35-4243-834f-34640e2ce1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.778858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df143dd-4b35-4243-834f-34640e2ce1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.779226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df143dd-4b35-4243-834f-34640e2ce1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.779586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df143dd-4b35-4243-834f-34640e2ce1b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.780321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df143dd-4b35-4243-834f-34640e2ce1b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:24.780712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df143dd-4b35-4243-834f-34640e2ce1b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.782208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df143dd-4b35-4243-834f-34640e2ce1b9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.793808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d630a2-9796-430e-ac96-e35994bbaed6 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.800741 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 360/728] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:24.800741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018affb-40f8-41d9-bf76-a7c61350b28f None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.800741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018affb-40f8-41d9-bf76-a7c61350b28f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.800741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018affb-40f8-41d9-bf76-a7c61350b28f None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.800741 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 361/729] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:24.800741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018affb-40f8-41d9-bf76-a7c61350b28f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.839373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84256-2fb4-458e-a768-60d9ef96e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.839986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84256-2fb4-458e-a768-60d9ef96e85e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.840284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84256-2fb4-458e-a768-60d9ef96e85e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.840787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84256-2fb4-458e-a768-60d9ef96e85e None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.841856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84256-2fb4-458e-a768-60d9ef96e85e None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:24.842170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84256-2fb4-458e-a768-60d9ef96e85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.843780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84256-2fb4-458e-a768-60d9ef96e85e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.859189 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 369/730] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:24.859189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f99e1-4114-4451-937c-c80f869d09c4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.859189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f99e1-4114-4451-937c-c80f869d09c4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.859189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f99e1-4114-4451-937c-c80f869d09c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.879774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c16f99e1-4114-4451-937c-c80f869d09c4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:24.881746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c16f99e1-4114-4451-937c-c80f869d09c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:24.935057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018affb-40f8-41d9-bf76-a7c61350b28f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.963398 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.973317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.974288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.980790 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 370/731] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:24.980946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.981040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f99e1-4114-4451-937c-c80f869d09c4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.981723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.997538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.999355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:25.016838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:25.017816 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:25.018732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:25.021411 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 362/732] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:25.027340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.120226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f99e1-4114-4451-937c-c80f869d09c4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.134596 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.169579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02a1d0-d003-46d2-8868-9f72e5fef9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.170203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02a1d0-d003-46d2-8868-9f72e5fef9dd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.170476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02a1d0-d003-46d2-8868-9f72e5fef9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.170741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02a1d0-d003-46d2-8868-9f72e5fef9dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.191549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02a1d0-d003-46d2-8868-9f72e5fef9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.193727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02a1d0-d003-46d2-8868-9f72e5fef9dd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-8f02a1d0-d003-46d2-8868-9f72e5fef9dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:25.213616 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:25.214604 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:25.215492 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:25.215492 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:25.215492 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:25.215492 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 371/733] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:25.216943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94491-90ff-4ab8-ae53-f0e96160fd7e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.217487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94491-90ff-4ab8-ae53-f0e96160fd7e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.217591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94491-90ff-4ab8-ae53-f0e96160fd7e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.220006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285cc87-d802-49e7-b449-cc5d3dc70f42 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.220137 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 372/734] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:25.226465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94491-90ff-4ab8-ae53-f0e96160fd7e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.268269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275470c4-292d-4f0c-a543-4e397738bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.268915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275470c4-292d-4f0c-a543-4e397738bc54 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.269213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275470c4-292d-4f0c-a543-4e397738bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.269586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275470c4-292d-4f0c-a543-4e397738bc54 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.271044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275470c4-292d-4f0c-a543-4e397738bc54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:25.271357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275470c4-292d-4f0c-a543-4e397738bc54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.272969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275470c4-292d-4f0c-a543-4e397738bc54 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.302152 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 363/735] 10.222.0.46 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:25.302152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841538-ceff-4898-b389-ae36da30e4af None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.302152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841538-ceff-4898-b389-ae36da30e4af None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.302152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841538-ceff-4898-b389-ae36da30e4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.302559 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.328321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9f841538-ceff-4898-b389-ae36da30e4af None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:25.329830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9f841538-ceff-4898-b389-ae36da30e4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:25.371139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94491-90ff-4ab8-ae53-f0e96160fd7e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.401343 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 364/736] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:25.402140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841538-ceff-4898-b389-ae36da30e4af None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.405248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.405857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.406129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.406393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.407030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:25.407327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.408681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.427768 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 373/737] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:25.427768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.439614 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.513227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841538-ceff-4898-b389-ae36da30e4af None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.538475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d174d9d-cb84-4c71-a2af-fd82dae8be26 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.546229 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.550047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.550683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.551039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.551309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.575293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e3d12-56df-4968-8be8-72395fd49d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.575920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3d12-56df-4968-8be8-72395fd49d97 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.576195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3d12-56df-4968-8be8-72395fd49d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.576461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3d12-56df-4968-8be8-72395fd49d97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.586415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e3d12-56df-4968-8be8-72395fd49d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-978e3d12-56df-4968-8be8-72395fd49d97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:25.591075 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:25.592168 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:25.593018 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 374/738] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:25.593818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda158a1-a30f-4b6b-9832-ac575eca5d4e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.594097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda158a1-a30f-4b6b-9832-ac575eca5d4e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.594366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda158a1-a30f-4b6b-9832-ac575eca5d4e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.595692 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 375/739] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:25.596292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda158a1-a30f-4b6b-9832-ac575eca5d4e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.632217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.633791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.669030 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.702069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda158a1-a30f-4b6b-9832-ac575eca5d4e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.735530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023f3d9-d58f-4bb7-84fa-1a44cb9aea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.735746 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 365/740] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:25.736159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f3d9-d58f-4bb7-84fa-1a44cb9aea06 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.736351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.736458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f3d9-d58f-4bb7-84fa-1a44cb9aea06 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.736685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f3d9-d58f-4bb7-84fa-1a44cb9aea06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.745937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023f3d9-d58f-4bb7-84fa-1a44cb9aea06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.747388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023f3d9-d58f-4bb7-84fa-1a44cb9aea06 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-b023f3d9-d58f-4bb7-84fa-1a44cb9aea06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:25.758859 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:25.759799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:25.760791 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 376/741] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:25.761401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b32140-ca37-4cfc-89b3-9cc248ca0bac None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.761478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b32140-ca37-4cfc-89b3-9cc248ca0bac None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.762026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b32140-ca37-4cfc-89b3-9cc248ca0bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.779424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-96b32140-ca37-4cfc-89b3-9cc248ca0bac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:25.780608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-96b32140-ca37-4cfc-89b3-9cc248ca0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:25.800261 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.839197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f4c-7f84-4cd8-9c7d-c3663df20942 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.846975 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 377/742] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:25.847944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b32140-ca37-4cfc-89b3-9cc248ca0bac None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.873008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.873613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.873887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.874176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.874802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:25.875098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.876451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.878623 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.889581 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 366/743] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:25.889581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.967915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b32140-ca37-4cfc-89b3-9cc248ca0bac None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.989069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3f73d-b999-4241-b30b-5b10f6f29650 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.005472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.006086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.006362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.006630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.007279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.008808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.022940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.023577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.023840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.024143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.025817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 378/744] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:25 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:26.026669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.044809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.044809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.052585 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:26.057967 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:26.059000 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:26.059905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:26.059905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:26.059905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:26.063995 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 367/745] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:26.064930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.122279 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.174380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb61ec1-3ef5-4e2d-8ade-e42c358bdc9d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.184418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf7a8-01e0-489e-92ba-7bf807298f29 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.217277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.217904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.218236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.218456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.219215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:26.219521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.221037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.227352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.228495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.228940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.229362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.240432 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 379/746] 10.222.0.46 () {56 vars in 1149 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:26.240935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.241314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.242757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:26.260050 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:26.261351 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:26.262253 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:26.262253 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:26.262253 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:26.262253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 368/747] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:26.262904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.321423 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.358109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c725c-905c-43aa-bd23-4a96c14cad2b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.365222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392abaa-2134-4455-a4df-a43bb75c0c95 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.366765 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.397507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.398097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.398370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.398642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.399283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:26.399584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.400979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.402188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.402984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.403459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.403732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.404375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.405766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.413050 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 380/748] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:26.417671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.423744 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 369/749] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:26 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:26.428830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.537818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eef0f-4028-442b-b739-834b7ef20c35 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.572410 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.586167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.586167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.586581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.586951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.591133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49bcc-05d3-4f00-a4ba-d529579cbd7a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.631387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.632005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.632280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.632549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.633234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:26.633532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.634910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.648817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 370/750] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:26.649454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.672052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.673548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.676238 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.778411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58760c-e04e-4f6d-9cbc-0b08392516db None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.799517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 381/751] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:52:26.799517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.823204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.823983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.824405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.824785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.831668 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.831818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.833420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:26.846396 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:26.847298 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:26.848720 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:26.851249 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 371/752] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:26.853053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.916243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f39f-3369-47a8-b356-3ba2c6a5572a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.949059 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.957404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.958505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.959015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.959463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.967943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:26.969774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:26.977974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf987eec-e8ce-44cb-9231-dcc0985dc0a1 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:26.982953 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:26.983871 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:26.985215 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 382/753] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:26.985798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.024366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.025275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.025690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.026094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.040463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.042185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:27.062381 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:27.063549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:27.064642 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:27.064642 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:27.064642 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:27.071193 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 372/754] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:27.071193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.081487 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.098260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5414f-5911-455c-8170-00b4b04d81c5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.143309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.144037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.144415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.145237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.146223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.146629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.148179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.162581 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 383/755] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:27.163447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.213989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce938f90-3958-4f69-bcc3-e61f5225d695 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.254298 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.263855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.264786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.265203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.265614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.266478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.267435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.269332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.280610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb5864-b312-40f7-a315-b08946bf105d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.292833 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 373/756] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:27.294527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.326961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.327894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.328311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.328902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.329992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.330566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.332482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.352105 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 384/757] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:27.352105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.363808 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.416151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923369-e071-4b54-a395-81ce665c872f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.453562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.454169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.454445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.454719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.455442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=1eadc3e155df4f5a9f40ae75ee27733f) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.455760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.457524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.464148 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 374/758] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/role_assignments?user.id=1eadc3e155df4f5a9f40ae75ee27733f&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:27.464981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.469502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da668cd-fb2b-4553-aec3-6f5cda83ca79 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.507142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.508163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.508631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.509127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.521793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.523645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.527123 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:27.539720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:27.540731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:27.541632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:27.541632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:27.541632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:27.543922 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 385/759] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:27.551295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.584505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35501b7-af4e-44fa-a990-ac1314e5a0b7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.626760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.627522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.627709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.627968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.641275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.642790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:27.663588 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:27.664523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:27.665585 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 375/760] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:27.673425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.687604 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.734085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e72072-f15f-4706-b1b8-cfefa1ce770b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.768815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.769264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.769777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.770154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.776792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.776792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.776792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.785761 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 386/761] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:27.790821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.835991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f19fd-e817-4bb0-95b5-4c37bac4d812 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.853377 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.897035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.897653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.897952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.898207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.898913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.899220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.900680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.928239 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 376/762] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:27.934130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.945166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d0c4d-efe4-4fe7-bb80-737ae20886cd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.969461 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.981431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.982082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.982364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.982644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.990811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.992272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:28.004666 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:28.005665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:28.006974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 387/763] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:28.011850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.114960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29288f-1d39-4c3f-9cc9-2102b511879e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.152366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afd9d1-266b-445e-9e53-3a1da94a47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.153011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afd9d1-266b-445e-9e53-3a1da94a47b4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.153291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afd9d1-266b-445e-9e53-3a1da94a47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.153564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afd9d1-266b-445e-9e53-3a1da94a47b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.154265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afd9d1-266b-445e-9e53-3a1da94a47b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:28.154570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afd9d1-266b-445e-9e53-3a1da94a47b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.155196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff5926-5e11-4b47-b2d7-fcbc58c4b6fe None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.156010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afd9d1-266b-445e-9e53-3a1da94a47b4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.169354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 388/764] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:28.175543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf352d8-ea89-4f58-98ba-fdabf579538a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.175866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf352d8-ea89-4f58-98ba-fdabf579538a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.176145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf352d8-ea89-4f58-98ba-fdabf579538a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.177746 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 389/765] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:28.178462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf352d8-ea89-4f58-98ba-fdabf579538a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.193689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8145c-be54-4b9e-90f8-ca7ee009ad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.194647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8145c-be54-4b9e-90f8-ca7ee009ad4a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.195112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8145c-be54-4b9e-90f8-ca7ee009ad4a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.195582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8145c-be54-4b9e-90f8-ca7ee009ad4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.196506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8145c-be54-4b9e-90f8-ca7ee009ad4a None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=ececa74a5c554c85b42f85ed93be05fc) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:28.197045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8145c-be54-4b9e-90f8-ca7ee009ad4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.198648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8145c-be54-4b9e-90f8-ca7ee009ad4a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.212732 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 377/766] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/role_assignments?user.id=ececa74a5c554c85b42f85ed93be05fc&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:28.214872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eda78-8991-4db2-9474-27a0d6ea7aaf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.215328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eda78-8991-4db2-9474-27a0d6ea7aaf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.215769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eda78-8991-4db2-9474-27a0d6ea7aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.222194 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:28.243590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-238eda78-8991-4db2-9474-27a0d6ea7aaf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:28.253409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-238eda78-8991-4db2-9474-27a0d6ea7aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:28.290946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf352d8-ea89-4f58-98ba-fdabf579538a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.306980 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:28.332791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa5f1-20ea-4bea-a1db-40d2703bb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.333845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa5f1-20ea-4bea-a1db-40d2703bb52a None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.334304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa5f1-20ea-4bea-a1db-40d2703bb52a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.334720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa5f1-20ea-4bea-a1db-40d2703bb52a None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/0ffef7873ae44899a84aa7376be7b8b8/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.337061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa5f1-20ea-4bea-a1db-40d2703bb52a None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=0ffef7873ae44899a84aa7376be7b8b8, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.338814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa5f1-20ea-4bea-a1db-40d2703bb52a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.358162 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 390/767] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:28 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/0ffef7873ae44899a84aa7376be7b8b8/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:28.403684 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 378/768] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:28.650007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f862-e32f-4b24-92a9-754a6d10c223 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.650527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f862-e32f-4b24-92a9-754a6d10c223 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.650946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f862-e32f-4b24-92a9-754a6d10c223 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.652499 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 391/769] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:28.662867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e420e-a1db-4079-8ffb-7ae0419cd1ae None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.663800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e420e-a1db-4079-8ffb-7ae0419cd1ae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.664231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e420e-a1db-4079-8ffb-7ae0419cd1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.686836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ca5e420e-a1db-4079-8ffb-7ae0419cd1ae None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:28.688324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ca5e420e-a1db-4079-8ffb-7ae0419cd1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:28.694040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f862-e32f-4b24-92a9-754a6d10c223 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.816828 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 379/770] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:28.872149 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:28.877338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f862-e32f-4b24-92a9-754a6d10c223 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.922036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.922570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.922899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.923172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.923753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.925127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:28.941602 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:28.942584 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:28.943430 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:28.945661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 392/771] 10.222.0.46 () {56 vars in 1129 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:28.950694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e420e-a1db-4079-8ffb-7ae0419cd1ae None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.077758 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.083957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e420e-a1db-4079-8ffb-7ae0419cd1ae None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.108875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.122206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.122924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.123199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.123465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.124096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:29.124393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.131387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.141831 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 380/772] 10.222.0.46 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:29.147969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.294686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee852b-0b8f-478f-a277-64a05f3a9b35 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.349440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.350058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.350336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.350609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.351278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:29.351813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.356789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.359838 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 381/773] 10.222.0.46 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:29.372475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e561c-97c7-41bc-b92c-2a45d0206f51 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.373771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.413694 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.417496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.418147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.418441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.418699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] PATH_INFO: `/v3/services/network` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.419294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.420683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:29.441785 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:29.442816 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:29.444393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 393/774] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/services/network => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:29.457571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.497565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21600-18af-4104-9790-8aed9b1020af None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.514161 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.534201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.534823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.535271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.535740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.536579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] RBAC: Adding query filter params (interface=public, service_id=ecb7375ac7774b1bb69ed3ed73259f7e, region_id=RegionOne) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:29.536914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.538395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.547608 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 382/775] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/endpoints?service_id=ecb7375ac7774b1bb69ed3ed73259f7e&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:29.555097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.665258 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.679060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbfb5a-1b1a-46ea-990b-9931a98fd2b8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.716314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca317541-528f-46f4-a959-a0daa159cff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.717024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca317541-528f-46f4-a959-a0daa159cff7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.717303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca317541-528f-46f4-a959-a0daa159cff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.717849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca317541-528f-46f4-a959-a0daa159cff7 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.718468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca317541-528f-46f4-a959-a0daa159cff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.720618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca317541-528f-46f4-a959-a0daa159cff7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.723001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36937a-4146-4815-91cc-e699ec224e44 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.728097 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 383/776] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:29.778004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15b3e-a1bb-49fb-b452-4e2d4a78b335 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.778544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15b3e-a1bb-49fb-b452-4e2d4a78b335 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.779105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15b3e-a1bb-49fb-b452-4e2d4a78b335 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.782139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 384/777] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:29.787354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e323-ef22-4743-8e83-08bd0590fcd3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.787895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e323-ef22-4743-8e83-08bd0590fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.788000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.788464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e323-ef22-4743-8e83-08bd0590fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.788611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.788893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.789164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.789804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] RBAC: Adding query filter params (name=network) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:29.790101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.791525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.805635 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 394/778] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:29.811936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.817669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-39f3e323-ef22-4743-8e83-08bd0590fcd3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:29.824449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-39f3e323-ef22-4743-8e83-08bd0590fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:29.950701 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 385/779] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:29.965047 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.975417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ee17-78d9-4e4c-bb54-4c14b6e2828b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.010853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.011452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.011730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.012000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.012639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] RBAC: Adding query filter params (type=network) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:30.012970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.014335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.019669 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 395/780] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:30.025198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e323-ef22-4743-8e83-08bd0590fcd3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.170281 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.192469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e323-ef22-4743-8e83-08bd0590fcd3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.244449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.245104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.245383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.245656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.246369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] RBAC: Adding query filter params (interface=public, service_id=3b04e75278194ed896d65c296ea16fe1, region_id=RegionOne) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:30.246675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.248060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.253726 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 386/781] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/endpoints?service_id=3b04e75278194ed896d65c296ea16fe1&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:30.259513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.321753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.440269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ca6ec-ff9e-4199-83ae-b51be50d7959 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.525440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391bc7b-9b98-47ec-b519-435cb42b4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.526056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391bc7b-9b98-47ec-b519-435cb42b4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.526449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391bc7b-9b98-47ec-b519-435cb42b4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.526721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391bc7b-9b98-47ec-b519-435cb42b4ae8 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.528074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391bc7b-9b98-47ec-b519-435cb42b4ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.529501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391bc7b-9b98-47ec-b519-435cb42b4ae8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.541723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c8116-2f21-4ee6-b448-16f7adb51691 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.543519 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 396/782] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/services => generated 772 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:30.587039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4720-a7d4-4760-bf7a-a5e679ed0585 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.587563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4720-a7d4-4760-bf7a-a5e679ed0585 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.587977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4720-a7d4-4760-bf7a-a5e679ed0585 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.589555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 397/783] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:30.595770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31825-6090-468d-9f1d-1cf2c562ce0d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.596289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31825-6090-468d-9f1d-1cf2c562ce0d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.596702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31825-6090-468d-9f1d-1cf2c562ce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.613028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.614075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.614417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.614694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.623558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-43d31825-6090-468d-9f1d-1cf2c562ce0d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:30.630459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-43d31825-6090-468d-9f1d-1cf2c562ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:30.633371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:30.638456 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:30.639397 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:30.640231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:30.643083 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 387/784] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:30.650743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.658813 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.665134 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.756955 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 398/785] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:30.782487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad85c60-3296-43fe-a633-6a9ac2112c37 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.803229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e7c8-e1d9-4178-9127-6c0a27b50588 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.803563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e7c8-e1d9-4178-9127-6c0a27b50588 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.803813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e7c8-e1d9-4178-9127-6c0a27b50588 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.805499 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 399/786] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:30.810982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5ba4-15ef-4449-bfec-d26ba38fb38a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.811262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5ba4-15ef-4449-bfec-d26ba38fb38a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.811533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5ba4-15ef-4449-bfec-d26ba38fb38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.824104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.824736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.825022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.825292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.826062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:30.826362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.827852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.837475 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 388/787] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:30.842132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3aab5ba4-15ef-4449-bfec-d26ba38fb38a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:30.843035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.843159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3aab5ba4-15ef-4449-bfec-d26ba38fb38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:30.945185 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 400/788] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:30.964194 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.009008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23077-484e-4a37-a90e-d0f705f66ae3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.044346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.045009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.045288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.045555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.056925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.058374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.069680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5ba4-15ef-4449-bfec-d26ba38fb38a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:31.072987 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.073902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:31.075326 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:31.075326 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:31.075326 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:31.075326 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 389/789] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:31.084683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.228698 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.270112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5ba4-15ef-4449-bfec-d26ba38fb38a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.272761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1767-25ba-4003-99b1-2e4b4882ceaa None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.310679 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.324547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.325262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.325543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.325813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.326077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.326747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.327090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.327526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.328341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:31.328705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.330166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.336339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:31.341251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.342356 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 401/790] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:31.343561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.344612 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 390/791] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:31.353825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.459757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab7068-d8fc-43c3-ac1f-d820ce026130 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.473614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478b7c-088f-46ed-a05d-199675b9c1bb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.497304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.498088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.498485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.498856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.500165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:31.500634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.502568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.514187 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 391/792] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:31.515191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.515830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.516467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.516743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.517040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.526253 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.532624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:31.539283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.540251 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:31.541143 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 402/793] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:31.545372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.572054 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.644236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1658e33-be89-4aad-bddc-9df14dd0b86c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.678467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654f1cc-3fde-48fe-b110-b8220e104e22 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.689583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.690854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.691699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.692417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.702339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.704831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:31.719478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.720484 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:31.721464 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:31.721993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.721993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.721993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.721993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.724672 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 392/794] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:31.725736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.734798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.736383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:31.754371 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.755387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:31.756276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:31.756276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:31.756276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:31.756276 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 403/795] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:31.756529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.810298 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.866930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b6ee-2b0d-4637-b391-afa6036bf805 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.871272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d5e5e-d2de-4d26-946a-e3a8f0a09f0d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.872414 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.910218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.911122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.911548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.911970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.912176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.912800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.913081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.913345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.913513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:31.913991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.914098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:31.914362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.915765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.915884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.927763 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 393/796] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:31.928989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.939929 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 404/797] 10.222.0.46 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:31.940816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.051399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6c60b-1ddb-47c4-9b23-b14e571f894d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.052515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2b9b5-aeec-4582-aa86-eaf67e4545d0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.062634 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.087574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.088271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.088548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.088839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.089390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95555f-7ebe-45e1-afb0-291e7d6ec02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.089521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:32.089755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.090013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95555f-7ebe-45e1-afb0-291e7d6ec02a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.090287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95555f-7ebe-45e1-afb0-291e7d6ec02a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.090555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95555f-7ebe-45e1-afb0-291e7d6ec02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.091108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.101450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95555f-7ebe-45e1-afb0-291e7d6ec02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.103167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95555f-7ebe-45e1-afb0-291e7d6ec02a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.104491 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 394/798] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:32.106264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-de95555f-7ebe-45e1-afb0-291e7d6ec02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:32.120050 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.121093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:32.122028 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:32.122028 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.122028 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:32.125287 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 405/799] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.127100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115da3-eb90-4258-914b-687114b2c972 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.127388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115da3-eb90-4258-914b-687114b2c972 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.127663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115da3-eb90-4258-914b-687114b2c972 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.129560 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 406/800] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:32.130282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115da3-eb90-4258-914b-687114b2c972 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.141885 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.219481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dedb4-86fd-471c-8258-c502269ee77e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.239796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115da3-eb90-4258-914b-687114b2c972 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.256908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.257610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.257839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.258110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.269234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.270880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.275156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9721f59-106f-4412-b70c-5574677914a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.275786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9721f59-106f-4412-b70c-5574677914a0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.276059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9721f59-106f-4412-b70c-5574677914a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.276324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9721f59-106f-4412-b70c-5574677914a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.283822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9721f59-106f-4412-b70c-5574677914a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.285328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9721f59-106f-4412-b70c-5574677914a0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:32.287523 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.288440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:32.294650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:32.294650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.294650 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:32.294650 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 395/801] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.294650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-b9721f59-106f-4412-b70c-5574677914a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:32.303440 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.304390 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 407/802] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad8663-4107-4264-9093-7b68783107bf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.310246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad8663-4107-4264-9093-7b68783107bf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.311974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad8663-4107-4264-9093-7b68783107bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.326689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4fad8663-4107-4264-9093-7b68783107bf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:32.327803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4fad8663-4107-4264-9093-7b68783107bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:32.343338 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.382868 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.403876 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 408/803] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:32.404544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad8663-4107-4264-9093-7b68783107bf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.420080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579b7e-392a-4bec-8ccc-a929f9b04417 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.455258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.455959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.456235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.456502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.457574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:32.457860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.459604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.477440 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 396/804] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:32.478277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.544302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad8663-4107-4264-9093-7b68783107bf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.584253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.584793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.585086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.585354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.586204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:32.586322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.587707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.597273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebac0c-04a6-42a2-a644-979f8be6d694 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.604869 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 409/805] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:32.605974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.619313 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.648617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.650143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.650644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.651131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.652456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:32.653387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.655572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.659584 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.678645 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 397/806] 10.222.0.46 () {56 vars in 1149 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:32.679900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.715468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba4cf-deb7-4c5f-9be9-dc151554c0c5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.748705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.749362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.749639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.749909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.757508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.758957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:32.770318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.771334 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 410/807] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.772254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.793416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3694-e3c4-4a66-89a9-9d371081acdb None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.828422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.829093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.829368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.829636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.836655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.838074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.841609 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:32.849425 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.850512 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:32.851424 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 398/808] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.851905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.875758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8e509-cf70-4a6d-b4a0-c15bf28915f0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.908572 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.909168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28597160-a0bf-4242-97dd-61a9a260f0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.909450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597160-a0bf-4242-97dd-61a9a260f0de None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.909784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597160-a0bf-4242-97dd-61a9a260f0de None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.910073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597160-a0bf-4242-97dd-61a9a260f0de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.910912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28597160-a0bf-4242-97dd-61a9a260f0de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.912334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28597160-a0bf-4242-97dd-61a9a260f0de None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-28597160-a0bf-4242-97dd-61a9a260f0de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.921202 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.922151 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:32.923236 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 411/809] 10.222.0.46 () {56 vars in 1129 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.924347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1e1e1-151a-4863-bb8f-8849cbf43cea None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.924347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1e1e1-151a-4863-bb8f-8849cbf43cea None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.924347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1e1e1-151a-4863-bb8f-8849cbf43cea None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.928807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 412/810] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:32.928807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1e1e1-151a-4863-bb8f-8849cbf43cea None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.958544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0b7c-9b83-46ba-98af-fa24b14c2c9f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.992359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.993010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.993249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.993518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.004235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.005538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:33.020038 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:33.021047 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:33.021937 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:33.021937 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:33.021937 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:33.021937 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 399/811] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:33.021937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.033433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1e1e1-151a-4863-bb8f-8849cbf43cea None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.069375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.069982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.070257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.070522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.071244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.071542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.073020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.074626 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.091837 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 413/812] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.092564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.135113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc13e88-17d7-4e81-96c1-733667c838ab None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.142311 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.170687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e482ee7-d2a0-410f-b427-c2e43c31d976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.171292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e482ee7-d2a0-410f-b427-c2e43c31d976 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.171572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e482ee7-d2a0-410f-b427-c2e43c31d976 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.171840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e482ee7-d2a0-410f-b427-c2e43c31d976 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.172543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e482ee7-d2a0-410f-b427-c2e43c31d976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.172874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e482ee7-d2a0-410f-b427-c2e43c31d976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.174340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e482ee7-d2a0-410f-b427-c2e43c31d976 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.186753 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 400/813] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.187918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f00e-2869-4c14-948f-29371c620922 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.188201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f00e-2869-4c14-948f-29371c620922 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.188472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f00e-2869-4c14-948f-29371c620922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.194052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97386-2eb4-467b-8417-181248c933a5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.206660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5e06f00e-2869-4c14-948f-29371c620922 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:33.207983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5e06f00e-2869-4c14-948f-29371c620922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:33.230347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.230961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.231243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.231516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.232124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.232457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.233870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.243181 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 414/814] 10.222.0.46 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.243181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.283418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 401/815] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:33.284262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06f00e-2869-4c14-948f-29371c620922 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.302670 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.351819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d87a-ebd8-4886-af15-b779bb4825cd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.386576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.387182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.387462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.387732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.388368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.388669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.390182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.391854 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.399179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06f00e-2869-4c14-948f-29371c620922 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.407644 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 415/816] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.407644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.434599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.435225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.435499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.435763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.511929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.513680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.608487 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.615576 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 402/817] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:52:33.616488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.630597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65bcf1-9014-43ed-8ff6-3d8b9d850cf4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.647273 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.666574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.667228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.667499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.667765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/1eadc3e155df4f5a9f40ae75ee27733f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.669688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=1eadc3e155df4f5a9f40ae75ee27733f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.671108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.684026 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 416/818] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:33 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/1eadc3e155df4f5a9f40ae75ee27733f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:33.684848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.722053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a56c-9560-46d4-913a-00848c9c231d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.761498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.762129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.762404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.762675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.763323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.763628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.765074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.771002 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 403/819] 10.222.0.46 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.771868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.818199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f00cc-c277-4706-920a-351f3ac59b1c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.843754 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.858192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.858885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.859112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.859378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.867699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.869181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:33.880638 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:33.881561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 417/820] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:33.883278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.894824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa7ce8-9e65-49ba-8c96-eaa0d98e335a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.920000 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.932238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.932909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.933183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.933543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] PATH_INFO: `/v3/services/network` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.934020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.935389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:33.944149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:33.945198 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:33.946049 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 404/821] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:33.946853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.998761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcb412-39a5-43fc-afce-2d57347011ff None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.036830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.037707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.038047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.038655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.051796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.053268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.053396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f55bb-e532-4c00-9ee0-bbebf2c85256 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:34.068562 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:34.069618 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:34.070502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:34.070502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:34.070502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:34.070502 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 418/822] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:34.070502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.086324 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.101998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.102924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.103167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.103448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.104321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.105548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.141214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 405/823] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:52:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:34.142485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.182137 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.197140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432ecc-6d35-41aa-a373-5bccdaf49684 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.246641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.247675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.248216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.248704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.249778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:34.250319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.252050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.267209 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 419/824] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:34.268572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.391565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e341c-41c3-4b6e-89ab-5d693e9533c5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.391870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74482-86d9-4e82-8ff9-9e9d4d905873 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.428683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.429329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.429597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.429870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.430506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] RBAC: Adding query filter params (name=network) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:34.430808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.432262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.436948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.437343 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 406/825] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:34.437554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.437831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.438098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.438200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.438737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:34.439033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.440391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.455225 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 420/826] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:34.456631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.492184 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.501108 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.554880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510835-e5f5-40b9-9c67-8184106fc820 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.587458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cc597-7fc0-48f4-9094-94fd04967757 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.591210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.591570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.591945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.592310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/ececa74a5c554c85b42f85ed93be05fc/roles/04b947d4d06d4c7080930518a54559c4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.607870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=ececa74a5c554c85b42f85ed93be05fc, role_id=04b947d4d06d4c7080930518a54559c4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.609480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.626775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.627005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 407/827] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:34 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/ececa74a5c554c85b42f85ed93be05fc/roles/04b947d4d06d4c7080930518a54559c4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:34.633082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.633265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.633265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.633265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.633265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] RBAC: Adding query filter params (type=network) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:34.633265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.633265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.651270 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 421/828] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:34.656185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.788964 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.809751 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.824344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140347-5fc7-49ae-a6d8-116038cd9cf8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.838053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97887a4-6ffe-4c48-8e23-d2b34b69dceb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.865493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.866533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.866817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.867080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.876103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.877570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.880560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.881773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.882250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.882737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.883612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.885259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:34.888881 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:34.889747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:34.890686 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 408/829] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:34.904876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.936952 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 422/830] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:52:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:35.136746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ffb8-186c-45d5-80c4-b8f231f1d561 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:35.219943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28841ccd-a3f0-4873-b881-9138a365c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:35.220485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841ccd-a3f0-4873-b881-9138a365c9dd None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.220780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841ccd-a3f0-4873-b881-9138a365c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.221069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841ccd-a3f0-4873-b881-9138a365c9dd None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.221766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28841ccd-a3f0-4873-b881-9138a365c9dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:35.222071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28841ccd-a3f0-4873-b881-9138a365c9dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:35.224235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28841ccd-a3f0-4873-b881-9138a365c9dd None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:35.245485 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 409/831] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:35.256717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:35.379956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd25af-949c-4060-ba71-16c0aa439d43 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:35.421187 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:35.433787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371739f-e2ca-4405-89c2-cffb0f9ef61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:35.434416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371739f-e2ca-4405-89c2-cffb0f9ef61a None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.434684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371739f-e2ca-4405-89c2-cffb0f9ef61a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.434987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371739f-e2ca-4405-89c2-cffb0f9ef61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.435877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371739f-e2ca-4405-89c2-cffb0f9ef61a None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=0ffef7873ae44899a84aa7376be7b8b8) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:35.436177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371739f-e2ca-4405-89c2-cffb0f9ef61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:35.437650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371739f-e2ca-4405-89c2-cffb0f9ef61a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:35.447426 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 423/832] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:35 2022] GET /identity/v3/role_assignments?user.id=0ffef7873ae44899a84aa7376be7b8b8&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:35.833737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322115-32bd-4bf2-936a-819e5c186a7e None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.834012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322115-32bd-4bf2-936a-819e5c186a7e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.834285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322115-32bd-4bf2-936a-819e5c186a7e None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.835998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 410/833] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:35.841522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242706d5-a1e8-419a-b503-7e461215d77f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.841914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242706d5-a1e8-419a-b503-7e461215d77f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.842277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242706d5-a1e8-419a-b503-7e461215d77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.861416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-242706d5-a1e8-419a-b503-7e461215d77f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:35.862645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-242706d5-a1e8-419a-b503-7e461215d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:35.932917 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 424/834] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:36.197275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77322115-32bd-4bf2-936a-819e5c186a7e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.210244 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.301342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77322115-32bd-4bf2-936a-819e5c186a7e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.336336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda8ed9-4ffc-428a-981e-bb09a9c9210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.336983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8ed9-4ffc-428a-981e-bb09a9c9210e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.337253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8ed9-4ffc-428a-981e-bb09a9c9210e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.337517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8ed9-4ffc-428a-981e-bb09a9c9210e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.347859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda8ed9-4ffc-428a-981e-bb09a9c9210e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-9fda8ed9-4ffc-428a-981e-bb09a9c9210e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:36.356890 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:36.357920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:36.358838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:36.359565 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 411/835] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:36.366773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242706d5-a1e8-419a-b503-7e461215d77f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.461696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae7d9-dcb2-4bf8-bc06-db51ae7740b7 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.461696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae7d9-dcb2-4bf8-bc06-db51ae7740b7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.461953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae7d9-dcb2-4bf8-bc06-db51ae7740b7 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.464024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 412/836] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:36.472792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4cac9-a948-45c5-937e-9f9bf816daf0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.472792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4cac9-a948-45c5-937e-9f9bf816daf0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.472792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4cac9-a948-45c5-937e-9f9bf816daf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.473080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242706d5-a1e8-419a-b503-7e461215d77f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.489724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ccb4cac9-a948-45c5-937e-9f9bf816daf0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:36.491254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ccb4cac9-a948-45c5-937e-9f9bf816daf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:36.497670 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.513302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.517492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.517767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.518038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.518724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:36.519026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.520657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.547483 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 425/837] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:36.548517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.568595 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.582690 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 413/838] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:36.662347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907b793-e168-414a-9e6b-dba020fbff33 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.697692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.698335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.698610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.698879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.710389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.711953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:36.726900 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:36.728152 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:36.729057 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:36.729057 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:36.729057 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:36.729057 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 426/839] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:36.735494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4cac9-a948-45c5-937e-9f9bf816daf0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.838556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4cac9-a948-45c5-937e-9f9bf816daf0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.850391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.881798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d498c8-3bfd-4dcf-a85b-b1fb73c261de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.882409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d498c8-3bfd-4dcf-a85b-b1fb73c261de None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.882686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d498c8-3bfd-4dcf-a85b-b1fb73c261de None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.882948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d498c8-3bfd-4dcf-a85b-b1fb73c261de None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.883585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d498c8-3bfd-4dcf-a85b-b1fb73c261de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:36.883878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d498c8-3bfd-4dcf-a85b-b1fb73c261de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.884389 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.885689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d498c8-3bfd-4dcf-a85b-b1fb73c261de None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.897935 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 414/840] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:36.899152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e6b4b-d024-4316-9a7d-01dcbef95245 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.899426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e6b4b-d024-4316-9a7d-01dcbef95245 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.899693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e6b4b-d024-4316-9a7d-01dcbef95245 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.901391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 415/841] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:36.903151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e6b4b-d024-4316-9a7d-01dcbef95245 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.964616 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.969013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6633d4-4e92-49e6-a7aa-3fb664292bde None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.007442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00fab-959e-4811-bd21-6f0d699928f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.008180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00fab-959e-4811-bd21-6f0d699928f7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.008396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e6b4b-d024-4316-9a7d-01dcbef95245 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.008500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00fab-959e-4811-bd21-6f0d699928f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.008719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00fab-959e-4811-bd21-6f0d699928f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.009333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00fab-959e-4811-bd21-6f0d699928f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.010942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00fab-959e-4811-bd21-6f0d699928f7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-11d00fab-959e-4811-bd21-6f0d699928f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:37.020542 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:37.021561 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:37.022469 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 427/842] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:37.023285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada31ff-ad98-4ce7-84a9-c120225ec02f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.023285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada31ff-ad98-4ce7-84a9-c120225ec02f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.023939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada31ff-ad98-4ce7-84a9-c120225ec02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.042039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dada31ff-ad98-4ce7-84a9-c120225ec02f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:37.043227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dada31ff-ad98-4ce7-84a9-c120225ec02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:37.049520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.050147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.050440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.050707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.058869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.060286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:37.071747 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:37.072876 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:37.073815 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:37.074348 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 416/843] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:37.074730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.118525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 428/844] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:37.119370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada31ff-ad98-4ce7-84a9-c120225ec02f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.156830 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.202492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ec9e8-d53a-41ee-9ad0-36188d22335c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.226752 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.244601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.245849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.246579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.247490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.248616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:37.249227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.251609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.253430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada31ff-ad98-4ce7-84a9-c120225ec02f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.262244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 417/845] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:37.263276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.293282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.294255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.294727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.295189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.296171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:37.296723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.298412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.320371 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 429/846] 10.222.0.46 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:37.326544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.372269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e07fe5-89c2-42b0-ac89-c0387b4ccf26 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.407615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.408223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.408494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.408757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.409419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:37.409712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.411157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.415758 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 418/847] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:37.416532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.437865 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.458144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b9b6d-0d5e-4272-93ab-83163eb8dcb6 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.474748 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.501398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e825cc9-4620-4afe-a037-ecd1e4c9bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.501930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825cc9-4620-4afe-a037-ecd1e4c9bc15 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.502203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825cc9-4620-4afe-a037-ecd1e4c9bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.502465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825cc9-4620-4afe-a037-ecd1e4c9bc15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.541187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac11b2-246a-4d3f-9b1d-ef9001642c64 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.581194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e825cc9-4620-4afe-a037-ecd1e4c9bc15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.582837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e825cc9-4620-4afe-a037-ecd1e4c9bc15 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.585813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ece4b3-14e2-4706-a62d-8445a5812f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.586686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ece4b3-14e2-4706-a62d-8445a5812f0d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.587156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ece4b3-14e2-4706-a62d-8445a5812f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.587424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ece4b3-14e2-4706-a62d-8445a5812f0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.601967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ece4b3-14e2-4706-a62d-8445a5812f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-88ece4b3-14e2-4706-a62d-8445a5812f0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:37.607423 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:37.608417 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:37.609355 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 419/848] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:37.610074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6648-6668-4530-8d28-9321035c2e4c None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.610641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6648-6668-4530-8d28-9321035c2e4c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.610641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6648-6668-4530-8d28-9321035c2e4c None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.617177 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 420/849] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:37.617715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6648-6668-4530-8d28-9321035c2e4c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.681069 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.704062 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 430/850] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:52:37.704062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2258-8782-47a8-a327-c5418111e36c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.704062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2258-8782-47a8-a327-c5418111e36c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.704062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2258-8782-47a8-a327-c5418111e36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.719779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e36e2258-8782-47a8-a327-c5418111e36c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:37.721007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e36e2258-8782-47a8-a327-c5418111e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:37.741760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6648-6668-4530-8d28-9321035c2e4c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.752156 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.781322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.782415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.782923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.783385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.784128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:37.784432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.786682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.800795 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 431/851] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:37.800795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e2258-8782-47a8-a327-c5418111e36c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.801081 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 421/852] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:37.801081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.921368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e2258-8782-47a8-a327-c5418111e36c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.937329 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.944154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9b7b0-0fb7-492e-9579-1d4850ace4c2 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.961854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.962631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.963295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.963429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.975226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.976896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.988932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.989786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.990206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.990614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:37.993778 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:37.994983 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:37.995947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:37.995947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:37.995947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:38.001282 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 432/853] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:38.002774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.004870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.006775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:38.025789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:38.026785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:38.027669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:38.027669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:38.027669 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:38.031884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 422/854] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:38.033248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.060475 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.137143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a365f-7a76-49e8-8f2f-a7478543bcd6 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.145915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605777f0-12ed-4c67-b313-a57ae4e2ef7a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.172720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.173346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.173618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.173883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.174640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.174940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.176443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.180210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.180833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.181113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.181383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.182017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.182315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.183662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.193078 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 433/855] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:38.193785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.197267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 423/856] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.198205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.225876 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.286935 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.306923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f8580-6131-4fc5-8bf4-06ae1bcb3e36 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.307777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1bfb6-6550-4788-ba63-521509be5b4f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.341319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.341950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.342232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.342488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.342826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.343065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.343562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.343832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.344095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.344435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.350946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.352660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:38.353300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:38.354214 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:38.355098 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 434/857] 10.222.0.46 () {56 vars in 1132 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:38.355889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:38.370202 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:38.371146 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:38.372043 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 424/858] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:38.373044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.460408 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.471947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b035e5-bdce-4bbc-bde1-72d354123ee4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.485545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da320f-4547-493b-a25c-64607c8e5361 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.510138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.510780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.511156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.511322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.521141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.522584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.523718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.524544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.525074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.525401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.526039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.526332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.527671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.537210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 425/859] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.537210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:38.537414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:38.538314 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:38.539259 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 435/860] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:38.540470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.548889 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.643254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eedac2-d332-4f7e-b102-732299bd86aa None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.649640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519ab56-e7e2-44ce-8852-b1cd7f83cd20 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.679458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.680338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.680699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.680987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.681671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.681951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.683365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.689081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.689682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.689958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.690221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.690840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.691312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.692733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.696123 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 426/861] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.697158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.697383 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 436/862] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.711658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.730549 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.783995 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.826428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc923da-0d5a-4e70-bc9f-ee10cfc16b10 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.853609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74c44-570a-44a8-b62a-7b1cb2755796 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.870586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.871545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.871958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.873436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.874364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.874671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.876112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.894992 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 427/863] 10.222.0.46 () {56 vars in 1149 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.898116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.898736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.899011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.899280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.900123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=1eadc3e155df4f5a9f40ae75ee27733f) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.900430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.901260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.902021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.908702 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 437/864] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/role_assignments?user.id=1eadc3e155df4f5a9f40ae75ee27733f&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:39.024422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92df5ad-220d-44fc-aeb9-288c169ab6bd None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.052595 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.067382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3115b3-8ea6-478a-b3a4-0d881b9053a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.067990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3115b3-8ea6-478a-b3a4-0d881b9053a0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.068257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3115b3-8ea6-478a-b3a4-0d881b9053a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.068520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3115b3-8ea6-478a-b3a4-0d881b9053a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.140141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3115b3-8ea6-478a-b3a4-0d881b9053a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.141630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3115b3-8ea6-478a-b3a4-0d881b9053a0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.253999 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 428/865] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:52:39.256812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.339793 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.346587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eefc5a-37b6-4351-9615-86aa4cfb1793 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.346587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eefc5a-37b6-4351-9615-86aa4cfb1793 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.346587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eefc5a-37b6-4351-9615-86aa4cfb1793 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.346587 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 429/866] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:39.350049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886551c-47f7-4772-826b-08c99a592cf4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.350338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886551c-47f7-4772-826b-08c99a592cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.351141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886551c-47f7-4772-826b-08c99a592cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.366338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf033d-f1cd-41f4-90a8-ac897cc740dc None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.369936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3886551c-47f7-4772-826b-08c99a592cf4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:39.371138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3886551c-47f7-4772-826b-08c99a592cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:39.392142 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.404039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.404852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.404986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.405283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.416578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.418067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:39.432392 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:39.433445 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:39.434713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:39.434713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:39.434713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:39.434713 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 438/867] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:39.439327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.454916 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 430/868] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:39.547110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7379-b7d7-4be8-bd95-d6c9a023a3c2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.577185 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.582678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.583297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.583573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.583846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.584488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:39.584807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.586185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.598554 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 439/869] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:39.604553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886551c-47f7-4772-826b-08c99a592cf4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.710750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886551c-47f7-4772-826b-08c99a592cf4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.719266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.753067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.754422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.754891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.755459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.762521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.764205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:39.775516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:39.776420 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:39.777352 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:39.779763 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 431/870] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:39.786287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.804178 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.830530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915621-224b-4abd-abb9-8bddb74c177b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.868596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.869343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.869611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.869875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.870532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.871953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.897116 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 440/871] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:39 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:39.907766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119264-0271-4f29-917f-36b3b16e5178 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.954717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f79c-bbc1-4ad6-97b7-96ea18b3fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.955503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f79c-bbc1-4ad6-97b7-96ea18b3fa74 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.955784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f79c-bbc1-4ad6-97b7-96ea18b3fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.956055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f79c-bbc1-4ad6-97b7-96ea18b3fa74 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.956929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f79c-bbc1-4ad6-97b7-96ea18b3fa74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:39.957281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f79c-bbc1-4ad6-97b7-96ea18b3fa74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.958804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f79c-bbc1-4ad6-97b7-96ea18b3fa74 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.974434 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 432/872] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:39.981134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:40.047125 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:40.105665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d4575-f291-4191-8c4b-7d7322b185f2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:40.147691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613f57d-6c19-47ad-b230-766750d99aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:40.148328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613f57d-6c19-47ad-b230-766750d99aca None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.148596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613f57d-6c19-47ad-b230-766750d99aca None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.148898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613f57d-6c19-47ad-b230-766750d99aca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.149660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613f57d-6c19-47ad-b230-766750d99aca None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=ececa74a5c554c85b42f85ed93be05fc) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:40.149966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613f57d-6c19-47ad-b230-766750d99aca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:40.151447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613f57d-6c19-47ad-b230-766750d99aca None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:40.158561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 441/873] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/role_assignments?user.id=ececa74a5c554c85b42f85ed93be05fc&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:40.807605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ba569-0df9-4970-93ea-646f17dffa12 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.807605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ba569-0df9-4970-93ea-646f17dffa12 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.807605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ba569-0df9-4970-93ea-646f17dffa12 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.817528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 433/874] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:40.817682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fb4f-054c-4de7-aacc-e782d3477f59 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.817682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fb4f-054c-4de7-aacc-e782d3477f59 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.817682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fb4f-054c-4de7-aacc-e782d3477f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.834809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bb79fb4f-054c-4de7-aacc-e782d3477f59 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:40.836311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb79fb4f-054c-4de7-aacc-e782d3477f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:40.910942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 442/875] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:41.027898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45242-24c3-461b-934f-6bdde4c6abbe None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.028248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45242-24c3-461b-934f-6bdde4c6abbe None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.028433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45242-24c3-461b-934f-6bdde4c6abbe None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.030070 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 434/876] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:41.036046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e1a71-5c77-420b-a9eb-7be390c99085 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.036331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e1a71-5c77-420b-a9eb-7be390c99085 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.036603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e1a71-5c77-420b-a9eb-7be390c99085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.057364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a06e1a71-5c77-420b-a9eb-7be390c99085 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:41.058663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a06e1a71-5c77-420b-a9eb-7be390c99085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:41.106355 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.135141 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 443/877] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:41.182575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45242-24c3-461b-934f-6bdde4c6abbe None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.257078 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.289092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45242-24c3-461b-934f-6bdde4c6abbe None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.325492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.326121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.326389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.326716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.327383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.328789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.352946 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 435/878] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:41 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:41.426780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e1a71-5c77-420b-a9eb-7be390c99085 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.537029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e1a71-5c77-420b-a9eb-7be390c99085 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.576556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.577143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.577419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.577689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.578273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.579758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:41.589231 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:41.590362 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:41.591261 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 444/879] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:41.599150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.711283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04497f61-406c-4dc5-9f68-2b4c96074a9b None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.740594 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.746237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31c88a-c89f-4d49-9cee-75bfa1e819f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.746850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c88a-c89f-4d49-9cee-75bfa1e819f6 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.747124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c88a-c89f-4d49-9cee-75bfa1e819f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.747389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c88a-c89f-4d49-9cee-75bfa1e819f6 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.748072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31c88a-c89f-4d49-9cee-75bfa1e819f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:41.748368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31c88a-c89f-4d49-9cee-75bfa1e819f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.749811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31c88a-c89f-4d49-9cee-75bfa1e819f6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.755911 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 436/880] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:41.765943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.804039 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.876544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012767e-d83f-4e81-96d4-c7273ad0e4c7 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.902098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a6f3-54c8-42ff-9f35-d6a10f2f9b4a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.902612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a6f3-54c8-42ff-9f35-d6a10f2f9b4a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.902922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a6f3-54c8-42ff-9f35-d6a10f2f9b4a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.905150 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 437/881] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:41.910755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a95c3-d69e-42d7-8f22-0ea78ed1427d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.911052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a95c3-d69e-42d7-8f22-0ea78ed1427d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.911708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a95c3-d69e-42d7-8f22-0ea78ed1427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.916146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d0f08-42ec-4047-a56f-31720decfc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.916751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d0f08-42ec-4047-a56f-31720decfc15 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.917067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d0f08-42ec-4047-a56f-31720decfc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.917333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d0f08-42ec-4047-a56f-31720decfc15 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.918071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d0f08-42ec-4047-a56f-31720decfc15 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:41.918240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d0f08-42ec-4047-a56f-31720decfc15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.919595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d0f08-42ec-4047-a56f-31720decfc15 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.925199 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 445/882] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:41.933708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f96a95c3-d69e-42d7-8f22-0ea78ed1427d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:41.934915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f96a95c3-d69e-42d7-8f22-0ea78ed1427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:42.016905 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 438/883] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:42.201292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4542c2-16ca-497f-bbbc-1d5b0bae7338 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.201635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4542c2-16ca-497f-bbbc-1d5b0bae7338 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.201845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4542c2-16ca-497f-bbbc-1d5b0bae7338 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.203455 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 446/884] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:42.208903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649194a-0d1c-456c-9f26-1914b4f52652 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.209175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649194a-0d1c-456c-9f26-1914b4f52652 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.209450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649194a-0d1c-456c-9f26-1914b4f52652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.227761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e649194a-0d1c-456c-9f26-1914b4f52652 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:42.228990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e649194a-0d1c-456c-9f26-1914b4f52652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:42.295684 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 439/885] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:42.298939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4542c2-16ca-497f-bbbc-1d5b0bae7338 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.405241 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.408133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4542c2-16ca-497f-bbbc-1d5b0bae7338 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.443937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.444577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.444888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.445162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.445752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.447180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:42.458261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:42.459289 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:42.460125 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 447/886] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:42.465451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649194a-0d1c-456c-9f26-1914b4f52652 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.526312 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.572709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649194a-0d1c-456c-9f26-1914b4f52652 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.605533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.616486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.617280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.617559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.617828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.618459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.618754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.620224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.625683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 440/887] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:42.631425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.735979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a16e-1b4a-4f53-abe9-93f978492f5f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.750808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a56309-6ae6-4127-b1a9-40cd3fde7f24 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.772372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.773009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.773283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.773553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.776385 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.785460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:42.790337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:42.791748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:42.792733 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 448/888] 10.222.0.46 () {56 vars in 1120 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:42.801246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.805045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.805690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.805962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.806228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.807372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.807372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.808537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.818728 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 441/889] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:42.819957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.831084 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.918064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2102b-062b-4474-9d48-402989981ca4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.926002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32be66f-5770-475f-a849-8c1383836aa3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.959334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.960323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.960914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.961608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.962350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.962959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.963244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.963495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.963861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.964186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] RBAC: Adding query filter params (interface=public, service_id=26ef6dd5038a47b28d027dfdce955aab, region_id=RegionOne) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.964485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.964982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.965861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.966783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.975897 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 442/890] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/endpoints?service_id=26ef6dd5038a47b28d027dfdce955aab&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:42.977515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.982666 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 449/891] 10.222.0.46 () {56 vars in 1115 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:42.983854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.028124 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:43.083407 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:43.090721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc627fad-b7aa-4ab9-8002-1c9bff272765 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.102919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be47c-2888-470d-a111-c9dc870b2ce8 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.128234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.128234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.129120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.129120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.129572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.130931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.143398 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 443/892] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:52:43.157511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.158540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.159020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.159575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.173219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.175066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:43.192710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:43.193779 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:43.194665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:43.194665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:43.194665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:43.196995 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 450/893] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:43.203126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.317682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f8b0-e10f-455a-b8ba-9fa564d06696 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.329337 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:43.357340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97b9c5-b589-421c-bb3b-b3ec0303368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.357948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97b9c5-b589-421c-bb3b-b3ec0303368e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.358218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97b9c5-b589-421c-bb3b-b3ec0303368e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.358481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97b9c5-b589-421c-bb3b-b3ec0303368e None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.359118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97b9c5-b589-421c-bb3b-b3ec0303368e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:43.359412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97b9c5-b589-421c-bb3b-b3ec0303368e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.360858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97b9c5-b589-421c-bb3b-b3ec0303368e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.375325 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 444/894] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:43.381900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.412091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3068-2de2-4108-a011-f6735b1bae69 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.412361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3068-2de2-4108-a011-f6735b1bae69 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.412733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3068-2de2-4108-a011-f6735b1bae69 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.414258 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 445/895] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:43.419380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560749-f97f-45dc-bfb7-72f4dc771716 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.419669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560749-f97f-45dc-bfb7-72f4dc771716 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.419936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560749-f97f-45dc-bfb7-72f4dc771716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.438774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-85560749-f97f-45dc-bfb7-72f4dc771716 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:43.440017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-85560749-f97f-45dc-bfb7-72f4dc771716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:43.516954 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 446/896] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:43.523527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48347a-014b-46ac-8d75-7de399626799 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.559634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.560653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.561171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.561637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.570017 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:43.571466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.573237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:43.586070 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:43.587056 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:43.588010 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:43.590565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 451/897] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:43.598019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560749-f97f-45dc-bfb7-72f4dc771716 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.706093 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:43.710157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560749-f97f-45dc-bfb7-72f4dc771716 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.750428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.751278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.751690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.752096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.753049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:43.753543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.755108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.777724 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 447/898] 10.222.0.46 () {56 vars in 1149 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:43.783249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.789483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.899168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3399f-28f0-417a-a7ae-f69f3c29bed7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.908862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1f51-8a3d-4621-9ab7-522c06b2994d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.938627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff25618-c282-418d-b080-c544d040c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.939583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff25618-c282-418d-b080-c544d040c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.939583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff25618-c282-418d-b080-c544d040c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.939765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff25618-c282-418d-b080-c544d040c5c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.940339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff25618-c282-418d-b080-c544d040c5c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.941837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff25618-c282-418d-b080-c544d040c5c0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.950324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-eff25618-c282-418d-b080-c544d040c5c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:43.950824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:43.951756 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:43.952656 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:43.953444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.953444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.953444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.956525 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 448/899] 10.222.0.46 () {56 vars in 1132 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:43.957850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a5af-cbb7-41a4-bf62-b7d6a801e925 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.958129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a5af-cbb7-41a4-bf62-b7d6a801e925 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.958402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a5af-cbb7-41a4-bf62-b7d6a801e925 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.964124 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 449/900] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:43.964124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01a5af-cbb7-41a4-bf62-b7d6a801e925 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.989307 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.023028 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.030639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.032106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.072012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01a5af-cbb7-41a4-bf62-b7d6a801e925 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.106686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48559-5c7c-4439-990a-003de5d8419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.107296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48559-5c7c-4439-990a-003de5d8419f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.107569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48559-5c7c-4439-990a-003de5d8419f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.107945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48559-5c7c-4439-990a-003de5d8419f None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.108570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf48559-5c7c-4439-990a-003de5d8419f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:44.108893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf48559-5c7c-4439-990a-003de5d8419f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.110938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf48559-5c7c-4439-990a-003de5d8419f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.116562 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 450/901] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:44.117842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec72fd-c54a-4089-a0bd-1a5882e50a3f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.118127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec72fd-c54a-4089-a0bd-1a5882e50a3f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.118398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec72fd-c54a-4089-a0bd-1a5882e50a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.139842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e1ec72fd-c54a-4089-a0bd-1a5882e50a3f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:44.140813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e1ec72fd-c54a-4089-a0bd-1a5882e50a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:44.147535 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 452/902] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:52:44.148364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.223755 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 451/903] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:44.223755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec72fd-c54a-4089-a0bd-1a5882e50a3f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.238242 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.274043 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.280817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ce14-f20c-48a5-9ab7-16451e2982d5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.319361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.320188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.320466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.320730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.321741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:44.321852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.323202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.328671 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 453/904] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:44.336804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.344171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec72fd-c54a-4089-a0bd-1a5882e50a3f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.386000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.386979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.387423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.387894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.399457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.401149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:44.417257 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:44.418188 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:44.419062 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:44.419062 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:44.419062 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:44.421286 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 452/905] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:44.426530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.461099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0acc4d-b075-4cf2-bddc-2c14daf00296 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.499816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919082-8e81-4827-8531-286120965995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.500727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919082-8e81-4827-8531-286120965995 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.501343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919082-8e81-4827-8531-286120965995 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.502104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919082-8e81-4827-8531-286120965995 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.503293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919082-8e81-4827-8531-286120965995 None admin] RBAC: Adding query filter params (interface=public, service_id=75baf91b161640cc99daf55ff45f6958, region_id=RegionOne) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:44.503937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919082-8e81-4827-8531-286120965995 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.506151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919082-8e81-4827-8531-286120965995 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.511807 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.520815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 454/906] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/endpoints?service_id=75baf91b161640cc99daf55ff45f6958&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:44.520815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919082-8e81-4827-8531-286120965995 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.544882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2517f-5672-439e-8339-03f6d830b0d9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.553046 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.580312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.580955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.581228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.581688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.582408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:44.582705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.584071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.595802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 453/907] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:44.596597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.649009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919082-8e81-4827-8531-286120965995 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.687859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.688908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.689406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.689764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.690492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.691991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.699162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdec68-f385-4bd8-ba25-cf3dfda32a18 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.712980 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 455/908] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:44 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:44.712980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.731054 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.747090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.747699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.747971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.748232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.749046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.750676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.757847 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 454/909] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:52:44.833129 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.855692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460a15-7849-4237-a8ce-d2e9afeacef2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.894885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.895533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.895804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.896068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.903498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.904995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:44.917791 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:44.918774 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:44.919665 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 456/910] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:44.925383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:45.036797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5b08f-1078-44e3-afd4-4245db39efba None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:45.072558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f416a50-407e-444d-a93e-0f93cc652b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:45.073543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f416a50-407e-444d-a93e-0f93cc652b72 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:45.074008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f416a50-407e-444d-a93e-0f93cc652b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:45.074487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f416a50-407e-444d-a93e-0f93cc652b72 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:45.075417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f416a50-407e-444d-a93e-0f93cc652b72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:45.075935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f416a50-407e-444d-a93e-0f93cc652b72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:45.077653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f416a50-407e-444d-a93e-0f93cc652b72 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:45.090545 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 455/911] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:45.099032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:45.177242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180d1ba-dfc2-4b60-b7e6-522f6cbd71a8 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:45.177527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180d1ba-dfc2-4b60-b7e6-522f6cbd71a8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:45.177834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180d1ba-dfc2-4b60-b7e6-522f6cbd71a8 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:45.183513 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 456/912] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:45.189412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354095-2417-42a6-b1b6-293e1708d1f4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:45.189971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354095-2417-42a6-b1b6-293e1708d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:45.189971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354095-2417-42a6-b1b6-293e1708d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:45.210273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6e354095-2417-42a6-b1b6-293e1708d1f4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:45.212138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e354095-2417-42a6-b1b6-293e1708d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:45.214576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211a817-e998-4f0f-8186-e41f1fef2ab2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:45.251282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:45.252128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:45.252541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:45.252999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:45.254099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] RBAC: Adding query filter params (role.id=ba3675426e234ee7a7e21c2c03f579a2, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=ececa74a5c554c85b42f85ed93be05fc) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:45.254705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:45.256376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:45.263423 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 457/913] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:45 2022] GET /identity/v3/role_assignments?user.id=ececa74a5c554c85b42f85ed93be05fc&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=ba3675426e234ee7a7e21c2c03f579a2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:45.268954 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:45.296134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 457/914] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:45.564448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:45.576331 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:45.667499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76efa-7802-4edb-8edb-19c66e0fd8fb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:45.702154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:45.703080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:45.703504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:45.703922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:45.704653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:45.706208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:45.715878 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:45.717089 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:52:45.718139 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:45.720481 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 458/915] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:45.727417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354095-2417-42a6-b1b6-293e1708d1f4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:45.830406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354095-2417-42a6-b1b6-293e1708d1f4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:45.866517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:45.867385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:45.867806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:45.868246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:45.869053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:45.869520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:45.871034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:45.876590 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 458/916] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:45.882552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:45.960048 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:45.992246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c172453-1d1f-477f-ae7c-b4e8fd6de080 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:46.026217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89154933-e1aa-4cc6-b7e2-a2e2bdcc2d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:46.026834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154933-e1aa-4cc6-b7e2-a2e2bdcc2d16 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.027102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154933-e1aa-4cc6-b7e2-a2e2bdcc2d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.027428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154933-e1aa-4cc6-b7e2-a2e2bdcc2d16 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.028399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154933-e1aa-4cc6-b7e2-a2e2bdcc2d16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:46.028780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154933-e1aa-4cc6-b7e2-a2e2bdcc2d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:46.030216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154933-e1aa-4cc6-b7e2-a2e2bdcc2d16 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:46.035738 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 459/917] 10.222.0.46 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:46.041604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:46.088887 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:46.145567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cf39e-cb4a-4c0c-821a-0b27e2409e92 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:46.181265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed50cb-e41d-4c0f-87b1-047a977ac1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:46.181924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed50cb-e41d-4c0f-87b1-047a977ac1db None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.182204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed50cb-e41d-4c0f-87b1-047a977ac1db None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.182475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed50cb-e41d-4c0f-87b1-047a977ac1db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.183148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed50cb-e41d-4c0f-87b1-047a977ac1db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:46.184528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed50cb-e41d-4c0f-87b1-047a977ac1db None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:46.213405 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 459/918] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:52:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:46.762955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068eeae-e2fc-4aff-8424-a68967bf4c15 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.763475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068eeae-e2fc-4aff-8424-a68967bf4c15 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.763475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068eeae-e2fc-4aff-8424-a68967bf4c15 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.765110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 460/919] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:46.770429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d1215-dc38-46ee-aed0-8573f870afc0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.770708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d1215-dc38-46ee-aed0-8573f870afc0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.770978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d1215-dc38-46ee-aed0-8573f870afc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.784429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177175-75b0-448f-9798-42643e5ddc29 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.784745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177175-75b0-448f-9798-42643e5ddc29 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.785057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177175-75b0-448f-9798-42643e5ddc29 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.788438 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 461/920] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:46.791493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3127-3b51-44fe-b071-47aacf9c1488 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.791774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3127-3b51-44fe-b071-47aacf9c1488 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.792044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3127-3b51-44fe-b071-47aacf9c1488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.793360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7f8d1215-dc38-46ee-aed0-8573f870afc0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:46.794765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7f8d1215-dc38-46ee-aed0-8573f870afc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:46.810537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e0ff3127-3b51-44fe-b071-47aacf9c1488 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:46.811764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e0ff3127-3b51-44fe-b071-47aacf9c1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:46.886572 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 460/921] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:46.898304 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 462/922] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:47.154506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d1215-dc38-46ee-aed0-8573f870afc0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.173063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3127-3b51-44fe-b071-47aacf9c1488 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.181427 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.240986 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.264161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d1215-dc38-46ee-aed0-8573f870afc0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.281293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3127-3b51-44fe-b071-47aacf9c1488 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.302732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e57af-c294-4ecb-8782-0d4607daf759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.303381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e57af-c294-4ecb-8782-0d4607daf759 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.303667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e57af-c294-4ecb-8782-0d4607daf759 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.303918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e57af-c294-4ecb-8782-0d4607daf759 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.304498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e57af-c294-4ecb-8782-0d4607daf759 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.305893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e57af-c294-4ecb-8782-0d4607daf759 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-3f4e57af-c294-4ecb-8782-0d4607daf759 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:47.315429 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:47.316511 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:47.317769 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 461/923] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:47.318563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1bfc1-e064-45d0-9372-5bb91998bda3 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.318563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1bfc1-e064-45d0-9372-5bb91998bda3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.318563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1bfc1-e064-45d0-9372-5bb91998bda3 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.319695 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 462/924] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:47.323879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c33fd-1bf8-4575-861b-eb8c0cb3b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.324422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1bfc1-e064-45d0-9372-5bb91998bda3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.324533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c33fd-1bf8-4575-861b-eb8c0cb3b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.324833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c33fd-1bf8-4575-861b-eb8c0cb3b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.325058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c33fd-1bf8-4575-861b-eb8c0cb3b7c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.325642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c33fd-1bf8-4575-861b-eb8c0cb3b7c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.327077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c33fd-1bf8-4575-861b-eb8c0cb3b7c5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-5e4c33fd-1bf8-4575-861b-eb8c0cb3b7c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:47.336461 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:47.337466 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:47.338381 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 463/925] 10.222.0.46 () {56 vars in 1132 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:47.339161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959008-66ef-46af-b7b2-41620b9dcba5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.339161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959008-66ef-46af-b7b2-41620b9dcba5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.339292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959008-66ef-46af-b7b2-41620b9dcba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.358648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1d959008-66ef-46af-b7b2-41620b9dcba5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:47.359846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1d959008-66ef-46af-b7b2-41620b9dcba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:47.431594 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.440271 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 464/926] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:47.440271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959008-66ef-46af-b7b2-41620b9dcba5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.457642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1bfc1-e064-45d0-9372-5bb91998bda3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.490453 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.501063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.502190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.502459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.502867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.503663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:47.504046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.506556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.512957 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 463/927] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:47.517605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.544890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959008-66ef-46af-b7b2-41620b9dcba5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.580877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.582026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.582319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.582584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.583209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:47.583503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.585920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.599176 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 465/928] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:47.601181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.638257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e0735-d0ee-4e1c-b9ce-53b0fecdeee8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.674365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.675405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.675892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.676385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.677239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:47.677735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.679346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.685275 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 464/929] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:47.698168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.720619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff04a2b-d5a1-4259-8d40-472e3aca4237 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.733960 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.745688 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.761716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.762351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.762628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.762893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.763522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:47.764071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.765198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.770554 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 466/930] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:47.773898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.812073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de78d1-1c9f-4c3e-b776-51f7b29dcc39 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.848052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.849227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.849507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.849833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.850535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] RBAC: Adding query filter params (interface=public, service_id=55d39cc777b24baf8f69951814f241ec, region_id=RegionOne) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:47.850841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.853188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.863977 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 465/931] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/endpoints?service_id=55d39cc777b24baf8f69951814f241ec&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:47.863977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.890705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ebb93-3a96-4e64-b22f-74410555e575 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.928339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.929148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.929430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.929797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.940623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:47.945571 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:47.946523 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:47.947380 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 467/932] 10.222.0.46 () {56 vars in 1120 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:47.948076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.959940 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.981730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b9b08-eb4c-4c5d-a00b-b1f60dbdffea None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.997711 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.021384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.021984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.022256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.022522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.023172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.024525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.048825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 466/933] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:52:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:48.048825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.078129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bacc1e-6af6-419e-8f1d-644617b6faf1 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.157564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7544789-891e-450f-bb69-97c8345bd25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.158348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544789-891e-450f-bb69-97c8345bd25e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.158714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544789-891e-450f-bb69-97c8345bd25e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.159075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544789-891e-450f-bb69-97c8345bd25e None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.160128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7544789-891e-450f-bb69-97c8345bd25e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.162462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7544789-891e-450f-bb69-97c8345bd25e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.170791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd474b30-e9f7-4cf1-b5ca-ed27c1c1ac6b None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.173436 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 468/934] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/services => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:52:48.188840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7675-2553-4c83-9012-b0da0799d15f None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.188840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7675-2553-4c83-9012-b0da0799d15f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.188840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7675-2553-4c83-9012-b0da0799d15f None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.193514 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 469/935] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:48.194904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751a74-b4be-43b1-a2d6-f295032865b5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.195188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751a74-b4be-43b1-a2d6-f295032865b5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.195461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751a74-b4be-43b1-a2d6-f295032865b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.216195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-57751a74-b4be-43b1-a2d6-f295032865b5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:48.217462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-57751a74-b4be-43b1-a2d6-f295032865b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:48.230393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.231034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.231316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.231588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.232699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:48.233029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.234431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.238681 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.247745 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 467/936] 10.222.0.46 () {56 vars in 1115 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:48.255661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.315502 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 470/937] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:48.386470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae0ed6-2680-441c-a7a4-ead1bc59b028 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.423157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.423793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.424061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.424321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.435184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.436673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:48.451833 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:48.453021 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:48.454252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:48.454252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:48.454252 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:48.454252 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 468/938] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:48.459230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751a74-b4be-43b1-a2d6-f295032865b5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.493981 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.567432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751a74-b4be-43b1-a2d6-f295032865b5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.603527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.604144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.604420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.604689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.605366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:48.605666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.607035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.619318 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 471/939] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:48.624858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.628639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.694715 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.735930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6a9e7-c12d-4cee-b973-aa0399f64551 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.747476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017131-2a08-4dba-b8de-2b2855da18b9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.753246 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.771974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.773422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.773901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.774383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.775228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.776900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.779803 n-d-master-1 devstack@keystone.service[81886]: WARNING keystone.server.flask.common [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 21 00:52:48.786107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.786750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.787029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.787304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.795549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.797324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.801648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.sql.core [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:52:48.801648 n-d-master-1 devstack@keystone.service[81886]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 00:52:48.801648 n-d-master-1 devstack@keystone.service[81886]: [parameters: {'id': 'edf56638cf2047d8976632b9dece2fc5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 00:52:48.801648 n-d-master-1 devstack@keystone.service[81886]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81886) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:48.809732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:48.810655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:48.811979 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 469/940] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:48.817031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id edf56638cf2047d8976632b9dece2fc5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id edf56638cf2047d8976632b9dece2fc5. Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:52:48.823421 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result.read() Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 21 00:52:48.824329 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application yield resource Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise self.value Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application session.commit() Aug 21 00:52:48.825351 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:52:48.826333 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:52:48.827209 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result.read() Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:52:48.827985 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [parameters: {'id': 'edf56638cf2047d8976632b9dece2fc5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.829003 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:48.829939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id edf56638cf2047d8976632b9dece2fc5. Aug 21 00:52:48.831220 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:48.834240 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 472/941] 10.222.0.46 () {60 vars in 1140 bytes} [Sun Aug 21 00:52:48 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:48.840031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.947727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6adc5-fc4e-4306-996a-5275153c89b0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.960393 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.978939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd0c55-ca7f-43f9-b6e8-8f639bd80d72 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.990668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.991215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.991486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.991757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.992873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:48.993181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.995218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.017449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 470/942] 10.222.0.46 () {56 vars in 1149 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:49.022434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.030499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.031925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.032430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.032955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.043408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.045332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:49.062091 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:49.062991 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:49.063909 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:49.071578 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 473/943] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:49.072782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.092821 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.155519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d241b1-96cd-4342-8d4b-c3bc50c701b4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.194256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.195587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.196148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.196617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.209017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.211023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.215849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331855af-1d0d-4248-bb03-512f06db49c5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:49.227599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:49.228577 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:49.229497 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:49.229497 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:49.229497 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:49.229497 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 471/944] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:49.234496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.262961 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.275872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.277016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.277738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.279098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.279996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:49.280500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.282148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.309590 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 474/945] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:49.363722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c36536-9ff8-40e8-8987-053ae85457e4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.402841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.403460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.403732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.403999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.404647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:49.404974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.406364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.420319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 472/946] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:49.426172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.507279 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.542186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2af4-be2e-493e-ad5d-03ad0b4413de None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.576888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.577512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.577791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.578065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.585897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.587313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:49.599789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:49.600720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:49.601686 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 475/947] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:49.608882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.699546 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.720593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab0abe-fe5a-4cb5-9698-14e7d54b2224 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.760393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af74e-3eb5-489f-bcca-17f5db0708f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.761041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af74e-3eb5-489f-bcca-17f5db0708f2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.761315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af74e-3eb5-489f-bcca-17f5db0708f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.761586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af74e-3eb5-489f-bcca-17f5db0708f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.762289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af74e-3eb5-489f-bcca-17f5db0708f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:49.762591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af74e-3eb5-489f-bcca-17f5db0708f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.764040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af74e-3eb5-489f-bcca-17f5db0708f2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.777286 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 473/948] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:49.783181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.891944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1cdbc-bdc4-4067-84d3-987d1e27ebcd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.921750 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.928639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783320f-2740-46e8-8070-917c9af5003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.929648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783320f-2740-46e8-8070-917c9af5003c None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.930138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783320f-2740-46e8-8070-917c9af5003c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.930608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783320f-2740-46e8-8070-917c9af5003c None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/ececa74a5c554c85b42f85ed93be05fc/roles/ba3675426e234ee7a7e21c2c03f579a2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.933068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783320f-2740-46e8-8070-917c9af5003c None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=ececa74a5c554c85b42f85ed93be05fc, role_id=ba3675426e234ee7a7e21c2c03f579a2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.934697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783320f-2740-46e8-8070-917c9af5003c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.950719 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 476/949] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:49 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/ececa74a5c554c85b42f85ed93be05fc/roles/ba3675426e234ee7a7e21c2c03f579a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:50.103733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bf441-87b7-49b5-863c-8f533a145f97 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.104078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bf441-87b7-49b5-863c-8f533a145f97 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.104291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bf441-87b7-49b5-863c-8f533a145f97 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.105745 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 474/950] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:50.111299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca28a55-8524-40b3-9b3e-649caa00ab79 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.111580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca28a55-8524-40b3-9b3e-649caa00ab79 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.111852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca28a55-8524-40b3-9b3e-649caa00ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.137272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fca28a55-8524-40b3-9b3e-649caa00ab79 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:50.137783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fca28a55-8524-40b3-9b3e-649caa00ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:50.212301 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 477/951] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:50.287942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada0e66-e337-4464-ab2c-80c644e07727 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.288478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada0e66-e337-4464-ab2c-80c644e07727 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.288478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada0e66-e337-4464-ab2c-80c644e07727 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.290124 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 475/952] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:50.295629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581aa2c-6110-445d-b6a2-6a4af929b2f2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.295914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581aa2c-6110-445d-b6a2-6a4af929b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.296190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581aa2c-6110-445d-b6a2-6a4af929b2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.315619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0581aa2c-6110-445d-b6a2-6a4af929b2f2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:50.317119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0581aa2c-6110-445d-b6a2-6a4af929b2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:50.392667 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 478/953] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:50.496102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada0e66-e337-4464-ab2c-80c644e07727 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.602997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada0e66-e337-4464-ab2c-80c644e07727 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.637452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.638467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.638943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.639418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.640186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.642021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:50.654231 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:50.655318 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:50.656535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 476/954] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:50.664151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581aa2c-6110-445d-b6a2-6a4af929b2f2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.680229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.684635 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.718681 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.781869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581aa2c-6110-445d-b6a2-6a4af929b2f2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.804153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03245a2-d417-4cc8-a2ef-a342601f0c82 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.820191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.821594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.822097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.822542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.823308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:50.823753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.825391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.836460 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 479/955] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:50.837279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.840988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.842417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.842417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.842417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.842718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.844076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:50.853584 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:50.854885 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:50.855968 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 477/956] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:50.861306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.946271 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.980838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788a5a2-13de-4f9b-83e9-819a45b6ba66 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.983353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4e018-c170-491f-bb12-84ff3c30cdfa None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.000003 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.022348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.023240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.023680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.024111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.024930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:51.025387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.025947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.026552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.026823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.027104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.027610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.027733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] RBAC: Adding query filter params (type=compute) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:51.027994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.030227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.033941 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 478/957] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:51.035482 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 480/958] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:51.040920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.161552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e39f2-a71b-4fb7-af94-5b4a577c7533 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.194316 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.200333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3ef25-a271-49eb-b37c-34d402c7b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.201161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ef25-a271-49eb-b37c-34d402c7b425 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.201600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ef25-a271-49eb-b37c-34d402c7b425 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.201875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ef25-a271-49eb-b37c-34d402c7b425 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.202513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3ef25-a271-49eb-b37c-34d402c7b425 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:51.202821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3ef25-a271-49eb-b37c-34d402c7b425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.204420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3ef25-a271-49eb-b37c-34d402c7b425 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.210476 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 479/959] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:51.216248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.331040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d43032-8fde-41e3-b29d-0f3233d9c2ea None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.367859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63d5f9-bb59-44c1-b2d4-2ca7d77a6c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.368870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d5f9-bb59-44c1-b2d4-2ca7d77a6c43 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.369360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d5f9-bb59-44c1-b2d4-2ca7d77a6c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.369852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d5f9-bb59-44c1-b2d4-2ca7d77a6c43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.370717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63d5f9-bb59-44c1-b2d4-2ca7d77a6c43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.372273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63d5f9-bb59-44c1-b2d4-2ca7d77a6c43 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.395849 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 481/960] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:52:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:51.466707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf210c0-98ec-47f8-8c76-ad8b7a739e1d None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.467266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf210c0-98ec-47f8-8c76-ad8b7a739e1d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.467266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf210c0-98ec-47f8-8c76-ad8b7a739e1d None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.469012 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 480/961] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:51.475970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d214d-b044-470e-a473-a7aa6c36fd70 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.477078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d214d-b044-470e-a473-a7aa6c36fd70 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.477612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d214d-b044-470e-a473-a7aa6c36fd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.498304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-620d214d-b044-470e-a473-a7aa6c36fd70 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:51.499888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-620d214d-b044-470e-a473-a7aa6c36fd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:51.533386 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.584398 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 482/962] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:51.861687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf210c0-98ec-47f8-8c76-ad8b7a739e1d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.888902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5bf4d-1f4a-4f32-a09c-5291881f3bcd None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.889434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5bf4d-1f4a-4f32-a09c-5291881f3bcd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.889741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5bf4d-1f4a-4f32-a09c-5291881f3bcd None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.892007 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 483/963] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:51.899017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d3e3-b9f0-4a5d-bfb9-e36979caa100 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.899297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d3e3-b9f0-4a5d-bfb9-e36979caa100 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.899570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d3e3-b9f0-4a5d-bfb9-e36979caa100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.919325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8ca5d3e3-b9f0-4a5d-bfb9-e36979caa100 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:51.920622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ca5d3e3-b9f0-4a5d-bfb9-e36979caa100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:51.974300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf210c0-98ec-47f8-8c76-ad8b7a739e1d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.010531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.011224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.011524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.011839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.012484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.013994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.016796 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.server.flask.common [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 21 00:52:52.017108 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 484/964] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:52.037625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.sql.core [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:52:52.037625 n-d-master-1 devstack@keystone.service[81885]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 21 00:52:52.037625 n-d-master-1 devstack@keystone.service[81885]: [parameters: {'user_id': '4296f0b6aa1f41e28b42e1daeb4bd684', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 21 00:52:52.037625 n-d-master-1 devstack@keystone.service[81885]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81885) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result.read() Aug 21 00:52:52.045128 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:52:52.046010 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application yield resource Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise self.value Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application session.commit() Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:52:52.047567 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:52:52.048668 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:52:52.049954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result.read() Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:52:52.051319 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [parameters: {'user_id': '4296f0b6aa1f41e28b42e1daeb4bd684', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.052625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 21 00:52:52.054399 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 21 00:52:52.056872 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 21 00:52:52.056872 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 21 00:52:52.056872 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:52:52.056872 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:52:52.056872 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 21 00:52:52.056872 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:52.056872 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 481/965] 10.222.0.46 () {60 vars in 1131 bytes} [Sun Aug 21 00:52:51 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:52.057766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5d3e3-b9f0-4a5d-bfb9-e36979caa100 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.174441 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.184902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5d3e3-b9f0-4a5d-bfb9-e36979caa100 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.221954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.222614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.222890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.223160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.231341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.232813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:52.244311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:52.245280 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:52.246598 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 485/966] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:52.251463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.304271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.311582 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.356451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8180c-5493-4b21-b74c-880f577388d8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.390341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.390962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.391235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.391542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.392240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:52.392536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.394651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.421348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041815a-40fb-43e6-a8e0-58957e73f25b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.434891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 482/967] 10.222.0.46 () {56 vars in 1101 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:52.457892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.458848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.459289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.459716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.475033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:52.481180 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:52.482227 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:52:52.483105 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:52.485989 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 486/968] 10.222.0.46 () {56 vars in 1120 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:52.492345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.610607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece0e4f-b813-4789-a46a-2b6eb559dfd9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.629106 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.650359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.651222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.651647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.652068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.653051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:52.653492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.655049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.665153 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 483/969] 10.222.0.46 () {56 vars in 1115 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:52.670678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.686543 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.781147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4bcf-ad90-4bcd-961e-00cad8fc6361 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.817421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.818059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.818313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.818605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.830814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.832521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:52.847540 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:52.848535 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:52.849786 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:52.849786 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:52.849786 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:52.849786 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 487/970] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:52.855132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.959310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f642812-176a-4e94-8524-dfbfab784d34 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.993675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d4f20-9fba-4bf8-8996-cca33c59cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.994431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d4f20-9fba-4bf8-8996-cca33c59cd4c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.994803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d4f20-9fba-4bf8-8996-cca33c59cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.995160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d4f20-9fba-4bf8-8996-cca33c59cd4c None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.995887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d4f20-9fba-4bf8-8996-cca33c59cd4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:52.996280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d4f20-9fba-4bf8-8996-cca33c59cd4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.997788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d4f20-9fba-4bf8-8996-cca33c59cd4c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.010226 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 484/971] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:53.015740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.060362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8dafa-d73f-4142-968e-fed9425cc88f None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.060640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8dafa-d73f-4142-968e-fed9425cc88f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.060936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8dafa-d73f-4142-968e-fed9425cc88f None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.062270 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 485/972] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:53.067508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd2cba-dfd8-498d-9322-69ab8084635d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.067787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd2cba-dfd8-498d-9322-69ab8084635d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.068054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd2cba-dfd8-498d-9322-69ab8084635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.086004 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.086196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e2dd2cba-dfd8-498d-9322-69ab8084635d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:53.087605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e2dd2cba-dfd8-498d-9322-69ab8084635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:53.121324 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.132222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c1503-5bf2-483d-abdd-2834986793e3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.167085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.167725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.168001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.168270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.174826 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 486/973] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:53.177922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.179377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:53.191337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:53.192263 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:53.193596 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 488/974] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:53.198245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd2cba-dfd8-498d-9322-69ab8084635d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.303364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd2cba-dfd8-498d-9322-69ab8084635d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.339172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd20c6-cec8-4508-8a64-ceb3f94b4539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.339784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd20c6-cec8-4508-8a64-ceb3f94b4539 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.340062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd20c6-cec8-4508-8a64-ceb3f94b4539 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.340333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd20c6-cec8-4508-8a64-ceb3f94b4539 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.341100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd20c6-cec8-4508-8a64-ceb3f94b4539 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:53.341405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd20c6-cec8-4508-8a64-ceb3f94b4539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.342923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd20c6-cec8-4508-8a64-ceb3f94b4539 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.361662 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 487/975] 10.222.0.46 () {56 vars in 1149 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:53.367420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.408095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b047a-d8a5-4c08-8c1c-b156f7bfb6c5 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.408406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b047a-d8a5-4c08-8c1c-b156f7bfb6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.408652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b047a-d8a5-4c08-8c1c-b156f7bfb6c5 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.410295 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 488/976] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:53.415446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558316ae-abb0-4495-96cd-b4a2b557f08b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.415729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558316ae-abb0-4495-96cd-b4a2b557f08b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.415995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558316ae-abb0-4495-96cd-b4a2b557f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.434000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-558316ae-abb0-4495-96cd-b4a2b557f08b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:53.435202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-558316ae-abb0-4495-96cd-b4a2b557f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:53.455933 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.474557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5d13-65c3-41a7-94ae-0abf4fd45331 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.498383 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.509831 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 489/977] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:53.510682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558316ae-abb0-4495-96cd-b4a2b557f08b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.512573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.513261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.513771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.514007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.591035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.592509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.620455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558316ae-abb0-4495-96cd-b4a2b557f08b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.657877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.658482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.658759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.659027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.659929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.661317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.678869 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 490/978] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:53 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:53.704236 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 489/979] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:52:53.710021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.732057 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.780402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.808274 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.843975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982bd93-a1e8-4cd3-b848-3dbf2fd7acee None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.884425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.885248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.885624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.885994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.897746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.899317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.899494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffbc9f-69f7-49fd-9c77-04f5400a6eea None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:53.915123 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:53.916304 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:53.917458 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:53.917458 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:53.917458 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:53.922452 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 491/980] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:53.923432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.942677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.943378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.943657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.943925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.944519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.945917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:53.955170 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:53.956348 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:53.957353 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 490/981] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:53.962417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.998570 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.043795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562538b-0406-4be1-badb-9ef9a4298c53 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.049462 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.065591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94f0e6-8ea3-4624-94e6-10d28b4c5963 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.082789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.083405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.083711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.083952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.084605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.084928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.086300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.104928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 492/982] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:54.105100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.105100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.105100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.105100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.105456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.105456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.105722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.107329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.110940 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 491/983] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:54.117595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.216246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5eadfd-36c0-4ec1-a5cb-3578cb0b02a8 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.239841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716961d8-8b51-4c4f-a4af-910dd84a9ec8 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.241609 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.253053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.253914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.254027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.254242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.262195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.263635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:54.274769 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:54.275704 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:54.276594 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 493/984] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:54.281518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.282424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.283284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.283772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.285154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.286982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.287504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.289138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.296941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 492/985] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:54.302671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.321273 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.391881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2969a-5a2c-4e41-9403-de277036ea52 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.416797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff283ae8-8f91-4c5f-aa95-d9fb169b345c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.429182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.430005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.430277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.430549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.431231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.431534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.432986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.445666 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 494/986] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:54.451590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.454105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.454855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.455123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.455394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.456791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] RBAC: Adding query filter params (interface=admin, service_id=55d39cc777b24baf8f69951814f241ec, region_id=RegionOne) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.457110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.458482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.463811 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 493/987] 10.222.0.46 () {56 vars in 1249 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/endpoints?service_id=55d39cc777b24baf8f69951814f241ec&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:54.469110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.502230 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.558472 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.572113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc36582-bb62-4187-8294-e63a0296f443 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.582136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e292a-5879-445b-aa91-d100e10d9d98 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.611920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940de3f6-4086-452f-b714-f41c54ecf187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.612920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940de3f6-4086-452f-b714-f41c54ecf187 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.613285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940de3f6-4086-452f-b714-f41c54ecf187 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.613622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940de3f6-4086-452f-b714-f41c54ecf187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.614545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940de3f6-4086-452f-b714-f41c54ecf187 None admin] RBAC: Adding query filter params (role.id=ba3675426e234ee7a7e21c2c03f579a2, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=ececa74a5c554c85b42f85ed93be05fc) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.614855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940de3f6-4086-452f-b714-f41c54ecf187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.615549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0896bc1-85c8-4af3-8aab-258859bd2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.616156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896bc1-85c8-4af3-8aab-258859bd2f28 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.616363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940de3f6-4086-452f-b714-f41c54ecf187 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.616458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896bc1-85c8-4af3-8aab-258859bd2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.616686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896bc1-85c8-4af3-8aab-258859bd2f28 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.617308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0896bc1-85c8-4af3-8aab-258859bd2f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.618658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0896bc1-85c8-4af3-8aab-258859bd2f28 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.633097 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 495/988] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/role_assignments?user.id=ececa74a5c554c85b42f85ed93be05fc&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=ba3675426e234ee7a7e21c2c03f579a2 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:54.633324 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 494/989] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:52:55.627874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925ccfc-7d43-4260-a5cd-8177cc597014 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:55.628489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925ccfc-7d43-4260-a5cd-8177cc597014 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:55.629095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925ccfc-7d43-4260-a5cd-8177cc597014 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:55.630616 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 496/990] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:55.635902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6137a4-c196-4579-a084-a6339128ff4a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:55.636333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6137a4-c196-4579-a084-a6339128ff4a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:55.636430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6137a4-c196-4579-a084-a6339128ff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:55.655446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9c6137a4-c196-4579-a084-a6339128ff4a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:55.656640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c6137a4-c196-4579-a084-a6339128ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:55.728515 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 495/991] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:55.997079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925ccfc-7d43-4260-a5cd-8177cc597014 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:56.106755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925ccfc-7d43-4260-a5cd-8177cc597014 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:56.117377 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:56.154181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:56.154827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.155103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.155371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.155960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:56.157404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:56.167243 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:56.168228 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:56.169446 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:56.170600 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 497/992] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:56.174326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6137a4-c196-4579-a084-a6339128ff4a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:56.251011 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:56.286671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6137a4-c196-4579-a084-a6339128ff4a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:56.321568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:56.322171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.322448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.322716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.323348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:56.323644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:56.325048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:56.330129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 496/993] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:56.336354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:56.442525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bdfb3-029d-42b4-9027-778db2a72583 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:56.478985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037cae9-2e05-4bfe-b8fe-69604403355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:56.479592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cae9-2e05-4bfe-b8fe-69604403355b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.479865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cae9-2e05-4bfe-b8fe-69604403355b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.480133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cae9-2e05-4bfe-b8fe-69604403355b None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.480784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037cae9-2e05-4bfe-b8fe-69604403355b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:56.481089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037cae9-2e05-4bfe-b8fe-69604403355b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:56.482466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037cae9-2e05-4bfe-b8fe-69604403355b None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:56.488846 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 498/994] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:56.493830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:56.563026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b99d9-b95d-4187-b50a-2ab75eadbabb None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.563317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b99d9-b95d-4187-b50a-2ab75eadbabb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.563591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b99d9-b95d-4187-b50a-2ab75eadbabb None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.564997 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 499/995] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:56.566015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71ce56-53a9-4cd0-a1b5-1a265462f5e6 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.566362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71ce56-53a9-4cd0-a1b5-1a265462f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.566665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71ce56-53a9-4cd0-a1b5-1a265462f5e6 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.567988 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 500/996] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:56.572900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017ff0-e7e8-45db-9713-83e2d66d71b5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.573188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017ff0-e7e8-45db-9713-83e2d66d71b5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.573463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017ff0-e7e8-45db-9713-83e2d66d71b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.591926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-29017ff0-e7e8-45db-9713-83e2d66d71b5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:56.593176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-29017ff0-e7e8-45db-9713-83e2d66d71b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:56.604809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511607e-ef44-44d3-9e5a-729732cb1386 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:56.635889 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:56.649133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04eb9d-620a-45a1-9fb7-2ecacfaf4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:56.649765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04eb9d-620a-45a1-9fb7-2ecacfaf4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.650071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04eb9d-620a-45a1-9fb7-2ecacfaf4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.650342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04eb9d-620a-45a1-9fb7-2ecacfaf4cc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.651048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04eb9d-620a-45a1-9fb7-2ecacfaf4cc9 None admin] RBAC: Adding query filter params (interface=public, service_id=75dd42832ad14af792cc507e45dc53a8, region_id=RegionOne) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:56.651353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04eb9d-620a-45a1-9fb7-2ecacfaf4cc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:56.652749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04eb9d-620a-45a1-9fb7-2ecacfaf4cc9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:56.655183 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:56.658957 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 497/997] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:56 2022] GET /identity/v3/endpoints?service_id=75dd42832ad14af792cc507e45dc53a8&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:56.660682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc222a5f-c93c-44d9-8bce-6cf539924713 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.661044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc222a5f-c93c-44d9-8bce-6cf539924713 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.661379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc222a5f-c93c-44d9-8bce-6cf539924713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.679464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dc222a5f-c93c-44d9-8bce-6cf539924713 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:56.680645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dc222a5f-c93c-44d9-8bce-6cf539924713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:56.681717 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 501/998] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:56.682552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017ff0-e7e8-45db-9713-83e2d66d71b5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:56.761867 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 498/999] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:56.788699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017ff0-e7e8-45db-9713-83e2d66d71b5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:56.824544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:56.825107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.825373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.825638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.826237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:56.827594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:56.834406 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 502/1000] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:56 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:52:56.949729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc222a5f-c93c-44d9-8bce-6cf539924713 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.029749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.057864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc222a5f-c93c-44d9-8bce-6cf539924713 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:57.063107 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:57.091076 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:57.099088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:57.099960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.100233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.100505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] PATH_INFO: `/v3/services/image` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.101118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:57.102797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:57.111891 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:57.112956 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:52:57.113772 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 499/1001] 10.222.0.46 () {56 vars in 1105 bytes} [Sun Aug 21 00:52:56 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:57.119179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.150698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003c2bb-87f2-41bf-87c0-d8d92abb4e72 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:57.187132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:57.187760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.188033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.188305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.188910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:57.190707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:57.199293 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:57.200279 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:57.201171 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 503/1002] 10.222.0.46 () {56 vars in 1126 bytes} [Sun Aug 21 00:52:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:57.206407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.229412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aea15e-0fe8-4653-b02d-0f33ed19c60c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:57.275199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:57.276259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.276672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.276975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.277849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] RBAC: Adding query filter params (name=image) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:57.278161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:57.280084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:57.291326 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 500/1003] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:57.292397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.314516 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:57.323792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201b566-1119-4c8e-9982-8d1f1e887bee None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:57.357772 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:57.361272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:57.362373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.363003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.363273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.363947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:57.364214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:57.365619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:57.375629 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 504/1004] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:57.376644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.409977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e42e-0dd2-4c50-8dfe-dd4697dec983 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:57.449676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:57.450284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.450569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.450822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.451449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] RBAC: Adding query filter params (type=image) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:57.451743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:57.453299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:57.460815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 501/1005] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:57.486813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9eac-0131-4cc3-ae53-9a4c48229ec2 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:57.525826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1388b5-b995-468a-968b-de0c55f48c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:57.526770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1388b5-b995-468a-968b-de0c55f48c73 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.527258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1388b5-b995-468a-968b-de0c55f48c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.527713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1388b5-b995-468a-968b-de0c55f48c73 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.528539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1388b5-b995-468a-968b-de0c55f48c73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:57.529071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1388b5-b995-468a-968b-de0c55f48c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:57.530757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1388b5-b995-468a-968b-de0c55f48c73 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:57.537415 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 505/1006] 10.222.0.46 () {56 vars in 1122 bytes} [Sun Aug 21 00:52:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:57.543425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.657763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d870-0926-4b2b-a547-011b3fe77e69 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:57.680444 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:57.693333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9c2a5-00de-409b-9b92-e0bdf748ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:57.693944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c2a5-00de-409b-9b92-e0bdf748ab19 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.694218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c2a5-00de-409b-9b92-e0bdf748ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.694485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c2a5-00de-409b-9b92-e0bdf748ab19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.695142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9c2a5-00de-409b-9b92-e0bdf748ab19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:57.696499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9c2a5-00de-409b-9b92-e0bdf748ab19 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:57.714222 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 502/1007] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:52:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:58.773543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1d7a5-4da8-4e84-b331-a486a07671d8 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:58.774118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1d7a5-4da8-4e84-b331-a486a07671d8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:58.774118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1d7a5-4da8-4e84-b331-a486a07671d8 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:58.775407 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 506/1008] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:58.780904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2ae79-2330-4394-b860-e3ceff86201b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:58.781710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2ae79-2330-4394-b860-e3ceff86201b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:58.781957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2ae79-2330-4394-b860-e3ceff86201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:58.802464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e3c2ae79-2330-4394-b860-e3ceff86201b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:58.803675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e3c2ae79-2330-4394-b860-e3ceff86201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:58.881030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 503/1009] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:59.149498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1d7a5-4da8-4e84-b331-a486a07671d8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.174981 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:59.253392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1d7a5-4da8-4e84-b331-a486a07671d8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.287847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a4d6d-7bdd-478d-820e-a2a4008e4923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.288482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4d6d-7bdd-478d-820e-a2a4008e4923 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.288758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4d6d-7bdd-478d-820e-a2a4008e4923 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.289051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4d6d-7bdd-478d-820e-a2a4008e4923 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.289630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a4d6d-7bdd-478d-820e-a2a4008e4923 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.290994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a4d6d-7bdd-478d-820e-a2a4008e4923 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-5f8a4d6d-7bdd-478d-820e-a2a4008e4923 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:59.299910 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:59.300924 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:52:59.301785 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:52:59.305091 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 507/1010] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:59.307097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2ae79-2330-4394-b860-e3ceff86201b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.410863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2ae79-2330-4394-b860-e3ceff86201b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.420446 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:59.428912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc184-714d-4011-949c-80f2135140ad None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.429199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc184-714d-4011-949c-80f2135140ad None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.430047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc184-714d-4011-949c-80f2135140ad None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.431471 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 508/1011] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:59.436534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27195-6c64-4039-9443-4b69774296f7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.436850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27195-6c64-4039-9443-4b69774296f7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.437130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27195-6c64-4039-9443-4b69774296f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.451928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.452537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.453040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.453307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.453942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:59.454237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.455409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-93e27195-6c64-4039-9443-4b69774296f7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:59.455812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.457325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-93e27195-6c64-4039-9443-4b69774296f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:59.466184 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 504/1012] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:59.467092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.532738 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 509/1013] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:59.585635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440130c-bab5-4f36-8b77-45605e6cb176 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.621865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6303-88ac-4445-8cec-8a2dffccd9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.622477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6303-88ac-4445-8cec-8a2dffccd9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.622754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6303-88ac-4445-8cec-8a2dffccd9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.622989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6303-88ac-4445-8cec-8a2dffccd9a0 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.623636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd6303-88ac-4445-8cec-8a2dffccd9a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:59.623936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd6303-88ac-4445-8cec-8a2dffccd9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.625341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd6303-88ac-4445-8cec-8a2dffccd9a0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.631031 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 505/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:59.636665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e27195-6c64-4039-9443-4b69774296f7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.642886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117537a-4e8e-4df4-a2df-8e10776c7251 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.643163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117537a-4e8e-4df4-a2df-8e10776c7251 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.643499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117537a-4e8e-4df4-a2df-8e10776c7251 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.645130 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 506/1015] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:59.650048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d862-61a1-429c-91a0-d501fd11319f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.650325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d862-61a1-429c-91a0-d501fd11319f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.650590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d862-61a1-429c-91a0-d501fd11319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.656028 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:59.670000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b997d862-61a1-429c-91a0-d501fd11319f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:59.671121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b997d862-61a1-429c-91a0-d501fd11319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:59.699318 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:59.751303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e27195-6c64-4039-9443-4b69774296f7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.757083 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 507/1016] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:59.788192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.788843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.789105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.789361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.790017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.791402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.801998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997d862-61a1-429c-91a0-d501fd11319f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.814683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 510/1017] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:52:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:59.919989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997d862-61a1-429c-91a0-d501fd11319f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.965262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.965791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.966068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.966337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.966987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.968413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.985741 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 508/1018] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:59 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:00.010767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.098694 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:00.136596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc330a7-1cab-4901-9343-04cf3b218bea None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.179691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2b8cd-4924-46ca-88d9-19dbbe310e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.180324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b8cd-4924-46ca-88d9-19dbbe310e4d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.180601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b8cd-4924-46ca-88d9-19dbbe310e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.180926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b8cd-4924-46ca-88d9-19dbbe310e4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.182071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b8cd-4924-46ca-88d9-19dbbe310e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:00.183516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b8cd-4924-46ca-88d9-19dbbe310e4d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:00.185274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 511/1019] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:00.191630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.216868 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:00.296651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e0c0-6c0a-4aaf-9ab6-45c9b830ca06 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.331175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c125a-b7a7-43a5-9a83-aad47c76e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.331785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c125a-b7a7-43a5-9a83-aad47c76e569 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.332058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c125a-b7a7-43a5-9a83-aad47c76e569 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.332313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c125a-b7a7-43a5-9a83-aad47c76e569 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.333052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c125a-b7a7-43a5-9a83-aad47c76e569 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:00.334473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c125a-b7a7-43a5-9a83-aad47c76e569 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:00.368866 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 509/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:00 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:01.890897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652fe7d-ab0b-4018-b0f8-7e57c9dd44ea None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.891471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652fe7d-ab0b-4018-b0f8-7e57c9dd44ea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.891471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652fe7d-ab0b-4018-b0f8-7e57c9dd44ea None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.892757 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 512/1021] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:01.898911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc793-1ce5-455a-9906-74131fbce8b2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.899354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc793-1ce5-455a-9906-74131fbce8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.899467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc793-1ce5-455a-9906-74131fbce8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.899963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde9cdc-add1-4d3f-98ad-5e63c4b48ff8 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.900238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde9cdc-add1-4d3f-98ad-5e63c4b48ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.900503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde9cdc-add1-4d3f-98ad-5e63c4b48ff8 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.901999 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 513/1022] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:01.906837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6232-5f3f-456e-bbe1-04ae52cd1471 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.907112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6232-5f3f-456e-bbe1-04ae52cd1471 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.907388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6232-5f3f-456e-bbe1-04ae52cd1471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.918885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d28fc793-1ce5-455a-9906-74131fbce8b2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:01.920085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d28fc793-1ce5-455a-9906-74131fbce8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:01.926142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c5ef6232-5f3f-456e-bbe1-04ae52cd1471 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:01.927302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5ef6232-5f3f-456e-bbe1-04ae52cd1471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:01.996819 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 514/1023] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:02.004797 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 510/1024] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:02.257263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef6232-5f3f-456e-bbe1-04ae52cd1471 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.261780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fc793-1ce5-455a-9906-74131fbce8b2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.265805 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.324475 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.358759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef6232-5f3f-456e-bbe1-04ae52cd1471 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.369555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fc793-1ce5-455a-9906-74131fbce8b2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.393230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55539c-4d1b-4b4a-996d-9bdf9d1cb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.393915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55539c-4d1b-4b4a-996d-9bdf9d1cb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.394187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55539c-4d1b-4b4a-996d-9bdf9d1cb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.394434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55539c-4d1b-4b4a-996d-9bdf9d1cb1c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.395017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55539c-4d1b-4b4a-996d-9bdf9d1cb1c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.396378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55539c-4d1b-4b4a-996d-9bdf9d1cb1c2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0b55539c-4d1b-4b4a-996d-9bdf9d1cb1c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:02.404956 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:02.405942 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:02.406771 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:02.407502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa49f0-b3c8-4ccd-b22f-1ddd320f2c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.407502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa49f0-b3c8-4ccd-b22f-1ddd320f2c36 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.407502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa49f0-b3c8-4ccd-b22f-1ddd320f2c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.407502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa49f0-b3c8-4ccd-b22f-1ddd320f2c36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.407777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 515/1025] 10.222.0.46 () {56 vars in 1105 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:02.408437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e02079-0695-4c04-b495-46f970371d31 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.408873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e02079-0695-4c04-b495-46f970371d31 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.409289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e02079-0695-4c04-b495-46f970371d31 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.410560 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 516/1026] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:02.411976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e02079-0695-4c04-b495-46f970371d31 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.420232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa49f0-b3c8-4ccd-b22f-1ddd320f2c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-76fa49f0-b3c8-4ccd-b22f-1ddd320f2c36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:02.425004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:02.425908 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:02.426745 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 511/1027] 10.222.0.46 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:02.427445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf07d5-3c0d-4ae1-84b9-4c927ce434b0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.427846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf07d5-3c0d-4ae1-84b9-4c927ce434b0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.427953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf07d5-3c0d-4ae1-84b9-4c927ce434b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.446463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1ebf07d5-3c0d-4ae1-84b9-4c927ce434b0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:02.447655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1ebf07d5-3c0d-4ae1-84b9-4c927ce434b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:02.505942 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.515677 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 512/1028] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:02.515984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e02079-0695-4c04-b495-46f970371d31 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.516453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf07d5-3c0d-4ae1-84b9-4c927ce434b0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.552798 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.559061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.559713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.559959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.560232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.560896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] RBAC: Adding query filter params (name=image) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:02.561198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.562612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.568029 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 517/1029] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:02.573928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.638962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf07d5-3c0d-4ae1-84b9-4c927ce434b0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.676734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.677366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.677650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.677906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.678759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:02.678890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.680212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.681875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ae847-62cf-4632-b96f-6ba21ad103be None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.692873 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 513/1030] 10.222.0.46 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:02.694095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.722844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.723569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.723809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.724121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.724805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] RBAC: Adding query filter params (type=image) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:02.725089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.726769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.734854 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 518/1031] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:02.740951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.754746 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.799541 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.804717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce097f85-01c7-46cc-8313-581de64cb9bb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.837777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.838398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.838673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.838941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.841057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d8eb0-afa5-4ab1-96de-e331a8a54386 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.850907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.853024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:02.867058 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:02.868287 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:02.869403 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:02.869403 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:02.869403 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:02.869403 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 514/1032] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:02.869403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.880032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.880643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.880954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.881222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.881921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] RBAC: Adding query filter params (interface=public, service_id=84ba52cbba6a466d8b845c19aaf0b202, region_id=RegionOne) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:02.882220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.883585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.893528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 519/1033] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/endpoints?service_id=84ba52cbba6a466d8b845c19aaf0b202&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:02.893528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.969218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53090adc-9ee0-4cca-abf7-76b585069943 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.978242 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.994293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177009a-95f1-4bb0-ba59-26cbae258ff2 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.003506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.004133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.004411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.004672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.005804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.007237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.009003 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 515/1034] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:03.009596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.021319 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.033403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.034072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.034327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.034610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.035219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:03.035530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.036913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.050533 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 520/1035] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:03.051257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.116417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847000d-9bdd-425e-bde7-3064547f69e7 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.151618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.152230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.152509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.152792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.153406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.154768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.160841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde873-416b-4128-8ebe-e010cf3bca64 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.161492 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 516/1036] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:53:03.162195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.207621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.208257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.208531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.208826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.209490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.210979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.212130 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.241928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 521/1037] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:53:03 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:03.284708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074bf1-d986-4326-87c9-a75b23d0145f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.324523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.325189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.325461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.326168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.337783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.339373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:03.352171 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:03.353478 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:03.354502 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 517/1038] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:03.359482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.403291 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.469404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd38ea5-84e0-46ed-9c4b-509529d73df6 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.507341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.508346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.508827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.509277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.510212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:03.510705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.512317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.532411 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 522/1039] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:03.538674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.652247 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.656007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8712e98-3497-4715-8f15-05ae80c16458 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.692276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.692922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.693289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.693564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.765005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.766536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.865710 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.875474 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 518/1040] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:03.876281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.975945 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.983814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1750-84b8-4e5c-b1a9-737cc5156ffe None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.017883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.018734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.019009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.019277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.029369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.030810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:04.045433 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:04.046361 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:04.047388 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:04.047388 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:04.047388 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:04.047388 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 523/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:04.053865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.159549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e59f39-dc8f-460e-80da-a2dfe79bb33e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.195356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.196050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.196331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.196596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.197260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:04.197558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.198915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.212929 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 519/1042] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:04.216503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.323694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cc62c-54f5-4c79-99b3-c9147550b163 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.358678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.359297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.359567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.359835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.366495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.367938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:04.379944 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:04.381201 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:04.382451 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 524/1043] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:04.387191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.447179 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:04.489363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a6eb-a566-4b29-869b-eccd7def257d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.526795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c062c-37b2-40ca-8297-0d163d693c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.527408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c062c-37b2-40ca-8297-0d163d693c37 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.527683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c062c-37b2-40ca-8297-0d163d693c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.527952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c062c-37b2-40ca-8297-0d163d693c37 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.528643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c062c-37b2-40ca-8297-0d163d693c37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:04.528976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c062c-37b2-40ca-8297-0d163d693c37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.530409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c062c-37b2-40ca-8297-0d163d693c37 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.548294 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 520/1044] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:04.549677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.562196 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:04.654306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b17e3-68d7-4369-90ab-d2d5982dda3c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.687377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac5d07-2db8-406d-ab80-3867fe35d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.687973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5d07-2db8-406d-ab80-3867fe35d1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.688247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5d07-2db8-406d-ab80-3867fe35d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.688514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5d07-2db8-406d-ab80-3867fe35d1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.689258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac5d07-2db8-406d-ab80-3867fe35d1e8 None admin] RBAC: Adding query filter params (role.id=ba3675426e234ee7a7e21c2c03f579a2, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=0ffef7873ae44899a84aa7376be7b8b8) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:04.689563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac5d07-2db8-406d-ab80-3867fe35d1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.691124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac5d07-2db8-406d-ab80-3867fe35d1e8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.705037 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 525/1045] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/role_assignments?user.id=0ffef7873ae44899a84aa7376be7b8b8&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=ba3675426e234ee7a7e21c2c03f579a2 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:05.085472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44cc6-9421-4cea-ba81-db56a3cb3460 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.086000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44cc6-9421-4cea-ba81-db56a3cb3460 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.086000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44cc6-9421-4cea-ba81-db56a3cb3460 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.087382 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 521/1046] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:05.092750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed47b-290d-4a7d-9917-3ee6454c002f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.093183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed47b-290d-4a7d-9917-3ee6454c002f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.093351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed47b-290d-4a7d-9917-3ee6454c002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.112524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b5fed47b-290d-4a7d-9917-3ee6454c002f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:05.113743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b5fed47b-290d-4a7d-9917-3ee6454c002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:05.188564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 526/1047] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:05.221326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3dca5-3903-4eb8-9290-bcd025ec756c None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.221651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3dca5-3903-4eb8-9290-bcd025ec756c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.221954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3dca5-3903-4eb8-9290-bcd025ec756c None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.223543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 522/1048] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:05.229255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba31d15-3449-4d4c-913b-eabf6e6028ed None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.229469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba31d15-3449-4d4c-913b-eabf6e6028ed None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.229774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba31d15-3449-4d4c-913b-eabf6e6028ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.236445 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:05.249442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2ba31d15-3449-4d4c-913b-eabf6e6028ed None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:05.250639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ba31d15-3449-4d4c-913b-eabf6e6028ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:05.320514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 527/1049] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:05.459424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3dca5-3903-4eb8-9290-bcd025ec756c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.599140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3dca5-3903-4eb8-9290-bcd025ec756c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:05.621580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba31d15-3449-4d4c-913b-eabf6e6028ed None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.627816 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:05.656801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:05.657706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.658156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.658497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] PATH_INFO: `/v3/services/image` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.659384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:05.663054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:05.677761 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:05.679030 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:05.679865 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:05.682043 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 523/1050] 10.222.0.46 () {56 vars in 1105 bytes} [Sun Aug 21 00:53:05 2022] GET /identity/v3/services/image => generated 86 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:05.688808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.766918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba31d15-3449-4d4c-913b-eabf6e6028ed None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:05.806906 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:05.813611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:05.814255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.814526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.814872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.820425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda4e1-a454-46ff-8b79-273598630e79 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:05.828283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:05.833518 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:05.834557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:05.835538 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 528/1051] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:05.842385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.870449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:05.871060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.871393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.871666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.872296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] RBAC: Adding query filter params (name=image) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:05.872594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:05.874011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:05.887407 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 524/1052] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:05.890498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.955453 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:05.975761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e15bc5-3387-4606-ade9-17c79a05248e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:06.012620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:06.013256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.013530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.013795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.014449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:06.014744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:06.016365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:06.024275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236cb7-0c33-42ac-994e-4c6b8f9225df None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:06.031862 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 529/1053] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:06.033743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:06.066540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:06.067404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.067667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.067944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.068745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:06.069068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:06.070436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:06.076814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 525/1054] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:06.084323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:06.111259 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:06.175299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca28f90-e4d2-4d57-8ed8-bcd5f8843b1d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:06.214626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:06.215264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.215542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.215823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] PATH_INFO: `/v3/users/dbb87b16790946439e66ffac3c67c4e0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.232726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] RBAC: Authorizing `identity:get_user(user_id=dbb87b16790946439e66ffac3c67c4e0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:06.234239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:06.235891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55180-53ce-46dc-bfa6-5ea62a2246a4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:06.240998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 530/1055] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:06 2022] GET /identity/v3/users/dbb87b16790946439e66ffac3c67c4e0 => generated 285 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:06.242162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:06.257943 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:06.285508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:06.286127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.286439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.287841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.289368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:06.289993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:06.319982 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 526/1056] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:06.367334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e18c-4514-412b-9ec6-feb5bfa2211c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:06.384320 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:06.423909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd1c22-40fe-4c38-bf81-e525a6eee04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:06.424620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1c22-40fe-4c38-bf81-e525a6eee04f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.424930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1c22-40fe-4c38-bf81-e525a6eee04f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.425204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1c22-40fe-4c38-bf81-e525a6eee04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.503139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd1c22-40fe-4c38-bf81-e525a6eee04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:06.504598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd1c22-40fe-4c38-bf81-e525a6eee04f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:06.609433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 531/1057] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:53:06.615659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:06.727109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b679ef-9d1b-4a70-805a-90ffa517662a None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:06.751667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea599b-39bd-48ce-9e68-81bc0071a7a0 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.751996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea599b-39bd-48ce-9e68-81bc0071a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.752234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea599b-39bd-48ce-9e68-81bc0071a7a0 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.753997 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 532/1058] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:06.758980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e41ab-75c5-42c8-b04b-3761053cf2ff None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.759273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e41ab-75c5-42c8-b04b-3761053cf2ff None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.759548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e41ab-75c5-42c8-b04b-3761053cf2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.762051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:06.762715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.762991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.763260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.764360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=84cc76d13464453b84d2e3ce21af8f09)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:06.765827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:06.767592 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 527/1059] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:06 2022] GET /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:06.773819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:06.779981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-db1e41ab-75c5-42c8-b04b-3761053cf2ff None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:06.781278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-db1e41ab-75c5-42c8-b04b-3761053cf2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:06.783403 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:06.812505 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:06.852642 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 533/1060] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:06.886720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35a18-e4da-43a3-9c12-e14ba2aab4c5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:06.921347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:06.921960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.922236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.922499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.923222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=84cc76d13464453b84d2e3ce21af8f09, user.id=dbb87b16790946439e66ffac3c67c4e0) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:06.923523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:06.925103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:06.930780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 528/1061] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:06 2022] GET /identity/v3/role_assignments?user.id=dbb87b16790946439e66ffac3c67c4e0&scope.project.id=84cc76d13464453b84d2e3ce21af8f09&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:07.114964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e41ab-75c5-42c8-b04b-3761053cf2ff None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.219763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e41ab-75c5-42c8-b04b-3761053cf2ff None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.255137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.255774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.256046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.256324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.263226 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:07.268089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:07.272970 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:07.273923 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:07.274864 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:07.279151 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 534/1062] 10.222.0.46 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:07.280384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.382292 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:07.385882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e63-a151-475a-97df-a3464c7a532e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.422406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.422919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.423190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.423455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.424105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:07.424424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:07.425969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:07.435058 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 529/1063] 10.222.0.46 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:07.440706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.550856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296f3f6-b202-40a4-a88e-283155177fe9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.586472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.587105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.587380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.587646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.598174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:07.599624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:07.614555 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:07.615478 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:07.616359 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:07.616359 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:07.616359 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:07.616359 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 535/1064] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:07.622752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.731738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60824c42-42f3-4194-906a-fd4f0242d236 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.766374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.766974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.767247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.767511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.768203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:07.768510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:07.769932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:07.784867 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 530/1065] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:07.787654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.841531 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:07.896929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837967d7-847c-4999-9327-d6f1f6ebe0d0 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.930958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.931978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.932474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.932958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.941242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:07.942913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:07.954390 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:07.955317 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:07.956434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:07.962744 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 536/1066] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:07.964300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.991504 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.071245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc5b47-d791-4cc1-bb75-f1a7b90d716c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.106131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.106761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.107035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.107303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.108027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:08.108325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.109773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.131943 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 531/1067] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:08.134781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.237724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2558b-1c51-46d5-90b0-b842f60d6831 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.248753 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.274223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09385d-02b6-4168-bc23-c6e4ac8bdd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.274848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09385d-02b6-4168-bc23-c6e4ac8bdd5f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.275121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09385d-02b6-4168-bc23-c6e4ac8bdd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.275388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09385d-02b6-4168-bc23-c6e4ac8bdd5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.286253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09385d-02b6-4168-bc23-c6e4ac8bdd5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.287687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09385d-02b6-4168-bc23-c6e4ac8bdd5f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-6e09385d-02b6-4168-bc23-c6e4ac8bdd5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:08.301853 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:08.302788 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:08.308468 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:08.308468 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:08.308468 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:08.308468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 537/1068] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:08.310327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.322152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa09f-9cff-4b8b-a6f2-32cd2286dce6 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.322438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa09f-9cff-4b8b-a6f2-32cd2286dce6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.322714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa09f-9cff-4b8b-a6f2-32cd2286dce6 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.324214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 538/1069] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:08.328930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9ab29-c5d8-4ef1-8c50-99a9fe939639 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.329215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9ab29-c5d8-4ef1-8c50-99a9fe939639 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.329523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9ab29-c5d8-4ef1-8c50-99a9fe939639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.349046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d7d9ab29-c5d8-4ef1-8c50-99a9fe939639 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:08.350243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d7d9ab29-c5d8-4ef1-8c50-99a9fe939639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:08.403358 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.420303 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 539/1070] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:08.424921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1d1d-20fa-494e-a884-cbeef5549cdd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.459906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.460861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.461311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.461768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.462625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:08.463091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.464618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.481139 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 532/1071] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:08.482958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9ab29-c5d8-4ef1-8c50-99a9fe939639 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.577083 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.587036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9ab29-c5d8-4ef1-8c50-99a9fe939639 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.625204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.625825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.626095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.626359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.633191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.634614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:08.645570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:08.646570 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:08.652324 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 540/1072] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:08.654442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.695448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.768118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21e308-ef5c-4cd3-bf02-fb77ccaf0998 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.801257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dca56-7189-415f-9619-0b52c321d6d9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.804853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac69ff-8d2a-4cea-a6af-789fc476e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.805459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac69ff-8d2a-4cea-a6af-789fc476e738 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.805732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac69ff-8d2a-4cea-a6af-789fc476e738 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.805996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac69ff-8d2a-4cea-a6af-789fc476e738 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.806678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac69ff-8d2a-4cea-a6af-789fc476e738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:08.806975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac69ff-8d2a-4cea-a6af-789fc476e738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.808389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac69ff-8d2a-4cea-a6af-789fc476e738 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.819521 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.824129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 533/1073] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:08.830247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f267a-27ac-4242-926f-43e32ca4047d None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.830525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f267a-27ac-4242-926f-43e32ca4047d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.830793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f267a-27ac-4242-926f-43e32ca4047d None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.832064 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 534/1074] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:08.832728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f267a-27ac-4242-926f-43e32ca4047d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.843975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.844579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.844913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.845207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.867729 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.917034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.918501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.938445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f267a-27ac-4242-926f-43e32ca4047d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.972236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdc12e-c628-493c-adf4-5049f934367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.972909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc12e-c628-493c-adf4-5049f934367e None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.973182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc12e-c628-493c-adf4-5049f934367e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.973443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc12e-c628-493c-adf4-5049f934367e None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/0ffef7873ae44899a84aa7376be7b8b8/roles/ba3675426e234ee7a7e21c2c03f579a2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.975606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdc12e-c628-493c-adf4-5049f934367e None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=0ffef7873ae44899a84aa7376be7b8b8, role_id=ba3675426e234ee7a7e21c2c03f579a2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.977378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdc12e-c628-493c-adf4-5049f934367e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.992921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 535/1075] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:08 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/0ffef7873ae44899a84aa7376be7b8b8/roles/ba3675426e234ee7a7e21c2c03f579a2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:53:08.994106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874c70-8837-4dbb-9bee-1fe98e6dd1c1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.994378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874c70-8837-4dbb-9bee-1fe98e6dd1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.994642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874c70-8837-4dbb-9bee-1fe98e6dd1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.014183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3b874c70-8837-4dbb-9bee-1fe98e6dd1c1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:09.015407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3b874c70-8837-4dbb-9bee-1fe98e6dd1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:09.040822 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 541/1076] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:53:09.043927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.085764 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:09.104188 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:09.107552 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 536/1077] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:09.159460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d1dd-ba05-4ec3-8e5c-5ddf0880064d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.194679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.195315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.195597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.195867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.206282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:09.207727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:09.222613 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:09.223569 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:09.224451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:09.224451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:09.224451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:09.224451 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 542/1078] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:09.230422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874c70-8837-4dbb-9bee-1fe98e6dd1c1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.333685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874c70-8837-4dbb-9bee-1fe98e6dd1c1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.369110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.369633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.369907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.370169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.370800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:09.371099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:09.372459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.383199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.384463 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 537/1079] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:09.498834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d88081-38ea-4acf-9e63-d5775f336893 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.501622 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:09.539472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.540110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.540389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.540658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.553168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:09.557827 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:09.558742 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:09.559568 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 543/1080] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:09.565014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.620698 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:09.678683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af783-04c9-4122-b9f5-3e947e0005c4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.714937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.715603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.715886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.716157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.716859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:09.717163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:09.718540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.727649 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 538/1081] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:09.733549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.834279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb643d1d-0a23-49e9-99d2-4c8e32d13c81 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.870500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.871180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.871405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.871674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] PATH_INFO: `/v3/users/dbb87b16790946439e66ffac3c67c4e0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.872803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] RBAC: Authorizing `identity:get_user(user_id=dbb87b16790946439e66ffac3c67c4e0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:09.874289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.875917 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 544/1082] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/users/dbb87b16790946439e66ffac3c67c4e0 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:09.881856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.984730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a882ec5-cfdd-4b64-a95f-d7f635b080c0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.998694 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:10.021149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbb55d-168d-43b0-a9c2-9d8ce2491ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.021778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbb55d-168d-43b0-a9c2-9d8ce2491ada None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.022029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbb55d-168d-43b0-a9c2-9d8ce2491ada None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.022321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbb55d-168d-43b0-a9c2-9d8ce2491ada None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.023480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbb55d-168d-43b0-a9c2-9d8ce2491ada None admin] RBAC: Authorizing `identity:get_project(project_id=84cc76d13464453b84d2e3ce21af8f09)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:10.024953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbb55d-168d-43b0-a9c2-9d8ce2491ada None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:10.026574 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 539/1083] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:10.032562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.067425 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:10.143653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8a15a-60e5-4c4f-aa87-0f3c8f7d091a None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:10.178739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f4390-8626-4124-bef5-3596b5d583a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.179449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f4390-8626-4124-bef5-3596b5d583a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.179655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f4390-8626-4124-bef5-3596b5d583a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.179918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f4390-8626-4124-bef5-3596b5d583a9 None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09/users/dbb87b16790946439e66ffac3c67c4e0/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.181851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f4390-8626-4124-bef5-3596b5d583a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=84cc76d13464453b84d2e3ce21af8f09, user_id=dbb87b16790946439e66ffac3c67c4e0, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:10.183268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f4390-8626-4124-bef5-3596b5d583a9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:10.197118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 545/1084] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:10 2022] PUT /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09/users/dbb87b16790946439e66ffac3c67c4e0/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:53:10.905741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a221fc-9541-4c89-b01f-f94e20bb36d3 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.906321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a221fc-9541-4c89-b01f-f94e20bb36d3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.906321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a221fc-9541-4c89-b01f-f94e20bb36d3 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.907619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 540/1085] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:10.913027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564ae1-cd23-4d3c-868d-ae59b7a1aa3c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.913313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564ae1-cd23-4d3c-868d-ae59b7a1aa3c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.913587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564ae1-cd23-4d3c-868d-ae59b7a1aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.932403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8e564ae1-cd23-4d3c-868d-ae59b7a1aa3c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:10.933620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8e564ae1-cd23-4d3c-868d-ae59b7a1aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:11.000788 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 546/1086] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:11.263496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a221fc-9541-4c89-b01f-f94e20bb36d3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.367837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a221fc-9541-4c89-b01f-f94e20bb36d3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.403413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.404030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.404301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.404563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.415741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:11.420361 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:11.421443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:11.422294 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 541/1087] 10.222.0.46 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:11.427729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564ae1-cd23-4d3c-868d-ae59b7a1aa3c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.453159 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.532428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564ae1-cd23-4d3c-868d-ae59b7a1aa3c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.566699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.567308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.567584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.567855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.568517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:11.568843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.570216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.578467 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 547/1088] 10.222.0.46 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:11.584411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.627296 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.691369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe87b-674f-4eab-ad7f-0a467c36655f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.726473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.727096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.727363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.727622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.737965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.739408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:11.754377 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:11.755354 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:11.756799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:11.756799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:11.756799 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:11.756799 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 542/1089] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:11.761502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.848826 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.866553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a221a2-f029-40dc-88a1-47b7b5b26cca None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.900073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48fc80-e176-44d3-9656-4aa4a00eddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.900676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48fc80-e176-44d3-9656-4aa4a00eddf4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.900980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48fc80-e176-44d3-9656-4aa4a00eddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.901251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48fc80-e176-44d3-9656-4aa4a00eddf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.901896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48fc80-e176-44d3-9656-4aa4a00eddf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:11.902193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48fc80-e176-44d3-9656-4aa4a00eddf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.903559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48fc80-e176-44d3-9656-4aa4a00eddf4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.916508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 548/1090] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:11.922266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.017560 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.027619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6376a75-d08e-4c52-9faa-41c3cc8fe7d9 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.047769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a938a-601f-43e3-aa88-f41e4e2863b1 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.048015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a938a-601f-43e3-aa88-f41e4e2863b1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.048515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a938a-601f-43e3-aa88-f41e4e2863b1 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.050089 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 549/1091] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:12.054982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7967e2-5b31-43e1-b8ea-dd25f30e5272 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.055250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7967e2-5b31-43e1-b8ea-dd25f30e5272 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.055516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7967e2-5b31-43e1-b8ea-dd25f30e5272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.062224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436641-445c-4c48-98da-784be0200076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.062853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436641-445c-4c48-98da-784be0200076 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.063130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436641-445c-4c48-98da-784be0200076 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.063403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436641-445c-4c48-98da-784be0200076 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.071429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b436641-445c-4c48-98da-784be0200076 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.072899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b436641-445c-4c48-98da-784be0200076 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.074027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ea7967e2-5b31-43e1-b8ea-dd25f30e5272 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:12.075204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ea7967e2-5b31-43e1-b8ea-dd25f30e5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-1b436641-445c-4c48-98da-784be0200076 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:12.084328 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:12.085307 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:12.086394 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 543/1092] 10.222.0.46 () {56 vars in 1093 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:12.091242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436641-445c-4c48-98da-784be0200076 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.144986 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 550/1093] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:12.196468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436641-445c-4c48-98da-784be0200076 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.233516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.234129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.234407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.234676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.235405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:12.235707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.237441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.256080 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 544/1094] 10.222.0.46 () {56 vars in 1133 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:12.261926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7967e2-5b31-43e1-b8ea-dd25f30e5272 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.337025 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.362853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7967e2-5b31-43e1-b8ea-dd25f30e5272 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.396371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.396937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.397207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.397476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.407284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.421282 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.466808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.468282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.506785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd8f3-b685-462b-ad28-bb52bf94e3e8 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.539048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.539664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.539931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.540187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.540998 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.550174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:12.554736 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:12.555837 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:12.556681 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 545/1095] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:12.561855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.567483 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 551/1096] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:12.573047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.629653 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.662128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba7c28-1777-472f-b55d-ee9e468a08c9 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.671875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469760c-e6af-43af-b183-182426b1b892 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.696610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.697257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.697525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.697799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.698459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:12.698755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.700123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.705376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.706007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.706285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.706556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.708420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 546/1097] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:12.714145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.717012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.718447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:12.734671 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:12.740562 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:12.741614 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:12.741614 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:12.741614 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:12.741614 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 552/1098] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:12.741614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.771509 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.819521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17649b5-a8aa-4c38-9d7a-439e44dcca49 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.842711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf602d-a054-4e50-9b9c-6cdd762c21fb None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.847962 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.853784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.854500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.854782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.855052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] PATH_INFO: `/v3/users/dbb87b16790946439e66ffac3c67c4e0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.856191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] RBAC: Authorizing `identity:get_user(user_id=dbb87b16790946439e66ffac3c67c4e0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.857659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.859269 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 547/1099] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/users/dbb87b16790946439e66ffac3c67c4e0 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:12.865149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.880840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.881444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.881719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.881981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.882610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:12.882907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.884288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.897300 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 553/1100] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:12.902813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.968916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3ca79-14e4-4a99-aaf2-fc5724a048d0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.992866 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:13.003895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.004504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.004791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.005060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.008935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb54dfe-d10c-4455-b7ef-fe71b85349a2 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.042975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.043601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.043877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.044150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.050689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.052131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:13.063386 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:13.064287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:13.065244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 554/1101] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:13.070363 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:13.070510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:13.072894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.075005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.174077 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 548/1102] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:53:13.175586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4967cb-2fcf-4334-99ec-00c9397af49d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.180828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:13.211069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.211666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.211937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.212197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.212903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:13.213196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.214619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.226903 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 555/1103] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:13.232936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:13.241511 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:13.279897 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:13.283012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0ec1-38d0-446a-836c-adeae7458229 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.323797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.324438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.324734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.325025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.326248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] RBAC: Authorizing `identity:get_project(project_id=84cc76d13464453b84d2e3ce21af8f09)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.327716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.329462 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 549/1104] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:13 2022] GET /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:13.336075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:13.339427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57710dc6-9f48-4bed-81b7-18ea463bc7f6 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.378193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d714f7-fde0-4366-beee-72d349ee74a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.378791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d714f7-fde0-4366-beee-72d349ee74a3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.379058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d714f7-fde0-4366-beee-72d349ee74a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.379319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d714f7-fde0-4366-beee-72d349ee74a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.380046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d714f7-fde0-4366-beee-72d349ee74a3 None admin] RBAC: Adding query filter params (role.id=ba3675426e234ee7a7e21c2c03f579a2, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=0ffef7873ae44899a84aa7376be7b8b8) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:13.380343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d714f7-fde0-4366-beee-72d349ee74a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.381804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d714f7-fde0-4366-beee-72d349ee74a3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.387547 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 556/1105] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:13 2022] GET /identity/v3/role_assignments?user.id=0ffef7873ae44899a84aa7376be7b8b8&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=ba3675426e234ee7a7e21c2c03f579a2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:13.444805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c368b-67fa-469e-a522-d297dca470fd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.484504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d912c1c-c2bc-4254-bdbe-c701877c1e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.485064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912c1c-c2bc-4254-bdbe-c701877c1e92 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.485344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912c1c-c2bc-4254-bdbe-c701877c1e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.485611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912c1c-c2bc-4254-bdbe-c701877c1e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.486377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d912c1c-c2bc-4254-bdbe-c701877c1e92 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=84cc76d13464453b84d2e3ce21af8f09, user.id=dbb87b16790946439e66ffac3c67c4e0) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:13.486722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d912c1c-c2bc-4254-bdbe-c701877c1e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.488830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d912c1c-c2bc-4254-bdbe-c701877c1e92 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.495594 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 550/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:13 2022] GET /identity/v3/role_assignments?user.id=dbb87b16790946439e66ffac3c67c4e0&scope.project.id=84cc76d13464453b84d2e3ce21af8f09&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:15.421452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be873796-fa54-4270-9014-2062f6f494a9 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:15.422263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be873796-fa54-4270-9014-2062f6f494a9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:15.422263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be873796-fa54-4270-9014-2062f6f494a9 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:15.424410 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 557/1107] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:15.430587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec7799-e3bb-4e2f-a16d-71495d7bb2fa None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:15.431269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec7799-e3bb-4e2f-a16d-71495d7bb2fa None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:15.431391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec7799-e3bb-4e2f-a16d-71495d7bb2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:15.458349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f0ec7799-e3bb-4e2f-a16d-71495d7bb2fa None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:15.459553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f0ec7799-e3bb-4e2f-a16d-71495d7bb2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:15.496264 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:15.541264 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 551/1108] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:15.821022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be873796-fa54-4270-9014-2062f6f494a9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:15.915394 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:15.965140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be873796-fa54-4270-9014-2062f6f494a9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.004735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb700-010b-4956-bab3-9b03c1fa1fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.005390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb700-010b-4956-bab3-9b03c1fa1fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.005665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb700-010b-4956-bab3-9b03c1fa1fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.005934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb700-010b-4956-bab3-9b03c1fa1fb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.007180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bb700-010b-4956-bab3-9b03c1fa1fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.008611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bb700-010b-4956-bab3-9b03c1fa1fb0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.010210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 558/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:16.016312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec7799-e3bb-4e2f-a16d-71495d7bb2fa None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:16.122004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec7799-e3bb-4e2f-a16d-71495d7bb2fa None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.158525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4f80-bf7c-4096-8533-d2b65653678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.159131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4f80-bf7c-4096-8533-d2b65653678d None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.159405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4f80-bf7c-4096-8533-d2b65653678d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.159672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4f80-bf7c-4096-8533-d2b65653678d None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.160311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4f80-bf7c-4096-8533-d2b65653678d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.161774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4f80-bf7c-4096-8533-d2b65653678d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.189000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 552/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:53:16 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:18.113502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b9426-acbe-43be-9268-96c3f748867e None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:18.114458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b9426-acbe-43be-9268-96c3f748867e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:18.114458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b9426-acbe-43be-9268-96c3f748867e None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:18.116523 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 559/1111] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:18.122799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47cd1-ab89-4cdf-8d66-6b9e5df0afda None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:18.123242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47cd1-ab89-4cdf-8d66-6b9e5df0afda None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:18.123341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47cd1-ab89-4cdf-8d66-6b9e5df0afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:18.147856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e5c47cd1-ab89-4cdf-8d66-6b9e5df0afda None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:18.149697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e5c47cd1-ab89-4cdf-8d66-6b9e5df0afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:18.166738 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:18.223269 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 553/1112] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:18.488756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b9426-acbe-43be-9268-96c3f748867e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:18.611451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b9426-acbe-43be-9268-96c3f748867e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:18.649849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:18.650465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:18.650739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:18.651006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] PATH_INFO: `/v3/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:18.652454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] RBAC: Authorizing `identity:get_role(role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:18.653862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:18.655191 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 560/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:18 2022] GET /identity/v3/roles/01f130b1020f40bf97184ccb199975bb => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:18.662019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47cd1-ab89-4cdf-8d66-6b9e5df0afda None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:18.770043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47cd1-ab89-4cdf-8d66-6b9e5df0afda None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:18.806794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:18.807412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:18.807686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:18.807949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] PATH_INFO: `/v3/users/bc9b08df48d04c0b9345511cc67e400a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:18.821561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] RBAC: Authorizing `identity:get_user(user_id=bc9b08df48d04c0b9345511cc67e400a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:18.822991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:18.824619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 554/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:18 2022] GET /identity/v3/users/bc9b08df48d04c0b9345511cc67e400a => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:18.831098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:18.840461 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:18.934605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f5f7-7c77-46d7-ba5c-1a105eb93a63 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:18.968015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:18.968607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:18.968895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:18.969159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.037423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.038870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.046194 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:19.151577 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 561/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:19.161063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.174778 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:19.278258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42389c-9624-4795-9ab5-f9ccc238eee8 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.316676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21495d-b322-4bca-bbb7-3ea67d8c202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.317245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21495d-b322-4bca-bbb7-3ea67d8c202f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.317523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21495d-b322-4bca-bbb7-3ea67d8c202f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.317789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21495d-b322-4bca-bbb7-3ea67d8c202f None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.318989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21495d-b322-4bca-bbb7-3ea67d8c202f None admin] RBAC: Authorizing `identity:get_project(project_id=84cc76d13464453b84d2e3ce21af8f09)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.320421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21495d-b322-4bca-bbb7-3ea67d8c202f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.322083 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 555/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:19.328576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.430763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346a07-4c7f-4c3e-bc9c-f6c4d2b43b9e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.438888 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:19.486261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3ee0-82c3-430c-b4b1-76306fd033c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.487086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3ee0-82c3-430c-b4b1-76306fd033c0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.487365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3ee0-82c3-430c-b4b1-76306fd033c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.487610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3ee0-82c3-430c-b4b1-76306fd033c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.488342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3ee0-82c3-430c-b4b1-76306fd033c0 None admin] RBAC: Adding query filter params (role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=84cc76d13464453b84d2e3ce21af8f09, user.id=bc9b08df48d04c0b9345511cc67e400a) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:19.488651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3ee0-82c3-430c-b4b1-76306fd033c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.490151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3ee0-82c3-430c-b4b1-76306fd033c0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.501456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 562/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/role_assignments?user.id=bc9b08df48d04c0b9345511cc67e400a&scope.project.id=84cc76d13464453b84d2e3ce21af8f09&role.id=01f130b1020f40bf97184ccb199975bb => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:21.389180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0a9e6-6f5f-4ed6-9b93-5e28541644f9 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.389719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0a9e6-6f5f-4ed6-9b93-5e28541644f9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:21.389719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0a9e6-6f5f-4ed6-9b93-5e28541644f9 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.390982 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 556/1118] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:21.397424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ad74c-b1b8-4a1d-b235-6e344cce1a81 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.398110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ad74c-b1b8-4a1d-b235-6e344cce1a81 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:21.398252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ad74c-b1b8-4a1d-b235-6e344cce1a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.426518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-351ad74c-b1b8-4a1d-b235-6e344cce1a81 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:21.427724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-351ad74c-b1b8-4a1d-b235-6e344cce1a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:21.505840 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 563/1119] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:21.771226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0a9e6-6f5f-4ed6-9b93-5e28541644f9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:21.863759 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:21.894431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0a9e6-6f5f-4ed6-9b93-5e28541644f9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:21.930652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:21.931263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.931537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:21.931794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] PATH_INFO: `/v3/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.933286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] RBAC: Authorizing `identity:get_role(role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:21.934648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:21.935968 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 557/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:21 2022] GET /identity/v3/roles/01f130b1020f40bf97184ccb199975bb => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:21.942376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ad74c-b1b8-4a1d-b235-6e344cce1a81 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.047696 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:22.052450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ad74c-b1b8-4a1d-b235-6e344cce1a81 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:22.097104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:22.097759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:22.098033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.098297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] PATH_INFO: `/v3/users/bc9b08df48d04c0b9345511cc67e400a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.099462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] RBAC: Authorizing `identity:get_user(user_id=bc9b08df48d04c0b9345511cc67e400a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.101232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.102785 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 564/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:21 2022] GET /identity/v3/users/bc9b08df48d04c0b9345511cc67e400a => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:22.108877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.218072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8227cd-6906-4325-87db-e72d090c7f90 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:22.261080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100950-b8ba-4945-a55f-ed15167488fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:22.261971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100950-b8ba-4945-a55f-ed15167488fd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:22.262314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100950-b8ba-4945-a55f-ed15167488fd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.262660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100950-b8ba-4945-a55f-ed15167488fd None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.264401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85100950-b8ba-4945-a55f-ed15167488fd None admin] RBAC: Authorizing `identity:get_project(project_id=84cc76d13464453b84d2e3ce21af8f09)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.266667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85100950-b8ba-4945-a55f-ed15167488fd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.268659 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 558/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:22 2022] GET /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:22.277585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.382646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111fa0-d2b1-4602-8f82-7da99e1df410 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:22.417908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5267-622e-4aeb-b70e-9b797339d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:22.418522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5267-622e-4aeb-b70e-9b797339d63c None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:22.418818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5267-622e-4aeb-b70e-9b797339d63c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.419067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5267-622e-4aeb-b70e-9b797339d63c None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09/users/bc9b08df48d04c0b9345511cc67e400a/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.421497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe5267-622e-4aeb-b70e-9b797339d63c None admin] RBAC: Authorizing `identity:create_grant(project_id=84cc76d13464453b84d2e3ce21af8f09, user_id=bc9b08df48d04c0b9345511cc67e400a, role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.422922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe5267-622e-4aeb-b70e-9b797339d63c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.439878 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 565/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:22 2022] PUT /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09/users/bc9b08df48d04c0b9345511cc67e400a/roles/01f130b1020f40bf97184ccb199975bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:53:24.301806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18c55-40ff-4a18-95e3-fefc2dcb7f29 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:24.302383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18c55-40ff-4a18-95e3-fefc2dcb7f29 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:24.302383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18c55-40ff-4a18-95e3-fefc2dcb7f29 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:24.303683 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 559/1124] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:24.310092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979685e2-bd9e-4699-93a1-859099456d4b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:24.310864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979685e2-bd9e-4699-93a1-859099456d4b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:24.311006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979685e2-bd9e-4699-93a1-859099456d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:24.337666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-979685e2-bd9e-4699-93a1-859099456d4b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:24.338871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-979685e2-bd9e-4699-93a1-859099456d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:24.365021 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:24.416279 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 566/1125] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:24.691732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd18c55-40ff-4a18-95e3-fefc2dcb7f29 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:24.712565 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:24.810110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd18c55-40ff-4a18-95e3-fefc2dcb7f29 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:24.845603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:24.846283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:24.846563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:24.846837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] PATH_INFO: `/v3/roles/01f130b1020f40bf97184ccb199975bb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:24.848284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] RBAC: Authorizing `identity:get_role(role_id=01f130b1020f40bf97184ccb199975bb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:24.849700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:24.851357 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 560/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:24 2022] GET /identity/v3/roles/01f130b1020f40bf97184ccb199975bb => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:24.857571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979685e2-bd9e-4699-93a1-859099456d4b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:24.978307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979685e2-bd9e-4699-93a1-859099456d4b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.017509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.018151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.018431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.018699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] PATH_INFO: `/v3/users/bc9b08df48d04c0b9345511cc67e400a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.019944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] RBAC: Authorizing `identity:get_user(user_id=bc9b08df48d04c0b9345511cc67e400a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.021406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.022966 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 567/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:24 2022] GET /identity/v3/users/bc9b08df48d04c0b9345511cc67e400a => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:25.032552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:25.117206 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:25.142513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0b0e-9f1a-4fd6-9d61-ad790ff95530 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.180400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.181103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.181391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.181646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.253769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.255136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.331763 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:25.355652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 561/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:25.362074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:25.390211 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:25.466227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982572e-f47b-4a14-8a3a-9aa3201b6067 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.501643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9879a9-5de2-4999-b326-1de70bea299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.502287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9879a9-5de2-4999-b326-1de70bea299e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.502558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9879a9-5de2-4999-b326-1de70bea299e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.502825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9879a9-5de2-4999-b326-1de70bea299e None admin] PATH_INFO: `/v3/projects/84cc76d13464453b84d2e3ce21af8f09` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.504063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9879a9-5de2-4999-b326-1de70bea299e None admin] RBAC: Authorizing `identity:get_project(project_id=84cc76d13464453b84d2e3ce21af8f09)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.505463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9879a9-5de2-4999-b326-1de70bea299e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.507089 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 568/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:25 2022] GET /identity/v3/projects/84cc76d13464453b84d2e3ce21af8f09 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:25.513508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:25.626611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea302f-9627-4ad2-85e0-df69259bde33 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.663711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c60c8-44db-4606-a755-d7dca85e0663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.664367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c60c8-44db-4606-a755-d7dca85e0663 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.664889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c60c8-44db-4606-a755-d7dca85e0663 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.665385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c60c8-44db-4606-a755-d7dca85e0663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.666310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c60c8-44db-4606-a755-d7dca85e0663 None admin] RBAC: Adding query filter params (role.id=01f130b1020f40bf97184ccb199975bb, scope.project.id=84cc76d13464453b84d2e3ce21af8f09, user.id=bc9b08df48d04c0b9345511cc67e400a) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:25.666621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c60c8-44db-4606-a755-d7dca85e0663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.668056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c60c8-44db-4606-a755-d7dca85e0663 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.675769 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 562/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:25 2022] GET /identity/v3/role_assignments?user.id=bc9b08df48d04c0b9345511cc67e400a&scope.project.id=84cc76d13464453b84d2e3ce21af8f09&role.id=01f130b1020f40bf97184ccb199975bb => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:27.653993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c28d0d-88ad-4891-b53b-773fb9d941a4 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:27.654842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c28d0d-88ad-4891-b53b-773fb9d941a4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:27.654842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c28d0d-88ad-4891-b53b-773fb9d941a4 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:27.657019 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 569/1131] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:27.663077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87c8a-40ad-4044-99ac-f46e34d221c6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:27.663473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87c8a-40ad-4044-99ac-f46e34d221c6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:27.663618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87c8a-40ad-4044-99ac-f46e34d221c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:27.684147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7bd87c8a-40ad-4044-99ac-f46e34d221c6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:27.685396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7bd87c8a-40ad-4044-99ac-f46e34d221c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:27.723134 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:27.769322 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 563/1132] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:28.050485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c28d0d-88ad-4891-b53b-773fb9d941a4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:28.159248 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:28.167966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c28d0d-88ad-4891-b53b-773fb9d941a4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:28.205619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f5989-639b-43fc-94ec-eb0742ba060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:28.206237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5989-639b-43fc-94ec-eb0742ba060d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.206505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5989-639b-43fc-94ec-eb0742ba060d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.206772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5989-639b-43fc-94ec-eb0742ba060d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.207927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f5989-639b-43fc-94ec-eb0742ba060d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:28.209393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f5989-639b-43fc-94ec-eb0742ba060d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:28.210965 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 570/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:28.217138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87c8a-40ad-4044-99ac-f46e34d221c6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:28.325580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87c8a-40ad-4044-99ac-f46e34d221c6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:28.360923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57341302-ed0e-4ede-95bc-a82400d694d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:28.361440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57341302-ed0e-4ede-95bc-a82400d694d6 None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.361715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57341302-ed0e-4ede-95bc-a82400d694d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.361981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57341302-ed0e-4ede-95bc-a82400d694d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.362626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57341302-ed0e-4ede-95bc-a82400d694d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:28.364054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57341302-ed0e-4ede-95bc-a82400d694d6 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:28.398533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 564/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:28 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:30.305102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f5aa-1c4d-4bee-9af3-30ae8830a09a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:30.305988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f5aa-1c4d-4bee-9af3-30ae8830a09a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:30.305988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f5aa-1c4d-4bee-9af3-30ae8830a09a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:30.308142 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 571/1135] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:30.319324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2978-f35f-41ab-a66c-7570cb6d2ad1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:30.320054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2978-f35f-41ab-a66c-7570cb6d2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:30.320240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2978-f35f-41ab-a66c-7570cb6d2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:30.351215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-82ff2978-f35f-41ab-a66c-7570cb6d2ad1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:30.353223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-82ff2978-f35f-41ab-a66c-7570cb6d2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:30.375426 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:30.428853 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 565/1136] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:30.702367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f5aa-1c4d-4bee-9af3-30ae8830a09a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:30.823219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f5aa-1c4d-4bee-9af3-30ae8830a09a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:30.859925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df68acb-0bae-447c-84f9-d840e4672778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:30.860539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df68acb-0bae-447c-84f9-d840e4672778 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:30.860898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df68acb-0bae-447c-84f9-d840e4672778 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:30.861162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df68acb-0bae-447c-84f9-d840e4672778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:30.863959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df68acb-0bae-447c-84f9-d840e4672778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:30.865438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df68acb-0bae-447c-84f9-d840e4672778 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:30.867024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 572/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:30.876364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff2978-f35f-41ab-a66c-7570cb6d2ad1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:30.993344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff2978-f35f-41ab-a66c-7570cb6d2ad1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:31.028851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6aac9-49bb-48b9-b1ac-158070cd4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:31.029449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6aac9-49bb-48b9-b1ac-158070cd4ebd None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:31.029721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6aac9-49bb-48b9-b1ac-158070cd4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:31.029993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6aac9-49bb-48b9-b1ac-158070cd4ebd None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:31.030624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6aac9-49bb-48b9-b1ac-158070cd4ebd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:31.032044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6aac9-49bb-48b9-b1ac-158070cd4ebd None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:31.060407 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 566/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:53:30 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:32.984549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9084-d743-4efa-8d74-88abbd936d8c None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:32.985541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9084-d743-4efa-8d74-88abbd936d8c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:32.985541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9084-d743-4efa-8d74-88abbd936d8c None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:32.988000 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 573/1139] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:32.994350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dfe6c-cc9a-40a7-9c0e-3a64e8434d5d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:32.995038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dfe6c-cc9a-40a7-9c0e-3a64e8434d5d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:32.995229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dfe6c-cc9a-40a7-9c0e-3a64e8434d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.016349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a21dfe6c-cc9a-40a7-9c0e-3a64e8434d5d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:33.017591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a21dfe6c-cc9a-40a7-9c0e-3a64e8434d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:33.020360 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:33.095879 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 567/1140] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:33.370425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9084-d743-4efa-8d74-88abbd936d8c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.410202 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:33.486430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9084-d743-4efa-8d74-88abbd936d8c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.530464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.531099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.531376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.531646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.541949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:33.546718 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:33.547936 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:33.549847 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 574/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:33.556281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dfe6c-cc9a-40a7-9c0e-3a64e8434d5d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.669238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dfe6c-cc9a-40a7-9c0e-3a64e8434d5d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.705858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.706441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.706677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.706959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.707612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:33.707903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:33.709301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:33.718161 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 568/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:33.724825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.845857 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:33.861597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48955aa8-90af-4f66-8b85-a9f2b96b2580 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.906500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.907124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.907434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.907669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] PATH_INFO: `/v3/users/1a617accdb5c49e89dae3a3dcfd52b68` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.921721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] RBAC: Authorizing `identity:get_user(user_id=1a617accdb5c49e89dae3a3dcfd52b68)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:33.923061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:33.924794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 575/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/users/1a617accdb5c49e89dae3a3dcfd52b68 => generated 286 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:33.931367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.934848 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:34.037934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2885bf5-e295-4492-a1da-b1664e7e69a4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:34.074345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:34.074934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.075175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.075473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.145095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:34.146554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:34.148352 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:34.269029 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 569/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:34.275877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:34.399100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34aec7-60f8-48ce-8c80-0de882665f9c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:34.440491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651607d0-2169-44ba-8346-dd4dedadfccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:34.441135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651607d0-2169-44ba-8346-dd4dedadfccb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.441409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651607d0-2169-44ba-8346-dd4dedadfccb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.441675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651607d0-2169-44ba-8346-dd4dedadfccb None admin] PATH_INFO: `/v3/projects/895d65f62b1548e1819cbfaa67f826f1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.442886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651607d0-2169-44ba-8346-dd4dedadfccb None admin] RBAC: Authorizing `identity:get_project(project_id=895d65f62b1548e1819cbfaa67f826f1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:34.444307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651607d0-2169-44ba-8346-dd4dedadfccb None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:34.446021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 576/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:34 2022] GET /identity/v3/projects/895d65f62b1548e1819cbfaa67f826f1 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:34.452487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:34.559765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134b6a2-9c22-4d88-9fb7-086eff25b21e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:34.561440 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:34.598082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f3e9-b1cd-44c5-92d1-8841ba8cf13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:34.598673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f3e9-b1cd-44c5-92d1-8841ba8cf13c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.598948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f3e9-b1cd-44c5-92d1-8841ba8cf13c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.599221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f3e9-b1cd-44c5-92d1-8841ba8cf13c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.599939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868f3e9-b1cd-44c5-92d1-8841ba8cf13c None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=895d65f62b1548e1819cbfaa67f826f1, user.id=1a617accdb5c49e89dae3a3dcfd52b68) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:34.600560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868f3e9-b1cd-44c5-92d1-8841ba8cf13c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:34.602027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868f3e9-b1cd-44c5-92d1-8841ba8cf13c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:34.607469 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 570/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:34 2022] GET /identity/v3/role_assignments?user.id=1a617accdb5c49e89dae3a3dcfd52b68&scope.project.id=895d65f62b1548e1819cbfaa67f826f1&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:36.470054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126467-2de8-436c-b194-aa2c8302ae84 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.471230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126467-2de8-436c-b194-aa2c8302ae84 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.471691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126467-2de8-436c-b194-aa2c8302ae84 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.473870 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 577/1147] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:36.482807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a5bc-d0a6-4e3b-98e1-06d5fb9908cd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.483509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a5bc-d0a6-4e3b-98e1-06d5fb9908cd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.483649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a5bc-d0a6-4e3b-98e1-06d5fb9908cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.505671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a9a7a5bc-d0a6-4e3b-98e1-06d5fb9908cd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:36.506862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a9a7a5bc-d0a6-4e3b-98e1-06d5fb9908cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:36.580612 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 571/1148] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:36.848335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126467-2de8-436c-b194-aa2c8302ae84 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:36.879026 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:36.974161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126467-2de8-436c-b194-aa2c8302ae84 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.011755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.012367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.012645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.012942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.024087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:37.028738 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:37.029794 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:37.030798 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:37.033123 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 578/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:37.036559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a5bc-d0a6-4e3b-98e1-06d5fb9908cd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.133075 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:37.140359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a5bc-d0a6-4e3b-98e1-06d5fb9908cd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.180149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.180760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.181069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.181335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.182137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:37.182440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:37.183820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:37.192834 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 572/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:37.199251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.283234 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:37.314004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead26143-56f1-4a8b-981a-e59e8b4a795f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.351198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.351818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.352090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.352362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] PATH_INFO: `/v3/users/1a617accdb5c49e89dae3a3dcfd52b68` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.353574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] RBAC: Authorizing `identity:get_user(user_id=1a617accdb5c49e89dae3a3dcfd52b68)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:37.355009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:37.356583 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 579/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:37 2022] GET /identity/v3/users/1a617accdb5c49e89dae3a3dcfd52b68 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:37.363617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.475247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1086-77ea-47fc-bcee-b1146cfe4f30 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.512183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cc9c3-f224-41f3-a14c-c4fb54063273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.512805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc9c3-f224-41f3-a14c-c4fb54063273 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.513083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc9c3-f224-41f3-a14c-c4fb54063273 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.513354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc9c3-f224-41f3-a14c-c4fb54063273 None admin] PATH_INFO: `/v3/projects/895d65f62b1548e1819cbfaa67f826f1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.514759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cc9c3-f224-41f3-a14c-c4fb54063273 None admin] RBAC: Authorizing `identity:get_project(project_id=895d65f62b1548e1819cbfaa67f826f1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:37.516189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cc9c3-f224-41f3-a14c-c4fb54063273 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:37.517845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 573/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:37 2022] GET /identity/v3/projects/895d65f62b1548e1819cbfaa67f826f1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:37.527069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.634440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8cc9f-ef1c-4336-b29c-fad7527056b5 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.669181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbe8f7-77e2-4663-9a35-1ac5bca98e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.669827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbe8f7-77e2-4663-9a35-1ac5bca98e9d None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.670070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbe8f7-77e2-4663-9a35-1ac5bca98e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.670360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbe8f7-77e2-4663-9a35-1ac5bca98e9d None admin] PATH_INFO: `/v3/projects/895d65f62b1548e1819cbfaa67f826f1/users/1a617accdb5c49e89dae3a3dcfd52b68/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.672369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbe8f7-77e2-4663-9a35-1ac5bca98e9d None admin] RBAC: Authorizing `identity:create_grant(project_id=895d65f62b1548e1819cbfaa67f826f1, user_id=1a617accdb5c49e89dae3a3dcfd52b68, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:37.674037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbe8f7-77e2-4663-9a35-1ac5bca98e9d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:37.691220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 580/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:37 2022] PUT /identity/v3/projects/895d65f62b1548e1819cbfaa67f826f1/users/1a617accdb5c49e89dae3a3dcfd52b68/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:53:39.582811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae77ea-00c3-4210-8cd1-40b91ce83766 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:39.583684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae77ea-00c3-4210-8cd1-40b91ce83766 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:39.583684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae77ea-00c3-4210-8cd1-40b91ce83766 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:39.585756 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 574/1154] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:39.594927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ef59-6e91-4fe7-ae30-b1fcb7cfae8a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:39.595710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ef59-6e91-4fe7-ae30-b1fcb7cfae8a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:39.595989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ef59-6e91-4fe7-ae30-b1fcb7cfae8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:39.604131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:39.618948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a6a6ef59-6e91-4fe7-ae30-b1fcb7cfae8a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:39.620903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6a6ef59-6e91-4fe7-ae30-b1fcb7cfae8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:39.694680 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 581/1155] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:39.963263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae77ea-00c3-4210-8cd1-40b91ce83766 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.003614 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.098909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae77ea-00c3-4210-8cd1-40b91ce83766 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.135541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.136280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.136644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.137050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.151078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:40.155723 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:40.156918 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:40.157858 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 575/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:40.163264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6ef59-6e91-4fe7-ae30-b1fcb7cfae8a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.274433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6ef59-6e91-4fe7-ae30-b1fcb7cfae8a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.309759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.310389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.310672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.310980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.311648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:40.311948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.313414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.314815 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.322541 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 582/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:40.335080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.430084 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.445372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6344b69-edff-47c9-9d15-682afdda2153 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.480093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.480708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.481026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.481296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] PATH_INFO: `/v3/users/1a617accdb5c49e89dae3a3dcfd52b68` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.482518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] RBAC: Authorizing `identity:get_user(user_id=1a617accdb5c49e89dae3a3dcfd52b68)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.483951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.485773 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 576/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:40 2022] GET /identity/v3/users/1a617accdb5c49e89dae3a3dcfd52b68 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:40.491969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.606718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111699ff-324a-455d-ae64-091eabed0c7c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.644647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.645263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.645534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.645798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.707494 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.715215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.716645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.821882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 583/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:40.828861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.963148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee26b9-ac33-4cc4-878f-07f1b0c43041 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.998653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a51c1-4ee2-4307-a116-dc47ff9ae328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.999270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a51c1-4ee2-4307-a116-dc47ff9ae328 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.999545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a51c1-4ee2-4307-a116-dc47ff9ae328 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.999812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a51c1-4ee2-4307-a116-dc47ff9ae328 None admin] PATH_INFO: `/v3/projects/895d65f62b1548e1819cbfaa67f826f1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:41.001132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a51c1-4ee2-4307-a116-dc47ff9ae328 None admin] RBAC: Authorizing `identity:get_project(project_id=895d65f62b1548e1819cbfaa67f826f1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:41.002552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a51c1-4ee2-4307-a116-dc47ff9ae328 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:41.004189 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 577/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:40 2022] GET /identity/v3/projects/895d65f62b1548e1819cbfaa67f826f1 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:41.010957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:41.114927 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:41.125016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e5dfb-2bb2-4645-94b8-c93d4191389c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:41.161422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2043b30-39ac-421c-ba1a-7397f9638d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:41.162022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2043b30-39ac-421c-ba1a-7397f9638d07 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:41.162296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2043b30-39ac-421c-ba1a-7397f9638d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:41.162562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2043b30-39ac-421c-ba1a-7397f9638d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:41.163285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2043b30-39ac-421c-ba1a-7397f9638d07 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=895d65f62b1548e1819cbfaa67f826f1, user.id=1a617accdb5c49e89dae3a3dcfd52b68) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:41.163588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2043b30-39ac-421c-ba1a-7397f9638d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:41.165040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2043b30-39ac-421c-ba1a-7397f9638d07 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:41.170632 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 584/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:41 2022] GET /identity/v3/role_assignments?user.id=1a617accdb5c49e89dae3a3dcfd52b68&scope.project.id=895d65f62b1548e1819cbfaa67f826f1&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:43.077631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82c2f9-ce6f-4be1-b88e-6d7fbe2d2db2 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.078189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82c2f9-ce6f-4be1-b88e-6d7fbe2d2db2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.078189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82c2f9-ce6f-4be1-b88e-6d7fbe2d2db2 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.079558 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 578/1162] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:43.085941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5e6b-e534-4e87-a47e-62f2f10895f2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.086696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5e6b-e534-4e87-a47e-62f2f10895f2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.086816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5e6b-e534-4e87-a47e-62f2f10895f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.114380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bb0e5e6b-e534-4e87-a47e-62f2f10895f2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:43.115578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb0e5e6b-e534-4e87-a47e-62f2f10895f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:43.188674 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 585/1163] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:43.457746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82c2f9-ce6f-4be1-b88e-6d7fbe2d2db2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:43.486950 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:43.571373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82c2f9-ce6f-4be1-b88e-6d7fbe2d2db2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:43.607104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:43.607696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.607972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.608238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.681207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:43.682652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:43.707735 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:43.790724 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 579/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:43.797523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e5e6b-e534-4e87-a47e-62f2f10895f2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:43.894068 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:43.903923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e5e6b-e534-4e87-a47e-62f2f10895f2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:43.938841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336aa8a-bce9-420f-b2d5-eac73eca24ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:43.939453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336aa8a-bce9-420f-b2d5-eac73eca24ae None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.939723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336aa8a-bce9-420f-b2d5-eac73eca24ae None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.939984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336aa8a-bce9-420f-b2d5-eac73eca24ae None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.946764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336aa8a-bce9-420f-b2d5-eac73eca24ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:43.948199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336aa8a-bce9-420f-b2d5-eac73eca24ae None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-9336aa8a-bce9-420f-b2d5-eac73eca24ae None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:43.961213 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:43.963463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:53:43.965471 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 586/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:53:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:43.970003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:44.082605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef2d6e-8fef-4782-9eb1-28d9ed959be3 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:44.105630 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:44.117814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde1ab4-eaa0-45c2-97b6-cdb04f97ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:44.118416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1ab4-eaa0-45c2-97b6-cdb04f97ff99 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:44.118690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1ab4-eaa0-45c2-97b6-cdb04f97ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:44.118960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1ab4-eaa0-45c2-97b6-cdb04f97ff99 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:44.119600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde1ab4-eaa0-45c2-97b6-cdb04f97ff99 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:44.119897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde1ab4-eaa0-45c2-97b6-cdb04f97ff99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:44.121335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde1ab4-eaa0-45c2-97b6-cdb04f97ff99 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:44.128487 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 580/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:46.024700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d54ca-d58b-44a9-a09c-e2dd576324d9 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.025325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d54ca-d58b-44a9-a09c-e2dd576324d9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.025325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d54ca-d58b-44a9-a09c-e2dd576324d9 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.026608 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 587/1167] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:46.033205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146b23a-365a-410a-ad2f-6b68477f94df None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.033845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146b23a-365a-410a-ad2f-6b68477f94df None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.034243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146b23a-365a-410a-ad2f-6b68477f94df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.058401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a146b23a-365a-410a-ad2f-6b68477f94df None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:46.059586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a146b23a-365a-410a-ad2f-6b68477f94df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:46.130452 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 581/1168] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:46.399760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d54ca-d58b-44a9-a09c-e2dd576324d9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.512587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d54ca-d58b-44a9-a09c-e2dd576324d9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:46.553415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638368c-d2e9-4140-8a19-2aa4bc3822fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:46.554013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638368c-d2e9-4140-8a19-2aa4bc3822fc None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.554293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638368c-d2e9-4140-8a19-2aa4bc3822fc None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.554564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638368c-d2e9-4140-8a19-2aa4bc3822fc None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.555221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638368c-d2e9-4140-8a19-2aa4bc3822fc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:46.556606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638368c-d2e9-4140-8a19-2aa4bc3822fc None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:46.579668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 588/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Sun Aug 21 00:53:46 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:48.567559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285d6e2-fe65-4744-b954-99b99c14b023 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:48.568461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285d6e2-fe65-4744-b954-99b99c14b023 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:48.568461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285d6e2-fe65-4744-b954-99b99c14b023 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:48.570651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 582/1170] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:48.579698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18ddb7-de69-4d7f-be39-c4ccde61d45a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:48.580162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18ddb7-de69-4d7f-be39-c4ccde61d45a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:48.580258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18ddb7-de69-4d7f-be39-c4ccde61d45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:48.601954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1c18ddb7-de69-4d7f-be39-c4ccde61d45a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:48.603143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1c18ddb7-de69-4d7f-be39-c4ccde61d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:48.606151 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:48.687483 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 589/1171] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:48.974289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285d6e2-fe65-4744-b954-99b99c14b023 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:49.115554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285d6e2-fe65-4744-b954-99b99c14b023 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:49.132997 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:49.152609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30a3ec-cb35-44e7-b885-098e724d114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:49.153272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a3ec-cb35-44e7-b885-098e724d114f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:49.153552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a3ec-cb35-44e7-b885-098e724d114f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:49.153828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a3ec-cb35-44e7-b885-098e724d114f None admin] PATH_INFO: `/v3/domains/f6f70fc5007547009feae3c805acd32e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:49.164813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30a3ec-cb35-44e7-b885-098e724d114f None admin] RBAC: Authorizing `identity:get_domain(domain_id=f6f70fc5007547009feae3c805acd32e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:49.166267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30a3ec-cb35-44e7-b885-098e724d114f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:49.167895 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 583/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Sun Aug 21 00:53:48 2022] GET /identity/v3/domains/f6f70fc5007547009feae3c805acd32e => generated 267 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:49.174892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18ddb7-de69-4d7f-be39-c4ccde61d45a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:49.294217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18ddb7-de69-4d7f-be39-c4ccde61d45a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:49.330785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4e8a5-dd49-4f79-a753-2053073e7ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:49.331376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4e8a5-dd49-4f79-a753-2053073e7ecf None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:49.331653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4e8a5-dd49-4f79-a753-2053073e7ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:49.331922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4e8a5-dd49-4f79-a753-2053073e7ecf None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:49.332548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4e8a5-dd49-4f79-a753-2053073e7ecf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:49.334016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4e8a5-dd49-4f79-a753-2053073e7ecf None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:49.345063 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:49.362634 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 590/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:49 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:51.335445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bcdf9-35ae-40b7-8a8e-fc8ca17787d9 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.336271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bcdf9-35ae-40b7-8a8e-fc8ca17787d9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.336271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bcdf9-35ae-40b7-8a8e-fc8ca17787d9 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.338512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 584/1174] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:51.344027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b29764-6953-4d1b-b432-611a0636cb47 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.344478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b29764-6953-4d1b-b432-611a0636cb47 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.345094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b29764-6953-4d1b-b432-611a0636cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.365837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-63b29764-6953-4d1b-b432-611a0636cb47 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:51.367028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63b29764-6953-4d1b-b432-611a0636cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:51.440503 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 591/1175] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:51.716364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bcdf9-35ae-40b7-8a8e-fc8ca17787d9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:51.839594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bcdf9-35ae-40b7-8a8e-fc8ca17787d9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:51.876220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d214-633e-4a59-87c9-0d7e35d0efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:51.876873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d214-633e-4a59-87c9-0d7e35d0efaa None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.877138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d214-633e-4a59-87c9-0d7e35d0efaa None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.877408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d214-633e-4a59-87c9-0d7e35d0efaa None admin] PATH_INFO: `/v3/domains/f6f70fc5007547009feae3c805acd32e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.878619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d214-633e-4a59-87c9-0d7e35d0efaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=f6f70fc5007547009feae3c805acd32e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:51.880049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d214-633e-4a59-87c9-0d7e35d0efaa None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:51.881660 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 585/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Sun Aug 21 00:53:51 2022] GET /identity/v3/domains/f6f70fc5007547009feae3c805acd32e => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:51.891038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b29764-6953-4d1b-b432-611a0636cb47 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:52.006940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b29764-6953-4d1b-b432-611a0636cb47 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:52.030186 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:52.044021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1db2-881c-426b-bc92-51c36910f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:52.044621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1db2-881c-426b-bc92-51c36910f356 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:52.044941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1db2-881c-426b-bc92-51c36910f356 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:52.045216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1db2-881c-426b-bc92-51c36910f356 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:52.045853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1db2-881c-426b-bc92-51c36910f356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:52.047386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1db2-881c-426b-bc92-51c36910f356 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:52.077416 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 592/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:53:51 2022] POST /identity/v3/users => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:54.100500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472ad1-7666-4baf-bcc7-5dfad8804b5b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.101106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472ad1-7666-4baf-bcc7-5dfad8804b5b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.101106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472ad1-7666-4baf-bcc7-5dfad8804b5b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.103094 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 586/1178] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:54.111506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956185-367d-460f-bb62-d9520a179789 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.111904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956185-367d-460f-bb62-d9520a179789 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.112096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956185-367d-460f-bb62-d9520a179789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.136163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6d956185-367d-460f-bb62-d9520a179789 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:54.137372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d956185-367d-460f-bb62-d9520a179789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:54.212078 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 593/1179] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:54.490500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32472ad1-7666-4baf-bcc7-5dfad8804b5b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:54.554304 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:54.611759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32472ad1-7666-4baf-bcc7-5dfad8804b5b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.650286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:54.650901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.651180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.651449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.662795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:54.667443 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:54.668551 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:54.670017 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 587/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:54.678056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956185-367d-460f-bb62-d9520a179789 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:54.793216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956185-367d-460f-bb62-d9520a179789 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.802955 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:54.830942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:54.831535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.831811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.832076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.832738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:54.833074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:54.834439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:54.843313 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 594/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:54.851319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:54.958539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff5450-37cc-491e-8ada-7b5c8d565c38 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.960963 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:55.004259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.005225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.005615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.005960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] PATH_INFO: `/v3/users/752a4b311a9a47c88b170c8321621d87` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.024257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] RBAC: Authorizing `identity:get_user(user_id=752a4b311a9a47c88b170c8321621d87)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.025740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.027316 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 588/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/users/752a4b311a9a47c88b170c8321621d87 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:55.034128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.146628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b651-e8cb-485c-bd62-b603cb9a4153 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:55.183448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.184048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.184325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.184593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.225969 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:55.259135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.260589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.375460 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 595/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:55.382596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.500379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31347-248c-42da-90e1-6cdc83e3da2e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:55.540325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c40cf-860a-44a0-a1fc-84d1fa2d8395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.540970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c40cf-860a-44a0-a1fc-84d1fa2d8395 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.541246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c40cf-860a-44a0-a1fc-84d1fa2d8395 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.541518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c40cf-860a-44a0-a1fc-84d1fa2d8395 None admin] PATH_INFO: `/v3/projects/054b8c4818114aa0b0fcc9a987885de7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.542811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c40cf-860a-44a0-a1fc-84d1fa2d8395 None admin] RBAC: Authorizing `identity:get_project(project_id=054b8c4818114aa0b0fcc9a987885de7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.544240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c40cf-860a-44a0-a1fc-84d1fa2d8395 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.545913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 589/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:55 2022] GET /identity/v3/projects/054b8c4818114aa0b0fcc9a987885de7 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:55.553043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.628264 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:55.669888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582732-f92e-4837-b3d2-99963e4df4e7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:55.707287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d53643-9212-4154-ad9d-9c4925838481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.707871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53643-9212-4154-ad9d-9c4925838481 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.708138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53643-9212-4154-ad9d-9c4925838481 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.708405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53643-9212-4154-ad9d-9c4925838481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.709152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d53643-9212-4154-ad9d-9c4925838481 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=054b8c4818114aa0b0fcc9a987885de7, user.id=752a4b311a9a47c88b170c8321621d87) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:55.709450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d53643-9212-4154-ad9d-9c4925838481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.710874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d53643-9212-4154-ad9d-9c4925838481 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.716244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 596/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:55 2022] GET /identity/v3/role_assignments?user.id=752a4b311a9a47c88b170c8321621d87&scope.project.id=054b8c4818114aa0b0fcc9a987885de7&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:57.577978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526cded-8a5a-4566-8bfb-71629b649f5e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:57.578769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526cded-8a5a-4566-8bfb-71629b649f5e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:57.578769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526cded-8a5a-4566-8bfb-71629b649f5e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:57.580037 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 590/1186] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:57.586292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d7bf-707b-47dc-8495-f627e6661043 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:57.586747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d7bf-707b-47dc-8495-f627e6661043 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:57.586845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d7bf-707b-47dc-8495-f627e6661043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:57.608797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4e26d7bf-707b-47dc-8495-f627e6661043 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:57.610102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4e26d7bf-707b-47dc-8495-f627e6661043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:57.686190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 597/1187] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:57.963807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526cded-8a5a-4566-8bfb-71629b649f5e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.007817 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.087913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526cded-8a5a-4566-8bfb-71629b649f5e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.139670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.140045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.140191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.140905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.153938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:58.158612 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:58.159839 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:53:58.160890 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 591/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:58.166165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d7bf-707b-47dc-8495-f627e6661043 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.233729 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.272420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d7bf-707b-47dc-8495-f627e6661043 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.308956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.309550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.309820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.310061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.310744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:58.311037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.312413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.320804 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 598/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:58.326913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.428261 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.441665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c585-e946-436f-9529-ed3c072b7bdd None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.477689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.478303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.478575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.478840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] PATH_INFO: `/v3/users/752a4b311a9a47c88b170c8321621d87` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.479979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] RBAC: Authorizing `identity:get_user(user_id=752a4b311a9a47c88b170c8321621d87)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.481427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.483097 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 592/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/users/752a4b311a9a47c88b170c8321621d87 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:58.489324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.599710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88acce-00c1-4321-9043-3482e0c631a7 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.626251 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.637783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e426ed7-6375-41d9-8647-725c1e4c6529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.638411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e426ed7-6375-41d9-8647-725c1e4c6529 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.638683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e426ed7-6375-41d9-8647-725c1e4c6529 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.638950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e426ed7-6375-41d9-8647-725c1e4c6529 None admin] PATH_INFO: `/v3/projects/054b8c4818114aa0b0fcc9a987885de7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.640153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e426ed7-6375-41d9-8647-725c1e4c6529 None admin] RBAC: Authorizing `identity:get_project(project_id=054b8c4818114aa0b0fcc9a987885de7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.641684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e426ed7-6375-41d9-8647-725c1e4c6529 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.643306 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 599/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/projects/054b8c4818114aa0b0fcc9a987885de7 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:58.650280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.758512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37297e4d-2bf3-436b-8732-5f6abc0667b2 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.797629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87503f10-a2a5-4e7f-a57f-dc5d46181e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.798275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503f10-a2a5-4e7f-a57f-dc5d46181e9b None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.798552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503f10-a2a5-4e7f-a57f-dc5d46181e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.798825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503f10-a2a5-4e7f-a57f-dc5d46181e9b None admin] PATH_INFO: `/v3/projects/054b8c4818114aa0b0fcc9a987885de7/users/752a4b311a9a47c88b170c8321621d87/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.800879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87503f10-a2a5-4e7f-a57f-dc5d46181e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=054b8c4818114aa0b0fcc9a987885de7, user_id=752a4b311a9a47c88b170c8321621d87, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.802303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87503f10-a2a5-4e7f-a57f-dc5d46181e9b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.818789 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 593/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:58 2022] PUT /identity/v3/projects/054b8c4818114aa0b0fcc9a987885de7/users/752a4b311a9a47c88b170c8321621d87/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:54:00.695123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5e38-c130-4de8-8116-a74541036a10 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.695681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5e38-c130-4de8-8116-a74541036a10 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.695681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5e38-c130-4de8-8116-a74541036a10 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.697019 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 600/1193] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:00.706021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8505e-1095-47b6-aeb7-a3e8131bf96c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.706708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8505e-1095-47b6-aeb7-a3e8131bf96c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.706920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8505e-1095-47b6-aeb7-a3e8131bf96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.731211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f2f8505e-1095-47b6-aeb7-a3e8131bf96c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:00.732406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f2f8505e-1095-47b6-aeb7-a3e8131bf96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:00.747187 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:00.806786 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 594/1194] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:01.074359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5e38-c130-4de8-8116-a74541036a10 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:01.192487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5e38-c130-4de8-8116-a74541036a10 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:01.229940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:01.230563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:01.230841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:01.231110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:01.243128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:54:01.247817 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:01.248920 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:01.250100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:54:01.252939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 601/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:54:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:54:01.255727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8505e-1095-47b6-aeb7-a3e8131bf96c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:01.363514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8505e-1095-47b6-aeb7-a3e8131bf96c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:01.403487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:01.404085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:01.404366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:01.404632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:01.405328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:01.405627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:01.407070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:01.415828 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 595/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:54:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:01.421823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:01.483305 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:01.533629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa860-942e-4916-b28d-9c3d6640826b None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:01.569787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:01.570412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:01.570688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:01.570958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] PATH_INFO: `/v3/users/752a4b311a9a47c88b170c8321621d87` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:01.572111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] RBAC: Authorizing `identity:get_user(user_id=752a4b311a9a47c88b170c8321621d87)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:01.573588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:01.575169 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 602/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:01 2022] GET /identity/v3/users/752a4b311a9a47c88b170c8321621d87 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:01.584058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:01.597909 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:01.689793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb29c0-28ba-4472-9829-9d5761f98e68 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:01.726041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:01.726662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:01.726897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:01.727168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:01.802653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:01.804096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:01.816479 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:01.908062 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 596/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:01.917026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:02.021620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeee05-241c-46d4-b468-495b0f0532a2 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:02.046704 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:02.059348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b878e9-a94c-4b7b-996e-f22708344a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:02.059967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b878e9-a94c-4b7b-996e-f22708344a10 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:02.060236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b878e9-a94c-4b7b-996e-f22708344a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:02.060499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b878e9-a94c-4b7b-996e-f22708344a10 None admin] PATH_INFO: `/v3/projects/054b8c4818114aa0b0fcc9a987885de7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:02.061684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b878e9-a94c-4b7b-996e-f22708344a10 None admin] RBAC: Authorizing `identity:get_project(project_id=054b8c4818114aa0b0fcc9a987885de7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:02.063136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b878e9-a94c-4b7b-996e-f22708344a10 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:02.064752 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 603/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:01 2022] GET /identity/v3/projects/054b8c4818114aa0b0fcc9a987885de7 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:02.071220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:02.196893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba562530-672b-4f9d-a69f-39703725eb16 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:02.207987 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:02.237087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5556b9-aee2-4e1c-bbe5-9f0ab8d00230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:02.237686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5556b9-aee2-4e1c-bbe5-9f0ab8d00230 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:02.237961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5556b9-aee2-4e1c-bbe5-9f0ab8d00230 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:02.238229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5556b9-aee2-4e1c-bbe5-9f0ab8d00230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:02.238945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5556b9-aee2-4e1c-bbe5-9f0ab8d00230 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=054b8c4818114aa0b0fcc9a987885de7, user.id=752a4b311a9a47c88b170c8321621d87) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:02.239258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5556b9-aee2-4e1c-bbe5-9f0ab8d00230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:02.240675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5556b9-aee2-4e1c-bbe5-9f0ab8d00230 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:02.246564 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 597/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:02 2022] GET /identity/v3/role_assignments?user.id=752a4b311a9a47c88b170c8321621d87&scope.project.id=054b8c4818114aa0b0fcc9a987885de7&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:12.055112 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:12.244234 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=13 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:58.045085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febace18-3f3e-4f3e-ab46-74ce5ce47181 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:58.045677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febace18-3f3e-4f3e-ab46-74ce5ce47181 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:58.045677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febace18-3f3e-4f3e-ab46-74ce5ce47181 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:58.047253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 604/1201] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:58.053768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936a4c-383f-499d-b52a-6fe6017dbf63 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:58.054334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936a4c-383f-499d-b52a-6fe6017dbf63 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:58.054334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936a4c-383f-499d-b52a-6fe6017dbf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:58.074198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ab936a4c-383f-499d-b52a-6fe6017dbf63 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:58.075458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab936a4c-383f-499d-b52a-6fe6017dbf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:58.160888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 598/1202] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:58.470374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febace18-3f3e-4f3e-ab46-74ce5ce47181 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:58.610774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febace18-3f3e-4f3e-ab46-74ce5ce47181 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:58.650965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:58.652093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:58.652443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:58.652720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:58.669085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:58.671341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:54:58.689952 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:58.691531 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:54:58.692940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:54:58.692940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:54:58.692940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:54:58.693649 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 605/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:54:58.701551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab936a4c-383f-499d-b52a-6fe6017dbf63 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:58.856891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab936a4c-383f-499d-b52a-6fe6017dbf63 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:58.912401 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:58.919892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557ad91-5849-4af5-a874-442b67a301ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:58.920585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ad91-5849-4af5-a874-442b67a301ae None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:58.920968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ad91-5849-4af5-a874-442b67a301ae None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:58.921311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ad91-5849-4af5-a874-442b67a301ae None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:58.922020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557ad91-5849-4af5-a874-442b67a301ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:58.922350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557ad91-5849-4af5-a874-442b67a301ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:58.924065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557ad91-5849-4af5-a874-442b67a301ae None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:58.941621 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 599/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:58.947761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:59.025449 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:59.090157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2967e8-1066-4aae-aa61-c351c81386b9 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:59.129748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aaa5b-61b5-46e1-9f86-f687c14ed0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:59.138436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aaa5b-61b5-46e1-9f86-f687c14ed0c8 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:59.138436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aaa5b-61b5-46e1-9f86-f687c14ed0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:59.138436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aaa5b-61b5-46e1-9f86-f687c14ed0c8 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:59.138436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aaa5b-61b5-46e1-9f86-f687c14ed0c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:59.138436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aaa5b-61b5-46e1-9f86-f687c14ed0c8 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:59.168804 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 606/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Sun Aug 21 00:54:58 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:55:01.211706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a532-d0e2-4837-8bb7-96c9c5d26ee9 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:01.212255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a532-d0e2-4837-8bb7-96c9c5d26ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:01.212255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a532-d0e2-4837-8bb7-96c9c5d26ee9 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:01.214129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 600/1206] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:01.222675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126681-54a8-48c7-aace-4fd6e01a4ad6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:01.222675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126681-54a8-48c7-aace-4fd6e01a4ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:01.227756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126681-54a8-48c7-aace-4fd6e01a4ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:01.248899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-27126681-54a8-48c7-aace-4fd6e01a4ad6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:01.250468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27126681-54a8-48c7-aace-4fd6e01a4ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:01.391886 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 607/1207] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:01.702534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a532-d0e2-4837-8bb7-96c9c5d26ee9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:01.924865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a532-d0e2-4837-8bb7-96c9c5d26ee9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:01.973700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:01.974046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:01.974325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:01.974628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:01.989829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:01.996409 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:01.997713 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:01.998549 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 601/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:02.004416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126681-54a8-48c7-aace-4fd6e01a4ad6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:02.078821 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:02.201308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126681-54a8-48c7-aace-4fd6e01a4ad6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:02.253580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:02.254603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:02.255194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:02.255663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:02.260883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:02.260883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:02.260883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:02.269532 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 608/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:02.275688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:02.341727 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:02.413957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b9e38-eb29-45a2-8457-743d02d0a77e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:02.462471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:02.463296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:02.463578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:02.463998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:02.479517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:02.481486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:02.501300 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:02.502311 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:02.503218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:02.503218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:02.503218 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:02.503218 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 602/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:02.507969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:02.659605 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:02.663086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211949af-d512-4909-bccd-724c7ac6671c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:02.735644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:02.735644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:02.735644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:02.735644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:02.736120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:02.736120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:02.737574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:02.751895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 609/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:02.758596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:02.886824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d9cdb-afb3-4b38-ac66-5e8b46b44439 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:02.887771 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:02.925459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:02.926877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:02.926877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:02.927179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:02.940069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:02.942445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:55:02.955768 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:02.957093 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:02.958250 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:02.959883 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 603/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:02.965822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:03.104667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72015-69d5-41e6-ae51-440fd9de1222 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:03.155483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:03.156372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:03.156722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:03.157111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:03.158042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:03.158482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:03.160153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:03.186898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 610/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Sun Aug 21 00:55:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:03.190334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:03.328346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a6f15-6cb5-4dc7-8af5-694bf89caa74 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:03.372146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:03.372931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:03.373219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:03.373479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:03.408922 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:03.452857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:03.454656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:03.579732 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 604/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:55:03.585611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:03.608325 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:03.701962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25e89-f0d2-4a72-8495-3814d305fbce None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:03.739832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:03.740615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:03.740926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:03.741198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:03.754112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:03.755578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:03.771142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:03.776843 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:03.778024 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:03.778024 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:03.778024 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:03.778024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 611/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:03.778308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:03.849609 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:03.896868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a3fc6-726e-45f4-8cf4-35d92a2d64fc None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:03.938760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:03.939363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:03.939639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:03.939902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:03.940540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:03.940866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:03.943039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:03.957255 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 605/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:03.962979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:04.051347 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:04.091759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4b440-64cf-4ca7-b06e-5241ecc77716 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:04.131449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:04.132321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:04.132712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:04.133123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:04.143715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:04.145539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:55:04.160366 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:04.161706 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:04.162860 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:04.168330 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 612/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:04.170077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:04.285970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71948e10-46ec-48d1-9e3b-2ac6356b5b30 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:04.315174 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:04.328148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59497c2-794d-4f9c-a088-5de56201e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:04.328756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59497c2-794d-4f9c-a088-5de56201e70c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:04.329421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59497c2-794d-4f9c-a088-5de56201e70c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:04.329421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59497c2-794d-4f9c-a088-5de56201e70c None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:04.330011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59497c2-794d-4f9c-a088-5de56201e70c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:04.330313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59497c2-794d-4f9c-a088-5de56201e70c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:04.331744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59497c2-794d-4f9c-a088-5de56201e70c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:04.345557 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 606/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:04.353093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:04.465550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284409d9-21a5-4b7f-b74c-64850ca3e9d4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:04.497200 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:04.506663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8178d82-d084-48d8-b308-4311c403cf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:04.507359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8178d82-d084-48d8-b308-4311c403cf6c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:04.507655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8178d82-d084-48d8-b308-4311c403cf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:04.508127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8178d82-d084-48d8-b308-4311c403cf6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:04.509032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8178d82-d084-48d8-b308-4311c403cf6c None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=609c592713644ef587afdbe37af676e0) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:04.509340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8178d82-d084-48d8-b308-4311c403cf6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:04.512838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8178d82-d084-48d8-b308-4311c403cf6c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:04.518034 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 613/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:04 2022] GET /identity/v3/role_assignments?user.id=609c592713644ef587afdbe37af676e0&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:06.484186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef9c76-fd3f-4e4c-9170-cd4917fe8d4b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:06.484702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef9c76-fd3f-4e4c-9170-cd4917fe8d4b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:06.484702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef9c76-fd3f-4e4c-9170-cd4917fe8d4b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:06.486012 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 607/1220] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:06.492024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab850-c3fd-4aa4-a038-7f1124ded2d9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:06.492448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab850-c3fd-4aa4-a038-7f1124ded2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:06.492607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab850-c3fd-4aa4-a038-7f1124ded2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:06.511764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0dbab850-c3fd-4aa4-a038-7f1124ded2d9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:06.513122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0dbab850-c3fd-4aa4-a038-7f1124ded2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:06.587265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 614/1221] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:06.887104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef9c76-fd3f-4e4c-9170-cd4917fe8d4b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:06.998516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef9c76-fd3f-4e4c-9170-cd4917fe8d4b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.038889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.039541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.039853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.040203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.052180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:07.057120 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:07.058261 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:07.059389 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 608/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:55:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:07.064668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab850-c3fd-4aa4-a038-7f1124ded2d9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:07.170366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab850-c3fd-4aa4-a038-7f1124ded2d9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.196611 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:07.209368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.210011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.210324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.210617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.211349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:07.211687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:07.213181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:07.222435 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 615/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:07.228253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:07.274956 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:07.336920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dbd1c-ac6e-45c5-a913-02d8a891150e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.372345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.373027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.373310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.373578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.383873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:07.385538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:07.401201 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:07.402387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:07.404111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:07.404111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:07.404111 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:07.404111 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 609/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:07.408284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:07.516287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00afb3-d068-4da2-977f-e39c63627d6c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.566934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.567551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.567857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.568096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.568738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:07.569074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:07.570554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:07.583156 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 616/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:07.589077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:07.696202 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:07.702926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f021a6f-ccde-42bb-8ff3-5614d9649abb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.736741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.737404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.737674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.738019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.745961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:07.747448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:55:07.758610 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:07.759726 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:07.760843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 610/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:07.765956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:07.824327 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:07.883594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c8aa-2009-4002-987c-3bf3e8543f81 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.918427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.919134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.919392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.919660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.920433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:07.920733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:07.922183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:07.939614 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 617/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:07.945604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:08.053922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ccecc-4d98-4785-a2d7-f61ee4f62c1e None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:08.090826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:08.091454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:08.091728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:08.091998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:08.103873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:08.105307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:08.120930 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:08.122494 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:08.123581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:08.123581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:08.123581 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:08.123581 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 611/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:55:08.129226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:08.246117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0312c-a7ce-42d2-8f81-0db6b7e4b786 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:08.248603 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:08.281768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:08.282376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:08.282664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:08.282949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:08.283564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:08.283862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:08.285273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:08.298731 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 618/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:08.303898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:08.315209 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:08.426930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ff35f-33fa-47fb-a89c-bd1a6fbb0c9b None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:08.470137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:08.471089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:08.471357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:08.471614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:08.484233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:08.485715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:55:08.498119 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:08.499446 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:08.500582 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 612/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:08.505872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:08.642837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32157c-3084-48a7-b0d7-3fd5f2874f64 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:08.690254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fdbed-8ef7-43d7-b2b2-5111d9687a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:08.691128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fdbed-8ef7-43d7-b2b2-5111d9687a78 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:08.691431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fdbed-8ef7-43d7-b2b2-5111d9687a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:08.691687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fdbed-8ef7-43d7-b2b2-5111d9687a78 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:08.692904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fdbed-8ef7-43d7-b2b2-5111d9687a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:08.693437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fdbed-8ef7-43d7-b2b2-5111d9687a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:08.695823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fdbed-8ef7-43d7-b2b2-5111d9687a78 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:08.717283 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 619/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:08.724544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:08.813813 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:08.860613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4f8fe-71d9-4728-809c-cb93889a8c6d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:08.904729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1efe8-c6db-4f61-8eb9-dfc349eb468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:08.905436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1efe8-c6db-4f61-8eb9-dfc349eb468b None admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:08.905833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1efe8-c6db-4f61-8eb9-dfc349eb468b None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:08.906166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1efe8-c6db-4f61-8eb9-dfc349eb468b None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/609c592713644ef587afdbe37af676e0/roles/04b947d4d06d4c7080930518a54559c4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:08.929921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1efe8-c6db-4f61-8eb9-dfc349eb468b None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=609c592713644ef587afdbe37af676e0, role_id=04b947d4d06d4c7080930518a54559c4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:08.932528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1efe8-c6db-4f61-8eb9-dfc349eb468b None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:08.951780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 613/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:08 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/609c592713644ef587afdbe37af676e0/roles/04b947d4d06d4c7080930518a54559c4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:10.985248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12e72-aa34-4ad9-b112-f4cd28d75e16 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.985879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12e72-aa34-4ad9-b112-f4cd28d75e16 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.985879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12e72-aa34-4ad9-b112-f4cd28d75e16 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:10.987216 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 620/1233] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:10.992531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddeee5-c35c-4983-9018-3cba15a82f6a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.992974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddeee5-c35c-4983-9018-3cba15a82f6a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.993081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddeee5-c35c-4983-9018-3cba15a82f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:11.012294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b8ddeee5-c35c-4983-9018-3cba15a82f6a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:11.013636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b8ddeee5-c35c-4983-9018-3cba15a82f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:11.089508 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 614/1234] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:11.354089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc12e72-aa34-4ad9-b112-f4cd28d75e16 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:11.384450 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:11.465688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc12e72-aa34-4ad9-b112-f4cd28d75e16 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:11.505065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:11.505800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:11.506163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:11.506498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:11.516894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:11.521557 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:11.522701 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:55:11.523789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:11.527869 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 621/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Sun Aug 21 00:55:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:11.529344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddeee5-c35c-4983-9018-3cba15a82f6a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:11.578870 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:11.635580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddeee5-c35c-4983-9018-3cba15a82f6a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:11.672577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:11.673234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:11.673515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:11.673771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:11.674436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] RBAC: Adding query filter params (name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:11.674729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:11.676104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:11.689334 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 615/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Sun Aug 21 00:55:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:11.690560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:11.790558 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:11.807915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21c994-ed04-4810-aede-601eaad19b35 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:11.850565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:11.851315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:11.851663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:11.851936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:11.862699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:11.864177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:11.880100 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:11.881237 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:11.882266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:11.882266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:11.882266 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:11.887035 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 622/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:11.888259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:11.993510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b342f87-fcc7-41ea-9c98-f1c4175d798d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:12.002741 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:12.030093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:12.030804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:12.031070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:12.031381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:12.032122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:12.032408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:12.033839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:12.046241 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 616/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:12.052292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:12.168380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017ffa-3a6e-41f0-b299-b30c794d1dd4 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:12.204203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:12.204953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:12.205231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:12.205513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:12.208951 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:12.214655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:12.216793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:55:12.230214 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:12.231772 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:12.232958 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 623/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:55:12.240514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:12.346564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76de4e-7411-4ae5-9c29-6325338c7c4f None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:12.381369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:12.381945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:12.382293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:12.382511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:12.383193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:12.383490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:12.385043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:12.410609 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 617/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Sun Aug 21 00:55:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:12.412505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:12.526238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097abba-78b0-4a36-ac7e-aa012614a32e None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:12.568926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:12.570633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:12.570633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:12.570633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:12.639298 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:12.648686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:12.650558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:12.789164 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 624/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:55:12.796738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:12.827093 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:12.908049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff435ecf-01bc-4e6b-b94c-7c8ba49dc1d4 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:12.948674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:12.949346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:12.950148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:12.950429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:12.963368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:12.965281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:12.983684 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:12.984710 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:12.986059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:12.986059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:12.986059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:12.986059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 618/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:12.990656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:13.095305 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:13.102699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814f3d-77d1-4e79-a906-6de41fbc724c None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:13.142908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:13.143620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.143954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.144279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.145066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:13.145435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:13.146853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:13.158578 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 625/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:13.164370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:13.255622 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:13.277721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3840-80e9-4d8d-a647-f6d82a48208c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:13.313931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:13.314560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.314840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.315106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.321966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:13.323398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:55:13.336147 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:13.337284 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:13.338312 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 619/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:13.346214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:13.451825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b739-c161-458f-afea-cc81043d1f39 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:13.491271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b564b7-01d4-4ce7-8b1e-d48a632b1a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:13.491992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b564b7-01d4-4ce7-8b1e-d48a632b1a0e None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.492361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b564b7-01d4-4ce7-8b1e-d48a632b1a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.492683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b564b7-01d4-4ce7-8b1e-d48a632b1a0e None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.493609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b564b7-01d4-4ce7-8b1e-d48a632b1a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:13.493959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b564b7-01d4-4ce7-8b1e-d48a632b1a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:13.495674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b564b7-01d4-4ce7-8b1e-d48a632b1a0e None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:13.509384 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 626/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:13.516744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:13.633986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35bef5-4972-4c80-bb0c-f93f3f4c7edb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:13.673592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506f66b-30c5-45ec-9e33-82e6c5d6f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:13.674210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f66b-30c5-45ec-9e33-82e6c5d6f232 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.674487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f66b-30c5-45ec-9e33-82e6c5d6f232 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.674755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f66b-30c5-45ec-9e33-82e6c5d6f232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.675544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506f66b-30c5-45ec-9e33-82e6c5d6f232 None admin] RBAC: Adding query filter params (role.id=04b947d4d06d4c7080930518a54559c4, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=609c592713644ef587afdbe37af676e0) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:13.675810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506f66b-30c5-45ec-9e33-82e6c5d6f232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:13.677316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506f66b-30c5-45ec-9e33-82e6c5d6f232 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:13.683748 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 620/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:13 2022] GET /identity/v3/role_assignments?user.id=609c592713644ef587afdbe37af676e0&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=04b947d4d06d4c7080930518a54559c4 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:15.686495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c582-9b48-4ee1-acad-51c0412a613a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.687042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c582-9b48-4ee1-acad-51c0412a613a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.687042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c582-9b48-4ee1-acad-51c0412a613a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.688371 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 627/1247] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:15.693838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4411-1e92-4e0a-8cf7-2250e6e73da5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.695269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4411-1e92-4e0a-8cf7-2250e6e73da5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.695269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4411-1e92-4e0a-8cf7-2250e6e73da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.701542 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:15.717386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3e6e4411-1e92-4e0a-8cf7-2250e6e73da5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:15.719016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3e6e4411-1e92-4e0a-8cf7-2250e6e73da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:15.794693 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 621/1248] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:16.065928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3c582-9b48-4ee1-acad-51c0412a613a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:16.086456 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:16.183928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3c582-9b48-4ee1-acad-51c0412a613a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:16.221399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:16.222037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:16.222315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:16.222582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:16.234880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:16.239793 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:16.240899 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:16.242009 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 628/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:16.247309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4411-1e92-4e0a-8cf7-2250e6e73da5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:16.355038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4411-1e92-4e0a-8cf7-2250e6e73da5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:16.386492 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:16.391946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:16.393591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:16.393591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:16.393591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:16.394011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:16.394313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:16.395979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:16.405786 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 622/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:16.412073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:16.504614 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:16.533838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504cfbd-f519-4cff-ac12-792e2a181d51 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:16.580117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:16.580947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:16.581286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:16.581674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:16.595114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:16.597077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:16.615655 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:16.616722 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:16.617684 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:16.617684 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:16.617684 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:16.617684 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 629/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:16.623765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:16.736390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89aead-6aca-4774-a3e2-d435b977daa0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:16.772959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:16.773590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:16.773867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:16.774132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:16.774943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:16.775181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:16.776679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:16.796165 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 623/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:16.798091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:16.919024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bb40e-f621-4d91-b8c8-a7e9d709119d None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:16.950366 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:16.959610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:16.960346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:16.960686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:16.961010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:16.970954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:16.972549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:55:16.984866 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:16.986092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:16.987082 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 630/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:16.992485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:17.062639 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:17.116457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca8853-0cfe-42d8-aa4e-bf70024ce3d5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:17.158148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:17.158762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.159067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.159306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.160240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:17.160545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:17.162037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:17.182939 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 624/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Sun Aug 21 00:55:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:17.189302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:17.305596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7f7d-611c-40cb-b1ba-fd7a4d706aeb None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:17.343602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:17.344279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.344642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.344998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.409954 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:17.424878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:17.426519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:17.537267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 631/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:55:17.543246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:17.664464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befddb7-af94-406d-b122-7093a2c66a51 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:17.677949 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:17.698755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:17.699427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.699720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.699977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.709911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:17.711344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:17.727531 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:17.728905 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:17.730125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:17.730125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:17.730125 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:17.730125 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 625/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:55:17.735792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:17.832158 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:17.846870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f8f22-16b9-4ca1-ac5e-623d107f61d1 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:17.882432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:17.883041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.883315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.883580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.884220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:17.884518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:17.885916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:17.897582 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 632/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:17.903935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.018006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add9e9-511d-4b23-89df-9c25883d28b9 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.053161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.053795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.054069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.054344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.061219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.062655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:55:18.077004 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:18.078336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:18.079431 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 626/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:18.084336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.197702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f46eb-1151-44ef-bed9-7597cd306619 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.239693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa946-5f5d-49df-a87f-aaa787ef0389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.240315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa946-5f5d-49df-a87f-aaa787ef0389 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.240669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa946-5f5d-49df-a87f-aaa787ef0389 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.240973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa946-5f5d-49df-a87f-aaa787ef0389 None admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.241658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa946-5f5d-49df-a87f-aaa787ef0389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:18.241961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa946-5f5d-49df-a87f-aaa787ef0389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.243529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa946-5f5d-49df-a87f-aaa787ef0389 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.258660 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 633/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:18.267213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.304748 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:18.388541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157720dd-80b5-40aa-a205-4bd021d080fb None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.424548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f15101-1b68-4819-9918-104086c1d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.425428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15101-1b68-4819-9918-104086c1d889 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.425708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15101-1b68-4819-9918-104086c1d889 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.425998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15101-1b68-4819-9918-104086c1d889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.426718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f15101-1b68-4819-9918-104086c1d889 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=609c592713644ef587afdbe37af676e0) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:18.427013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f15101-1b68-4819-9918-104086c1d889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.428903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f15101-1b68-4819-9918-104086c1d889 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.435259 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 627/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:18 2022] GET /identity/v3/role_assignments?user.id=609c592713644ef587afdbe37af676e0&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=fd13fde432a246499375976d02e43d56 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:20.369321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d7f2-5bf8-437f-91d7-64ab6e9d1c0b None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:20.370216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d7f2-5bf8-437f-91d7-64ab6e9d1c0b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:20.370216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d7f2-5bf8-437f-91d7-64ab6e9d1c0b None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:20.372396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 634/1261] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:20.377727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb70c-7b22-4b1e-b55a-3ea444412bbf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:20.378170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb70c-7b22-4b1e-b55a-3ea444412bbf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:20.378277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb70c-7b22-4b1e-b55a-3ea444412bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:20.397897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bd1cb70c-7b22-4b1e-b55a-3ea444412bbf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:20.398993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bd1cb70c-7b22-4b1e-b55a-3ea444412bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:20.469149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 628/1262] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:20.747524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201d7f2-5bf8-437f-91d7-64ab6e9d1c0b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:20.765437 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:20.864001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201d7f2-5bf8-437f-91d7-64ab6e9d1c0b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:20.900246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:20.900890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:20.901164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:20.901440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:20.912005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:20.916694 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:20.917976 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:20.919069 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 635/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:20.924088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cb70c-7b22-4b1e-b55a-3ea444412bbf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:20.944307 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:21.027530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cb70c-7b22-4b1e-b55a-3ea444412bbf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.069716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5824176-136b-4686-891f-655518e111a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.070319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5824176-136b-4686-891f-655518e111a0 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.070594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5824176-136b-4686-891f-655518e111a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.070867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5824176-136b-4686-891f-655518e111a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.071538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5824176-136b-4686-891f-655518e111a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:21.071927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5824176-136b-4686-891f-655518e111a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.073331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5824176-136b-4686-891f-655518e111a0 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.081740 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 629/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:21.087897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:21.164558 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:21.215381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd37eb1-3d5d-4c89-a78e-f31df1b09907 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.256164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.256811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.257078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.257347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.268134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.269613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:21.284292 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:21.285428 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:21.286697 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:21.286697 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:21.286697 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:21.286697 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 636/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:21.293130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5824176-136b-4686-891f-655518e111a0 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:21.376154 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:21.396595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5824176-136b-4686-891f-655518e111a0 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.431557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.432149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.432422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.432690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.433365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:21.433698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.435071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.446923 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 630/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:21.456285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:21.573417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b7e26-d11d-4112-8558-48f3771a2f32 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.594418 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:21.609568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.610199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.610476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.610747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.618339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.619788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:55:21.631246 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:21.632334 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:21.633524 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 637/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:21.638825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:21.757103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c60be-781c-4090-9b18-4cba03892cef None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.796788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.797403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.797670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.797932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.798651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:21.798953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.800375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.809197 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:21.817955 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 631/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Sun Aug 21 00:55:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:21.826309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:21.930849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a1dd-a1ee-454c-85c4-5d3c0a234f45 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.965960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.966563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.966835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.967106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.978383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.979829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:21.993988 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:21.995084 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:21.996683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:21.996683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:21.996683 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:21.996683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 638/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:22.003089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:22.118897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165995d-00cb-4a80-873d-b8f414f614f6 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:22.156045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:22.156654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:22.156956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:22.157219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:22.157850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:22.158146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:22.159509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:22.171186 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 632/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:22.180309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:22.219082 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:22.308272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2787e9-6966-4b55-9c76-67b6e756b350 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:22.344104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:22.344723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:22.345345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:22.345617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:22.352594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:22.354143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:55:22.365516 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:22.366539 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:22.367777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 639/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:22.372975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:22.432527 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:22.484058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13f0e-5024-4ef5-bd72-3c8537bcd5a7 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:22.522111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc13d69-3400-4c2b-9510-c6dd070d3209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:22.522705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc13d69-3400-4c2b-9510-c6dd070d3209 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:22.522981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc13d69-3400-4c2b-9510-c6dd070d3209 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:22.523252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc13d69-3400-4c2b-9510-c6dd070d3209 None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:22.523949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc13d69-3400-4c2b-9510-c6dd070d3209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:22.524241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc13d69-3400-4c2b-9510-c6dd070d3209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:22.525698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc13d69-3400-4c2b-9510-c6dd070d3209 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:22.538047 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 633/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:22.547256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:22.661878 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:22.673144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0421b-6f5b-4ce3-95d3-d573d9213e54 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:22.709953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797f52-d1e9-4440-9861-a1eaaa24b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:22.710599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797f52-d1e9-4440-9861-a1eaaa24b6a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:22.710898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797f52-d1e9-4440-9861-a1eaaa24b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:22.711143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797f52-d1e9-4440-9861-a1eaaa24b6a2 None admin] PATH_INFO: `/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/609c592713644ef587afdbe37af676e0/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:22.713318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797f52-d1e9-4440-9861-a1eaaa24b6a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=17cc8cf359884968a7d28733cf2489c4, user_id=609c592713644ef587afdbe37af676e0, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:22.714825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797f52-d1e9-4440-9861-a1eaaa24b6a2 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:22.730113 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 640/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:22 2022] PUT /identity/v3/projects/17cc8cf359884968a7d28733cf2489c4/users/609c592713644ef587afdbe37af676e0/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:24.619243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90603d-cc9b-40f2-b324-aaca189a7ecf None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.619799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90603d-cc9b-40f2-b324-aaca189a7ecf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.619799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90603d-cc9b-40f2-b324-aaca189a7ecf None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:24.621299 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 634/1274] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:24.627627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510b53-02ed-4520-bc63-058cd6a1be4e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.628362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510b53-02ed-4520-bc63-058cd6a1be4e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.628533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510b53-02ed-4520-bc63-058cd6a1be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:24.651069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e3510b53-02ed-4520-bc63-058cd6a1be4e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:24.652670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3510b53-02ed-4520-bc63-058cd6a1be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:24.726188 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 641/1275] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:24.993419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90603d-cc9b-40f2-b324-aaca189a7ecf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.104852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90603d-cc9b-40f2-b324-aaca189a7ecf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.122479 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.141033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.141676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.141950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.142215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.153098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:25.157734 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:25.158874 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:25.160158 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 635/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:25.164942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510b53-02ed-4520-bc63-058cd6a1be4e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.263214 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.284373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510b53-02ed-4520-bc63-058cd6a1be4e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.320606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.321228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.321507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.321776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.322443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:25.322739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.324608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.332949 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 642/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:25.342568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.449022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b45604-ee60-4249-a60c-2a552448cd8c None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.487712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.488322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.488596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.488892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.499540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.500998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:25.515097 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:25.516061 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:25.517117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:25.517117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:25.517117 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:25.517117 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 636/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:25.523007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.650618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3a97b-2fb0-48c2-b51c-23f5ee240286 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.687527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.688119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.688392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.688653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.689320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:25.689624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.690989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.702967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 643/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:25.709059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.742451 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.832474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a11b1-400e-4d4e-9f47-f432c937ee01 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.868862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.869470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.869740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.870000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.877691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.879118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:55:25.890173 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:25.891249 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:55:25.892412 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:25.896017 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 637/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:25.897152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.901131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.008462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d396d2-7e70-41ad-8c6b-e5df32fe8fd1 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.044043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.044638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.044943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.045210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.045936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:26.046240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.047681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.064673 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 644/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:26.071235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.166559 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.181033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5822ef-453a-44ce-bba3-ed903317d639 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.224203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.224806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.225119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.225390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.297786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.299243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.412090 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.425514 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 638/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:55:26.431758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.495284 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.539999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792cd27-d917-4700-b629-694b8c42ea8f None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.578330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.578951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.579221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.579485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.589807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.591238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:26.606165 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:26.607250 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:26.608427 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:26.608427 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:26.608427 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:26.608427 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 645/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:26.613230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.719199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21e24-6db7-4bfb-8266-02a996c3b392 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.754377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.754967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.755242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.755504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.756135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:26.756429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.757817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.770400 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 639/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:26.779314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.895455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb4b1-32cc-4341-b82c-00eee8405945 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.909561 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.932980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.933797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.934079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.934355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.941616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.943059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:55:26.954715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:26.955819 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 00:55:26.957447 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 646/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:26.966077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.029498 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:27.081890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a90a0-971b-4339-b8ee-9bef2e17cb74 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.120264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52feab-7f87-4252-af75-13350937b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.120889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52feab-7f87-4252-af75-13350937b3de None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.121168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52feab-7f87-4252-af75-13350937b3de None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.121437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52feab-7f87-4252-af75-13350937b3de None admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.122125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52feab-7f87-4252-af75-13350937b3de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:27.122431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52feab-7f87-4252-af75-13350937b3de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.123869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52feab-7f87-4252-af75-13350937b3de None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.136383 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 640/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:27.142775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.246712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155574-c27a-4599-a71f-7eddee00ccb3 None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.285133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3b416-4c14-4f5e-9150-3ed3c9f4f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.285640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3b416-4c14-4f5e-9150-3ed3c9f4f304 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.285907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3b416-4c14-4f5e-9150-3ed3c9f4f304 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.286175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3b416-4c14-4f5e-9150-3ed3c9f4f304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.286881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3b416-4c14-4f5e-9150-3ed3c9f4f304 None admin] RBAC: Adding query filter params (role.id=fd13fde432a246499375976d02e43d56, scope.project.id=17cc8cf359884968a7d28733cf2489c4, user.id=609c592713644ef587afdbe37af676e0) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:27.287185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3b416-4c14-4f5e-9150-3ed3c9f4f304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.288607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3b416-4c14-4f5e-9150-3ed3c9f4f304 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.295072 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 647/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/role_assignments?user.id=609c592713644ef587afdbe37af676e0&scope.project.id=17cc8cf359884968a7d28733cf2489c4&role.id=fd13fde432a246499375976d02e43d56 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:29.226042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba619e8-fc7b-4e1b-b286-efb187b4cc7f None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:29.226891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba619e8-fc7b-4e1b-b286-efb187b4cc7f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:29.226891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba619e8-fc7b-4e1b-b286-efb187b4cc7f None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:29.229146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 641/1288] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:29.235738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bc274-2b5c-437c-a5f2-f2c2b60212ad None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:29.236445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bc274-2b5c-437c-a5f2-f2c2b60212ad None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:29.236535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bc274-2b5c-437c-a5f2-f2c2b60212ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:29.264017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d83bc274-2b5c-437c-a5f2-f2c2b60212ad None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:29.265267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d83bc274-2b5c-437c-a5f2-f2c2b60212ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:29.297330 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:29.338213 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 648/1289] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:29.617102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba619e8-fc7b-4e1b-b286-efb187b4cc7f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:29.723306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba619e8-fc7b-4e1b-b286-efb187b4cc7f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:29.734034 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:29.772386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:29.773439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:29.773899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:29.774342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:29.775268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:29.777417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:29.786765 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:29.787942 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:29.789059 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:29.792969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 642/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:55:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:29.794168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bc274-2b5c-437c-a5f2-f2c2b60212ad None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:29.900241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bc274-2b5c-437c-a5f2-f2c2b60212ad None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:29.936428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93b58-4b98-4f65-9fb5-f62d8928252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:29.937043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93b58-4b98-4f65-9fb5-f62d8928252c None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:29.937319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93b58-4b98-4f65-9fb5-f62d8928252c None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:29.937583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93b58-4b98-4f65-9fb5-f62d8928252c None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:29.938214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93b58-4b98-4f65-9fb5-f62d8928252c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:29.938514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93b58-4b98-4f65-9fb5-f62d8928252c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:29.939878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93b58-4b98-4f65-9fb5-f62d8928252c None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:29.944781 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 649/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Sun Aug 21 00:55:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:29.952383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:30.062952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962ed5a-6f19-4193-b7ba-711d06c69f74 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:30.098370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bed72-5de6-4e93-b337-51dd89c14e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:30.098955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bed72-5de6-4e93-b337-51dd89c14e2f None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.099208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bed72-5de6-4e93-b337-51dd89c14e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.099489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bed72-5de6-4e93-b337-51dd89c14e2f None admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.100105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bed72-5de6-4e93-b337-51dd89c14e2f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:30.100388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bed72-5de6-4e93-b337-51dd89c14e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:30.101783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bed72-5de6-4e93-b337-51dd89c14e2f None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:30.106424 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 643/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Sun Aug 21 00:55:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:31.984746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584be90-e9be-4028-a4ef-fd0a062e5982 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.985364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584be90-e9be-4028-a4ef-fd0a062e5982 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.985364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584be90-e9be-4028-a4ef-fd0a062e5982 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.986663 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 650/1293] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:31.993143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f57df-11d8-4e79-8327-00423be17d05 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.993830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f57df-11d8-4e79-8327-00423be17d05 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.993964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f57df-11d8-4e79-8327-00423be17d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.015132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-672f57df-11d8-4e79-8327-00423be17d05 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:32.016335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-672f57df-11d8-4e79-8327-00423be17d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:32.048610 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.088350 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 644/1294] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:32.357503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584be90-e9be-4028-a4ef-fd0a062e5982 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.393747 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.481662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584be90-e9be-4028-a4ef-fd0a062e5982 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.518117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da76eb9-f03b-4206-80a9-3f69cb07ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.518713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da76eb9-f03b-4206-80a9-3f69cb07ec59 None admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.518989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da76eb9-f03b-4206-80a9-3f69cb07ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.519257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da76eb9-f03b-4206-80a9-3f69cb07ec59 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.519895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da76eb9-f03b-4206-80a9-3f69cb07ec59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.521298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da76eb9-f03b-4206-80a9-3f69cb07ec59 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.538214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 651/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Sun Aug 21 00:55:32 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:34.490871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded05e5-798b-433f-aef6-c9c066a907ca None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.491392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded05e5-798b-433f-aef6-c9c066a907ca None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.491392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded05e5-798b-433f-aef6-c9c066a907ca None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.493393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 645/1296] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:34.502516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d45ee5-e9a4-4deb-9319-16714393729f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.502926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d45ee5-e9a4-4deb-9319-16714393729f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.503115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d45ee5-e9a4-4deb-9319-16714393729f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.531254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-22d45ee5-e9a4-4deb-9319-16714393729f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:34.532834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-22d45ee5-e9a4-4deb-9319-16714393729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:34.616978 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 652/1297] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:34.880277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded05e5-798b-433f-aef6-c9c066a907ca None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:35.008037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded05e5-798b-433f-aef6-c9c066a907ca None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:35.043176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:35.043800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.044073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.044339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.044947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:35.046317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:35.054977 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:35.056113 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:35.057370 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 646/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:55:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:35.062363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d45ee5-e9a4-4deb-9319-16714393729f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:35.082426 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:35.183315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d45ee5-e9a4-4deb-9319-16714393729f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:35.220786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:35.221411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.221686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.221959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.222580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:35.222878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:35.224253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:35.229357 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 653/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Sun Aug 21 00:55:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:35.235726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:35.270708 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:35.339930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644279e-3e65-4772-a424-d88b27ac46f5 None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:35.374822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699617a6-40f1-4e86-b8e9-7a90abcd89aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:35.375404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699617a6-40f1-4e86-b8e9-7a90abcd89aa None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.375676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699617a6-40f1-4e86-b8e9-7a90abcd89aa None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.375940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699617a6-40f1-4e86-b8e9-7a90abcd89aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.376628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699617a6-40f1-4e86-b8e9-7a90abcd89aa None admin] RBAC: Adding query filter params (interface=public, service_id=0e1a3cebdb29455aa9464deacfa5213b, region_id=RegionOne) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:35.376954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699617a6-40f1-4e86-b8e9-7a90abcd89aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:35.378313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699617a6-40f1-4e86-b8e9-7a90abcd89aa None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:35.383254 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 647/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Sun Aug 21 00:55:35 2022] GET /identity/v3/endpoints?service_id=0e1a3cebdb29455aa9464deacfa5213b&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:35.390371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:35.485877 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:35.516370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792041f6-6ffb-4462-96ed-9211fdb784eb None admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:35.564615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d013a-c586-4c73-83c8-df0088dca007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:35.565246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d013a-c586-4c73-83c8-df0088dca007 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.565519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d013a-c586-4c73-83c8-df0088dca007 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.565787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d013a-c586-4c73-83c8-df0088dca007 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.566427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d013a-c586-4c73-83c8-df0088dca007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:35.567792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d013a-c586-4c73-83c8-df0088dca007 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:35.574848 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 654/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Sun Aug 21 00:55:35 2022] GET /identity/v3/services => generated 2191 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:55:37.527086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0b93-582d-491b-b12f-875403d71622 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.527894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0b93-582d-491b-b12f-875403d71622 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.527894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0b93-582d-491b-b12f-875403d71622 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.530077 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 648/1302] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:55:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:37.535525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b5679-f0c0-4383-bfb2-402523951f4c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.535955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b5679-f0c0-4383-bfb2-402523951f4c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.536106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b5679-f0c0-4383-bfb2-402523951f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.554376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-980b5679-f0c0-4383-bfb2-402523951f4c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:37.555568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-980b5679-f0c0-4383-bfb2-402523951f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:37.632222 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 655/1303] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:55:37.906619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf0b93-582d-491b-b12f-875403d71622 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.022661 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.032654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf0b93-582d-491b-b12f-875403d71622 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.068124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.068746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.069060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.069326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.069901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.071263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:38.080336 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:38.081425 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 00:55:38.082318 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 649/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:38.088349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b5679-f0c0-4383-bfb2-402523951f4c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.174846 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.200486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b5679-f0c0-4383-bfb2-402523951f4c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.236496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a778380-6f60-4167-b349-d38f6be1cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.237235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778380-6f60-4167-b349-d38f6be1cce0 None admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.237508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778380-6f60-4167-b349-d38f6be1cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.237777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778380-6f60-4167-b349-d38f6be1cce0 None admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.238399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a778380-6f60-4167-b349-d38f6be1cce0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:38.238696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a778380-6f60-4167-b349-d38f6be1cce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.240065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a778380-6f60-4167-b349-d38f6be1cce0 None admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.245499 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 656/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:38.251398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.357750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321cb7c-510a-433f-a811-777772edfa5d None admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.393989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591ae35-2e0c-4537-92d5-1874614b7d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.394581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ae35-2e0c-4537-92d5-1874614b7d2e None admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.394859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ae35-2e0c-4537-92d5-1874614b7d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.395127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ae35-2e0c-4537-92d5-1874614b7d2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.395795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ae35-2e0c-4537-92d5-1874614b7d2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.397191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ae35-2e0c-4537-92d5-1874614b7d2e None admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.420969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 650/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 00:55:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:48.244320 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=30 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:48.416319 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:43.373000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6001c-14ed-4db2-a9c6-fb9e27fbcd21 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.373598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6001c-14ed-4db2-a9c6-fb9e27fbcd21 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.373598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6001c-14ed-4db2-a9c6-fb9e27fbcd21 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.378787 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 657/1307] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:56:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:43.380192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65683-3cce-45a5-94c8-274079b85518 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.381322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65683-3cce-45a5-94c8-274079b85518 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.381895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65683-3cce-45a5-94c8-274079b85518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.523548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f9c65683-3cce-45a5-94c8-274079b85518 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:43.524882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f9c65683-3cce-45a5-94c8-274079b85518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:43.655526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 651/1308] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:56:43.946116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cffd9c-44f8-4311-9d07-5ba7f02c56ee None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.946387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cffd9c-44f8-4311-9d07-5ba7f02c56ee None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.946925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cffd9c-44f8-4311-9d07-5ba7f02c56ee None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.948365 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 658/1309] 10.222.0.46 () {54 vars in 965 bytes} [Sun Aug 21 00:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:43.955047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d4f53-a374-46aa-ae07-cb91bda5b65b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.955393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d4f53-a374-46aa-ae07-cb91bda5b65b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.955624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d4f53-a374-46aa-ae07-cb91bda5b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.043681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fb6d4f53-a374-46aa-ae07-cb91bda5b65b None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:44.044964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fb6d4f53-a374-46aa-ae07-cb91bda5b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:44.068425 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:44.131479 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 652/1310] 10.222.0.46 () {58 vars in 1062 bytes} [Sun Aug 21 00:56:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:56:44.143225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cffd9c-44f8-4311-9d07-5ba7f02c56ee None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.145165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e0cffd9c-44f8-4311-9d07-5ba7f02c56ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:44.263680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cffd9c-44f8-4311-9d07-5ba7f02c56ee None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:44.343632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891f9f0-3c62-4a58-9917-919b36072d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:44.344166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891f9f0-3c62-4a58-9917-919b36072d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.344440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891f9f0-3c62-4a58-9917-919b36072d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.344708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891f9f0-3c62-4a58-9917-919b36072d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.346368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2891f9f0-3c62-4a58-9917-919b36072d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:44.408619 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:44.469778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891f9f0-3c62-4a58-9917-919b36072d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:44.471328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891f9f0-3c62-4a58-9917-919b36072d95 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:44.492472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 659/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:56:46.669237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afe33-a90a-4229-a14d-7dcf8dd92a3a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.669704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afe33-a90a-4229-a14d-7dcf8dd92a3a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.669784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afe33-a90a-4229-a14d-7dcf8dd92a3a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.671890 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 653/1312] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:46.680505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2317-a5b5-4645-94e6-92503bb67868 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.680978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2317-a5b5-4645-94e6-92503bb67868 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.681176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2317-a5b5-4645-94e6-92503bb67868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.756456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-294c2317-a5b5-4645-94e6-92503bb67868 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:46.758274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-294c2317-a5b5-4645-94e6-92503bb67868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:46.873434 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 660/1313] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:56:47.162616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1afe33-a90a-4229-a14d-7dcf8dd92a3a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.164222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fa1afe33-a90a-4229-a14d-7dcf8dd92a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:47.283615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1afe33-a90a-4229-a14d-7dcf8dd92a3a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.363637 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.367191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47717805-4b4b-49ff-be40-5cc86b572602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.367825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717805-4b4b-49ff-be40-5cc86b572602 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.368371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717805-4b4b-49ff-be40-5cc86b572602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.368649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717805-4b4b-49ff-be40-5cc86b572602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.370793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47717805-4b4b-49ff-be40-5cc86b572602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:47.488753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47717805-4b4b-49ff-be40-5cc86b572602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.490158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47717805-4b4b-49ff-be40-5cc86b572602 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.510306 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 654/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:56:49.727277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1a2a5-2e34-4185-999a-14dc61cd7606 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.728150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1a2a5-2e34-4185-999a-14dc61cd7606 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.728150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1a2a5-2e34-4185-999a-14dc61cd7606 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.730116 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 661/1315] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:56:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:49.739024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cc631-909c-4118-946e-bd57e4ee88d0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.739451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cc631-909c-4118-946e-bd57e4ee88d0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.739595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cc631-909c-4118-946e-bd57e4ee88d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.820886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c11cc631-909c-4118-946e-bd57e4ee88d0 None None] MFA Rules not processed for user `1fc6c732aa6743328b8eda20a790b5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:49.822116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c11cc631-909c-4118-946e-bd57e4ee88d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:49.889128 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:49.941178 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 655/1316] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:56:50.260866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1a2a5-2e34-4185-999a-14dc61cd7606 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:50.263367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9bd1a2a5-2e34-4185-999a-14dc61cd7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:50.279126 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:50.396108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1a2a5-2e34-4185-999a-14dc61cd7606 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:50.475105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39780b-0c82-46fd-98b2-03e97e7e161a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:50.475936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39780b-0c82-46fd-98b2-03e97e7e161a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:50.476538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39780b-0c82-46fd-98b2-03e97e7e161a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:50.476800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39780b-0c82-46fd-98b2-03e97e7e161a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:50.478457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-af39780b-0c82-46fd-98b2-03e97e7e161a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:50.549691 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:50.601313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39780b-0c82-46fd-98b2-03e97e7e161a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:50.602766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39780b-0c82-46fd-98b2-03e97e7e161a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:50.621688 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 662/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:56:53.046771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775a9f5-6cdb-4a87-ad33-ac85b2f62b31 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.047669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775a9f5-6cdb-4a87-ad33-ac85b2f62b31 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.047669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775a9f5-6cdb-4a87-ad33-ac85b2f62b31 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.049754 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 656/1318] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:56:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:53.058078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc68e-cddc-49b7-88f9-98413de66c44 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.058572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc68e-cddc-49b7-88f9-98413de66c44 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.058940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc68e-cddc-49b7-88f9-98413de66c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.128134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f05bc68e-cddc-49b7-88f9-98413de66c44 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:53.129383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f05bc68e-cddc-49b7-88f9-98413de66c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:53.235094 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 663/1319] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:56:53.521741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775a9f5-6cdb-4a87-ad33-ac85b2f62b31 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.523796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9775a9f5-6cdb-4a87-ad33-ac85b2f62b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:53.642753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775a9f5-6cdb-4a87-ad33-ac85b2f62b31 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.720300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54868e-1111-43f0-88bc-870f6791d05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.720930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54868e-1111-43f0-88bc-870f6791d05e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.721206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54868e-1111-43f0-88bc-870f6791d05e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.721474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54868e-1111-43f0-88bc-870f6791d05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.723111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b54868e-1111-43f0-88bc-870f6791d05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:53.730636 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.859210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54868e-1111-43f0-88bc-870f6791d05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.861442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54868e-1111-43f0-88bc-870f6791d05e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.882453 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 657/1320] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:56:56.480992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc914-9db1-490d-a8e8-3acbdcdf55e2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.481550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc914-9db1-490d-a8e8-3acbdcdf55e2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.481550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc914-9db1-490d-a8e8-3acbdcdf55e2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.482779 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 664/1321] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:56.488273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915153-b3a3-4897-8507-e3b8944420c7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.488711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915153-b3a3-4897-8507-e3b8944420c7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.488844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915153-b3a3-4897-8507-e3b8944420c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.559426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-33915153-b3a3-4897-8507-e3b8944420c7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:56.560684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33915153-b3a3-4897-8507-e3b8944420c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:56.621943 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:56.661984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 658/1322] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:56:56.951935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e174-fdad-4db9-9fb9-27f6afe2fa1d None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.952215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e174-fdad-4db9-9fb9-27f6afe2fa1d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.952480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e174-fdad-4db9-9fb9-27f6afe2fa1d None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.953869 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 665/1323] 10.222.0.46 () {54 vars in 965 bytes} [Sun Aug 21 00:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:56.959904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91282356-bf92-4715-9e0d-0023423dd916 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.960344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91282356-bf92-4715-9e0d-0023423dd916 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.960617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91282356-bf92-4715-9e0d-0023423dd916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.040535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-91282356-bf92-4715-9e0d-0023423dd916 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:57.041801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-91282356-bf92-4715-9e0d-0023423dd916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:57.120508 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 659/1324] 10.222.0.46 () {58 vars in 1062 bytes} [Sun Aug 21 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:56:57.129480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46e174-fdad-4db9-9fb9-27f6afe2fa1d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.131042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2a46e174-fdad-4db9-9fb9-27f6afe2fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:57.151591 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.239019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46e174-fdad-4db9-9fb9-27f6afe2fa1d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.321923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67812bcf-33d2-46c3-9037-8339d5915437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.322527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67812bcf-33d2-46c3-9037-8339d5915437 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.322806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67812bcf-33d2-46c3-9037-8339d5915437 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.323072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67812bcf-33d2-46c3-9037-8339d5915437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.324721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-67812bcf-33d2-46c3-9037-8339d5915437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:57.400811 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.439669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67812bcf-33d2-46c3-9037-8339d5915437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.441154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67812bcf-33d2-46c3-9037-8339d5915437 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.461110 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 666/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 00:56:59.675833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b886-3b23-45e5-bda9-d800dfe27dad None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.676392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b886-3b23-45e5-bda9-d800dfe27dad None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.676392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b886-3b23-45e5-bda9-d800dfe27dad None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.677929 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 660/1326] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:59.688519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96100-2144-4558-b0bd-f62178359cb1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.689053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96100-2144-4558-b0bd-f62178359cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.689173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce96100-2144-4558-b0bd-f62178359cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.758469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8ce96100-2144-4558-b0bd-f62178359cb1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:59.759678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8ce96100-2144-4558-b0bd-f62178359cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:59.874909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 667/1327] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:00.159859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b886-3b23-45e5-bda9-d800dfe27dad None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:00.161493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3473b886-3b23-45e5-bda9-d800dfe27dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:00.226200 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:00.270533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b886-3b23-45e5-bda9-d800dfe27dad None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:00.347855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20a0da-02fc-44ee-b75f-69eea0870efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:00.348462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a0da-02fc-44ee-b75f-69eea0870efd service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.348739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a0da-02fc-44ee-b75f-69eea0870efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.349038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a0da-02fc-44ee-b75f-69eea0870efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.350676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e20a0da-02fc-44ee-b75f-69eea0870efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:00.465648 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:00.468351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20a0da-02fc-44ee-b75f-69eea0870efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:00.470240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20a0da-02fc-44ee-b75f-69eea0870efd service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:00.489285 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 661/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:02.481294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbfa2d-d46d-4ec1-ba4c-9eb4b6c9f030 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:02.481864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbfa2d-d46d-4ec1-ba4c-9eb4b6c9f030 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:02.481864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbfa2d-d46d-4ec1-ba4c-9eb4b6c9f030 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:02.483175 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 668/1329] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:02.489042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4bdde-b30c-443b-9f97-a795af754ba7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:02.489506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4bdde-b30c-443b-9f97-a795af754ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:02.489614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4bdde-b30c-443b-9f97-a795af754ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:02.562203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1ea4bdde-b30c-443b-9f97-a795af754ba7 None None] MFA Rules not processed for user `1fc6c732aa6743328b8eda20a790b5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:02.563408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1ea4bdde-b30c-443b-9f97-a795af754ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:02.665365 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 662/1330] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:02.959444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbfa2d-d46d-4ec1-ba4c-9eb4b6c9f030 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:02.961361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-03bbfa2d-d46d-4ec1-ba4c-9eb4b6c9f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:02.999576 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.087785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbfa2d-d46d-4ec1-ba4c-9eb4b6c9f030 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.172926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847cc5-8470-4a88-8119-3bb9a7234b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.173547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847cc5-8470-4a88-8119-3bb9a7234b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.173823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847cc5-8470-4a88-8119-3bb9a7234b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.174095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847cc5-8470-4a88-8119-3bb9a7234b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.175753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-28847cc5-8470-4a88-8119-3bb9a7234b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:03.263704 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.299001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847cc5-8470-4a88-8119-3bb9a7234b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.300593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847cc5-8470-4a88-8119-3bb9a7234b96 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.322855 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 669/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:05.447769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e54b70-5256-42fd-9654-33ebbba73ac4 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.448629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e54b70-5256-42fd-9654-33ebbba73ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.448629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e54b70-5256-42fd-9654-33ebbba73ac4 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.450744 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 663/1332] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:05.457096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda685-b14e-4661-8168-3ddd9f1fc492 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.457816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda685-b14e-4661-8168-3ddd9f1fc492 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.457991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda685-b14e-4661-8168-3ddd9f1fc492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.531458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a0bda685-b14e-4661-8168-3ddd9f1fc492 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:05.532667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a0bda685-b14e-4661-8168-3ddd9f1fc492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:05.639904 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 670/1333] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:05.924884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e54b70-5256-42fd-9654-33ebbba73ac4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:05.926439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53e54b70-5256-42fd-9654-33ebbba73ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:06.002595 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:06.040943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e54b70-5256-42fd-9654-33ebbba73ac4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:06.121746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2017f42-79e2-4c66-9c7c-087719f1caf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:06.122353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2017f42-79e2-4c66-9c7c-087719f1caf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.122623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2017f42-79e2-4c66-9c7c-087719f1caf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.122884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2017f42-79e2-4c66-9c7c-087719f1caf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.124472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d2017f42-79e2-4c66-9c7c-087719f1caf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:06.244497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2017f42-79e2-4c66-9c7c-087719f1caf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:06.246012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2017f42-79e2-4c66-9c7c-087719f1caf2 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:06.256091 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:06.265898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 664/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 00:57:08.201453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4444a-81a3-4e1c-80c7-5dd6c1054071 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.202278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4444a-81a3-4e1c-80c7-5dd6c1054071 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.202278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4444a-81a3-4e1c-80c7-5dd6c1054071 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.204569 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 671/1335] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:08.210060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035450-a8e4-4f52-9883-5236ef319c8e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.210490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035450-a8e4-4f52-9883-5236ef319c8e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.210581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035450-a8e4-4f52-9883-5236ef319c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.283858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4d035450-a8e4-4f52-9883-5236ef319c8e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:08.285132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4d035450-a8e4-4f52-9883-5236ef319c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:08.383505 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 665/1336] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:08.670742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4444a-81a3-4e1c-80c7-5dd6c1054071 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:08.672322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-30a4444a-81a3-4e1c-80c7-5dd6c1054071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:08.724208 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.795908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4444a-81a3-4e1c-80c7-5dd6c1054071 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.879717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3b974-66b1-4770-aadf-75f60d0235cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.880299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b974-66b1-4770-aadf-75f60d0235cf service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.880579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b974-66b1-4770-aadf-75f60d0235cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.880928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b974-66b1-4770-aadf-75f60d0235cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.882625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e5a3b974-66b1-4770-aadf-75f60d0235cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:08.965743 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.994974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3b974-66b1-4770-aadf-75f60d0235cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:08.996419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3b974-66b1-4770-aadf-75f60d0235cf service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.015643 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 672/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 00:57:11.587632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb63c69-ae53-4f57-85d1-bc71a14f2f88 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.588498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb63c69-ae53-4f57-85d1-bc71a14f2f88 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.588498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb63c69-ae53-4f57-85d1-bc71a14f2f88 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.591008 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 666/1338] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:11.599856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9073ac-c6f5-4dc4-a008-831df70246ba None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.600297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9073ac-c6f5-4dc4-a008-831df70246ba None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.600418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9073ac-c6f5-4dc4-a008-831df70246ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.681495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9c9073ac-c6f5-4dc4-a008-831df70246ba None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:11.682723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9c9073ac-c6f5-4dc4-a008-831df70246ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:11.800335 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 673/1339] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:12.096369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb63c69-ae53-4f57-85d1-bc71a14f2f88 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:12.098934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-deb63c69-ae53-4f57-85d1-bc71a14f2f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:12.183693 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:12.213183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb63c69-ae53-4f57-85d1-bc71a14f2f88 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:12.299200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782ade4-cb1d-48c9-a7a0-3fc28436db4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:12.299808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782ade4-cb1d-48c9-a7a0-3fc28436db4e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.300088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782ade4-cb1d-48c9-a7a0-3fc28436db4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.300353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782ade4-cb1d-48c9-a7a0-3fc28436db4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.301993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2782ade4-cb1d-48c9-a7a0-3fc28436db4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:12.418034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782ade4-cb1d-48c9-a7a0-3fc28436db4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:12.419370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782ade4-cb1d-48c9-a7a0-3fc28436db4e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:12.437597 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 667/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:16.462829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176bde-62f4-463f-b0fa-804231a4baee None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.463329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176bde-62f4-463f-b0fa-804231a4baee None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.463329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176bde-62f4-463f-b0fa-804231a4baee None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.465048 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 674/1341] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:16.470720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e834f8-8ee7-4fcd-b7a8-6352e5387289 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.471198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e834f8-8ee7-4fcd-b7a8-6352e5387289 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.471475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e834f8-8ee7-4fcd-b7a8-6352e5387289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.477247 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:16.539458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-05e834f8-8ee7-4fcd-b7a8-6352e5387289 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:16.540682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05e834f8-8ee7-4fcd-b7a8-6352e5387289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:16.640267 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 668/1342] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:16.918019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176bde-62f4-463f-b0fa-804231a4baee None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:16.919550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-59176bde-62f4-463f-b0fa-804231a4baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:16.969324 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:17.032154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176bde-62f4-463f-b0fa-804231a4baee None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.110869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a330ed-1a4e-48fe-8ccc-eb33d8a215bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.111476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a330ed-1a4e-48fe-8ccc-eb33d8a215bd service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.111723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a330ed-1a4e-48fe-8ccc-eb33d8a215bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.112017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a330ed-1a4e-48fe-8ccc-eb33d8a215bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.113667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b9a330ed-1a4e-48fe-8ccc-eb33d8a215bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:17.213155 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:17.230614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a330ed-1a4e-48fe-8ccc-eb33d8a215bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.231982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a330ed-1a4e-48fe-8ccc-eb33d8a215bd service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.250471 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 675/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:19.819433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715fca-28c7-4747-b0ef-b811a62627bb None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.820019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715fca-28c7-4747-b0ef-b811a62627bb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.820019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715fca-28c7-4747-b0ef-b811a62627bb None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.821371 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 669/1344] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:19.826731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789472-4b73-4ff1-ab60-e3992305d706 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.827185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789472-4b73-4ff1-ab60-e3992305d706 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.827275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789472-4b73-4ff1-ab60-e3992305d706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.898459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c0789472-4b73-4ff1-ab60-e3992305d706 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:19.899690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c0789472-4b73-4ff1-ab60-e3992305d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:20.001649 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 676/1345] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:20.276118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715fca-28c7-4747-b0ef-b811a62627bb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:20.277653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-06715fca-28c7-4747-b0ef-b811a62627bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:20.369111 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:20.388516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715fca-28c7-4747-b0ef-b811a62627bb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:20.470848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05499bd4-f518-4fe8-b134-2f347f2141a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:20.471371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05499bd4-f518-4fe8-b134-2f347f2141a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:20.472497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05499bd4-f518-4fe8-b134-2f347f2141a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:20.472740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05499bd4-f518-4fe8-b134-2f347f2141a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:20.474722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05499bd4-f518-4fe8-b134-2f347f2141a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:20.597320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05499bd4-f518-4fe8-b134-2f347f2141a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:20.598793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05499bd4-f518-4fe8-b134-2f347f2141a5 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:20.617834 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 670/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:24.492692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c108c0-eaef-45fa-ba79-08482e908029 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:24.492692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c108c0-eaef-45fa-ba79-08482e908029 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:24.492692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c108c0-eaef-45fa-ba79-08482e908029 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:24.494354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 677/1347] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:24.502725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f35aa-2866-472c-b3db-0e8d7625ba1f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:24.502725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f35aa-2866-472c-b3db-0e8d7625ba1f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:24.502725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f35aa-2866-472c-b3db-0e8d7625ba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:24.525498 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:24.587380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b69f35aa-2866-472c-b3db-0e8d7625ba1f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:24.589142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b69f35aa-2866-472c-b3db-0e8d7625ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:24.697231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 671/1348] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:24.980841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c108c0-eaef-45fa-ba79-08482e908029 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:24.982359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-50c108c0-eaef-45fa-ba79-08482e908029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:25.046139 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:25.103554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c108c0-eaef-45fa-ba79-08482e908029 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:25.185647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f817a-6ccc-4433-9657-870ab9ba7382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:25.185888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f817a-6ccc-4433-9657-870ab9ba7382 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.186117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f817a-6ccc-4433-9657-870ab9ba7382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.186563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f817a-6ccc-4433-9657-870ab9ba7382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.188186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-908f817a-6ccc-4433-9657-870ab9ba7382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:25.306320 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:25.309729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f817a-6ccc-4433-9657-870ab9ba7382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:25.311893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f817a-6ccc-4433-9657-870ab9ba7382 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:25.332686 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 678/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:30.320177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa9c3-1b20-4ea3-aade-6f249fb23ad3 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:30.320666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa9c3-1b20-4ea3-aade-6f249fb23ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:30.320760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa9c3-1b20-4ea3-aade-6f249fb23ad3 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:30.329850 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 672/1350] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 00:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:30.330460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886598-81f3-4223-b15f-53e6e4f81a18 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:30.330460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886598-81f3-4223-b15f-53e6e4f81a18 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:30.330460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886598-81f3-4223-b15f-53e6e4f81a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:30.419484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-60886598-81f3-4223-b15f-53e6e4f81a18 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:30.426155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-60886598-81f3-4223-b15f-53e6e4f81a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:30.567165 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 679/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:34.690626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae092df-65c9-490e-a254-5c4955dd41ba None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:34.691152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae092df-65c9-490e-a254-5c4955dd41ba None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:34.691152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae092df-65c9-490e-a254-5c4955dd41ba None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:34.693022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 673/1352] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 00:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:34.697133 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=59 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:34.700811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366571c-2c49-4022-8f3c-da0dd71049c4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:34.700811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366571c-2c49-4022-8f3c-da0dd71049c4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:34.700811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366571c-2c49-4022-8f3c-da0dd71049c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:34.761719 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:34.785135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5366571c-2c49-4022-8f3c-da0dd71049c4 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:34.786490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5366571c-2c49-4022-8f3c-da0dd71049c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:34.902816 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 680/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 00:57:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:36.195498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbd787-a851-41a1-829e-b1b19caf321b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:36.196314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbd787-a851-41a1-829e-b1b19caf321b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:36.196469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbd787-a851-41a1-829e-b1b19caf321b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:36.197907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 674/1354] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 00:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:36.203094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037288-5a2d-4f2b-9a60-0b9f64e865e2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:36.203525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037288-5a2d-4f2b-9a60-0b9f64e865e2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:36.203787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037288-5a2d-4f2b-9a60-0b9f64e865e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:36.283793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b4037288-5a2d-4f2b-9a60-0b9f64e865e2 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:36.285146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b4037288-5a2d-4f2b-9a60-0b9f64e865e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:36.329626 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:36.395977 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 681/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 00:57:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:39.679784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d944c9-a956-4c9b-9d01-e0ae0251c27a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:39.680824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d944c9-a956-4c9b-9d01-e0ae0251c27a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:39.681289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d944c9-a956-4c9b-9d01-e0ae0251c27a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:39.682977 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 675/1356] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:39.688653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0275-7f22-4cda-98b3-c40658d861c8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:39.689157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0275-7f22-4cda-98b3-c40658d861c8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:39.689448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0275-7f22-4cda-98b3-c40658d861c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:39.780506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-180a0275-7f22-4cda-98b3-c40658d861c8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:39.780506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-180a0275-7f22-4cda-98b3-c40658d861c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:39.899276 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 682/1357] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:40.205596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e1ba-422f-49b7-a98d-2a754db53fc5 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:40.205872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e1ba-422f-49b7-a98d-2a754db53fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:40.206387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e1ba-422f-49b7-a98d-2a754db53fc5 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:40.207930 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 676/1358] 10.222.0.46 () {54 vars in 962 bytes} [Sun Aug 21 00:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:40.219809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321de3c-76e5-402f-bbd8-fab0e8321fcc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:40.220509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321de3c-76e5-402f-bbd8-fab0e8321fcc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:40.221442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321de3c-76e5-402f-bbd8-fab0e8321fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:40.244152 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:40.312659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1321de3c-76e5-402f-bbd8-fab0e8321fcc None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:40.313897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1321de3c-76e5-402f-bbd8-fab0e8321fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:40.440173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 683/1359] 10.222.0.46 () {58 vars in 1059 bytes} [Sun Aug 21 00:57:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:57:40.448625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e1ba-422f-49b7-a98d-2a754db53fc5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:40.450436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4129e1ba-422f-49b7-a98d-2a754db53fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:40.610899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e1ba-422f-49b7-a98d-2a754db53fc5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:40.687150 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:40.729354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0c401-240c-481a-ad57-6a050260959a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:40.729971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c401-240c-481a-ad57-6a050260959a service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:40.730272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c401-240c-481a-ad57-6a050260959a service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:40.730545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c401-240c-481a-ad57-6a050260959a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:40.732376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-18d0c401-240c-481a-ad57-6a050260959a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:40.829867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0c401-240c-481a-ad57-6a050260959a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:40.859255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0c401-240c-481a-ad57-6a050260959a service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:40.862872 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 677/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:42.994473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84f77-f329-46ba-a074-40c5f4377eb7 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:42.995026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84f77-f329-46ba-a074-40c5f4377eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:42.995026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84f77-f329-46ba-a074-40c5f4377eb7 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:42.996670 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 684/1361] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:43.002025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd541d2-97f6-483a-9a8c-dd812b96cb6e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:43.002806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd541d2-97f6-483a-9a8c-dd812b96cb6e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:43.003318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd541d2-97f6-483a-9a8c-dd812b96cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:43.074535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bcd541d2-97f6-483a-9a8c-dd812b96cb6e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:43.075743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bcd541d2-97f6-483a-9a8c-dd812b96cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:43.115454 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:43.178112 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 678/1362] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:43.464907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde84f77-f329-46ba-a074-40c5f4377eb7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:43.468317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dde84f77-f329-46ba-a074-40c5f4377eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:43.561542 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:43.651851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde84f77-f329-46ba-a074-40c5f4377eb7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:43.809006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a47a-f46d-40ac-9f91-24ec130b116d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:43.809727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a47a-f46d-40ac-9f91-24ec130b116d service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:43.810105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a47a-f46d-40ac-9f91-24ec130b116d service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:43.810471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a47a-f46d-40ac-9f91-24ec130b116d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:43.812259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-29a3a47a-f46d-40ac-9f91-24ec130b116d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:43.837125 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:43.907803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a47a-f46d-40ac-9f91-24ec130b116d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:43.909549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a47a-f46d-40ac-9f91-24ec130b116d service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:43.930139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 685/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:46.178216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1f2c-2171-440e-b1c8-0361641c83b9 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:46.179100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1f2c-2171-440e-b1c8-0361641c83b9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:46.179376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1f2c-2171-440e-b1c8-0361641c83b9 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:46.180757 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 679/1364] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:46.186535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647f174-3515-4049-ab40-9f171938cc45 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:46.187037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647f174-3515-4049-ab40-9f171938cc45 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:46.187142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647f174-3515-4049-ab40-9f171938cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:46.264961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9647f174-3515-4049-ab40-9f171938cc45 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:46.264961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9647f174-3515-4049-ab40-9f171938cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:46.376054 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:46.389027 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 686/1365] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:46.672006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bbe8-fc33-4b60-9c39-8c6c78908e52 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:46.672287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bbe8-fc33-4b60-9c39-8c6c78908e52 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:46.672558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bbe8-fc33-4b60-9c39-8c6c78908e52 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:46.674204 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 680/1366] 10.222.0.46 () {54 vars in 962 bytes} [Sun Aug 21 00:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:46.682898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06ffb-2185-4335-8fc5-65dc9bb62b97 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:46.683529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06ffb-2185-4335-8fc5-65dc9bb62b97 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:46.683947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06ffb-2185-4335-8fc5-65dc9bb62b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:46.777753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b4b06ffb-2185-4335-8fc5-65dc9bb62b97 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:46.779037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b4b06ffb-2185-4335-8fc5-65dc9bb62b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:46.934655 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 687/1367] 10.222.0.46 () {58 vars in 1059 bytes} [Sun Aug 21 00:57:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:46.948628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9bbe8-fc33-4b60-9c39-8c6c78908e52 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:46.953882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c3a9bbe8-fc33-4b60-9c39-8c6c78908e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:47.144849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9bbe8-fc33-4b60-9c39-8c6c78908e52 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:47.166865 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:47.276836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99102d4-73d7-48bb-b1f2-07d20ba5fbfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:47.277633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99102d4-73d7-48bb-b1f2-07d20ba5fbfa service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:47.277839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99102d4-73d7-48bb-b1f2-07d20ba5fbfa service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:47.278247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99102d4-73d7-48bb-b1f2-07d20ba5fbfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:47.279861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f99102d4-73d7-48bb-b1f2-07d20ba5fbfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:47.387456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99102d4-73d7-48bb-b1f2-07d20ba5fbfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:47.389220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99102d4-73d7-48bb-b1f2-07d20ba5fbfa service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:47.423313 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 681/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:49.475006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbf33b-aa1a-4fe6-9a8d-65431e99189c None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:49.475548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbf33b-aa1a-4fe6-9a8d-65431e99189c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:49.475548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbf33b-aa1a-4fe6-9a8d-65431e99189c None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:49.478383 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 688/1369] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:49.482574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48a757-8193-45ae-8b88-576e3e47b355 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:49.483023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48a757-8193-45ae-8b88-576e3e47b355 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:49.483123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48a757-8193-45ae-8b88-576e3e47b355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:49.515706 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:49.553811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ce48a757-8193-45ae-8b88-576e3e47b355 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:49.555178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ce48a757-8193-45ae-8b88-576e3e47b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:49.724815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 682/1370] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:50.047379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbf33b-aa1a-4fe6-9a8d-65431e99189c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:50.049974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-19dbf33b-aa1a-4fe6-9a8d-65431e99189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:50.117974 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:50.262296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbf33b-aa1a-4fe6-9a8d-65431e99189c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:50.401975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bba65-528e-4bd7-a617-bd8dc35f4474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:50.403050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bba65-528e-4bd7-a617-bd8dc35f4474 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:50.403556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bba65-528e-4bd7-a617-bd8dc35f4474 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:50.404026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bba65-528e-4bd7-a617-bd8dc35f4474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:50.405997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-255bba65-528e-4bd7-a617-bd8dc35f4474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:50.416147 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:50.513411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bba65-528e-4bd7-a617-bd8dc35f4474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:50.515782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bba65-528e-4bd7-a617-bd8dc35f4474 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:50.549255 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 689/1371] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:51.849631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163708b5-4fd4-4ed0-b2d4-c6cee4cf27fb None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:51.850623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163708b5-4fd4-4ed0-b2d4-c6cee4cf27fb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:51.850971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163708b5-4fd4-4ed0-b2d4-c6cee4cf27fb None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:51.852532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 683/1372] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:51.858434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ac99-c367-4051-a425-711b2ad67fc6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:51.858877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ac99-c367-4051-a425-711b2ad67fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:51.858979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ac99-c367-4051-a425-711b2ad67fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:51.932181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e763ac99-c367-4051-a425-711b2ad67fc6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:51.933411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e763ac99-c367-4051-a425-711b2ad67fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:52.035973 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:52.059619 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 690/1373] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:52.655688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583573f-98cc-490c-bca6-8a9c34362bc9 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:52.655944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583573f-98cc-490c-bca6-8a9c34362bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:52.656235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583573f-98cc-490c-bca6-8a9c34362bc9 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:52.657836 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 684/1374] 10.222.0.46 () {54 vars in 964 bytes} [Sun Aug 21 00:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:52.663085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11dab6-88d1-4505-81f3-a56a70eb5cce None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:52.663434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11dab6-88d1-4505-81f3-a56a70eb5cce None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:52.663778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11dab6-88d1-4505-81f3-a56a70eb5cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:52.746589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef39ad-201d-480e-a10e-c1d214360c1f None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:52.747120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef39ad-201d-480e-a10e-c1d214360c1f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:52.747606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef39ad-201d-480e-a10e-c1d214360c1f None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:52.751919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fb11dab6-88d1-4505-81f3-a56a70eb5cce None None] MFA Rules not processed for user `1c9c0901260e44a789d750c2032bfbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:52.752382 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 685/1375] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:52.753485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb11dab6-88d1-4505-81f3-a56a70eb5cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:52.754507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:52.754789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:52.755058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:52.827415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:52.828622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:52.840719 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 691/1376] 10.222.0.46 () {58 vars in 1061 bytes} [Sun Aug 21 00:57:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:57:52.851688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11dab6-88d1-4505-81f3-a56a70eb5cce None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:52.860068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11dab6-88d1-4505-81f3-a56a70eb5cce None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:52.883966 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:52.938638 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 686/1377] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:57:52.949999 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:52.952044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8463bf-f6f4-44d9-84ff-06d4280732fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:52.952740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8463bf-f6f4-44d9-84ff-06d4280732fd service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:52.953109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8463bf-f6f4-44d9-84ff-06d4280732fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:52.953757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8463bf-f6f4-44d9-84ff-06d4280732fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:52.956013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3b8463bf-f6f4-44d9-84ff-06d4280732fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:53.071464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8463bf-f6f4-44d9-84ff-06d4280732fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:53.072954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8463bf-f6f4-44d9-84ff-06d4280732fd service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:53.093477 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 692/1378] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 00:57:53.225496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:53.226955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:53.346862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707cfd1-ce67-487f-9fee-c37d12af71b8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:53.418528 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:53.471937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12dcb3-54d2-4a91-b616-1dcf1f853803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:53.472548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12dcb3-54d2-4a91-b616-1dcf1f853803 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:53.472848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12dcb3-54d2-4a91-b616-1dcf1f853803 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:53.473121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12dcb3-54d2-4a91-b616-1dcf1f853803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:53.474778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c12dcb3-54d2-4a91-b616-1dcf1f853803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:53.577780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12dcb3-54d2-4a91-b616-1dcf1f853803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:53.579477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12dcb3-54d2-4a91-b616-1dcf1f853803 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:53.609632 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 687/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:55.613547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468237a7-61b4-4829-ad15-0fb052330ac4 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:55.614329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468237a7-61b4-4829-ad15-0fb052330ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:55.614329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468237a7-61b4-4829-ad15-0fb052330ac4 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:55.615689 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 693/1380] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:55.622054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef45e2-cbae-409b-a4c2-4d23d294b72b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:55.622579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef45e2-cbae-409b-a4c2-4d23d294b72b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:55.622658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef45e2-cbae-409b-a4c2-4d23d294b72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:55.704625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7bef45e2-cbae-409b-a4c2-4d23d294b72b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:55.705907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7bef45e2-cbae-409b-a4c2-4d23d294b72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:55.739532 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:55.828783 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 688/1381] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:57:56.148085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468237a7-61b4-4829-ad15-0fb052330ac4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:56.149759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-468237a7-61b4-4829-ad15-0fb052330ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:56.262909 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:56.362151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468237a7-61b4-4829-ad15-0fb052330ac4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:56.493711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8297e-5843-461e-a6ec-72edbc60ded8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:56.494581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8297e-5843-461e-a6ec-72edbc60ded8 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:56.495094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8297e-5843-461e-a6ec-72edbc60ded8 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:56.495516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8297e-5843-461e-a6ec-72edbc60ded8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:56.497383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f1c8297e-5843-461e-a6ec-72edbc60ded8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:56.575821 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:56.608128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8297e-5843-461e-a6ec-72edbc60ded8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:56.609771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8297e-5843-461e-a6ec-72edbc60ded8 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:56.646396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 694/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:57:58.765012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7623a-3a33-4775-ad43-0b675559de6c None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:58.765532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7623a-3a33-4775-ad43-0b675559de6c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:58.765532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7623a-3a33-4775-ad43-0b675559de6c None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:58.771080 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 689/1383] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:57:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:58.772546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ff17-d358-4ef5-af4f-4f81822ba5c8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:58.773047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ff17-d358-4ef5-af4f-4f81822ba5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:58.773146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ff17-d358-4ef5-af4f-4f81822ba5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:58.851115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d0d4ff17-d358-4ef5-af4f-4f81822ba5c8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:58.852658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0d4ff17-d358-4ef5-af4f-4f81822ba5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:58.973822 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 695/1384] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:57:59.258842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7623a-3a33-4775-ad43-0b675559de6c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:59.260358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26c7623a-3a33-4775-ad43-0b675559de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:59.417282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7623a-3a33-4775-ad43-0b675559de6c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:59.430841 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:59.543165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4473301-d6bf-4c91-9ca2-70d0e1ea4a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:59.543782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473301-d6bf-4c91-9ca2-70d0e1ea4a0d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:59.544069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473301-d6bf-4c91-9ca2-70d0e1ea4a0d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:59.544325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473301-d6bf-4c91-9ca2-70d0e1ea4a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:59.545962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f4473301-d6bf-4c91-9ca2-70d0e1ea4a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:59.653468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4473301-d6bf-4c91-9ca2-70d0e1ea4a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:59.655057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4473301-d6bf-4c91-9ca2-70d0e1ea4a0d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:59.686402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 690/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:01.617892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1ca03-3a18-4b5e-a5e5-1ec168bc2eae None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:01.618454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1ca03-3a18-4b5e-a5e5-1ec168bc2eae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:01.618454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1ca03-3a18-4b5e-a5e5-1ec168bc2eae None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:01.620018 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 696/1386] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:01.625376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35956a4-00b0-4b83-a2a8-be0e04a73025 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:01.625814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35956a4-00b0-4b83-a2a8-be0e04a73025 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:01.625928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35956a4-00b0-4b83-a2a8-be0e04a73025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:01.646937 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:01.700570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f35956a4-00b0-4b83-a2a8-be0e04a73025 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:01.702433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f35956a4-00b0-4b83-a2a8-be0e04a73025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:01.831665 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 691/1387] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:02.129031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1ca03-3a18-4b5e-a5e5-1ec168bc2eae None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:02.131075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-18d1ca03-3a18-4b5e-a5e5-1ec168bc2eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:02.181805 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:02.317387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1ca03-3a18-4b5e-a5e5-1ec168bc2eae None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:02.471918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd94793-a9e4-4c2d-9059-ae88aef336f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:02.472624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94793-a9e4-4c2d-9059-ae88aef336f0 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:02.473002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94793-a9e4-4c2d-9059-ae88aef336f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:02.473334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94793-a9e4-4c2d-9059-ae88aef336f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:02.475380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5dd94793-a9e4-4c2d-9059-ae88aef336f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:02.479544 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:02.579458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd94793-a9e4-4c2d-9059-ae88aef336f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:02.581414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd94793-a9e4-4c2d-9059-ae88aef336f0 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:02.603190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 697/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:04.530756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3b1f-e47c-4e85-b130-e8df2bb1b14c None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:04.531370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3b1f-e47c-4e85-b130-e8df2bb1b14c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:04.531467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3b1f-e47c-4e85-b130-e8df2bb1b14c None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:04.533232 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 692/1389] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:04.540991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78497686-e192-4061-9633-63f8c329029a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:04.541755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78497686-e192-4061-9633-63f8c329029a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:04.541918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78497686-e192-4061-9633-63f8c329029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:04.634328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-78497686-e192-4061-9633-63f8c329029a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:04.635658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-78497686-e192-4061-9633-63f8c329029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:04.721115 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:04.745415 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 698/1390] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:05.129894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc3b1f-e47c-4e85-b130-e8df2bb1b14c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:05.131697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bdfc3b1f-e47c-4e85-b130-e8df2bb1b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:05.238833 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:05.307270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc3b1f-e47c-4e85-b130-e8df2bb1b14c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:05.434955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227af31-dd11-410e-b98f-41460847fffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:05.435502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227af31-dd11-410e-b98f-41460847fffd service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:05.435784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227af31-dd11-410e-b98f-41460847fffd service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:05.436062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227af31-dd11-410e-b98f-41460847fffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:05.437748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3227af31-dd11-410e-b98f-41460847fffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:05.501241 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:05.535996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227af31-dd11-410e-b98f-41460847fffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:05.537897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227af31-dd11-410e-b98f-41460847fffd service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:05.559913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 693/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:07.566639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd0e1-2365-4bfe-9957-c4e1486a5feb None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:07.567237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd0e1-2365-4bfe-9957-c4e1486a5feb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:07.567237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd0e1-2365-4bfe-9957-c4e1486a5feb None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:07.569195 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 699/1392] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:07.574871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8590ba-268e-4e24-a441-33fbc1ca9d76 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:07.575301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8590ba-268e-4e24-a441-33fbc1ca9d76 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:07.575428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8590ba-268e-4e24-a441-33fbc1ca9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:07.645216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ec8590ba-268e-4e24-a441-33fbc1ca9d76 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:07.646806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ec8590ba-268e-4e24-a441-33fbc1ca9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:07.751487 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 694/1393] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:08.039504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd0e1-2365-4bfe-9957-c4e1486a5feb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:08.041080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dafdd0e1-2365-4bfe-9957-c4e1486a5feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:08.198625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd0e1-2365-4bfe-9957-c4e1486a5feb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:08.262279 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:08.324653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d8750-9024-4508-bf2a-90adb9d9a76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:08.325206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d8750-9024-4508-bf2a-90adb9d9a76c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.325495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d8750-9024-4508-bf2a-90adb9d9a76c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:08.325722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d8750-9024-4508-bf2a-90adb9d9a76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:08.327354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c55d8750-9024-4508-bf2a-90adb9d9a76c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:08.426578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d8750-9024-4508-bf2a-90adb9d9a76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:08.429029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d8750-9024-4508-bf2a-90adb9d9a76c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:08.448610 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 700/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:08.500202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c885-1c49-484b-a5f3-a8169d826dcd None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.500505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c885-1c49-484b-a5f3-a8169d826dcd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:08.500794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c885-1c49-484b-a5f3-a8169d826dcd None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:08.502610 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 695/1395] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:08.508420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849580-0e5a-4d2b-8225-e20fffe8fa9c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.508708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849580-0e5a-4d2b-8225-e20fffe8fa9c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:08.509010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849580-0e5a-4d2b-8225-e20fffe8fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:08.590472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-af849580-0e5a-4d2b-8225-e20fffe8fa9c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:08.591631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-af849580-0e5a-4d2b-8225-e20fffe8fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:08.613027 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:08.698859 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 701/1396] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:08.997039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab516b4-13a4-478d-8065-59ae204e1ab8 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.997520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab516b4-13a4-478d-8065-59ae204e1ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:09.003679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab516b4-13a4-478d-8065-59ae204e1ab8 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:09.006028 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 696/1397] 10.222.0.46 () {54 vars in 967 bytes} [Sun Aug 21 00:58:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:09.011482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4abad-4a4e-45d8-a029-349da2498f73 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:09.011887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4abad-4a4e-45d8-a029-349da2498f73 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:09.012163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4abad-4a4e-45d8-a029-349da2498f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:09.094050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-10f4abad-4a4e-45d8-a029-349da2498f73 None None] MFA Rules not processed for user `9fff798abd7e4970977c2465aaed01b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:09.095273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10f4abad-4a4e-45d8-a029-349da2498f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:09.182051 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 702/1398] 10.222.0.46 () {58 vars in 1064 bytes} [Sun Aug 21 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:09.189749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab516b4-13a4-478d-8065-59ae204e1ab8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:09.191383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7ab516b4-13a4-478d-8065-59ae204e1ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:09.231584 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:09.307481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab516b4-13a4-478d-8065-59ae204e1ab8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:09.393114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faaf47-d121-4934-bec4-0f5a448a5854 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:09.393790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faaf47-d121-4934-bec4-0f5a448a5854 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:09.394069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faaf47-d121-4934-bec4-0f5a448a5854 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:09.394337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faaf47-d121-4934-bec4-0f5a448a5854 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:09.395915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17faaf47-d121-4934-bec4-0f5a448a5854 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:09.479958 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:09.507836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faaf47-d121-4934-bec4-0f5a448a5854 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:09.509623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faaf47-d121-4934-bec4-0f5a448a5854 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:09.527780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 697/1399] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:10.281707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a6ca-888f-483f-8b1b-a2615a398c0b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.282299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a6ca-888f-483f-8b1b-a2615a398c0b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.282299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a6ca-888f-483f-8b1b-a2615a398c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.308933 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:10.375795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e0a7a6ca-888f-483f-8b1b-a2615a398c0b None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:10.377372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e0a7a6ca-888f-483f-8b1b-a2615a398c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:10.402274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3091b-4435-4cc0-9a9d-bedf68a84ee9 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.402806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3091b-4435-4cc0-9a9d-bedf68a84ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.402806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3091b-4435-4cc0-9a9d-bedf68a84ee9 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.404371 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 698/1400] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:58:10.409325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.409580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.409868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.479753 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 703/1401] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:10.488155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:10.489328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:10.529147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c91b7-8869-466d-8a07-d52ccc6c916b None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.529431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c91b7-8869-466d-8a07-d52ccc6c916b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.529718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c91b7-8869-466d-8a07-d52ccc6c916b None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.531095 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 704/1402] 10.222.0.46 () {54 vars in 943 bytes} [Sun Aug 21 00:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:10.538565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.538920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.539272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.605769 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 699/1403] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:58:10.621456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] MFA Rules not processed for user `1eadc3e155df4f5a9f40ae75ee27733f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:10.622695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:10.672336 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:10.736667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 705/1404] 10.222.0.46 () {58 vars in 1040 bytes} [Sun Aug 21 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:58:10.746480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:10.747846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:10.798110 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:10.859627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cacb5-b75a-4793-9e83-e48d2f202660 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:10.897409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:10.898806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:10.966878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13c0f-f5b9-4bf0-a364-8fea87437ee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:10.967482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13c0f-f5b9-4bf0-a364-8fea87437ee1 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.967751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13c0f-f5b9-4bf0-a364-8fea87437ee1 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.968018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13c0f-f5b9-4bf0-a364-8fea87437ee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.969664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d4c13c0f-f5b9-4bf0-a364-8fea87437ee1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:11.000546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d573-10e1-496b-b191-eda9b1f619e8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:11.031907 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:11.055137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c13c0f-f5b9-4bf0-a364-8fea87437ee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:11.056790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c13c0f-f5b9-4bf0-a364-8fea87437ee1 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:11.064217 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:11.064850 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 700/1405] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 00:58:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 00:58:11.141982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac696-d691-491f-8478-08f0cb808614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:11.142980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac696-d691-491f-8478-08f0cb808614 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:11.143442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac696-d691-491f-8478-08f0cb808614 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:11.143897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac696-d691-491f-8478-08f0cb808614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:11.146698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb4ac696-d691-491f-8478-08f0cb808614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:11.263074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ac696-d691-491f-8478-08f0cb808614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:11.265088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ac696-d691-491f-8478-08f0cb808614 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:11.286147 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 706/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:13.385748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7c53-9b2e-4055-80d7-4ef4d6983b5e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:13.386310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7c53-9b2e-4055-80d7-4ef4d6983b5e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:13.386310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7c53-9b2e-4055-80d7-4ef4d6983b5e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:13.388799 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 701/1407] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:13.394667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335db15-2632-4593-8649-e45040f8b574 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:13.395150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335db15-2632-4593-8649-e45040f8b574 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:13.395150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335db15-2632-4593-8649-e45040f8b574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:13.475168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6335db15-2632-4593-8649-e45040f8b574 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:13.478496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6335db15-2632-4593-8649-e45040f8b574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:13.512284 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:13.603206 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 707/1408] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:13.891173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7c53-9b2e-4055-80d7-4ef4d6983b5e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:13.892757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36fe7c53-9b2e-4055-80d7-4ef4d6983b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:14.054948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7c53-9b2e-4055-80d7-4ef4d6983b5e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:14.119370 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:14.191687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3178015-fd12-49af-b9d6-3588d52a7786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:14.192331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178015-fd12-49af-b9d6-3588d52a7786 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:14.192612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178015-fd12-49af-b9d6-3588d52a7786 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:14.192917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178015-fd12-49af-b9d6-3588d52a7786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:14.194960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e3178015-fd12-49af-b9d6-3588d52a7786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:14.298872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3178015-fd12-49af-b9d6-3588d52a7786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:14.300617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3178015-fd12-49af-b9d6-3588d52a7786 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:14.324537 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 702/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:23.600393 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=33 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:24.322242 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=73 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:33.728727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cc50b-0bf4-468a-8cb9-7e47a98695f2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:33.729344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cc50b-0bf4-468a-8cb9-7e47a98695f2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:33.729344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cc50b-0bf4-468a-8cb9-7e47a98695f2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:33.730651 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 708/1410] 10.222.0.46 () {54 vars in 918 bytes} [Sun Aug 21 00:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:33.737134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f00fc-ad8d-4552-95ed-72ccc3e6723a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:33.737893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f00fc-ad8d-4552-95ed-72ccc3e6723a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:33.738058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f00fc-ad8d-4552-95ed-72ccc3e6723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:33.835352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-250f00fc-ad8d-4552-95ed-72ccc3e6723a None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:33.836617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-250f00fc-ad8d-4552-95ed-72ccc3e6723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:33.958885 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 703/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Aug 21 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:33.978377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5201b3-fba2-4f16-9f0c-983920f9b9da None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:33.978670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5201b3-fba2-4f16-9f0c-983920f9b9da None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:33.978987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5201b3-fba2-4f16-9f0c-983920f9b9da None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:33.980305 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 709/1412] 10.222.0.46 () {54 vars in 918 bytes} [Sun Aug 21 00:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:58:33.986005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde408-a5da-4aa8-b50c-3a4279b74887 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:33.986478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde408-a5da-4aa8-b50c-3a4279b74887 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:33.986934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde408-a5da-4aa8-b50c-3a4279b74887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:34.067229 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:34.070631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-30bde408-a5da-4aa8-b50c-3a4279b74887 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:34.072322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30bde408-a5da-4aa8-b50c-3a4279b74887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:34.189916 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 704/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Aug 21 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:36.636708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3e0b1-b861-490e-84e8-ecefae242490 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:36.637641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3e0b1-b861-490e-84e8-ecefae242490 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:36.637641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3e0b1-b861-490e-84e8-ecefae242490 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:36.639825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:36.648471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6215a1b-48f7-4dce-87b5-f3900ab77471 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:36.648956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6215a1b-48f7-4dce-87b5-f3900ab77471 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:36.649079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6215a1b-48f7-4dce-87b5-f3900ab77471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:36.729684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b6215a1b-48f7-4dce-87b5-f3900ab77471 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:36.730899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b6215a1b-48f7-4dce-87b5-f3900ab77471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:36.794916 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:36.840271 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:37.135193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3e0b1-b861-490e-84e8-ecefae242490 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:37.136882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-42a3e0b1-b861-490e-84e8-ecefae242490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:37.292570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3e0b1-b861-490e-84e8-ecefae242490 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:37.372198 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:37.415814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff591a32-2c61-4039-aae8-207e54f16c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:37.416429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591a32-2c61-4039-aae8-207e54f16c69 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:37.416709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591a32-2c61-4039-aae8-207e54f16c69 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:37.417014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591a32-2c61-4039-aae8-207e54f16c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:37.418690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ff591a32-2c61-4039-aae8-207e54f16c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:37.515944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff591a32-2c61-4039-aae8-207e54f16c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:37.518340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff591a32-2c61-4039-aae8-207e54f16c69 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:37.542274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 711/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:38.416244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0a3a-2609-4cf7-917c-0177a283a068 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:38.417147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0a3a-2609-4cf7-917c-0177a283a068 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:38.417147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0a3a-2609-4cf7-917c-0177a283a068 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:38.419216 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:38.427127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeebbf-97f7-4dce-ae03-6a0f31cfb409 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:38.427906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeebbf-97f7-4dce-ae03-6a0f31cfb409 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:38.427906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeebbf-97f7-4dce-ae03-6a0f31cfb409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:38.511599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-afeeebbf-97f7-4dce-ae03-6a0f31cfb409 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:38.512807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-afeeebbf-97f7-4dce-ae03-6a0f31cfb409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:38.548481 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:38.630799 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:38.805245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0a3a-2609-4cf7-917c-0177a283a068 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:38.806759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac3e0a3a-2609-4cf7-917c-0177a283a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:38.976412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0a3a-2609-4cf7-917c-0177a283a068 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:39.029000 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:39.117586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7611-4519-43cd-8406-507d53d5ae0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:39.118177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7611-4519-43cd-8406-507d53d5ae0c service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:39.118457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7611-4519-43cd-8406-507d53d5ae0c service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:39.118720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7611-4519-43cd-8406-507d53d5ae0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:39.120320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-558a7611-4519-43cd-8406-507d53d5ae0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:39.217172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a7611-4519-43cd-8406-507d53d5ae0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:39.218762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a7611-4519-43cd-8406-507d53d5ae0c service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:39.239060 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 707/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:40.147229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95899fa-912c-4004-aca0-8e10292eadfc None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:40.147677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95899fa-912c-4004-aca0-8e10292eadfc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:40.147788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95899fa-912c-4004-aca0-8e10292eadfc None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:40.149862 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:40.157709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566491-8a85-4d81-8c34-52dc8a6e60dd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:40.158100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566491-8a85-4d81-8c34-52dc8a6e60dd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:40.158277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566491-8a85-4d81-8c34-52dc8a6e60dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:40.215874 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:40.239112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-47566491-8a85-4d81-8c34-52dc8a6e60dd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:40.240372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47566491-8a85-4d81-8c34-52dc8a6e60dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:40.345093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:40.495607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95899fa-912c-4004-aca0-8e10292eadfc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:40.497821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c95899fa-912c-4004-aca0-8e10292eadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:40.679748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95899fa-912c-4004-aca0-8e10292eadfc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:40.699276 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:40.818524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aeaca-b1a7-4584-9aaf-d23ec690043b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:40.819532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aeaca-b1a7-4584-9aaf-d23ec690043b service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:40.819814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aeaca-b1a7-4584-9aaf-d23ec690043b service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:40.820084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aeaca-b1a7-4584-9aaf-d23ec690043b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:40.821727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-921aeaca-b1a7-4584-9aaf-d23ec690043b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:40.934588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921aeaca-b1a7-4584-9aaf-d23ec690043b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:40.936232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921aeaca-b1a7-4584-9aaf-d23ec690043b service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:40.955318 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 714/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:41.828140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a49e4-cd15-47a6-b956-8e2303afae81 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:41.828669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a49e4-cd15-47a6-b956-8e2303afae81 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:41.828669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a49e4-cd15-47a6-b956-8e2303afae81 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:41.830592 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:41.838791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e93ba-61b2-403b-b019-9b71007c8046 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:41.839235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e93ba-61b2-403b-b019-9b71007c8046 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:41.839339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e93ba-61b2-403b-b019-9b71007c8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:41.863643 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:41.923540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2e7e93ba-61b2-403b-b019-9b71007c8046 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:41.924756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2e7e93ba-61b2-403b-b019-9b71007c8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:42.025947 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:42.175977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a49e4-cd15-47a6-b956-8e2303afae81 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:42.177576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-961a49e4-cd15-47a6-b956-8e2303afae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:42.293771 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:42.331687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a49e4-cd15-47a6-b956-8e2303afae81 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:42.459079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b09d4-9f45-4898-95e8-b838b986ecd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:42.460163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b09d4-9f45-4898-95e8-b838b986ecd4 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:42.460440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b09d4-9f45-4898-95e8-b838b986ecd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:42.460717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b09d4-9f45-4898-95e8-b838b986ecd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:42.462376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fa7b09d4-9f45-4898-95e8-b838b986ecd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:42.544466 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:42.563378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b09d4-9f45-4898-95e8-b838b986ecd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:42.563629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b09d4-9f45-4898-95e8-b838b986ecd4 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:42.586124 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 710/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:43.463221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc0e3-a76e-4dec-8698-b6365fc09069 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:43.463764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc0e3-a76e-4dec-8698-b6365fc09069 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:43.463764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc0e3-a76e-4dec-8698-b6365fc09069 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:43.465369 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:43.471033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601e72-1f13-4774-8d6b-fbaefc36e657 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:43.471510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601e72-1f13-4774-8d6b-fbaefc36e657 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:43.471616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601e72-1f13-4774-8d6b-fbaefc36e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:43.555682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2c601e72-1f13-4774-8d6b-fbaefc36e657 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:43.556939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c601e72-1f13-4774-8d6b-fbaefc36e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:43.671378 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:43.824056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc0e3-a76e-4dec-8698-b6365fc09069 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:43.826678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-85fbc0e3-a76e-4dec-8698-b6365fc09069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:43.926750 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:43.993371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc0e3-a76e-4dec-8698-b6365fc09069 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:44.122332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f11f49-6c1b-4fe5-b5bf-562823ab2a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:44.122893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f11f49-6c1b-4fe5-b5bf-562823ab2a75 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:44.123170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f11f49-6c1b-4fe5-b5bf-562823ab2a75 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:44.123439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f11f49-6c1b-4fe5-b5bf-562823ab2a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:44.125115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-23f11f49-6c1b-4fe5-b5bf-562823ab2a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:44.180401 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:44.226983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f11f49-6c1b-4fe5-b5bf-562823ab2a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:44.228601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f11f49-6c1b-4fe5-b5bf-562823ab2a75 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:44.249095 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 717/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:45.052491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19935a-cd1a-4428-881c-1d25e9cc6d99 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:45.053051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19935a-cd1a-4428-881c-1d25e9cc6d99 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:45.053279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19935a-cd1a-4428-881c-1d25e9cc6d99 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:45.054509 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:45.059771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467374c-6ba9-476a-8299-6db1c89fb20f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:45.060248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467374c-6ba9-476a-8299-6db1c89fb20f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:45.060351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467374c-6ba9-476a-8299-6db1c89fb20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:45.153961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0467374c-6ba9-476a-8299-6db1c89fb20f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:45.155321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0467374c-6ba9-476a-8299-6db1c89fb20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:45.259264 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:45.427337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19935a-cd1a-4428-881c-1d25e9cc6d99 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:45.430381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1f19935a-cd1a-4428-881c-1d25e9cc6d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:45.488648 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:45.601624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19935a-cd1a-4428-881c-1d25e9cc6d99 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:45.724639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfa090-6f83-45d7-a1aa-2057d7ef84b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:45.725353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfa090-6f83-45d7-a1aa-2057d7ef84b1 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:45.725615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfa090-6f83-45d7-a1aa-2057d7ef84b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:45.725885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfa090-6f83-45d7-a1aa-2057d7ef84b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:45.727491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3bdfa090-6f83-45d7-a1aa-2057d7ef84b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:45.734838 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:45.818891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfa090-6f83-45d7-a1aa-2057d7ef84b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:45.820501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfa090-6f83-45d7-a1aa-2057d7ef84b1 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:45.838856 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 713/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:46.637457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa9bf-6ebe-4f78-a93f-0657828a5c0f None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:46.638032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa9bf-6ebe-4f78-a93f-0657828a5c0f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:46.638032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa9bf-6ebe-4f78-a93f-0657828a5c0f None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:46.639363 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:46.645591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274b7c9-b464-4697-a1af-d9d00b94326f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:46.646332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274b7c9-b464-4697-a1af-d9d00b94326f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:46.646479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274b7c9-b464-4697-a1af-d9d00b94326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:46.734159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e274b7c9-b464-4697-a1af-d9d00b94326f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:46.735368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e274b7c9-b464-4697-a1af-d9d00b94326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:46.811160 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:46.854924 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:47.012459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fa9bf-6ebe-4f78-a93f-0657828a5c0f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:47.014760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3f9fa9bf-6ebe-4f78-a93f-0657828a5c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:47.041598 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:47.190479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fa9bf-6ebe-4f78-a93f-0657828a5c0f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:47.291612 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:47.320461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ee591-dc0e-488e-88c4-40a76f439248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:47.321114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee591-dc0e-488e-88c4-40a76f439248 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:47.321385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee591-dc0e-488e-88c4-40a76f439248 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:47.321650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee591-dc0e-488e-88c4-40a76f439248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:47.323264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e96ee591-dc0e-488e-88c4-40a76f439248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:47.426785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ee591-dc0e-488e-88c4-40a76f439248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:47.429012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ee591-dc0e-488e-88c4-40a76f439248 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:47.447593 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 720/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:48.274303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fcc2b-071b-4298-9159-f4fc8105971e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:48.274837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fcc2b-071b-4298-9159-f4fc8105971e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:48.274837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fcc2b-071b-4298-9159-f4fc8105971e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:48.276218 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:48.282377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf69ff-1f35-49f5-8dac-c28cb33883bf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:48.283103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf69ff-1f35-49f5-8dac-c28cb33883bf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:48.283314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf69ff-1f35-49f5-8dac-c28cb33883bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:48.382684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-33bf69ff-1f35-49f5-8dac-c28cb33883bf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:48.383896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-33bf69ff-1f35-49f5-8dac-c28cb33883bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:48.430056 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:48.494217 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:48.646767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fcc2b-071b-4298-9159-f4fc8105971e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:48.648501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3b6fcc2b-071b-4298-9159-f4fc8105971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:48.810737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fcc2b-071b-4298-9159-f4fc8105971e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:48.869884 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:48.937381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0d286-288b-488c-95c6-94428f6e51bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:48.938000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d286-288b-488c-95c6-94428f6e51bb service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:48.938272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d286-288b-488c-95c6-94428f6e51bb service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:48.938539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d286-288b-488c-95c6-94428f6e51bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:48.940168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0fb0d286-288b-488c-95c6-94428f6e51bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:49.033420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0d286-288b-488c-95c6-94428f6e51bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:49.034975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0d286-288b-488c-95c6-94428f6e51bb service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:49.054999 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 716/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:49.872810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f750d7-0d40-4041-aa4e-628549644367 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:49.873418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f750d7-0d40-4041-aa4e-628549644367 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:49.873418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f750d7-0d40-4041-aa4e-628549644367 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:49.874763 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 00:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:49.880825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32621cbc-392c-4f2e-9993-59800b44cc1e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:49.881725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32621cbc-392c-4f2e-9993-59800b44cc1e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:49.881725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32621cbc-392c-4f2e-9993-59800b44cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:49.967072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-32621cbc-392c-4f2e-9993-59800b44cc1e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:49.968403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-32621cbc-392c-4f2e-9993-59800b44cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:49.970621 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:50.079320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 00:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:50.241032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f750d7-0d40-4041-aa4e-628549644367 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:50.242595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6f750d7-0d40-4041-aa4e-628549644367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:50.404085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f750d7-0d40-4041-aa4e-628549644367 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:50.437356 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:50.530386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4370b1-b0b9-4bca-8e79-647537c7715b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:50.531080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4370b1-b0b9-4bca-8e79-647537c7715b service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:50.531362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4370b1-b0b9-4bca-8e79-647537c7715b service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:50.531652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4370b1-b0b9-4bca-8e79-647537c7715b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:50.533338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5d4370b1-b0b9-4bca-8e79-647537c7715b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:50.638753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4370b1-b0b9-4bca-8e79-647537c7715b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:50.640384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4370b1-b0b9-4bca-8e79-647537c7715b service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:50.660568 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 723/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:52.454013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323a60-9dae-4917-ab84-ee4bd7816613 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:52.454556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323a60-9dae-4917-ab84-ee4bd7816613 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:52.454556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323a60-9dae-4917-ab84-ee4bd7816613 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:52.455819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:52.461588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48985b69-c23f-400f-b724-b3c98359fd69 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:52.462089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48985b69-c23f-400f-b724-b3c98359fd69 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:52.462089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48985b69-c23f-400f-b724-b3c98359fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:52.504715 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:52.531595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-48985b69-c23f-400f-b724-b3c98359fd69 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:52.532871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-48985b69-c23f-400f-b724-b3c98359fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:52.637558 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:52.942434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323a60-9dae-4917-ab84-ee4bd7816613 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:52.945199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e3323a60-9dae-4917-ab84-ee4bd7816613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:53.071427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323a60-9dae-4917-ab84-ee4bd7816613 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:53.107024 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:53.151131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ccf55-108a-442c-b7fc-74e9dff798ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:53.151747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ccf55-108a-442c-b7fc-74e9dff798ea service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:53.152027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ccf55-108a-442c-b7fc-74e9dff798ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:53.152301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ccf55-108a-442c-b7fc-74e9dff798ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:53.153949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-093ccf55-108a-442c-b7fc-74e9dff798ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:53.267574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ccf55-108a-442c-b7fc-74e9dff798ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:53.269039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ccf55-108a-442c-b7fc-74e9dff798ea service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:53.288986 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 719/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:55.415941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037bad-7446-4cd5-974d-bed51d99cd00 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:55.416502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037bad-7446-4cd5-974d-bed51d99cd00 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:55.416502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037bad-7446-4cd5-974d-bed51d99cd00 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:55.417757 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:55.424169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3c9b-8c6e-457b-9c98-ea4ba7e27537 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:55.424963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3c9b-8c6e-457b-9c98-ea4ba7e27537 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:55.425119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3c9b-8c6e-457b-9c98-ea4ba7e27537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:55.508595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ca3b3c9b-8c6e-457b-9c98-ea4ba7e27537 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:55.509880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca3b3c9b-8c6e-457b-9c98-ea4ba7e27537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:55.524312 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:55.615525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:55.910948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037bad-7446-4cd5-974d-bed51d99cd00 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:55.912502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2037bad-7446-4cd5-974d-bed51d99cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:56.033992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037bad-7446-4cd5-974d-bed51d99cd00 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:56.046811 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:56.110467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de1a00-1bfd-40d7-90c5-ec94b8b70311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:56.111068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de1a00-1bfd-40d7-90c5-ec94b8b70311 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:56.111340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de1a00-1bfd-40d7-90c5-ec94b8b70311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:56.111606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de1a00-1bfd-40d7-90c5-ec94b8b70311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:56.113367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-43de1a00-1bfd-40d7-90c5-ec94b8b70311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:56.241771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de1a00-1bfd-40d7-90c5-ec94b8b70311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:56.243112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de1a00-1bfd-40d7-90c5-ec94b8b70311 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:56.262361 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 726/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:58.463071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04f23-4068-4f12-8a9c-6a34e5fc10b2 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:58.463626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04f23-4068-4f12-8a9c-6a34e5fc10b2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:58.463626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04f23-4068-4f12-8a9c-6a34e5fc10b2 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:58.465481 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:58.474303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e031407-9e42-49c2-91e9-49325ec77888 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:58.475032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e031407-9e42-49c2-91e9-49325ec77888 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:58.475505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e031407-9e42-49c2-91e9-49325ec77888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:58.536676 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:58.560696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9e031407-9e42-49c2-91e9-49325ec77888 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:58.562139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9e031407-9e42-49c2-91e9-49325ec77888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:58.662843 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:58.950437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04f23-4068-4f12-8a9c-6a34e5fc10b2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:58.951984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-84a04f23-4068-4f12-8a9c-6a34e5fc10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:59.061852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04f23-4068-4f12-8a9c-6a34e5fc10b2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:59.104200 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:59.140620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee70f6-bcb2-41b6-93bf-f46f5b751330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:59.141294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee70f6-bcb2-41b6-93bf-f46f5b751330 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:59.141572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee70f6-bcb2-41b6-93bf-f46f5b751330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:59.141834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee70f6-bcb2-41b6-93bf-f46f5b751330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:59.143434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1fee70f6-bcb2-41b6-93bf-f46f5b751330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:59.255814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee70f6-bcb2-41b6-93bf-f46f5b751330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:59.257431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee70f6-bcb2-41b6-93bf-f46f5b751330 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:59.279102 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 722/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 00:59:01.299416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811790-de0c-4f47-b149-5f2efea00940 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:01.300065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811790-de0c-4f47-b149-5f2efea00940 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:01.300065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811790-de0c-4f47-b149-5f2efea00940 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:01.301339 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:01.307169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb47edc-cddc-4a5c-b72a-39004ef732d7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:01.307656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb47edc-cddc-4a5c-b72a-39004ef732d7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:01.307656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb47edc-cddc-4a5c-b72a-39004ef732d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:01.374849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bfb47edc-cddc-4a5c-b72a-39004ef732d7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:01.376033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bfb47edc-cddc-4a5c-b72a-39004ef732d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:01.397188 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:01.475780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:01.754772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69811790-de0c-4f47-b149-5f2efea00940 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:01.756328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-69811790-de0c-4f47-b149-5f2efea00940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:01.872347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69811790-de0c-4f47-b149-5f2efea00940 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:01.894338 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:01.951873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b42809-1ae2-4bfb-9ab6-aed082bf4e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:01.952483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b42809-1ae2-4bfb-9ab6-aed082bf4e6d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:01.952759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b42809-1ae2-4bfb-9ab6-aed082bf4e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:01.953054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b42809-1ae2-4bfb-9ab6-aed082bf4e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:01.955014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-72b42809-1ae2-4bfb-9ab6-aed082bf4e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:02.072368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b42809-1ae2-4bfb-9ab6-aed082bf4e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:02.073853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b42809-1ae2-4bfb-9ab6-aed082bf4e6d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:02.093178 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 729/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:04.059995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57641dd-66db-4449-8c86-7f9f12ebb13c None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:04.060945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57641dd-66db-4449-8c86-7f9f12ebb13c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:04.060945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57641dd-66db-4449-8c86-7f9f12ebb13c None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:04.063206 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:59:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:04.071401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bad5a-cc81-4c65-8c29-f857c7c59d95 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:04.071887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bad5a-cc81-4c65-8c29-f857c7c59d95 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:04.071887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bad5a-cc81-4c65-8c29-f857c7c59d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:04.139868 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:04.143701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-588bad5a-cc81-4c65-8c29-f857c7c59d95 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:04.146516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-588bad5a-cc81-4c65-8c29-f857c7c59d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:04.271753 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:04.551150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57641dd-66db-4449-8c86-7f9f12ebb13c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:04.552698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d57641dd-66db-4449-8c86-7f9f12ebb13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:04.676013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57641dd-66db-4449-8c86-7f9f12ebb13c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:04.728466 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:04.756758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e070db-df41-4913-b6ed-e16be512db34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:04.758245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e070db-df41-4913-b6ed-e16be512db34 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:04.758917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e070db-df41-4913-b6ed-e16be512db34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:04.759421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e070db-df41-4913-b6ed-e16be512db34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:04.762197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-98e070db-df41-4913-b6ed-e16be512db34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:04.906357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e070db-df41-4913-b6ed-e16be512db34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:04.907777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e070db-df41-4913-b6ed-e16be512db34 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:04.926409 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 725/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:06.911045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb56e0-24c3-41c3-a43c-eebd315acb3d None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:06.911636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb56e0-24c3-41c3-a43c-eebd315acb3d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:06.911636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb56e0-24c3-41c3-a43c-eebd315acb3d None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:06.913523 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:06.922378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7cdc-801b-4499-9c8a-1bdb2fd3ece3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:06.923103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7cdc-801b-4499-9c8a-1bdb2fd3ece3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:06.923252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7cdc-801b-4499-9c8a-1bdb2fd3ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:06.995151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0dbc7cdc-801b-4499-9c8a-1bdb2fd3ece3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:06.996419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0dbc7cdc-801b-4499-9c8a-1bdb2fd3ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:07.026333 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:07.098226 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:07.384658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb56e0-24c3-41c3-a43c-eebd315acb3d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:07.386396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-57cb56e0-24c3-41c3-a43c-eebd315acb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:07.507188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb56e0-24c3-41c3-a43c-eebd315acb3d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:07.537570 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:07.596141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd69d1b-869e-407c-a151-a532ed90ea91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:07.596745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69d1b-869e-407c-a151-a532ed90ea91 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:07.597051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69d1b-869e-407c-a151-a532ed90ea91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:07.597310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69d1b-869e-407c-a151-a532ed90ea91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:07.598918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-edd69d1b-869e-407c-a151-a532ed90ea91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:07.711185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd69d1b-869e-407c-a151-a532ed90ea91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:07.712552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd69d1b-869e-407c-a151-a532ed90ea91 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:07.731243 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 732/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:09.798203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d9066-8484-48bc-b701-3183e7ef7e9e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:09.799095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d9066-8484-48bc-b701-3183e7ef7e9e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:09.799095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d9066-8484-48bc-b701-3183e7ef7e9e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:09.801276 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:09.808838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496daa-e188-4382-b8bc-7a5aeffa807b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:09.809265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496daa-e188-4382-b8bc-7a5aeffa807b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:09.809371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496daa-e188-4382-b8bc-7a5aeffa807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:09.883643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-14496daa-e188-4382-b8bc-7a5aeffa807b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:09.884877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-14496daa-e188-4382-b8bc-7a5aeffa807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:09.894038 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:09.998580 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:10.285693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d9066-8484-48bc-b701-3183e7ef7e9e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:10.288149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a20d9066-8484-48bc-b701-3183e7ef7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:10.399566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d9066-8484-48bc-b701-3183e7ef7e9e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:10.459260 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:10.488364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37625d24-07c2-4353-9e92-022dc54acbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:10.489293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37625d24-07c2-4353-9e92-022dc54acbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:10.489711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37625d24-07c2-4353-9e92-022dc54acbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:10.490115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37625d24-07c2-4353-9e92-022dc54acbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:10.492212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-37625d24-07c2-4353-9e92-022dc54acbc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:10.606008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37625d24-07c2-4353-9e92-022dc54acbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:10.607446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37625d24-07c2-4353-9e92-022dc54acbc4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:10.625374 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 728/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:12.603359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57ed5-b121-4801-8dc3-d877e0f1d7d8 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:12.604238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57ed5-b121-4801-8dc3-d877e0f1d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:12.604238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57ed5-b121-4801-8dc3-d877e0f1d7d8 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:12.606527 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:59:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:12.613576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f11e6d-2a38-4be7-90e8-24fa56887edb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:12.614352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f11e6d-2a38-4be7-90e8-24fa56887edb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:12.614525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f11e6d-2a38-4be7-90e8-24fa56887edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:12.702563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-21f11e6d-2a38-4be7-90e8-24fa56887edb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:12.706899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-21f11e6d-2a38-4be7-90e8-24fa56887edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:12.752836 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:12.838042 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:13.129369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57ed5-b121-4801-8dc3-d877e0f1d7d8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:13.131343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3a57ed5-b121-4801-8dc3-d877e0f1d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:13.279520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57ed5-b121-4801-8dc3-d877e0f1d7d8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:13.323568 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:13.370593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553c8e-197f-429f-8fda-d7670c9c8c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:13.371456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553c8e-197f-429f-8fda-d7670c9c8c32 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:13.371900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553c8e-197f-429f-8fda-d7670c9c8c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:13.372338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553c8e-197f-429f-8fda-d7670c9c8c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:13.375111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-26553c8e-197f-429f-8fda-d7670c9c8c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:13.494613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553c8e-197f-429f-8fda-d7670c9c8c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:13.496110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553c8e-197f-429f-8fda-d7670c9c8c32 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:13.515143 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 735/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:15.440165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7087daa-64ed-47d1-a770-5e78085a5c85 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:15.440688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7087daa-64ed-47d1-a770-5e78085a5c85 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:15.440688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7087daa-64ed-47d1-a770-5e78085a5c85 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:15.442689 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:15.450405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289b01-4028-4120-b014-235e5b565495 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:15.450800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289b01-4028-4120-b014-235e5b565495 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:15.450947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289b01-4028-4120-b014-235e5b565495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:15.526498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0c289b01-4028-4120-b014-235e5b565495 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:15.527739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c289b01-4028-4120-b014-235e5b565495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:15.546515 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:15.640436 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:15.924304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7087daa-64ed-47d1-a770-5e78085a5c85 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:15.926949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c7087daa-64ed-47d1-a770-5e78085a5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:16.050745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7087daa-64ed-47d1-a770-5e78085a5c85 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:16.123336 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:16.132487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11362a-2d4d-427b-970d-67afd39f818d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:16.133044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11362a-2d4d-427b-970d-67afd39f818d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:16.133322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11362a-2d4d-427b-970d-67afd39f818d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:16.133589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11362a-2d4d-427b-970d-67afd39f818d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:16.135224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b11362a-2d4d-427b-970d-67afd39f818d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:16.259067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11362a-2d4d-427b-970d-67afd39f818d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:16.260409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11362a-2d4d-427b-970d-67afd39f818d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:16.279666 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 731/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:18.263802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4bf1-c802-4f57-bebe-9ca66173d4ae None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:18.264356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4bf1-c802-4f57-bebe-9ca66173d4ae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:18.264356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4bf1-c802-4f57-bebe-9ca66173d4ae None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:18.266520 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 00:59:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:18.272114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2534a-5dc8-4489-b98a-c3ab4c3afba1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:18.272744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2534a-5dc8-4489-b98a-c3ab4c3afba1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:18.273058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2534a-5dc8-4489-b98a-c3ab4c3afba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:18.344055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-53a2534a-5dc8-4489-b98a-c3ab4c3afba1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:18.345299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53a2534a-5dc8-4489-b98a-c3ab4c3afba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:18.396986 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:18.448554 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 00:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:18.741650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4bf1-c802-4f57-bebe-9ca66173d4ae None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:18.743213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-263e4bf1-c802-4f57-bebe-9ca66173d4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:18.858446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4bf1-c802-4f57-bebe-9ca66173d4ae None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:18.915671 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:18.948211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a06dd3-343f-4039-a489-3bfeff5711b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:18.948814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a06dd3-343f-4039-a489-3bfeff5711b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:18.949119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a06dd3-343f-4039-a489-3bfeff5711b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:18.949379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a06dd3-343f-4039-a489-3bfeff5711b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:18.950985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a3a06dd3-343f-4039-a489-3bfeff5711b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:19.071880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a06dd3-343f-4039-a489-3bfeff5711b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:19.073348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a06dd3-343f-4039-a489-3bfeff5711b4 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:19.093329 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 738/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:28.446623 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=22 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:29.090782 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=66 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:38.645000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb6fe4-1d3b-45a7-87c0-0ec27cde7e26 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:38.645623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb6fe4-1d3b-45a7-87c0-0ec27cde7e26 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:38.645623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb6fe4-1d3b-45a7-87c0-0ec27cde7e26 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:38.646904 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 733/1471] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:38.653492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a1507-26a1-4326-80da-6793e0055cd6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:38.653978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a1507-26a1-4326-80da-6793e0055cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:38.654082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a1507-26a1-4326-80da-6793e0055cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:38.729769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1d6a1507-26a1-4326-80da-6793e0055cd6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:38.731614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d6a1507-26a1-4326-80da-6793e0055cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:38.848574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 739/1472] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:39.152900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8417d-b5fa-4706-82b0-1540a8931965 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:39.153215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8417d-b5fa-4706-82b0-1540a8931965 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:39.153482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8417d-b5fa-4706-82b0-1540a8931965 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:39.154819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 734/1473] 10.222.0.46 () {54 vars in 967 bytes} [Sun Aug 21 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:39.159742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae3ea-54b1-449e-b087-be68a5d6ad49 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:39.160023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae3ea-54b1-449e-b087-be68a5d6ad49 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:39.160297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae3ea-54b1-449e-b087-be68a5d6ad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:39.245290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-35dae3ea-54b1-449e-b087-be68a5d6ad49 None None] MFA Rules not processed for user `9fff798abd7e4970977c2465aaed01b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:39.246492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-35dae3ea-54b1-449e-b087-be68a5d6ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:39.267706 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:39.328713 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 740/1474] 10.222.0.46 () {58 vars in 1064 bytes} [Sun Aug 21 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:39.336832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8417d-b5fa-4706-82b0-1540a8931965 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:39.338347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63c8417d-b5fa-4706-82b0-1540a8931965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:39.450367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8417d-b5fa-4706-82b0-1540a8931965 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:39.533277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67429093-65c7-4d79-bfcb-0e3a6888910f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:39.534198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429093-65c7-4d79-bfcb-0e3a6888910f service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:39.534482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429093-65c7-4d79-bfcb-0e3a6888910f service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:39.534722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429093-65c7-4d79-bfcb-0e3a6888910f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:39.536384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-67429093-65c7-4d79-bfcb-0e3a6888910f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:39.596075 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:39.668816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67429093-65c7-4d79-bfcb-0e3a6888910f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:39.670275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67429093-65c7-4d79-bfcb-0e3a6888910f service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:39.689117 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 735/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:41.720064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4f030-e771-46c5-901b-3fb6ee03e856 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:41.720577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4f030-e771-46c5-901b-3fb6ee03e856 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:41.720577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4f030-e771-46c5-901b-3fb6ee03e856 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:41.723024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 741/1476] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:41.730126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752fe57-478b-4c9f-9324-ee8e3f803434 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:41.730634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752fe57-478b-4c9f-9324-ee8e3f803434 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:41.730634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752fe57-478b-4c9f-9324-ee8e3f803434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:41.806443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0752fe57-478b-4c9f-9324-ee8e3f803434 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:41.807560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0752fe57-478b-4c9f-9324-ee8e3f803434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:41.914905 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 736/1477] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:42.181909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4f030-e771-46c5-901b-3fb6ee03e856 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:42.183478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c3c4f030-e771-46c5-901b-3fb6ee03e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:42.326246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4f030-e771-46c5-901b-3fb6ee03e856 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:42.387654 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:42.442524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15bfc-5f8a-4069-818e-60ef5dcbc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:42.443127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15bfc-5f8a-4069-818e-60ef5dcbc9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:42.443400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15bfc-5f8a-4069-818e-60ef5dcbc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:42.443664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15bfc-5f8a-4069-818e-60ef5dcbc9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:42.444608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15bfc-5f8a-4069-818e-60ef5dcbc9c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:42.446293 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-b9c15bfc-5f8a-4069-818e-60ef5dcbc9c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 00:59:42.446293 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 00:59:42.446293 n-d-master-1 devstack@keystone.service[81885]: Aug 21 00:59:42.447425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15bfc-5f8a-4069-818e-60ef5dcbc9c8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:42.466280 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 742/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:42 2022] GET /identity/v3/projects => generated 2553 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:59:44.378085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf434c-6e7c-4d30-87ea-b76610c9b31b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:44.378887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf434c-6e7c-4d30-87ea-b76610c9b31b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:44.379051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf434c-6e7c-4d30-87ea-b76610c9b31b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:44.380975 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 737/1479] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:59:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:44.387175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609fa4-d695-4f28-aa6c-4f1d398f2509 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:44.387762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609fa4-d695-4f28-aa6c-4f1d398f2509 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:44.387940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609fa4-d695-4f28-aa6c-4f1d398f2509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:44.464367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-10609fa4-d695-4f28-aa6c-4f1d398f2509 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:44.465876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10609fa4-d695-4f28-aa6c-4f1d398f2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:44.567652 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 743/1480] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:44.875270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf434c-6e7c-4d30-87ea-b76610c9b31b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:44.877376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-55cf434c-6e7c-4d30-87ea-b76610c9b31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:44.889777 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.043065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf434c-6e7c-4d30-87ea-b76610c9b31b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:45.135633 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.173780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343825be-aa68-43c9-8435-8e154f29e859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:45.174387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343825be-aa68-43c9-8435-8e154f29e859 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:45.174659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343825be-aa68-43c9-8435-8e154f29e859 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:45.174903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343825be-aa68-43c9-8435-8e154f29e859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:45.176694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-343825be-aa68-43c9-8435-8e154f29e859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:45.275551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343825be-aa68-43c9-8435-8e154f29e859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:45.277189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343825be-aa68-43c9-8435-8e154f29e859 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:45.295448 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 738/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:47.433041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93d6a-4a4f-4df2-aa76-296551af2983 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:47.433572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93d6a-4a4f-4df2-aa76-296551af2983 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:47.433572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93d6a-4a4f-4df2-aa76-296551af2983 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:47.434857 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 744/1482] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:47.441141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef1764-e8d4-4393-a0c1-ab48e06462a5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:47.441627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef1764-e8d4-4393-a0c1-ab48e06462a5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:47.441906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef1764-e8d4-4393-a0c1-ab48e06462a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:47.521539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-19ef1764-e8d4-4393-a0c1-ab48e06462a5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:47.522830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19ef1764-e8d4-4393-a0c1-ab48e06462a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:47.574593 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:47.636031 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 739/1483] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:47.933730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93d6a-4a4f-4df2-aa76-296551af2983 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:47.935295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-49c93d6a-4a4f-4df2-aa76-296551af2983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:47.962920 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:48.048567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93d6a-4a4f-4df2-aa76-296551af2983 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:48.130901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08390-1edb-46cd-8339-db6b41eacb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:48.132038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08390-1edb-46cd-8339-db6b41eacb92 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:48.132347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08390-1edb-46cd-8339-db6b41eacb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:48.132601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08390-1edb-46cd-8339-db6b41eacb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:48.134629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84a08390-1edb-46cd-8339-db6b41eacb92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:48.218007 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:48.261248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a08390-1edb-46cd-8339-db6b41eacb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:48.262697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a08390-1edb-46cd-8339-db6b41eacb92 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:48.281257 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 745/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:50.241119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27078-d561-43dc-aa1a-d4a6a6745a42 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:50.241737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27078-d561-43dc-aa1a-d4a6a6745a42 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:50.241737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27078-d561-43dc-aa1a-d4a6a6745a42 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:50.243099 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 740/1485] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:50.248665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fec8-329e-4711-b4c8-7e3c01ee24b7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:50.249144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fec8-329e-4711-b4c8-7e3c01ee24b7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:50.249249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fec8-329e-4711-b4c8-7e3c01ee24b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:50.322654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7952fec8-329e-4711-b4c8-7e3c01ee24b7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:50.322654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7952fec8-329e-4711-b4c8-7e3c01ee24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:50.427816 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 746/1486] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:50.715211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27078-d561-43dc-aa1a-d4a6a6745a42 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:50.717791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-92d27078-d561-43dc-aa1a-d4a6a6745a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:50.831682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27078-d561-43dc-aa1a-d4a6a6745a42 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:50.919727 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:50.922180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a07ff1-faa2-451b-8f1b-d7da5a8b70c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:50.922808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a07ff1-faa2-451b-8f1b-d7da5a8b70c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:50.923091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a07ff1-faa2-451b-8f1b-d7da5a8b70c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:50.923358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a07ff1-faa2-451b-8f1b-d7da5a8b70c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:50.925657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-83a07ff1-faa2-451b-8f1b-d7da5a8b70c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:51.051201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a07ff1-faa2-451b-8f1b-d7da5a8b70c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:51.052648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a07ff1-faa2-451b-8f1b-d7da5a8b70c9 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:51.072990 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 741/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:53.156643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cdef-cd11-45d5-81f7-7a36b7137749 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.157416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cdef-cd11-45d5-81f7-7a36b7137749 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.157416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cdef-cd11-45d5-81f7-7a36b7137749 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.158691 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 747/1488] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:53.165872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460e9d1-602d-427c-a1a5-115473b43ce3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.165872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460e9d1-602d-427c-a1a5-115473b43ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.165872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460e9d1-602d-427c-a1a5-115473b43ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.245891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d460e9d1-602d-427c-a1a5-115473b43ce3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:53.247134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d460e9d1-602d-427c-a1a5-115473b43ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:53.306800 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:53.356455 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 742/1489] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:53.644353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2cdef-cd11-45d5-81f7-7a36b7137749 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:53.645963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dcd2cdef-cd11-45d5-81f7-7a36b7137749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:53.688065 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:53.758882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2cdef-cd11-45d5-81f7-7a36b7137749 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:53.847199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b526d2-f7e6-4376-94ae-5ae0e5ad4663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:53.847921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b526d2-f7e6-4376-94ae-5ae0e5ad4663 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.848189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b526d2-f7e6-4376-94ae-5ae0e5ad4663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.848453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b526d2-f7e6-4376-94ae-5ae0e5ad4663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.850119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-98b526d2-f7e6-4376-94ae-5ae0e5ad4663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:53.940020 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:53.979540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b526d2-f7e6-4376-94ae-5ae0e5ad4663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:53.981058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b526d2-f7e6-4376-94ae-5ae0e5ad4663 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:54.002674 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 748/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:56.107939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f6a7-0842-42a5-a805-86a3c30f6aed None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:56.108644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f6a7-0842-42a5-a805-86a3c30f6aed None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:56.108644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f6a7-0842-42a5-a805-86a3c30f6aed None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:56.110557 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 743/1491] 10.222.0.46 () {54 vars in 927 bytes} [Sun Aug 21 00:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:56.116277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e85e6-94b0-4653-9b3b-837b6cf4be28 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:56.116277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e85e6-94b0-4653-9b3b-837b6cf4be28 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:56.117222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e85e6-94b0-4653-9b3b-837b6cf4be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:56.320025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-246e85e6-94b0-4653-9b3b-837b6cf4be28 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:56.321198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-246e85e6-94b0-4653-9b3b-837b6cf4be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:56.423746 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 749/1492] 10.222.0.46 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:56.718364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3f6a7-0842-42a5-a805-86a3c30f6aed None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:56.720976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1db3f6a7-0842-42a5-a805-86a3c30f6aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:56.971741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3f6a7-0842-42a5-a805-86a3c30f6aed None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:57.049102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb37b-1313-4c66-bf57-d27926932de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:57.049707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb37b-1313-4c66-bf57-d27926932de9 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:57.049976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb37b-1313-4c66-bf57-d27926932de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:57.050244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb37b-1313-4c66-bf57-d27926932de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:57.051964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b12eb37b-1313-4c66-bf57-d27926932de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:57.061155 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:57.176559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb37b-1313-4c66-bf57-d27926932de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:57.178031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb37b-1313-4c66-bf57-d27926932de9 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:57.207507 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 744/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:06.421963 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=82 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:07.203465 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=50 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:15.626597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:15.627571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:15.627571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:15.713883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:15.715432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:15.819879 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 750/1494] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:15.831802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f1dd-b749-4632-b90f-52341f350ef8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:15.832369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f1dd-b749-4632-b90f-52341f350ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:15.832369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f1dd-b749-4632-b90f-52341f350ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:15.919517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9106f1dd-b749-4632-b90f-52341f350ef8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:15.920630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9106f1dd-b749-4632-b90f-52341f350ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:16.033476 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 745/1495] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:16.040012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:16.041290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:16.052959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a694f-0daf-426f-8d48-a5de7b62c056 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:16.125678 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:16.161081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:16.161688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:16.161969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:16.162310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:16.162967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:01:16.163285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:16.164325 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:16.164325 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:01:16.164325 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:01:16.165238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:16.179523 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 751/1496] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:01:16.192154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f1dd-b749-4632-b90f-52341f350ef8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:16.208636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f1dd-b749-4632-b90f-52341f350ef8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:16.275416 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:16.317674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:16.318281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:16.318642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:16.318848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:16.319483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:16.321287 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:16.321287 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:01:16.321287 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:01:16.322508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:16.384754 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 746/1497] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:01:16 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:01:16.389215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:16.390763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:16.426263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483faf9-205c-4483-b1ae-099d0ae3f306 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:16.532825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:16.533436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:16.533708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:16.534079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:16.534589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:16.535597 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:16.535597 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:01:16.535597 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:01:16.536826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:16.584514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 752/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:01:16 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:01:16.590458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:16.592030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:16.654273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d00c4e-0c8c-4306-9890-5ce1e8c2e677 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:16.751656 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:16.764068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:16.764671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:16.765587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:16.765860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:16.766509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:16.767523 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:16.767523 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:01:16.767523 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:01:16.768393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:16.781292 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 747/1499] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:01:16.785636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:16.787158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:16.798881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8c97-4c50-4c44-8fc1-b1d0377200e7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:16.824435 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:16.903651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876cbaa-7190-4e37-aae6-32d2f2bfd6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:16.904260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876cbaa-7190-4e37-aae6-32d2f2bfd6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:16.904537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876cbaa-7190-4e37-aae6-32d2f2bfd6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:16.904819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876cbaa-7190-4e37-aae6-32d2f2bfd6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:16.905466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876cbaa-7190-4e37-aae6-32d2f2bfd6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:16.906487 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-7876cbaa-7190-4e37-aae6-32d2f2bfd6ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:16.906487 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:01:16.906487 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:01:16.907374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876cbaa-7190-4e37-aae6-32d2f2bfd6ce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:16.920401 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 753/1500] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:01:16.924755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:16.926387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:16.963013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a065-e30b-4e92-b731-cc3098e92730 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:17.067677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523606d-bd8c-4cc0-8fa4-5c26a1ea5084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:17.068592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523606d-bd8c-4cc0-8fa4-5c26a1ea5084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:17.068915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523606d-bd8c-4cc0-8fa4-5c26a1ea5084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:17.069385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523606d-bd8c-4cc0-8fa4-5c26a1ea5084 admin admin] PATH_INFO: `/v3/projects/4a6be39941ae4c869ccebefb7ccb330e/users/0f3ca8fffe374ae389c98e92554da985/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:17.098379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523606d-bd8c-4cc0-8fa4-5c26a1ea5084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6be39941ae4c869ccebefb7ccb330e, user_id=0f3ca8fffe374ae389c98e92554da985, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:17.099422 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-f523606d-bd8c-4cc0-8fa4-5c26a1ea5084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:17.099422 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:01:17.099422 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:01:17.101614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523606d-bd8c-4cc0-8fa4-5c26a1ea5084 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:17.127876 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 748/1501] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:01:16 2022] PUT /identity/v3/projects/4a6be39941ae4c869ccebefb7ccb330e/users/0f3ca8fffe374ae389c98e92554da985/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:01:17.140166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1f5e-6e61-4951-8f95-76473526a627 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:17.140166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1f5e-6e61-4951-8f95-76473526a627 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:17.140380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1f5e-6e61-4951-8f95-76473526a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:17.199164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-22ab1f5e-6e61-4951-8f95-76473526a627 None None] MFA Rules not processed for user `0f3ca8fffe374ae389c98e92554da985`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:17.200374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-22ab1f5e-6e61-4951-8f95-76473526a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:17.282690 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 754/1502] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:17.297795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6c17-55fa-4719-aa82-82bc5e327355 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:17.298206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6c17-55fa-4719-aa82-82bc5e327355 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:17.298673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6c17-55fa-4719-aa82-82bc5e327355 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:17.300862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 749/1503] 10.222.0.46 () {54 vars in 964 bytes} [Sun Aug 21 01:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:17.306325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad552-e939-4964-aa39-877da63dc95e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:17.306607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad552-e939-4964-aa39-877da63dc95e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:17.306887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad552-e939-4964-aa39-877da63dc95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:17.339567 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:17.388107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e11ad552-e939-4964-aa39-877da63dc95e None None] MFA Rules not processed for user `1c9c0901260e44a789d750c2032bfbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:17.389379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e11ad552-e939-4964-aa39-877da63dc95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:17.474037 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 755/1504] 10.222.0.46 () {58 vars in 1061 bytes} [Sun Aug 21 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:01:17.482071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6c17-55fa-4719-aa82-82bc5e327355 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:17.483639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-10fd6c17-55fa-4719-aa82-82bc5e327355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:17.544322 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:17.604130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6c17-55fa-4719-aa82-82bc5e327355 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:17.683057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:17.683658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:17.683928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:17.684193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:17.685819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:17.794114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:17.795569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:17.799068 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:17.815132 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 750/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:17.868254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db414d-1765-4a5d-b04a-23280c600727 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:17.868842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db414d-1765-4a5d-b04a-23280c600727 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:17.869285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db414d-1765-4a5d-b04a-23280c600727 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:17.871246 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 756/1506] 10.222.0.46 () {52 vars in 830 bytes} [Sun Aug 21 01:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:17.875881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:17.884010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:17.984676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89720c4-421e-44cc-9175-d6874641900e service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:18.086805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:18.087443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:18.087718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:18.087986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] PATH_INFO: `/v3/users/0f3ca8fffe374ae389c98e92554da985` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:18.102435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3ca8fffe374ae389c98e92554da985)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:18.103472 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:18.103472 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:01:18.103472 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:01:18.104686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:18.115183 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:18.177533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3ca8fffe374ae389c98e92554da985'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:18.189846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3ca8fffe374ae389c98e92554da985'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:18.190308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3ca8fffe374ae389c98e92554da985'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:18.205808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3ca8fffe374ae389c98e92554da985'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:18.206340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3ca8fffe374ae389c98e92554da985'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:18.237908 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 751/1507] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:01:17 2022] DELETE /identity/v3/users/0f3ca8fffe374ae389c98e92554da985 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:01:18.243857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:18.244135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:18.244405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:18.309209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:18.310441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:18.392862 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:18.407118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 757/1508] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:18.418529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:18.420398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:18.540276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf07e3-ceb5-44c4-af1d-49e30fdbf380 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:18.603949 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:18.628642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91743860-c0c7-40b9-96cc-e6415aca985b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:18.629280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743860-c0c7-40b9-96cc-e6415aca985b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:18.629555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743860-c0c7-40b9-96cc-e6415aca985b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:18.629819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743860-c0c7-40b9-96cc-e6415aca985b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:18.631571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-91743860-c0c7-40b9-96cc-e6415aca985b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:18.748743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743860-c0c7-40b9-96cc-e6415aca985b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:18.750134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743860-c0c7-40b9-96cc-e6415aca985b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:18.770534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 752/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:19.130470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:19.131886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:19.144120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f452cb-5afe-4bb9-a9f0-afbc9f36e0ff None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:19.248379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:19.249028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:19.249297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:19.249558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] PATH_INFO: `/v3/projects/4a6be39941ae4c869ccebefb7ccb330e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:19.260047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6be39941ae4c869ccebefb7ccb330e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:19.261128 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:19.261128 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:01:19.261128 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:01:19.262333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:19.323366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6be39941ae4c869ccebefb7ccb330e', 'request_id': 'req-c3185126-805d-4af4-bfef-16e368f3e55e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:19.338208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6be39941ae4c869ccebefb7ccb330e', 'request_id': 'req-c3185126-805d-4af4-bfef-16e368f3e55e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:19.345699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6be39941ae4c869ccebefb7ccb330e', 'request_id': 'req-c3185126-805d-4af4-bfef-16e368f3e55e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:19.373100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] The token cache is being invalidate because project 4a6be39941ae4c869ccebefb7ccb330e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:01:19.373385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:19.373898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3185126-805d-4af4-bfef-16e368f3e55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:01:19.375204 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 758/1510] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:01:19 2022] DELETE /identity/v3/projects/4a6be39941ae4c869ccebefb7ccb330e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:01:28.768158 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=62 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:29.371288 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:25.586251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504ee29-f46b-47d7-98be-f043d967efdb None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:25.586935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504ee29-f46b-47d7-98be-f043d967efdb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:25.586935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504ee29-f46b-47d7-98be-f043d967efdb None None] PATH_INFO: `/v3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:25.588136 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 753/1511] 10.222.0.16 () {54 vars in 925 bytes} [Sun Aug 21 01:04:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:04:25.594784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a188-ea75-4cca-97f2-773390a84716 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:25.595276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a188-ea75-4cca-97f2-773390a84716 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:25.595276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a188-ea75-4cca-97f2-773390a84716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:25.689164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b123a188-ea75-4cca-97f2-773390a84716 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:25.690396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b123a188-ea75-4cca-97f2-773390a84716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:25.815372 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 759/1512] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Aug 21 01:04:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:29.502021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f53c9-c27b-4fdd-80a0-7bc93c0b62b1 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:29.502879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f53c9-c27b-4fdd-80a0-7bc93c0b62b1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:29.502879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f53c9-c27b-4fdd-80a0-7bc93c0b62b1 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:29.505036 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 754/1513] 10.222.0.46 () {54 vars in 961 bytes} [Sun Aug 21 01:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:29.510265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0ba2a-d543-4e99-b0ec-adab7e82b6eb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:29.510731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0ba2a-d543-4e99-b0ec-adab7e82b6eb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:29.510832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0ba2a-d543-4e99-b0ec-adab7e82b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:29.531384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2ca0ba2a-d543-4e99-b0ec-adab7e82b6eb None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:29.532620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ca0ba2a-d543-4e99-b0ec-adab7e82b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:29.542147 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 760/1514] 10.222.0.46 () {58 vars in 1058 bytes} [Sun Aug 21 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:29.549925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f53c9-c27b-4fdd-80a0-7bc93c0b62b1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:29.566054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f53c9-c27b-4fdd-80a0-7bc93c0b62b1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:29.571988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0f370-6577-454b-8e14-64724fae7d4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:29.572582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f370-6577-454b-8e14-64724fae7d4f service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:29.572875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f370-6577-454b-8e14-64724fae7d4f service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:29.573146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f370-6577-454b-8e14-64724fae7d4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:29.581565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0f370-6577-454b-8e14-64724fae7d4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:29.583143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0f370-6577-454b-8e14-64724fae7d4f service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:29.593353 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 755/1515] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:39.526104 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=77 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:39.589539 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:52.291655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1afaab-bd7d-4bd6-8681-3432c4e3b328 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:52.292484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1afaab-bd7d-4bd6-8681-3432c4e3b328 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:52.292484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1afaab-bd7d-4bd6-8681-3432c4e3b328 None None] PATH_INFO: `/v3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:52.294826 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 761/1516] 10.222.0.70 () {54 vars in 925 bytes} [Sun Aug 21 01:04:52 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:04:52.304089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c3e5-c82e-4504-bb74-53e4384037b9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:52.304898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c3e5-c82e-4504-bb74-53e4384037b9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:52.304898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c3e5-c82e-4504-bb74-53e4384037b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:52.331806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a5f6c3e5-c82e-4504-bb74-53e4384037b9 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:52.333024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a5f6c3e5-c82e-4504-bb74-53e4384037b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:52.344263 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 756/1517] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Aug 21 01:04:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:02.326318 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:02.369803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1afaab-bd7d-4bd6-8681-3432c4e3b328 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:02.385313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1afaab-bd7d-4bd6-8681-3432c4e3b328 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:02.390666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88879bfe-fdcf-42f4-945f-9b88dc47f887 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:02.391283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879bfe-fdcf-42f4-945f-9b88dc47f887 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:02.391539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879bfe-fdcf-42f4-945f-9b88dc47f887 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:02.391804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879bfe-fdcf-42f4-945f-9b88dc47f887 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:02.400837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88879bfe-fdcf-42f4-945f-9b88dc47f887 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:02.402423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88879bfe-fdcf-42f4-945f-9b88dc47f887 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:02.412754 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 762/1518] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:05:02.469034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc41f0-083a-4b7c-ac48-b2604b13c755 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:02.469312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc41f0-083a-4b7c-ac48-b2604b13c755 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:02.469576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc41f0-083a-4b7c-ac48-b2604b13c755 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:02.470982 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 757/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:05:02.475970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773e1d-f46b-47c5-b079-1877e29ce8dd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:02.476279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773e1d-f46b-47c5-b079-1877e29ce8dd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:02.476550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773e1d-f46b-47c5-b079-1877e29ce8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:02.538176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-01773e1d-f46b-47c5-b079-1877e29ce8dd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:02.539439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-01773e1d-f46b-47c5-b079-1877e29ce8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:02.629685 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 763/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:05:02.789513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc41f0-083a-4b7c-ac48-b2604b13c755 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:02.791317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26bc41f0-083a-4b7c-ac48-b2604b13c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:02.900360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc41f0-083a-4b7c-ac48-b2604b13c755 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:02.905921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4a13a-ac2d-4be4-9fdd-2153901804e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:02.906527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4a13a-ac2d-4be4-9fdd-2153901804e1 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:02.906800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4a13a-ac2d-4be4-9fdd-2153901804e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:02.907066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4a13a-ac2d-4be4-9fdd-2153901804e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:02.915587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4a13a-ac2d-4be4-9fdd-2153901804e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:02.917191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4a13a-ac2d-4be4-9fdd-2153901804e1 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:02.927159 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 758/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:05:03.779739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a265ac-82da-4029-ae21-55f0db2b262d None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:03.780348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a265ac-82da-4029-ae21-55f0db2b262d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:03.780348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a265ac-82da-4029-ae21-55f0db2b262d None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:03.781672 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:05:03.788260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af87c-9ac4-4829-9799-17a954b4b545 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:03.789107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af87c-9ac4-4829-9799-17a954b4b545 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:03.789107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af87c-9ac4-4829-9799-17a954b4b545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:03.814015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-571af87c-9ac4-4829-9799-17a954b4b545 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:03.815269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-571af87c-9ac4-4829-9799-17a954b4b545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:03.823621 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:03.973879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a265ac-82da-4029-ae21-55f0db2b262d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:03.995538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a265ac-82da-4029-ae21-55f0db2b262d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:04.001824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638566a-d991-4b8f-89cc-3a1438f838d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:04.002426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638566a-d991-4b8f-89cc-3a1438f838d0 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:04.002706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638566a-d991-4b8f-89cc-3a1438f838d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:04.002983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638566a-d991-4b8f-89cc-3a1438f838d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:04.011904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638566a-d991-4b8f-89cc-3a1438f838d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:04.013530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638566a-d991-4b8f-89cc-3a1438f838d0 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:04.023431 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 765/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:05:08.034400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9f0c-325f-41eb-9cfe-6557db0e799e None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:08.034971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9f0c-325f-41eb-9cfe-6557db0e799e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:08.034971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9f0c-325f-41eb-9cfe-6557db0e799e None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:08.036317 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:05:08.041854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155db033-0d67-4252-a525-bc8bee25a76e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:08.042324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155db033-0d67-4252-a525-bc8bee25a76e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:08.042433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155db033-0d67-4252-a525-bc8bee25a76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:08.064300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-155db033-0d67-4252-a525-bc8bee25a76e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:08.065558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-155db033-0d67-4252-a525-bc8bee25a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:08.075017 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:08.364996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9f0c-325f-41eb-9cfe-6557db0e799e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:08.366981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b6ce9f0c-325f-41eb-9cfe-6557db0e799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:08.459991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9f0c-325f-41eb-9cfe-6557db0e799e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:08.465128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0fc04-377c-4bfc-a8cf-0250642e5345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:08.465739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fc04-377c-4bfc-a8cf-0250642e5345 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:08.466017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fc04-377c-4bfc-a8cf-0250642e5345 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:08.466291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fc04-377c-4bfc-a8cf-0250642e5345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:08.481392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0fc04-377c-4bfc-a8cf-0250642e5345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:08.483660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0fc04-377c-4bfc-a8cf-0250642e5345 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:08.496046 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 761/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:05:10.420912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669886eb-ca01-40f7-940a-6639c6a3642e None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:10.421516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669886eb-ca01-40f7-940a-6639c6a3642e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:10.421516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669886eb-ca01-40f7-940a-6639c6a3642e None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:10.423522 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:05:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:05:10.431655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abaa9c-b27a-445b-83fc-012ed5e67fa8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:10.432111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abaa9c-b27a-445b-83fc-012ed5e67fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:10.432235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abaa9c-b27a-445b-83fc-012ed5e67fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:10.453448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b8abaa9c-b27a-445b-83fc-012ed5e67fa8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:10.454642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b8abaa9c-b27a-445b-83fc-012ed5e67fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:10.463837 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:10.758770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669886eb-ca01-40f7-940a-6639c6a3642e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:10.775151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669886eb-ca01-40f7-940a-6639c6a3642e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:10.779499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62952-5a85-4ce3-bf4e-cb0b64894938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:10.780089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62952-5a85-4ce3-bf4e-cb0b64894938 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:10.780356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62952-5a85-4ce3-bf4e-cb0b64894938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:10.780615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62952-5a85-4ce3-bf4e-cb0b64894938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:10.790747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62952-5a85-4ce3-bf4e-cb0b64894938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:10.792178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62952-5a85-4ce3-bf4e-cb0b64894938 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:10.802206 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 768/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:05:20.448758 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:20.797881 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=71 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:04.430123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17373472-f5ef-4802-a898-c2afa9c613c7 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:04.430627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17373472-f5ef-4802-a898-c2afa9c613c7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:04.430627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17373472-f5ef-4802-a898-c2afa9c613c7 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:04.432081 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 763/1531] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:04.437291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9497-498c-44e2-8aa1-34d9f1a078d1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:04.437710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9497-498c-44e2-8aa1-34d9f1a078d1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:04.437955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9497-498c-44e2-8aa1-34d9f1a078d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:04.457439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b0fa9497-498c-44e2-8aa1-34d9f1a078d1 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:04.459023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b0fa9497-498c-44e2-8aa1-34d9f1a078d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:04.467542 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 769/1532] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:14.452444 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:35.762623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac316d-514b-4faf-b257-4eae98e6a2f7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:35.763751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac316d-514b-4faf-b257-4eae98e6a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:35.764258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac316d-514b-4faf-b257-4eae98e6a2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:35.794892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-30ac316d-514b-4faf-b257-4eae98e6a2f7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:35.796472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30ac316d-514b-4faf-b257-4eae98e6a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:35.808137 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 764/1533] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:35.820279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5096c4-4bd7-4b70-9152-30c7202dddd0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:35.821349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5096c4-4bd7-4b70-9152-30c7202dddd0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:35.821818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5096c4-4bd7-4b70-9152-30c7202dddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:35.825313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac5af8-bbd0-47c8-ac65-6fe133207c00 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:35.825602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac5af8-bbd0-47c8-ac65-6fe133207c00 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:35.825871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac5af8-bbd0-47c8-ac65-6fe133207c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:35.850989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ef5096c4-4bd7-4b70-9152-30c7202dddd0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:35.851203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-10ac5af8-bbd0-47c8-ac65-6fe133207c00 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:35.852541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ef5096c4-4bd7-4b70-9152-30c7202dddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:35.852686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-10ac5af8-bbd0-47c8-ac65-6fe133207c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:35.879233 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 765/1534] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:35.879759 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 770/1535] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:35.884180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac5af8-bbd0-47c8-ac65-6fe133207c00 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:35.895087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac5af8-bbd0-47c8-ac65-6fe133207c00 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:35.904827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:35.905714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:35.906074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:35.906349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:35.907013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:35.907315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:35.908418 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:35.908418 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:06:35.908418 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:06:35.909582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccfdff-48e9-409c-a0b9-585d73ab50e4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:35.922357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6fc4-90c3-40b0-982f-ab69b52f6e00 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:35.922641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6fc4-90c3-40b0-982f-ab69b52f6e00 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:35.922919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6fc4-90c3-40b0-982f-ab69b52f6e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:35.943519 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 766/1536] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:35.944905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0fbe-5d96-4341-8878-7a2c30afc987 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:35.945187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0fbe-5d96-4341-8878-7a2c30afc987 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:35.945957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0fbe-5d96-4341-8878-7a2c30afc987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:35.953992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-44ab6fc4-90c3-40b0-982f-ab69b52f6e00 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:35.955195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-44ab6fc4-90c3-40b0-982f-ab69b52f6e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:35.973417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d20f0fbe-5d96-4341-8878-7a2c30afc987 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:35.974648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d20f0fbe-5d96-4341-8878-7a2c30afc987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:35.981308 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 771/1537] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:35.982228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6fc4-90c3-40b0-982f-ab69b52f6e00 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:35.989733 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 767/1538] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:35.990578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0fbe-5d96-4341-8878-7a2c30afc987 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.002448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6fc4-90c3-40b0-982f-ab69b52f6e00 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.009790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0fbe-5d96-4341-8878-7a2c30afc987 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.011531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9de72a-f771-4a0a-af3f-7d6d1de85032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.012170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de72a-f771-4a0a-af3f-7d6d1de85032 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.012434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de72a-f771-4a0a-af3f-7d6d1de85032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.012827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de72a-f771-4a0a-af3f-7d6d1de85032 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.013369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de72a-f771-4a0a-af3f-7d6d1de85032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.014395 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-de9de72a-f771-4a0a-af3f-7d6d1de85032 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:36.014395 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:06:36.014395 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:06:36.015575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de72a-f771-4a0a-af3f-7d6d1de85032 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.021363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4b62-09b3-4200-9cd3-15000f4c6e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.021992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4b62-09b3-4200-9cd3-15000f4c6e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.022268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4b62-09b3-4200-9cd3-15000f4c6e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.022537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4b62-09b3-4200-9cd3-15000f4c6e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.023206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4b62-09b3-4200-9cd3-15000f4c6e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:36.023509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4b62-09b3-4200-9cd3-15000f4c6e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.025868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4b62-09b3-4200-9cd3-15000f4c6e50 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.046035 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 768/1539] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:36.047763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858862e5-8523-4214-b9dc-167d1c712ba4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.048074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858862e5-8523-4214-b9dc-167d1c712ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.053421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858862e5-8523-4214-b9dc-167d1c712ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.080791 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 772/1540] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:35 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.082598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1a24-e162-4bc1-b039-330742f8f741 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.082875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1a24-e162-4bc1-b039-330742f8f741 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.083275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1a24-e162-4bc1-b039-330742f8f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.089847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-858862e5-8523-4214-b9dc-167d1c712ba4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.091274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-858862e5-8523-4214-b9dc-167d1c712ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.128465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6e1e1a24-e162-4bc1-b039-330742f8f741 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.130070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e1e1a24-e162-4bc1-b039-330742f8f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.224753 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 769/1541] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.225749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858862e5-8523-4214-b9dc-167d1c712ba4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.232508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 773/1542] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.233944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e1a24-e162-4bc1-b039-330742f8f741 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.238927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858862e5-8523-4214-b9dc-167d1c712ba4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.243955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841ec5f-7fef-4c6c-acfb-6f4fab68a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.244565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ec5f-7fef-4c6c-acfb-6f4fab68a02c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.244870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ec5f-7fef-4c6c-acfb-6f4fab68a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.245167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ec5f-7fef-4c6c-acfb-6f4fab68a02c admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.245794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841ec5f-7fef-4c6c-acfb-6f4fab68a02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.246192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e1a24-e162-4bc1-b039-330742f8f741 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.247718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841ec5f-7fef-4c6c-acfb-6f4fab68a02c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.251504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c06cf-23f6-4f9d-a333-7d93a3d082c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.252630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c06cf-23f6-4f9d-a333-7d93a3d082c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.253363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c06cf-23f6-4f9d-a333-7d93a3d082c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.253634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c06cf-23f6-4f9d-a333-7d93a3d082c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.254270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c06cf-23f6-4f9d-a333-7d93a3d082c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.256194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c06cf-23f6-4f9d-a333-7d93a3d082c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.280759 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 770/1543] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.281622 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 774/1544] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.282116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0675c-c6c3-4875-a7d4-47f049ca3cac None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.282461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0675c-c6c3-4875-a7d4-47f049ca3cac None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.282735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0675c-c6c3-4875-a7d4-47f049ca3cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.283525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e555a-113b-48a7-a041-dbc2f287abc1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.284022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e555a-113b-48a7-a041-dbc2f287abc1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.284304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e555a-113b-48a7-a041-dbc2f287abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.302394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f3b0675c-c6c3-4875-a7d4-47f049ca3cac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.303591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f3b0675c-c6c3-4875-a7d4-47f049ca3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.307435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ac2e555a-113b-48a7-a041-dbc2f287abc1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.308612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ac2e555a-113b-48a7-a041-dbc2f287abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.362698 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 771/1545] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.363967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f1fb-b386-474c-ba1b-a999900898ce None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.364254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f1fb-b386-474c-ba1b-a999900898ce None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.364529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f1fb-b386-474c-ba1b-a999900898ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.374669 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 775/1546] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.374669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935cf5-b621-418f-bb87-3050ff090452 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.374669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935cf5-b621-418f-bb87-3050ff090452 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.374669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935cf5-b621-418f-bb87-3050ff090452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.391215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ff935cf5-b621-418f-bb87-3050ff090452 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.392431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ff935cf5-b621-418f-bb87-3050ff090452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.392541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f4c9f1fb-b386-474c-ba1b-a999900898ce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.393730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f4c9f1fb-b386-474c-ba1b-a999900898ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.400455 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 776/1547] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.401267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935cf5-b621-418f-bb87-3050ff090452 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.402802 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 772/1548] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.404206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8facc-cede-41b5-a65b-e6d3b8d8abf3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.404490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8facc-cede-41b5-a65b-e6d3b8d8abf3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.404760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8facc-cede-41b5-a65b-e6d3b8d8abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.410916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935cf5-b621-418f-bb87-3050ff090452 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.417259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.418469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.418751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.419026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.419680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:36.419981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.421651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.425328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a2c8facc-cede-41b5-a65b-e6d3b8d8abf3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.426534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a2c8facc-cede-41b5-a65b-e6d3b8d8abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.434776 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 777/1549] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:36.435308 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 773/1550] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.435630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.439611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8facc-cede-41b5-a65b-e6d3b8d8abf3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.446483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaaa00-7383-4c5c-aa89-d07c2ccc11d9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.449500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8facc-cede-41b5-a65b-e6d3b8d8abf3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.451288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8047a-a309-4caf-827d-1e592f605eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.451895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8047a-a309-4caf-827d-1e592f605eac admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.452170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8047a-a309-4caf-827d-1e592f605eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.452440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8047a-a309-4caf-827d-1e592f605eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.453106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8047a-a309-4caf-827d-1e592f605eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.454116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc18f4-48f8-4239-88ea-397762990c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.454714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc18f4-48f8-4239-88ea-397762990c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.454804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8047a-a309-4caf-827d-1e592f605eac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.454991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc18f4-48f8-4239-88ea-397762990c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.455320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc18f4-48f8-4239-88ea-397762990c1f admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.456047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc18f4-48f8-4239-88ea-397762990c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.457741 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-cbcc18f4-48f8-4239-88ea-397762990c1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:36.457741 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:06:36.457741 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:06:36.458636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc18f4-48f8-4239-88ea-397762990c1f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.466833 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 778/1551] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:36.467913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86195b3-3be3-4eb8-bbca-74839251f4d2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.468188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86195b3-3be3-4eb8-bbca-74839251f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.468799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86195b3-3be3-4eb8-bbca-74839251f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.481079 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 774/1552] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.482362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566dbb4-b4b0-4077-a754-25c9e9137899 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.482648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566dbb4-b4b0-4077-a754-25c9e9137899 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.482920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566dbb4-b4b0-4077-a754-25c9e9137899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.490244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f86195b3-3be3-4eb8-bbca-74839251f4d2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.490712 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:36.491502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f86195b3-3be3-4eb8-bbca-74839251f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.500742 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 779/1553] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.502073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3b05-6831-4736-aeff-c740069eaf84 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.502311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3b05-6831-4736-aeff-c740069eaf84 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.502655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3b05-6831-4736-aeff-c740069eaf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.504591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5566dbb4-b4b0-4077-a754-25c9e9137899 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.505832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5566dbb4-b4b0-4077-a754-25c9e9137899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.513738 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 775/1554] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.515057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5220ad-a144-42f6-918e-19833063e9f2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.515196 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:36.515339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5220ad-a144-42f6-918e-19833063e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.515612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5220ad-a144-42f6-918e-19833063e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.532458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-adab3b05-6831-4736-aeff-c740069eaf84 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.533707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-adab3b05-6831-4736-aeff-c740069eaf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.536470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ff5220ad-a144-42f6-918e-19833063e9f2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:36.537729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ff5220ad-a144-42f6-918e-19833063e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:36.542362 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 780/1555] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.543383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3b05-6831-4736-aeff-c740069eaf84 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.548692 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 776/1556] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:36.549592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5220ad-a144-42f6-918e-19833063e9f2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.556530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3b05-6831-4736-aeff-c740069eaf84 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.559234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5220ad-a144-42f6-918e-19833063e9f2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.561614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.562212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.562483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.562744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.563364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.563788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.564380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.564692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.564992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.565452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.565772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:36.566079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.567651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.579650 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 777/1557] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:36.580514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.591268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e387b-7ed0-45c1-a703-cecdafa6e783 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.595996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.596708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.597012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.597283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.597917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.599504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.600990 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 781/1558] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.602090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.613222 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 778/1559] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:36.613222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.621495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d8ce4-c8d5-44b9-8731-5174c243c3fb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.667046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f9c72-2d0d-4af5-a181-7d2e7f42eff2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.672409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.673050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.673457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.673735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.674436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.676057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.679316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.679929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.680208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.680506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.681194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:36.681937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.683532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.686468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 782/1560] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:36.687352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.697665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7f8db-4199-48fa-9320-4afc33d45ec1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.698435 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 779/1561] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:36.699284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.705802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.706753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.707038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.707307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.708001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:36.708299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.709300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5203b-b9b9-4815-98dc-8c4466d48702 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.709913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.714705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.715318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.715597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.715869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.716509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:36.716844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.718485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.722996 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 783/1562] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:36.723794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.740344 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 780/1563] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:36.740545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14881-bd8e-4c43-a48d-51aa1a2e5a4f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.740641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.740726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.740726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.740726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.740726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.741085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:36.741085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.742478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.746288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e2e4-fee9-49b8-bc88-c7a59ec913b3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.750891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.751481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.751759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.752026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.752892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.754775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.754901 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 784/1564] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:36.755766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.766107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53bc2-1742-422d-84c2-1463a4007680 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.771086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.771760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.772141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.772654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.773586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.776192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.782713 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 781/1565] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.785693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.799126 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 785/1566] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.800275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.809834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd604d9-6705-4af6-a90e-e4da2e1cabf8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.851131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6c464-aea2-421b-8238-155d6f40d8df admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.855867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.856528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.856834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.857110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] PATH_INFO: `/v3/projects/337d4ac2ab75412a90dfabc54449050d/users/83aa475e10e748c29ffcb2e194db06c3/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.868062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.868677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.868994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.869265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.869939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.871695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.873115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337d4ac2ab75412a90dfabc54449050d, user_id=83aa475e10e748c29ffcb2e194db06c3, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.875773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.885887 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 786/1567] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:36.885887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.889279 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 782/1568] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:36 2022] PUT /identity/v3/projects/337d4ac2ab75412a90dfabc54449050d/users/83aa475e10e748c29ffcb2e194db06c3/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:36.892831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39722c8-42b2-412e-8bc8-d0fe5c4b145f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.897738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:36.907424 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:36.913412 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:36.954812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.955628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.956167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.956870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.957596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.959599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.963235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a15e3-d807-44c7-ab2f-0a458d28c8e7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:36.968170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:36.968792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:36.969092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:36.969398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:36.969996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:36.972621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:36.992621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 787/1569] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:36.992621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.005376 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 783/1570] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.009493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.054050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8db5f-8e1f-475c-9318-4ffde25b0fd2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.074032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65dce-e4a8-4208-9d78-48f7ed022b01 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.079517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.080138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.080792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.080898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.082056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.084007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.110849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.111533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.111965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.112256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.112893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.113252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 784/1571] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.114963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.117232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.143739 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 788/1572] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:36 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.144677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.185277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad445a-d27f-4e85-837c-100cbc483e38 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.186149 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:37.208164 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:37.210059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ef1a-be03-43ea-98c1-2de2f5133cb0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.215935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.216584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.216902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.217178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.217836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.219496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.232635 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 789/1573] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.235855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.246081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0c24d-7a1c-4bd8-aa84-c818489a03dd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.248058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998138fd-e711-4fa1-8975-96e9d8f874c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.248676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998138fd-e711-4fa1-8975-96e9d8f874c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.249007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998138fd-e711-4fa1-8975-96e9d8f874c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.249276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998138fd-e711-4fa1-8975-96e9d8f874c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.249902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998138fd-e711-4fa1-8975-96e9d8f874c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.251168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.251808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998138fd-e711-4fa1-8975-96e9d8f874c4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.251906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.252127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.252388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] PATH_INFO: `/v3/projects/5c1ed37794e64d02b4a9aace33ab7d2d/users/ed42ee9fffaa49bfb15f6ee2d691004f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.269875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1ed37794e64d02b4a9aace33ab7d2d, user_id=ed42ee9fffaa49bfb15f6ee2d691004f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.271132 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:37.271132 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:06:37.271132 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:06:37.273461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.274660 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 785/1574] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.276022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ee4f-5de9-46b6-a77e-85940d980812 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.276416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ee4f-5de9-46b6-a77e-85940d980812 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.276799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ee4f-5de9-46b6-a77e-85940d980812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.289501 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 790/1575] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:37 2022] PUT /identity/v3/projects/5c1ed37794e64d02b4a9aace33ab7d2d/users/ed42ee9fffaa49bfb15f6ee2d691004f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:37.290930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.307494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5ab2ee4f-5de9-46b6-a77e-85940d980812 None None] MFA Rules not processed for user `83aa475e10e748c29ffcb2e194db06c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:37.308652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5ab2ee4f-5de9-46b6-a77e-85940d980812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:37.354480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d08a14-0154-4003-a501-3220e3a63984 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.359256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.359862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.360142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.360438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.361084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.363741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.374536 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 786/1576] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:37.375445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2ee4f-5de9-46b6-a77e-85940d980812 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.385766 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 791/1577] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.386566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.388112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2ee4f-5de9-46b6-a77e-85940d980812 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.393082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.393694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.393971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.394241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.394867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.396788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.397026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051478-3678-4426-81ff-c1bb99ffc733 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.401577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.402166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.402451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.402713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.403326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.405301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.422664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 787/1578] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/users => generated 291 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.422664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.429332 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 792/1579] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/users => generated 299 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.430327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.430915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ce37c-3e1c-4c0a-93bb-1bfe01033ac6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.435808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139496-a977-44b7-b069-59208f142c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.436470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139496-a977-44b7-b069-59208f142c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.436742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139496-a977-44b7-b069-59208f142c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.437045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139496-a977-44b7-b069-59208f142c91 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.437664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139496-a977-44b7-b069-59208f142c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.439627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139496-a977-44b7-b069-59208f142c91 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.441077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c71d5f-4281-4496-abbb-f62607892b55 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.445974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.446561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.446838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.447108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.447742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.449390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.461133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 793/1580] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.461920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.463198 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 788/1581] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.467208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288cf2e-4146-4129-8594-9bc88c67f996 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.467501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288cf2e-4146-4129-8594-9bc88c67f996 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.467779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288cf2e-4146-4129-8594-9bc88c67f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.471915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bf917-f86b-49f0-ac2f-1705390615d3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.476599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.477223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.477501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.477770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.478399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.479973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.490145 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 794/1582] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.490920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.496374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5288cf2e-4146-4129-8594-9bc88c67f996 None None] MFA Rules not processed for user `ed42ee9fffaa49bfb15f6ee2d691004f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:37.497630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5288cf2e-4146-4129-8594-9bc88c67f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:37.500572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35904caf-b134-4059-af46-e208cfbb72d6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.505622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.506236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.506511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.506763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.507380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.509293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.543122 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 795/1583] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.543122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.567590 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:37.574604 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 789/1584] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:37.575321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288cf2e-4146-4129-8594-9bc88c67f996 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.586867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288cf2e-4146-4129-8594-9bc88c67f996 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.588919 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:37.612486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fc97-68b9-4c9d-a4c8-184666450e3a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.617794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.618423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.618757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.619037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.619718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.621377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.632173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 796/1585] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.633066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.643096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dedb1-fd15-4e02-950c-24c053a78d24 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.648189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.648856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.649120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.649387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.650019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.650965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.651586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.651680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.651867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.652141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.652823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.654426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.662265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 797/1586] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.663038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.667298 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 790/1587] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.667298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.673691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c24d-7d88-4ee8-8846-a01a12a69b03 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.675351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f7ed5-7453-4b29-a4be-bcd7124dfc60 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.679568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.680018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.680408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.680603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.680873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.680994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.681171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.681307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] PATH_INFO: `/v3/projects/7969fbfe11204268ba47c497448be0dc/users/f83dfdbfecd9420dbc75d1d1dfcb59f8/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.681807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.683397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.694393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 791/1588] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.695213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.697820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7969fbfe11204268ba47c497448be0dc, user_id=f83dfdbfecd9420dbc75d1d1dfcb59f8, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.701438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.704711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd1851-d578-42a8-a92c-a065fdf42300 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.710929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.711744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.712025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.712297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.713038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.714617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.716000 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 798/1589] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:37 2022] PUT /identity/v3/projects/7969fbfe11204268ba47c497448be0dc/users/f83dfdbfecd9420dbc75d1d1dfcb59f8/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:37.716793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.740814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 792/1590] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.740814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.749344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad57b7-f540-4466-b1cf-79bb9f2e89f8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.777660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd67ac-8cb8-4e8f-8d30-ad8b67c4049f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.782252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.782861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.783132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.783709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.784324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.786258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.808196 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 799/1591] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.809252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.813313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.813935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.814213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.814483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.815274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.817249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.820227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a7718-d314-4ba4-9d59-226d5ef2cdd7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.824752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.825379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.825661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.825944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.826575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.828161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.838977 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 800/1592] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.839853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.846923 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 793/1593] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:37.847745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.850145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d125a08-3769-400d-8ca6-2cca8e39e91c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.906073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.906749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.906946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.907219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.907861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.908358 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:37.909578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.912451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45771c-d7a6-4533-adef-e0c291e9fc57 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.918873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d143a8-72a5-4d94-852c-02e6ce94e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.919474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d143a8-72a5-4d94-852c-02e6ce94e800 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.919595 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 801/1594] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.920543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.921005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d143a8-72a5-4d94-852c-02e6ce94e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.921471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d143a8-72a5-4d94-852c-02e6ce94e800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.922235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d143a8-72a5-4d94-852c-02e6ce94e800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.924121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d143a8-72a5-4d94-852c-02e6ce94e800 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.930197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3f687-efff-496a-a781-650b3bdd6373 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.934787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.935028 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 794/1595] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.935508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.935790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.936063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.936223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5b82-b83b-4b61-aa9e-cf98b6208d65 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.936508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5b82-b83b-4b61-aa9e-cf98b6208d65 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.936695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.936804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5b82-b83b-4b61-aa9e-cf98b6208d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.938657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:37.949685 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 802/1596] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:37.950476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:37.957737 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:37.961893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa579e-0d34-47be-8238-5181420b2aed admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:37.967956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2aac5b82-b83b-4b61-aa9e-cf98b6208d65 None None] MFA Rules not processed for user `f83dfdbfecd9420dbc75d1d1dfcb59f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:37.968640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:37.969181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2aac5b82-b83b-4b61-aa9e-cf98b6208d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:37.969332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:37.969610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:37.969894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] PATH_INFO: `/v3/projects/fbc6ed90a2184b0e9381063346c3fd10/users/9fb5177c08374a34965f906b7451f1e1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:37.985380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc6ed90a2184b0e9381063346c3fd10, user_id=9fb5177c08374a34965f906b7451f1e1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:37.988556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.004468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 803/1597] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:37 2022] PUT /identity/v3/projects/fbc6ed90a2184b0e9381063346c3fd10/users/9fb5177c08374a34965f906b7451f1e1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:38.005654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.045931 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 795/1598] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:38.046785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac5b82-b83b-4b61-aa9e-cf98b6208d65 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.058368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac5b82-b83b-4b61-aa9e-cf98b6208d65 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.077050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd1df1-8dcb-4c53-8423-c0b7e59415d0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.082663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.083271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.083551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.083820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.084460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.086107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.096950 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 804/1599] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:38.097746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.107456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418c68c-be9f-4f3d-aec7-f945d18049ba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.113308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.113896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.114170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.114452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.115080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.117025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.117149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.117805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.118099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.118369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] PATH_INFO: `/v3/projects/d0add9174f0a4d94af45b509a5258ed5/users/ac4d7fcf06e646e48e9d615a5098e1c1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.139065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0add9174f0a4d94af45b509a5258ed5, user_id=ac4d7fcf06e646e48e9d615a5098e1c1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.140761 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 805/1600] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:38.141782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.142540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.152025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b681-4ce6-49fe-a51e-442b6b37de2c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.157474 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 796/1601] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:38 2022] PUT /identity/v3/projects/d0add9174f0a4d94af45b509a5258ed5/users/ac4d7fcf06e646e48e9d615a5098e1c1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:38.161758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.210958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.211635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.211899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.212170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] PATH_INFO: `/v3/projects/34bacf2fc234419fa36f2f38a3208acf/users/907073f9a3fa44869bced2e46ed909fb/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.226492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bacf2fc234419fa36f2f38a3208acf, user_id=907073f9a3fa44869bced2e46ed909fb, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.229193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.233008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837f14-6d4d-4b1e-9f05-63c4ff921412 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.239038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b234ac-8052-4ecb-970c-8b9d9b85eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.239704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b234ac-8052-4ecb-970c-8b9d9b85eb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.239984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b234ac-8052-4ecb-970c-8b9d9b85eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.240252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b234ac-8052-4ecb-970c-8b9d9b85eb81 admin admin] PATH_INFO: `/v3/projects/80fa6743ec83465ea48c22c0d8ce07f7/users/8ed40211c03744929209e6d4f029bb44/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.242779 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 806/1602] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:38 2022] PUT /identity/v3/projects/34bacf2fc234419fa36f2f38a3208acf/users/907073f9a3fa44869bced2e46ed909fb/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:38.243668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.261774 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:38.267103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b234ac-8052-4ecb-970c-8b9d9b85eb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fa6743ec83465ea48c22c0d8ce07f7, user_id=8ed40211c03744929209e6d4f029bb44, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.270570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b234ac-8052-4ecb-970c-8b9d9b85eb81 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.285896 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 797/1603] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:38 2022] PUT /identity/v3/projects/80fa6743ec83465ea48c22c0d8ce07f7/users/8ed40211c03744929209e6d4f029bb44/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:38.287135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac747656-2952-46ef-8c10-f88ebc7717b0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.287410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac747656-2952-46ef-8c10-f88ebc7717b0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.287683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac747656-2952-46ef-8c10-f88ebc7717b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.294670 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:38.315629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624b1d-1dfb-4bec-86f7-829b8bafc09f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.316852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ac747656-2952-46ef-8c10-f88ebc7717b0 None None] MFA Rules not processed for user `9fb5177c08374a34965f906b7451f1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:38.318011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac747656-2952-46ef-8c10-f88ebc7717b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:38.372140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.372747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.373074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.373370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] PATH_INFO: `/v3/projects/364660defd60430b9098d4eb84d399d7/users/a4ea03fb1c6240fca90d8d3eaa20138f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.381997 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 798/1604] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:38.383048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac747656-2952-46ef-8c10-f88ebc7717b0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.389816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364660defd60430b9098d4eb84d399d7, user_id=a4ea03fb1c6240fca90d8d3eaa20138f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.392653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.394593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac747656-2952-46ef-8c10-f88ebc7717b0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.399825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.400436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.400739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.401020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.401685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.403587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.406798 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 807/1605] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:38 2022] PUT /identity/v3/projects/364660defd60430b9098d4eb84d399d7/users/a4ea03fb1c6240fca90d8d3eaa20138f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:38.407648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.433154 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 799/1606] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:38.434160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.475751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff1e52-8184-42be-b85b-fef774bc8583 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.495048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40998-6023-4c0a-be14-3619c5e82f5a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.499644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2af3a3-4113-43f4-a457-d8c143afc349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.500248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2af3a3-4113-43f4-a457-d8c143afc349 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.500527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2af3a3-4113-43f4-a457-d8c143afc349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.500817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2af3a3-4113-43f4-a457-d8c143afc349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.501461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2af3a3-4113-43f4-a457-d8c143afc349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.503208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2af3a3-4113-43f4-a457-d8c143afc349 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.513196 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 800/1607] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:38.517556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f97fd1-28e9-42d8-9018-85272a9b7dbe None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.517872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f97fd1-28e9-42d8-9018-85272a9b7dbe None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.518146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f97fd1-28e9-42d8-9018-85272a9b7dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.533665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be565cad-56d5-4d90-9649-479f8675f37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.534573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565cad-56d5-4d90-9649-479f8675f37f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.534850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565cad-56d5-4d90-9649-479f8675f37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.535122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565cad-56d5-4d90-9649-479f8675f37f admin admin] PATH_INFO: `/v3/projects/c5bb28ef4ffc4af2a0c5fc7a0cec70d4/users/abca8601739b44d1ab8fccb425ff0db9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.545583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-68f97fd1-28e9-42d8-9018-85272a9b7dbe None None] MFA Rules not processed for user `ac4d7fcf06e646e48e9d615a5098e1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:38.546900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68f97fd1-28e9-42d8-9018-85272a9b7dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:38.549561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be565cad-56d5-4d90-9649-479f8675f37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bb28ef4ffc4af2a0c5fc7a0cec70d4, user_id=abca8601739b44d1ab8fccb425ff0db9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.552217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be565cad-56d5-4d90-9649-479f8675f37f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.566653 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 808/1608] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:38 2022] PUT /identity/v3/projects/c5bb28ef4ffc4af2a0c5fc7a0cec70d4/users/abca8601739b44d1ab8fccb425ff0db9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:38.568629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c7ff-6eb3-4c95-843f-d4583b8dec9d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.569288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c7ff-6eb3-4c95-843f-d4583b8dec9d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.569974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c7ff-6eb3-4c95-843f-d4583b8dec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.576838 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:38.592499 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:38.602086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2563c7ff-6eb3-4c95-843f-d4583b8dec9d None None] MFA Rules not processed for user `907073f9a3fa44869bced2e46ed909fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:38.603310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2563c7ff-6eb3-4c95-843f-d4583b8dec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:38.617647 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 801/1609] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:38.619292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f57b2-d63a-4f81-a1a1-0044ecd809a5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.619584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f57b2-d63a-4f81-a1a1-0044ecd809a5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.619855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f57b2-d63a-4f81-a1a1-0044ecd809a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.648563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-de6f57b2-d63a-4f81-a1a1-0044ecd809a5 None None] MFA Rules not processed for user `8ed40211c03744929209e6d4f029bb44`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:38.649832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de6f57b2-d63a-4f81-a1a1-0044ecd809a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:38.669325 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 809/1610] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:38.670421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c7ff-6eb3-4c95-843f-d4583b8dec9d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.717772 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 802/1611] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:38.719069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a1db-6333-406f-be87-6f520af17023 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.719354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a1db-6333-406f-be87-6f520af17023 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.719738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a1db-6333-406f-be87-6f520af17023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.734175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c7ff-6eb3-4c95-843f-d4583b8dec9d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.738746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.739343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.739616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.739881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.740504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.742436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.747534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ded2a1db-6333-406f-be87-6f520af17023 None None] MFA Rules not processed for user `a4ea03fb1c6240fca90d8d3eaa20138f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:38.748727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ded2a1db-6333-406f-be87-6f520af17023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:38.771998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 810/1612] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:38.772847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.822970 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 803/1613] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:38.822970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2a1db-6333-406f-be87-6f520af17023 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.831630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2a1db-6333-406f-be87-6f520af17023 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.837019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.837700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.837840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f643-b1ba-4768-8ef5-02b85dc22859 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.837933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.838240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] PATH_INFO: `/v3/projects/f68a907348e04362a8413cd6312d1aee/users/d6966e9b09c147d78e602b5bc93655ca/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.842738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.843341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.843612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.843877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.844497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.846614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.853308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68a907348e04362a8413cd6312d1aee, user_id=d6966e9b09c147d78e602b5bc93655ca, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.856011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.869657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 811/1614] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:38.870473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.875229 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 804/1615] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:38 2022] PUT /identity/v3/projects/f68a907348e04362a8413cd6312d1aee/users/d6966e9b09c147d78e602b5bc93655ca/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:38.876102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.880805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450f81a-cc1e-47dc-8686-73893a9527c8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.884703 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:38.920898 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:38.941668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311c00c-e04a-48b4-bf47-438bd844bfeb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.944076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.944722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.945053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.945327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.945981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.946603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.947211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.947488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.947712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.947870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.948500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.950449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:38.962217 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 812/1616] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:38.962217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.973317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45416f01-2a10-4ae5-9746-04c468586c13 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:38.979005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:38.979510 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 805/1617] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:38.979613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:38.979889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:38.980161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:38.980556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:38.981524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:38.983477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.016577 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 813/1618] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.016577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.060714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48cb13-2bca-4115-8763-b88ec17ab72a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.108464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d621-0141-49b1-a42e-49da7f6799ac admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.113591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.114346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.114791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.115075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.115795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.117984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.134309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.134932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.135205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.135468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.136148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.138255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.147210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 814/1619] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.148201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.161798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336faa1-7e4f-4fac-aed3-325027bb26ed admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.166930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.167870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.168208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.168561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.169274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.172207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.175129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 806/1620] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:38 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.175667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.211963 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 815/1621] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.211963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.248420 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.253871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c8d07-2608-4dd5-a975-a65ffdb4c275 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.283147 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.300965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee5567-7d63-4766-9c57-bd3c90ecbef1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.306261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.306947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.307293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.307812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.308522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.310230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.321512 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 816/1622] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.322421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.329300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.329934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.331132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.331737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.332412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.332632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6d36d-b87e-426a-a1bb-843dd726827b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.334056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.338182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.338844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.339116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.339385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] PATH_INFO: `/v3/projects/c5bb28ef4ffc4af2a0c5fc7a0cec70d4/users/abca8601739b44d1ab8fccb425ff0db9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.341431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bb28ef4ffc4af2a0c5fc7a0cec70d4, user_id=abca8601739b44d1ab8fccb425ff0db9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.344061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.345506 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 807/1623] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.346188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.356627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ff46a-948b-4725-ac7b-fab03b810ef0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.357657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 817/1624] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:39 2022] PUT /identity/v3/projects/c5bb28ef4ffc4af2a0c5fc7a0cec70d4/users/abca8601739b44d1ab8fccb425ff0db9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:39.358475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.423613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.424760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.425074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.425339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38b87-ad87-4924-9cf3-a7ae32c339b4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.425444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.425967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.427882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.429973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.430569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.430841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.431104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.431911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.433836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.453494 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 808/1625] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.453494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.458980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 818/1626] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/users => generated 306 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.458980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.461466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40095416-3130-4cd7-83e5-5ffedf80d488 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.466288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.466857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.467132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.467401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.467923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bf914-d3c2-4627-bcbb-f164eeb9a59b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.468026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.469681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.473949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.474544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.474858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.475140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.475776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.477711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.480812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 809/1627] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.484868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.494927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2b2e0-5bd0-47a6-b259-19a7c21b287f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.499431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.500167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.500453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.500617 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 819/1628] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.500703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.501433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.502119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.504025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.512934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8b40-7c80-4cec-a731-a3bf69d1a94f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.517878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd4783-c908-476e-a878-d62a58e0b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.518524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd4783-c908-476e-a878-d62a58e0b884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.518857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd4783-c908-476e-a878-d62a58e0b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.519135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd4783-c908-476e-a878-d62a58e0b884 admin admin] PATH_INFO: `/v3/projects/f68a907348e04362a8413cd6312d1aee/users/d6966e9b09c147d78e602b5bc93655ca/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.521177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd4783-c908-476e-a878-d62a58e0b884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68a907348e04362a8413cd6312d1aee, user_id=d6966e9b09c147d78e602b5bc93655ca, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.523807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd4783-c908-476e-a878-d62a58e0b884 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.529359 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 810/1629] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:39.529359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.538394 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 820/1630] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:39 2022] PUT /identity/v3/projects/f68a907348e04362a8413cd6312d1aee/users/d6966e9b09c147d78e602b5bc93655ca/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:39.538674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5672a-fbb4-4cdd-92c9-dbb25d411359 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.539603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9268b-9c93-4fbe-adff-d4df53f67c42 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.539880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9268b-9c93-4fbe-adff-d4df53f67c42 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.540202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9268b-9c93-4fbe-adff-d4df53f67c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.573090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8ad9268b-9c93-4fbe-adff-d4df53f67c42 None None] MFA Rules not processed for user `abca8601739b44d1ab8fccb425ff0db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:39.574306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8ad9268b-9c93-4fbe-adff-d4df53f67c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:39.608031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.609219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.609699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.610000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] PATH_INFO: `/v3/projects/ba8597f8fa994c60b4eb65f99799c313/users/5f0e210ad13e4a8988a425d272f3f6b8/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.613040 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.630423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8597f8fa994c60b4eb65f99799c313, user_id=5f0e210ad13e4a8988a425d272f3f6b8, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.633506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.647475 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 811/1631] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:39 2022] PUT /identity/v3/projects/ba8597f8fa994c60b4eb65f99799c313/users/5f0e210ad13e4a8988a425d272f3f6b8/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:39.648280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.656002 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 821/1632] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:39.656002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9268b-9c93-4fbe-adff-d4df53f67c42 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.663726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9268b-9c93-4fbe-adff-d4df53f67c42 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.677193 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.722498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66c89-84dc-4f28-8a05-7e67a179c72d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.727180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.727828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.728058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.728331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.728430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.729008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.729144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.729391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.729662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.730305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.730586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.731882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.740486 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 812/1633] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.741374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.745241 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 822/1634] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.745241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.752984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8da4-f4ae-48e1-bb61-4e97afeb4361 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.753256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa517820-d29b-44be-8a5c-b315dacc95ca admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.757683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16aac-b54c-4839-ba3a-15aca549825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.757928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.758339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16aac-b54c-4839-ba3a-15aca549825a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.758509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.758603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16aac-b54c-4839-ba3a-15aca549825a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.758780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.758876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16aac-b54c-4839-ba3a-15aca549825a admin admin] PATH_INFO: `/v3/projects/a3731e06873646788047f44e158908d4/users/178b05b43bda4eaa81eafec393bbbc5a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.759046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.759869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.761490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.771808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 823/1635] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.772457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.777594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16aac-b54c-4839-ba3a-15aca549825a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3731e06873646788047f44e158908d4, user_id=178b05b43bda4eaa81eafec393bbbc5a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.780267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16aac-b54c-4839-ba3a-15aca549825a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.782142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9eab8-aaf2-45de-9bbf-71dff3fefb1c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.787245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.787827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.788102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.788370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.789164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.790913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.795252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 813/1636] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:39 2022] PUT /identity/v3/projects/a3731e06873646788047f44e158908d4/users/178b05b43bda4eaa81eafec393bbbc5a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:39.796431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f50e7-e7a8-4abe-a16f-2f06022ee254 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.796703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f50e7-e7a8-4abe-a16f-2f06022ee254 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.797348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f50e7-e7a8-4abe-a16f-2f06022ee254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.802066 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 824/1637] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.802762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.812535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd1a0b-36f1-40d4-914f-023773b19d9b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.828569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a58f50e7-e7a8-4abe-a16f-2f06022ee254 None None] MFA Rules not processed for user `d6966e9b09c147d78e602b5bc93655ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:39.830933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a58f50e7-e7a8-4abe-a16f-2f06022ee254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:39.868712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204bbde-54e5-480b-aaea-493eee5b03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.869342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204bbde-54e5-480b-aaea-493eee5b03e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.869617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204bbde-54e5-480b-aaea-493eee5b03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.869905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204bbde-54e5-480b-aaea-493eee5b03e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.870542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204bbde-54e5-480b-aaea-493eee5b03e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.872126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204bbde-54e5-480b-aaea-493eee5b03e0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.885945 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 825/1638] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:39.885945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb5fab-f698-426c-8a85-56c360b1fa93 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.885945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb5fab-f698-426c-8a85-56c360b1fa93 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.885945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb5fab-f698-426c-8a85-56c360b1fa93 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.886282 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 826/1639] 10.222.0.46 () {54 vars in 962 bytes} [Sun Aug 21 01:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:39.887055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb5fab-f698-426c-8a85-56c360b1fa93 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.902569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb5fab-f698-426c-8a85-56c360b1fa93 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.908020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.908721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.909051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.909290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] PATH_INFO: `/v3/projects/671fb99e61c841dca797cb670c12d178/users/e4c44b6830de460a944c2faffc2daefa/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.913918 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 814/1640] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:39.913918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f50e7-e7a8-4abe-a16f-2f06022ee254 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.926100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=671fb99e61c841dca797cb670c12d178, user_id=e4c44b6830de460a944c2faffc2daefa, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.928988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.929117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f50e7-e7a8-4abe-a16f-2f06022ee254 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:39.934533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:39.935420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:39.935714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:39.936208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] PATH_INFO: `/v3/projects/7826447993f745a192767a8f573df304/users/9b87749d407d4ddc92ad45d7bd34ed1d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:39.948492 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 827/1641] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:39 2022] PUT /identity/v3/projects/671fb99e61c841dca797cb670c12d178/users/e4c44b6830de460a944c2faffc2daefa/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:39.948492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.954252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7826447993f745a192767a8f573df304, user_id=9b87749d407d4ddc92ad45d7bd34ed1d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:39.957544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:39.972057 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 815/1642] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:39 2022] PUT /identity/v3/projects/7826447993f745a192767a8f573df304/users/9b87749d407d4ddc92ad45d7bd34ed1d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:39.973000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:39.994138 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.017663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aab40-90b3-489a-b635-08022c7c99cb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.023131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.044387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31304-bae7-4885-be44-060140e2b159 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.050121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.050731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.051008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.051278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.051924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.053593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.064739 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 816/1643] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:40.065981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.075942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef992f10-2e4f-4054-85f6-4e87093d7c38 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.082764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.083412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.083695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.083970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] PATH_INFO: `/v3/projects/8ad2bb994bad44a5ae7d9b19743c2164/users/29f07275933b48808749dc08213d191e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.093846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300bc99-0c97-4d99-8bf5-5fcabb8ccfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.094578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300bc99-0c97-4d99-8bf5-5fcabb8ccfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.094857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300bc99-0c97-4d99-8bf5-5fcabb8ccfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.095126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300bc99-0c97-4d99-8bf5-5fcabb8ccfb1 admin admin] PATH_INFO: `/v3/projects/51d7159686d44d0cb556570431c8c70c/users/54743c1f0b7146999d405b79dbb584b1/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.101906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad2bb994bad44a5ae7d9b19743c2164, user_id=29f07275933b48808749dc08213d191e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.105628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.110247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300bc99-0c97-4d99-8bf5-5fcabb8ccfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d7159686d44d0cb556570431c8c70c, user_id=54743c1f0b7146999d405b79dbb584b1, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.113766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300bc99-0c97-4d99-8bf5-5fcabb8ccfb1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.125945 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 817/1644] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:40 2022] PUT /identity/v3/projects/8ad2bb994bad44a5ae7d9b19743c2164/users/29f07275933b48808749dc08213d191e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.125945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.137081 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 828/1645] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:39 2022] PUT /identity/v3/projects/51d7159686d44d0cb556570431c8c70c/users/54743c1f0b7146999d405b79dbb584b1/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.138060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f077b-a491-436b-a4b4-0ddec5169ebb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.138171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f077b-a491-436b-a4b4-0ddec5169ebb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.138536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f077b-a491-436b-a4b4-0ddec5169ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.178762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ae6f077b-a491-436b-a4b4-0ddec5169ebb None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:40.180025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ae6f077b-a491-436b-a4b4-0ddec5169ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:40.194151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b78dd-8c99-4689-8543-86542b75433a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.248812 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 829/1646] 10.222.0.46 () {58 vars in 1059 bytes} [Sun Aug 21 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:40.250037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34654051-61a8-4bf3-9254-eba4c9a75605 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.250319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34654051-61a8-4bf3-9254-eba4c9a75605 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.250436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.250626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34654051-61a8-4bf3-9254-eba4c9a75605 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.250988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.251314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.251600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] PATH_INFO: `/v3/projects/ba8597f8fa994c60b4eb65f99799c313/users/5f0e210ad13e4a8988a425d272f3f6b8/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.251837 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 830/1647] 10.222.0.46 () {54 vars in 962 bytes} [Sun Aug 21 01:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:40.254962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8597f8fa994c60b4eb65f99799c313, user_id=5f0e210ad13e4a8988a425d272f3f6b8, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.256609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.256923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34654051-61a8-4bf3-9254-eba4c9a75605 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.268226 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 818/1648] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:40 2022] PUT /identity/v3/projects/ba8597f8fa994c60b4eb65f99799c313/users/5f0e210ad13e4a8988a425d272f3f6b8/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.269097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.270686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34654051-61a8-4bf3-9254-eba4c9a75605 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.307912 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.342647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf82f2b-5245-4559-8476-f29530d0d85c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.343408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.344030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.344312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.344585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.345276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.347466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.347611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.348150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.348423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.348710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.349493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.351072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.364695 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 819/1649] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:40.364695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.368064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 831/1650] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:40.368809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.372156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4244b5-ad06-4ec6-b7b8-58dc5999c650 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.377118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.377802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.378076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.378360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] PATH_INFO: `/v3/projects/a3731e06873646788047f44e158908d4/users/178b05b43bda4eaa81eafec393bbbc5a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.380241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3731e06873646788047f44e158908d4, user_id=178b05b43bda4eaa81eafec393bbbc5a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.381351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daa963-ba1f-487b-ac31-ff0d4e7cedbd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.382930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.386514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5ac5-7922-4b75-8fef-e068b39a7bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.387112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5ac5-7922-4b75-8fef-e068b39a7bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.387381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5ac5-7922-4b75-8fef-e068b39a7bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.387650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5ac5-7922-4b75-8fef-e068b39a7bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.388287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5ac5-7922-4b75-8fef-e068b39a7bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.389898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5ac5-7922-4b75-8fef-e068b39a7bd1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.391182 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.393943 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 820/1651] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:40 2022] PUT /identity/v3/projects/a3731e06873646788047f44e158908d4/users/178b05b43bda4eaa81eafec393bbbc5a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.394902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.402524 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 832/1652] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:40.404593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcae7d-8abf-4eb4-8ac1-e1f3a417f571 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.404930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcae7d-8abf-4eb4-8ac1-e1f3a417f571 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.405210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcae7d-8abf-4eb4-8ac1-e1f3a417f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.426341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ffdcae7d-8abf-4eb4-8ac1-e1f3a417f571 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:40.427531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ffdcae7d-8abf-4eb4-8ac1-e1f3a417f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:40.460691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fae97a-4122-45c5-852d-0b5282e23752 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.465482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.466121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.466403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.466688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.467798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.468989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.479874 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 821/1653] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:40.483367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.500348 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 833/1654] 10.222.0.46 () {58 vars in 1059 bytes} [Sun Aug 21 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:40.501638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0da5f-5036-41cc-9717-2b47e481cb25 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.502010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0da5f-5036-41cc-9717-2b47e481cb25 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.502459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0da5f-5036-41cc-9717-2b47e481cb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.532729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6de0da5f-5036-41cc-9717-2b47e481cb25 None None] MFA Rules not processed for user `5f0e210ad13e4a8988a425d272f3f6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:40.534073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6de0da5f-5036-41cc-9717-2b47e481cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:40.561537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1725b-b6ab-4ea7-ad2d-a764d5d59511 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.567807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425f93d-f9eb-4195-9f32-e9e2b3783c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.568445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f93d-f9eb-4195-9f32-e9e2b3783c93 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.568862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f93d-f9eb-4195-9f32-e9e2b3783c93 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.569189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f93d-f9eb-4195-9f32-e9e2b3783c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.604480 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 834/1655] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:40.605347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0da5f-5036-41cc-9717-2b47e481cb25 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.620359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0da5f-5036-41cc-9717-2b47e481cb25 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.621619 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.626433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.627164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.627444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.627745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] PATH_INFO: `/v3/projects/7826447993f745a192767a8f573df304/users/9b87749d407d4ddc92ad45d7bd34ed1d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.629828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7826447993f745a192767a8f573df304, user_id=9b87749d407d4ddc92ad45d7bd34ed1d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.632494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.637608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425f93d-f9eb-4195-9f32-e9e2b3783c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.639182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425f93d-f9eb-4195-9f32-e9e2b3783c93 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.643195 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 835/1656] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:40 2022] PUT /identity/v3/projects/7826447993f745a192767a8f573df304/users/9b87749d407d4ddc92ad45d7bd34ed1d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.644221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.654863 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 822/1657] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:40.656410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe0a7e-89f8-417f-b377-be54779df5c6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.656695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe0a7e-89f8-417f-b377-be54779df5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.657083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe0a7e-89f8-417f-b377-be54779df5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.687173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-55fe0a7e-89f8-417f-b377-be54779df5c6 None None] MFA Rules not processed for user `178b05b43bda4eaa81eafec393bbbc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:40.688393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-55fe0a7e-89f8-417f-b377-be54779df5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:40.712633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060a5-a0b4-4516-a022-6e6eb5a38626 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.717643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.718405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.718678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.718946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] PATH_INFO: `/v3/projects/671fb99e61c841dca797cb670c12d178/users/e4c44b6830de460a944c2faffc2daefa/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.721103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] RBAC: Authorizing `identity:create_grant(project_id=671fb99e61c841dca797cb670c12d178, user_id=e4c44b6830de460a944c2faffc2daefa, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.724523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.726938 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.747319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 836/1658] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:40 2022] PUT /identity/v3/projects/671fb99e61c841dca797cb670c12d178/users/e4c44b6830de460a944c2faffc2daefa/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.747319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.775001 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 823/1659] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:40.775001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe0a7e-89f8-417f-b377-be54779df5c6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.785422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe0a7e-89f8-417f-b377-be54779df5c6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.811397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3025fa-0059-4761-be50-127026f3513c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.816174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.816845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.817120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.817381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] PATH_INFO: `/v3/projects/8ad2bb994bad44a5ae7d9b19743c2164/users/29f07275933b48808749dc08213d191e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.819268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad2bb994bad44a5ae7d9b19743c2164, user_id=29f07275933b48808749dc08213d191e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.822798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.834661 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 837/1660] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:40 2022] PUT /identity/v3/projects/8ad2bb994bad44a5ae7d9b19743c2164/users/29f07275933b48808749dc08213d191e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.835363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:40.853425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edbb91-0dad-4be9-a623-655cda034b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.854249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edbb91-0dad-4be9-a623-655cda034b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.854665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edbb91-0dad-4be9-a623-655cda034b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.855006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edbb91-0dad-4be9-a623-655cda034b2c admin admin] PATH_INFO: `/v3/projects/51d7159686d44d0cb556570431c8c70c/users/54743c1f0b7146999d405b79dbb584b1/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.857064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edbb91-0dad-4be9-a623-655cda034b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d7159686d44d0cb556570431c8c70c, user_id=54743c1f0b7146999d405b79dbb584b1, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:40.859759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edbb91-0dad-4be9-a623-655cda034b2c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:40.871033 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 824/1661] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:40 2022] PUT /identity/v3/projects/51d7159686d44d0cb556570431c8c70c/users/54743c1f0b7146999d405b79dbb584b1/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:40.872030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a4d3-1b9a-4a96-b064-ce314f3a6327 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.872311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a4d3-1b9a-4a96-b064-ce314f3a6327 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.872583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a4d3-1b9a-4a96-b064-ce314f3a6327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.901684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c7f2a4d3-1b9a-4a96-b064-ce314f3a6327 None None] MFA Rules not processed for user `9b87749d407d4ddc92ad45d7bd34ed1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:40.902886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c7f2a4d3-1b9a-4a96-b064-ce314f3a6327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:40.919899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc291c31-c6a0-4a9e-9b53-4053dfb669ab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:40.956645 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.980290 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 825/1662] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:40.981522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32285f9-bca2-417c-9469-6764e08564ef None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.981807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32285f9-bca2-417c-9469-6764e08564ef None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.982079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32285f9-bca2-417c-9469-6764e08564ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:40.984804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271063-17b7-4472-b5b8-3f4e94520bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:40.985414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271063-17b7-4472-b5b8-3f4e94520bfb service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:40.985694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271063-17b7-4472-b5b8-3f4e94520bfb service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:40.985970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271063-17b7-4472-b5b8-3f4e94520bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.007844 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:41.009401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a32285f9-bca2-417c-9469-6764e08564ef None None] MFA Rules not processed for user `e4c44b6830de460a944c2faffc2daefa`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:41.010756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a32285f9-bca2-417c-9469-6764e08564ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.054012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44271063-17b7-4472-b5b8-3f4e94520bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.055640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44271063-17b7-4472-b5b8-3f4e94520bfb service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.065667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 838/1663] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:41.067065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2ce4b-d4e9-4de0-8852-a44d966c6934 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.067357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2ce4b-d4e9-4de0-8852-a44d966c6934 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.067732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2ce4b-d4e9-4de0-8852-a44d966c6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.090245 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 826/1664] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:41.090245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657610e-3e41-4d7d-b294-1d928ecf4859 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.090245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657610e-3e41-4d7d-b294-1d928ecf4859 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.090245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657610e-3e41-4d7d-b294-1d928ecf4859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.101207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b8a2ce4b-d4e9-4de0-8852-a44d966c6934 None None] MFA Rules not processed for user `29f07275933b48808749dc08213d191e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:41.103538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b8a2ce4b-d4e9-4de0-8852-a44d966c6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.117077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0657610e-3e41-4d7d-b294-1d928ecf4859 None None] MFA Rules not processed for user `54743c1f0b7146999d405b79dbb584b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:41.118598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0657610e-3e41-4d7d-b294-1d928ecf4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.182184 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 839/1665] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:41.183529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2ce4b-d4e9-4de0-8852-a44d966c6934 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.197993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2ce4b-d4e9-4de0-8852-a44d966c6934 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.199918 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 827/1666] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:41.204051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.204659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.204986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.205489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.264850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.266410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.277005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 840/1667] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:41.346335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657610e-3e41-4d7d-b294-1d928ecf4859 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.360347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657610e-3e41-4d7d-b294-1d928ecf4859 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.366705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.367395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.367736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.368092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.386126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.398036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581f35e-b802-4aad-a51a-a4e417867135 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.403588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beff145-4873-4808-9392-b09060232d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.404193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff145-4873-4808-9392-b09060232d66 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.404491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff145-4873-4808-9392-b09060232d66 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.404789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff145-4873-4808-9392-b09060232d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.413475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beff145-4873-4808-9392-b09060232d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.415050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beff145-4873-4808-9392-b09060232d66 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.425432 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 841/1668] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:41.426083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beff145-4873-4808-9392-b09060232d66 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.430588 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:41.444569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.446414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.454941 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:41.460461 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 828/1669] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:41.473225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.493397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008ee36-afb8-482f-8e44-46d199d519d1 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.498704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.499333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.499611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.499885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.509185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.510757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.511597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beff145-4873-4808-9392-b09060232d66 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.516199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.516845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.517077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.517341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] PATH_INFO: `/v3/users/83aa475e10e748c29ffcb2e194db06c3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.518720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83aa475e10e748c29ffcb2e194db06c3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.519730 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.519730 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:06:41.519730 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:06:41.520612 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 829/1670] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:41.520960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.525693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.539740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ec1e9-54a6-4ce5-8bd4-824011df1c59 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.546261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.546935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.547238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.547513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.592085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83aa475e10e748c29ffcb2e194db06c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.602596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83aa475e10e748c29ffcb2e194db06c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.617102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.618695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.622842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83aa475e10e748c29ffcb2e194db06c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.623527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83aa475e10e748c29ffcb2e194db06c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.628985 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 830/1671] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:41.630582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.634906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b9eb0101-8b81-4185-8a39-68bd3732af66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83aa475e10e748c29ffcb2e194db06c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.641626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47171c07-56b1-419a-b9af-012f43f46ede service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.643536 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 842/1672] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:41 2022] DELETE /identity/v3/users/83aa475e10e748c29ffcb2e194db06c3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:41.647757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.648044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.648334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.669458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:41.670682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.719389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.722713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.723003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.723285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.726129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.737254 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 843/1673] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:41.738071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.739363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.756137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b213c-17d4-4d2f-832b-cf069d10ae62 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.764503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.765706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.766481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.766860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] PATH_INFO: `/v3/users/a4ea03fb1c6240fca90d8d3eaa20138f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.770183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ea03fb1c6240fca90d8d3eaa20138f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.772998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.813624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:41.815357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:41.824929 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:41.825296 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 831/1674] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:41.826118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.827469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.834389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ea03fb1c6240fca90d8d3eaa20138f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.837316 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:41.849726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ea03fb1c6240fca90d8d3eaa20138f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.863180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ea03fb1c6240fca90d8d3eaa20138f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.863977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ea03fb1c6240fca90d8d3eaa20138f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.872147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ea03fb1c6240fca90d8d3eaa20138f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:41.886311 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 844/1675] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:41 2022] DELETE /identity/v3/users/a4ea03fb1c6240fca90d8d3eaa20138f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:41.886311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:41.887833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.901303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17805c3-7c7b-4b65-91d6-33998f8a0ab5 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.960956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b65f0-ea3d-4806-8ea3-b8c429424804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.961727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b65f0-ea3d-4806-8ea3-b8c429424804 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.962152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b65f0-ea3d-4806-8ea3-b8c429424804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.962421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b65f0-ea3d-4806-8ea3-b8c429424804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.964580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-184b65f0-ea3d-4806-8ea3-b8c429424804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:41.968412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388e1a3-f901-4424-b8a2-f7fe3a60fc86 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:41.981296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:41.981985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:41.982314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:41.982667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:41.984847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.045834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b65f0-ea3d-4806-8ea3-b8c429424804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.047410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b65f0-ea3d-4806-8ea3-b8c429424804 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.058408 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 832/1676] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:42.060557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079625-460d-4867-b647-86efa3c784f3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.061159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079625-460d-4867-b647-86efa3c784f3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.061777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079625-460d-4867-b647-86efa3c784f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.064551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.066526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.077483 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 845/1677] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:42.083965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-61079625-460d-4867-b647-86efa3c784f3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:42.085224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-61079625-460d-4867-b647-86efa3c784f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.098964 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 833/1678] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:42.109805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:42.110765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.123920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c5cc-a574-418b-abb0-18cd4e03135c service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:42.138144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d118c-f4ac-42a1-a137-def5856e99f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:42.139101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d118c-f4ac-42a1-a137-def5856e99f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.139441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d118c-f4ac-42a1-a137-def5856e99f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.139774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d118c-f4ac-42a1-a137-def5856e99f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.154698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d118c-f4ac-42a1-a137-def5856e99f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.157085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d118c-f4ac-42a1-a137-def5856e99f0 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.180620 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 846/1679] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:42.257948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d20d-b685-4f64-93a8-dccd97d3d601 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.258237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d20d-b685-4f64-93a8-dccd97d3d601 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.258502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d20d-b685-4f64-93a8-dccd97d3d601 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.260576 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 834/1680] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:42.282190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.282559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.282956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.310186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:42.311723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.400300 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:42.479737 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 847/1681] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:42.519633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d20d-b685-4f64-93a8-dccd97d3d601 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:42.521714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7335d20d-b685-4f64-93a8-dccd97d3d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.538932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:42.540565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.553994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d20d-b685-4f64-93a8-dccd97d3d601 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:42.561093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d72beb-4dc7-43da-9c60-be1c379b1946 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:42.566269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:42.566901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.567198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:42.567309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.567497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] PATH_INFO: `/v3/users/9fb5177c08374a34965f906b7451f1e1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.567825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.568101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.568376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.569227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb5177c08374a34965f906b7451f1e1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.573530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.578040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.579734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.604634 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 835/1682] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:42.606198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:42.626154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.644932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb5177c08374a34965f906b7451f1e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.652940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e70628-dee1-4a4e-90af-8ae45c135111 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:42.655620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb5177c08374a34965f906b7451f1e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.664229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:42.668734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.669988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.670336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] PATH_INFO: `/v3/projects/337d4ac2ab75412a90dfabc54449050d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.676483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337d4ac2ab75412a90dfabc54449050d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.680532 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:42.680532 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:06:42.680532 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:06:42.681770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.686034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb5177c08374a34965f906b7451f1e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.686774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb5177c08374a34965f906b7451f1e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.704508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce1ead5-02be-4279-8625-2fb90480fb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb5177c08374a34965f906b7451f1e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.717506 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 848/1683] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:42 2022] DELETE /identity/v3/users/9fb5177c08374a34965f906b7451f1e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:06:42.723162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675d00-bee6-415b-920b-d17fb596d7c8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.723592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675d00-bee6-415b-920b-d17fb596d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.723994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675d00-bee6-415b-920b-d17fb596d7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.779217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5c675d00-bee6-415b-920b-d17fb596d7c8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:42.779217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5c675d00-bee6-415b-920b-d17fb596d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.790341 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:42.793214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337d4ac2ab75412a90dfabc54449050d', 'request_id': 'req-13b386b2-570b-4759-8ff1-032997f3df66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.806188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337d4ac2ab75412a90dfabc54449050d', 'request_id': 'req-13b386b2-570b-4759-8ff1-032997f3df66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.814174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337d4ac2ab75412a90dfabc54449050d', 'request_id': 'req-13b386b2-570b-4759-8ff1-032997f3df66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.834539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] The token cache is being invalidate because project 337d4ac2ab75412a90dfabc54449050d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:42.834827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.835505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.839974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 836/1684] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:42 2022] DELETE /identity/v3/projects/337d4ac2ab75412a90dfabc54449050d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:42.839974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:42.839974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.857041 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 849/1685] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:42.860008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.860008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.860008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.883577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] MFA Rules not processed for user `f83dfdbfecd9420dbc75d1d1dfcb59f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:42.885110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.931326 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:42.931838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b386b2-570b-4759-8ff1-032997f3df66 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:42.936694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:42.937480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.937771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.938027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] PATH_INFO: `/v3/projects/364660defd60430b9098d4eb84d399d7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.939146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364660defd60430b9098d4eb84d399d7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.941215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.945076 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 850/1686] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:42.946102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:42.947369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:42.966230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a144-51ee-4d9c-98b8-eeb84e35e8d1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:42.972172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:42.972872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:42.973183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:42.973452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] PATH_INFO: `/v3/users/abca8601739b44d1ab8fccb425ff0db9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:42.975003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abca8601739b44d1ab8fccb425ff0db9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:42.976655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:42.989812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364660defd60430b9098d4eb84d399d7', 'request_id': 'req-ce8fc75a-d1ae-44f8-be03-0012f6956a74'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:42.997911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364660defd60430b9098d4eb84d399d7', 'request_id': 'req-ce8fc75a-d1ae-44f8-be03-0012f6956a74'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.004699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364660defd60430b9098d4eb84d399d7', 'request_id': 'req-ce8fc75a-d1ae-44f8-be03-0012f6956a74'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.016366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] The token cache is being invalidate because project 364660defd60430b9098d4eb84d399d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:43.016650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.017326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.018883 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 837/1687] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:42 2022] DELETE /identity/v3/projects/364660defd60430b9098d4eb84d399d7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:43.022028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.023007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.025379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abca8601739b44d1ab8fccb425ff0db9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.034672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abca8601739b44d1ab8fccb425ff0db9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.047669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abca8601739b44d1ab8fccb425ff0db9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.048291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abca8601739b44d1ab8fccb425ff0db9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.056961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abca8601739b44d1ab8fccb425ff0db9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.062849 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 851/1688] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:42 2022] DELETE /identity/v3/users/abca8601739b44d1ab8fccb425ff0db9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:43.063629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.065027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.088987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc75a-d1ae-44f8-be03-0012f6956a74 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:43.108906 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:43.143689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:43.143896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.144177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.144451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.146303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.167935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ca2c9-a86c-498d-bd25-0dcf4489654e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:43.174037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:43.174760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.174964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.175234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.177662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.218304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:43.220215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:43.232596 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 838/1689] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:43.233582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.234961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.251630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c081-5d16-4c03-9df4-316fa81dbfad service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:43.252389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:43.254291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:43.259195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:43.260031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.260330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.260630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.263871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.267942 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 852/1690] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:43.269518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.273314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.284926 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:43.293275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4714ad-9bfa-4c7a-afaa-c6f24492f2ef service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:43.303593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:43.304244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.304805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.306184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] PATH_INFO: `/v3/users/29f07275933b48808749dc08213d191e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.307356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f07275933b48808749dc08213d191e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:43.310795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:43.382197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:43.384336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:43.396570 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 839/1691] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:43.414077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f07275933b48808749dc08213d191e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.426067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f07275933b48808749dc08213d191e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.447256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f07275933b48808749dc08213d191e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.448228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f07275933b48808749dc08213d191e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.465665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bbe1b4b-25c8-4ecd-bd50-929a0693238f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f07275933b48808749dc08213d191e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.480137 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 853/1692] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:43 2022] DELETE /identity/v3/users/29f07275933b48808749dc08213d191e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:43.490689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.492410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.510408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d24c1b-21b9-40be-98a0-8350fe1c6002 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.510756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d24c1b-21b9-40be-98a0-8350fe1c6002 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.511139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d24c1b-21b9-40be-98a0-8350fe1c6002 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.512809 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 854/1693] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:06:43.518654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.519227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.521003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.527555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6735870-ab72-454a-88a3-4a30d615347e service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:43.543287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:43.544588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.615825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:43.616717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.617115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.617291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] PATH_INFO: `/v3/projects/c5bb28ef4ffc4af2a0c5fc7a0cec70d4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.619145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bb28ef4ffc4af2a0c5fc7a0cec70d4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:43.621385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:43.635147 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:43.688880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bb28ef4ffc4af2a0c5fc7a0cec70d4', 'request_id': 'req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.709933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bb28ef4ffc4af2a0c5fc7a0cec70d4', 'request_id': 'req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.724139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bb28ef4ffc4af2a0c5fc7a0cec70d4', 'request_id': 'req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.726373 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 855/1694] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:43.728810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.733977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.749331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] The token cache is being invalidate because project c5bb28ef4ffc4af2a0c5fc7a0cec70d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:43.749624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.750923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.753008 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 840/1695] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:43 2022] DELETE /identity/v3/projects/c5bb28ef4ffc4af2a0c5fc7a0cec70d4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:43.754411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89f4bc-ab5e-45d3-913d-fa8c58e7d272 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:43.757401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.759742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.826837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:43.827491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.827769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.828040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] PATH_INFO: `/v3/projects/fbc6ed90a2184b0e9381063346c3fd10` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.829219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc6ed90a2184b0e9381063346c3fd10)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:43.831584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:43.846560 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:43.874973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497a54-cfbe-4d38-89a5-9ca9f0c37945 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:43.879973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:43.880595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.881289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.881564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.886669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.897509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc6ed90a2184b0e9381063346c3fd10', 'request_id': 'req-1be65edd-71f7-4609-bb07-9e2684f1d9b4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.904709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc6ed90a2184b0e9381063346c3fd10', 'request_id': 'req-1be65edd-71f7-4609-bb07-9e2684f1d9b4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.911618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc6ed90a2184b0e9381063346c3fd10', 'request_id': 'req-1be65edd-71f7-4609-bb07-9e2684f1d9b4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.935177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] The token cache is being invalidate because project fbc6ed90a2184b0e9381063346c3fd10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:43.935578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.936306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1be65edd-71f7-4609-bb07-9e2684f1d9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:43.941486 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 856/1696] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:43 2022] DELETE /identity/v3/projects/fbc6ed90a2184b0e9381063346c3fd10 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:43.941486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:43.941486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:43.941486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:43.970010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:43.971251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:43.982112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:43.983553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:43.994994 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 841/1697] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:43.995928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:43.997424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.015347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7a48a-e493-4fee-9f55-d56d3152d8d6 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.041007 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:44.071432 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 857/1698] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:44.071432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.071432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.080362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d67e76-a5bb-4a3a-8c65-8a10d0fc767c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.086739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.087384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.087658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.088028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] PATH_INFO: `/v3/users/178b05b43bda4eaa81eafec393bbbc5a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.089211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] RBAC: Authorizing `identity:delete_user(user_id=178b05b43bda4eaa81eafec393bbbc5a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.091281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.146511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.147526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.147856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.148135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] PATH_INFO: `/v3/projects/8ad2bb994bad44a5ae7d9b19743c2164` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.149622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad2bb994bad44a5ae7d9b19743c2164)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.154948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.155597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178b05b43bda4eaa81eafec393bbbc5a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.167815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178b05b43bda4eaa81eafec393bbbc5a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.183814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178b05b43bda4eaa81eafec393bbbc5a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.185735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178b05b43bda4eaa81eafec393bbbc5a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.195491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4579a5c-487c-4a18-8b33-49a3b607932e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178b05b43bda4eaa81eafec393bbbc5a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.205614 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 858/1699] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:44 2022] DELETE /identity/v3/users/178b05b43bda4eaa81eafec393bbbc5a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:44.209055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0bef-171f-4a6d-87f3-d78fbed581f0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.209343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0bef-171f-4a6d-87f3-d78fbed581f0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.209666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0bef-171f-4a6d-87f3-d78fbed581f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.221745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad2bb994bad44a5ae7d9b19743c2164', 'request_id': 'req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.233370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad2bb994bad44a5ae7d9b19743c2164', 'request_id': 'req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.236183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ffcb0bef-171f-4a6d-87f3-d78fbed581f0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:44.237656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ffcb0bef-171f-4a6d-87f3-d78fbed581f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.241786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad2bb994bad44a5ae7d9b19743c2164', 'request_id': 'req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.242803 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:44.263566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] The token cache is being invalidate because project 8ad2bb994bad44a5ae7d9b19743c2164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:44.263945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.266810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d70197a-3c8e-4d99-b3d5-403ea90ffaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.273100 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 842/1700] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:43 2022] DELETE /identity/v3/projects/8ad2bb994bad44a5ae7d9b19743c2164 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:44.275327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd4e15-3ef9-4d9b-a166-754a6c8e6218 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.275678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd4e15-3ef9-4d9b-a166-754a6c8e6218 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.275982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd4e15-3ef9-4d9b-a166-754a6c8e6218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.312542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ddcd4e15-3ef9-4d9b-a166-754a6c8e6218 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:44.313737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ddcd4e15-3ef9-4d9b-a166-754a6c8e6218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.358346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 859/1701] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:44.359842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0bef-171f-4a6d-87f3-d78fbed581f0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.380514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0bef-171f-4a6d-87f3-d78fbed581f0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.400597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.400597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.400597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.400597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.401149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:44.401149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.401149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.428810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 860/1702] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:44.433489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.440527 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 843/1703] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:44.455590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b469-8789-4bff-aa0f-40a0ecdc6e95 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.456663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b469-8789-4bff-aa0f-40a0ecdc6e95 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.456663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b469-8789-4bff-aa0f-40a0ecdc6e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.477816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1868e26-999d-4cc0-a2d3-551c9b0f0ee3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.486574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.490138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7b64b469-8789-4bff-aa0f-40a0ecdc6e95 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:44.490389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.490691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.491113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.491770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.492440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b64b469-8789-4bff-aa0f-40a0ecdc6e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.493840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.507672 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 844/1704] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:44.512673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64b469-8789-4bff-aa0f-40a0ecdc6e95 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.525942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64b469-8789-4bff-aa0f-40a0ecdc6e95 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.541452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.542318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.542606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.542924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.543810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:44.544277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.546408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.561449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 861/1705] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:44 2022] POST /identity/v3/projects => generated 395 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:44.562534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 845/1706] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:44.565732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.566917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.582367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d5413-cf89-48ae-a2ea-ca1ddccebb0d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.639076 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:44.677030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.677651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.677926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.678197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.678833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.681873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.683455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d33ab-cf00-41db-8a55-260c9b1a283f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.691314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.692038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.692933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.693213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.693847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.696976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.716227 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 846/1707] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:44 2022] POST /identity/v3/projects => generated 401 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:44.717522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.721141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.730607 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 862/1708] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:44 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:06:44.730607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.731978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.745181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad70164-2b31-4dff-bd6f-18c1ad00a59f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.803639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dcf1d-f003-4f87-8e71-d9f9573cdc06 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:44.809244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.809897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.810173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.810442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] PATH_INFO: `/v3/projects/a3731e06873646788047f44e158908d4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.812006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3731e06873646788047f44e158908d4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.815385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.823230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:44.825211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:44.825488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:44.825758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] PATH_INFO: `/v3/users/ed42ee9fffaa49bfb15f6ee2d691004f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:44.828828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed42ee9fffaa49bfb15f6ee2d691004f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:44.837878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:44.845924 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:44.887100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3731e06873646788047f44e158908d4', 'request_id': 'req-6485bfd2-993d-40ea-9ffc-c1410551f82c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.896157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3731e06873646788047f44e158908d4', 'request_id': 'req-6485bfd2-993d-40ea-9ffc-c1410551f82c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.899823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed42ee9fffaa49bfb15f6ee2d691004f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.901861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3731e06873646788047f44e158908d4', 'request_id': 'req-6485bfd2-993d-40ea-9ffc-c1410551f82c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.909147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed42ee9fffaa49bfb15f6ee2d691004f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.913604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] The token cache is being invalidate because project a3731e06873646788047f44e158908d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:44.913893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.915167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.920082 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 847/1709] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:44 2022] DELETE /identity/v3/projects/a3731e06873646788047f44e158908d4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:44.920082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.920082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.921439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed42ee9fffaa49bfb15f6ee2d691004f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.922212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed42ee9fffaa49bfb15f6ee2d691004f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.929477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed42ee9fffaa49bfb15f6ee2d691004f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:44.935477 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 863/1710] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:44 2022] DELETE /identity/v3/users/ed42ee9fffaa49bfb15f6ee2d691004f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:44.936272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:44.937589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:44.968629 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:44.985203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485bfd2-993d-40ea-9ffc-c1410551f82c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.000970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66006-588b-40dd-afd0-a4f853637e60 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.006790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcced5-890b-4b54-b204-10fcfbb598f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.007422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcced5-890b-4b54-b204-10fcfbb598f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.007702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcced5-890b-4b54-b204-10fcfbb598f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.007966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcced5-890b-4b54-b204-10fcfbb598f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.008606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcced5-890b-4b54-b204-10fcfbb598f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.010421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcced5-890b-4b54-b204-10fcfbb598f2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.022372 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 864/1711] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:45.023508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e9561-c92e-4a78-b40c-3176dc7ad6af None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.023773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e9561-c92e-4a78-b40c-3176dc7ad6af None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.024053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e9561-c92e-4a78-b40c-3176dc7ad6af None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.025645 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 865/1712] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:45.026512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73176222-e9dd-4136-ab99-aaf8c4df04a2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.026848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73176222-e9dd-4136-ab99-aaf8c4df04a2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.027117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73176222-e9dd-4136-ab99-aaf8c4df04a2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.028312 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 866/1713] 10.222.0.46 () {54 vars in 961 bytes} [Sun Aug 21 01:06:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:45.029302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c686-4ce4-4b4e-af9e-0cfa6eaaa8ae None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.029702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c686-4ce4-4b4e-af9e-0cfa6eaaa8ae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.030065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c686-4ce4-4b4e-af9e-0cfa6eaaa8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.053727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.053946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4567c686-4ce4-4b4e-af9e-0cfa6eaaa8ae None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:45.054395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.054670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.054939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.055114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4567c686-4ce4-4b4e-af9e-0cfa6eaaa8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.055577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.057569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.063358 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 867/1714] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:45.070235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dfa95-ad8f-481e-be88-5d093cd32852 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.070235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dfa95-ad8f-481e-be88-5d093cd32852 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.070235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dfa95-ad8f-481e-be88-5d093cd32852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.087524 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 848/1715] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:44 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:45.087681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9a3dfa95-ad8f-481e-be88-5d093cd32852 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:45.088095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.088545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a3dfa95-ad8f-481e-be88-5d093cd32852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.096502 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 868/1716] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:45.097731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd058-3cae-4aee-abb3-68a6dac48435 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.098010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd058-3cae-4aee-abb3-68a6dac48435 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.098283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd058-3cae-4aee-abb3-68a6dac48435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.100953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d42c-64d8-4537-8554-f01ed877196d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.105875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b534aab-2c81-4239-a6a7-173eb51d9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.106427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b534aab-2c81-4239-a6a7-173eb51d9482 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.106690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b534aab-2c81-4239-a6a7-173eb51d9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.106982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b534aab-2c81-4239-a6a7-173eb51d9482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.107628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b534aab-2c81-4239-a6a7-173eb51d9482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.109310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b534aab-2c81-4239-a6a7-173eb51d9482 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.117843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-709cd058-3cae-4aee-abb3-68a6dac48435 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:45.119051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-709cd058-3cae-4aee-abb3-68a6dac48435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.120843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 849/1717] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:45.121157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.121436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.121703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.146241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:45.147446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.182635 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:45.195607 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 869/1718] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:45.197493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.197783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.198114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.214869 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 850/1719] 10.222.0.46 () {58 vars in 1058 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:45.215918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.217256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.218184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:45.219333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.228814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 870/1720] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:45.229697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.230978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.233108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b1dce-4509-41f2-91ac-940ea1c27d44 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.239505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.240124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.240397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.240663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.241351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.242977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.255235 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 851/1721] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:45.256125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.269321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a19748-b1d9-4b3e-b22d-13a54f847045 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.273922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.274581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.274856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.275125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] PATH_INFO: `/v3/projects/16579e1e520e472a9ff663e210931c5d/users/bcc3be52ed8a47a39d124500df3681de/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.292660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16579e1e520e472a9ff663e210931c5d, user_id=bcc3be52ed8a47a39d124500df3681de, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.295523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.298213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e3057-245c-4318-a19c-a5383f858759 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.302759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.303465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.303726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.304001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.313030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 852/1722] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:45 2022] PUT /identity/v3/projects/16579e1e520e472a9ff663e210931c5d/users/bcc3be52ed8a47a39d124500df3681de/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:45.314041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.322528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.324511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.337233 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 871/1723] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:45.344454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.356266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d375-194b-4708-ada5-a80725230859 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.357326 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:45.377560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3644b-aaf3-4bf9-87e2-17c7b705bd9e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.381510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.382127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.382399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.382765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.428206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.429025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.429384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.429817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.431685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.444249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.446400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.458577 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 872/1724] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:45.460886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.462632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.464240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.477174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 853/1725] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:45.478045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.557481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027790-3727-4fdd-b5c6-f08cfa55e5e1 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.563832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.564755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.565812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.566235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.567030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:45.567510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.569416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.576960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973030a8-b077-492a-8176-5f9d6f3a9a1e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.586404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041b9f5-591b-4ffc-b0a4-70d93ed5e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.587034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041b9f5-591b-4ffc-b0a4-70d93ed5e303 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.587307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041b9f5-591b-4ffc-b0a4-70d93ed5e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.587573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041b9f5-591b-4ffc-b0a4-70d93ed5e303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.588221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041b9f5-591b-4ffc-b0a4-70d93ed5e303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.589837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041b9f5-591b-4ffc-b0a4-70d93ed5e303 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.601633 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 873/1726] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:45.601787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 854/1727] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:45.602889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08f62e-61ba-4f22-a08e-171aa9da2206 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.603121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08f62e-61ba-4f22-a08e-171aa9da2206 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.603397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08f62e-61ba-4f22-a08e-171aa9da2206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.604816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.618587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ab8e-12fa-454b-b55d-8dcd7c82fc6f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.623680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.624624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.625108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.625667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.626586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.629432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.650686 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:45.651911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cb08f62e-61ba-4f22-a08e-171aa9da2206 None None] MFA Rules not processed for user `bcc3be52ed8a47a39d124500df3681de`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:45.653864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cb08f62e-61ba-4f22-a08e-171aa9da2206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.668871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 874/1728] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:45.669882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.756603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb75a7-8ee9-4571-985b-f0f6b9dd68a8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.763638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.764413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.764685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.765557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] PATH_INFO: `/v3/projects/c81f6af23f174318870b6ef8633f5cf3/users/52db969e85344bb6a40150cedc205df8/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.769486 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 855/1729] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:45.769486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08f62e-61ba-4f22-a08e-171aa9da2206 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.773431 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:45.779592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08f62e-61ba-4f22-a08e-171aa9da2206 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.786242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81f6af23f174318870b6ef8633f5cf3, user_id=52db969e85344bb6a40150cedc205df8, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.786649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.787470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.788334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.788913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.789034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.789834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.792761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.803256 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 875/1730] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:45 2022] PUT /identity/v3/projects/c81f6af23f174318870b6ef8633f5cf3/users/52db969e85344bb6a40150cedc205df8/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:45.804912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.806868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.818972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 856/1731] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:45.820220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:45.830914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f849b36-7ddd-431e-931d-2340a1b0b4e7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.878204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe80fa-55a3-4553-b966-a706254689ef admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:45.883098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.883731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.884001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.884533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] PATH_INFO: `/v3/projects/5c1ed37794e64d02b4a9aace33ab7d2d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.885870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1ed37794e64d02b4a9aace33ab7d2d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.887766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.892535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fd35d-2cfd-4f9b-9e62-a384a664b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:45.893474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fd35d-2cfd-4f9b-9e62-a384a664b3fc admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.893607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fd35d-2cfd-4f9b-9e62-a384a664b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.894527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fd35d-2cfd-4f9b-9e62-a384a664b3fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.895180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fd35d-2cfd-4f9b-9e62-a384a664b3fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:45.897130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fd35d-2cfd-4f9b-9e62-a384a664b3fc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:45.934970 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 857/1732] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/projects => generated 395 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:45.934970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:45.935554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:45.936073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:45.956699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1ed37794e64d02b4a9aace33ab7d2d', 'request_id': 'req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:45.966237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:45.967007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1ed37794e64d02b4a9aace33ab7d2d', 'request_id': 'req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:45.968360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:45.976061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1ed37794e64d02b4a9aace33ab7d2d', 'request_id': 'req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:45.994517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] The token cache is being invalidate because project 5c1ed37794e64d02b4a9aace33ab7d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:45.994805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:45.995497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:45.998969 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 876/1733] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:45 2022] DELETE /identity/v3/projects/5c1ed37794e64d02b4a9aace33ab7d2d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:45.998969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.000902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.015731 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:46.055057 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 858/1734] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:46.056805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.059136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.076268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4a90-5be0-4431-ac71-252433fae6b8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.081977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.082679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.082925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.083194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.083821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.085936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.092898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5c98-3f3c-438e-9452-f9ae77d4c4f6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.100345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.101379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.101913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.102312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.103151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.105080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.113215 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 859/1735] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:46 2022] POST /identity/v3/users => generated 304 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:46.117278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.118866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.120681 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 877/1736] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:46.121581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.126121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.135656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8e00b-1c8e-44b8-a203-3bbd2af0b5a4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.141113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.142196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.142196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.142196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] PATH_INFO: `/v3/users/d6966e9b09c147d78e602b5bc93655ca` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.143690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6966e9b09c147d78e602b5bc93655ca)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.145670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.203227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6966e9b09c147d78e602b5bc93655ca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:46.205072 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:46.210042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381c8d7-1cc4-4b7e-b1fc-67e245e63e25 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.213932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.214644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.214914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.215251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.216596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6966e9b09c147d78e602b5bc93655ca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:46.217904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6966e9b09c147d78e602b5bc93655ca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:46.226616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.227375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6966e9b09c147d78e602b5bc93655ca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:46.228147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6966e9b09c147d78e602b5bc93655ca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:46.228335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.238691 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 878/1737] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:46.239534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.250206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65b7bc-8450-42d4-a953-d52f538edc1e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.257518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.258641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.259039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.259410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.260212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.262125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.264844 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 860/1738] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:46 2022] DELETE /identity/v3/users/d6966e9b09c147d78e602b5bc93655ca => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:46.269556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.271746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.281605 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 879/1739] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:46.286205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.288356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.303995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8577d-b030-46a9-9458-b22c55d3b0bd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.358047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6943506-fc3c-49fc-aebb-73e117846064 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.363756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.364401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.364799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.365087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.365736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.367473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.385563 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 861/1740] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:46.387414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.401391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9728c-0b38-44ee-ac59-3bf2af630abc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.409612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c515-edd0-4c7c-9b24-be3601c5088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.411001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c515-edd0-4c7c-9b24-be3601c5088b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.411377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c515-edd0-4c7c-9b24-be3601c5088b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.411868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c515-edd0-4c7c-9b24-be3601c5088b admin admin] PATH_INFO: `/v3/projects/7eb2b61108224266b050a58ffbf0c445/users/a0ebb6aa35a7482d888d8e59cb29b891/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.426959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.428075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.428363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.428699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] PATH_INFO: `/v3/projects/877e38f15766473b9c3047efe6a901e1/users/33427f6bd4bb4ba29cdc179966e9a09d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.440290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c515-edd0-4c7c-9b24-be3601c5088b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb2b61108224266b050a58ffbf0c445, user_id=a0ebb6aa35a7482d888d8e59cb29b891, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.445995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c515-edd0-4c7c-9b24-be3601c5088b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.459570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877e38f15766473b9c3047efe6a901e1, user_id=33427f6bd4bb4ba29cdc179966e9a09d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.466231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.474462 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 862/1741] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:46 2022] PUT /identity/v3/projects/7eb2b61108224266b050a58ffbf0c445/users/a0ebb6aa35a7482d888d8e59cb29b891/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:46.485216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7b4b-10f5-47ec-8b0e-ce408bd86dec None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.485775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7b4b-10f5-47ec-8b0e-ce408bd86dec None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.486236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7b4b-10f5-47ec-8b0e-ce408bd86dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.488466 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 880/1742] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:46 2022] PUT /identity/v3/projects/877e38f15766473b9c3047efe6a901e1/users/33427f6bd4bb4ba29cdc179966e9a09d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:46.492115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.523255 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:46.534910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-29bb7b4b-10f5-47ec-8b0e-ce408bd86dec None None] MFA Rules not processed for user `a0ebb6aa35a7482d888d8e59cb29b891`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:46.537330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-29bb7b4b-10f5-47ec-8b0e-ce408bd86dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.624819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b34c2d-8748-4ee2-aa24-c8265af40720 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.629109 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 863/1743] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:46.630173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7b4b-10f5-47ec-8b0e-ce408bd86dec None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.633523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.635107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.635420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.635802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.636907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.639148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.653052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7b4b-10f5-47ec-8b0e-ce408bd86dec None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.653761 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 881/1744] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:06:46.658203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.674533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.675926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.676238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.676600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.681866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.684824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.702709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e6726-6ced-4610-9dff-2e7d42894fd0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.717287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.718105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.718395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.718992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] PATH_INFO: `/v3/projects/877e38f15766473b9c3047efe6a901e1/users/33427f6bd4bb4ba29cdc179966e9a09d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.722570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=877e38f15766473b9c3047efe6a901e1, user_id=33427f6bd4bb4ba29cdc179966e9a09d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.727632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.775026 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 882/1745] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:46 2022] PUT /identity/v3/projects/877e38f15766473b9c3047efe6a901e1/users/33427f6bd4bb4ba29cdc179966e9a09d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:46.779069 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 864/1746] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:46 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:46.780441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.781809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:46.785094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.790537 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:46.874480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa71118-ab6f-44ab-b299-03c47e3ede81 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.896600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f2cd-ba92-4d4a-80cc-d2542a026b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.898361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f2cd-ba92-4d4a-80cc-d2542a026b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.898657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f2cd-ba92-4d4a-80cc-d2542a026b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.898931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f2cd-ba92-4d4a-80cc-d2542a026b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.901204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f2cd-ba92-4d4a-80cc-d2542a026b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.904714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f2cd-ba92-4d4a-80cc-d2542a026b7e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.928145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21270bac-8748-4bad-a38e-346a8fe4e99b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:46.934224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:46.935650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.936090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.936819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] PATH_INFO: `/v3/projects/f68a907348e04362a8413cd6312d1aee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.937847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68a907348e04362a8413cd6312d1aee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:46.940286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:46.961371 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 865/1747] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:46 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:46.962726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602572-d6d8-4316-97df-3e335d6670a5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.963017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602572-d6d8-4316-97df-3e335d6670a5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.963295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602572-d6d8-4316-97df-3e335d6670a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.000219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68a907348e04362a8413cd6312d1aee', 'request_id': 'req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:47.003867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c9602572-d6d8-4316-97df-3e335d6670a5 None None] MFA Rules not processed for user `33427f6bd4bb4ba29cdc179966e9a09d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.005328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c9602572-d6d8-4316-97df-3e335d6670a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.010669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68a907348e04362a8413cd6312d1aee', 'request_id': 'req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:47.017130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68a907348e04362a8413cd6312d1aee', 'request_id': 'req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:47.037846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] The token cache is being invalidate because project f68a907348e04362a8413cd6312d1aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:47.038229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:47.039084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:47.043994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 883/1748] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:46 2022] DELETE /identity/v3/projects/f68a907348e04362a8413cd6312d1aee => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:47.043994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.045211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.091820 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:47.094237 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 866/1749] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:47.095571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.096469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.096897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.119378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.120850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.127064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7841-9d05-4d53-a6d7-eeba7fd8a72d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.141284 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 867/1750] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:47.141284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.144008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.147128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60d18c-f362-4467-8184-1e8656ff4c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.147699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60d18c-f362-4467-8184-1e8656ff4c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.148021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60d18c-f362-4467-8184-1e8656ff4c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.148288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60d18c-f362-4467-8184-1e8656ff4c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.149664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60d18c-f362-4467-8184-1e8656ff4c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.151752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60d18c-f362-4467-8184-1e8656ff4c17 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.157368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15cf1-f713-4b72-86f7-7583c61b6e82 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.163310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.163980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.164262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.164914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.165094 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 884/1751] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:47.166377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913176-ff58-4cee-803d-613dfabcfaf7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.166698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913176-ff58-4cee-803d-613dfabcfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.166937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913176-ff58-4cee-803d-613dfabcfaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.169530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.171396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.200045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d6913176-ff58-4cee-803d-613dfabcfaf7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.202096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d6913176-ff58-4cee-803d-613dfabcfaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.212234 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 868/1752] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/projects => generated 395 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:47.213780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.216922 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 885/1753] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:47.219477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913176-ff58-4cee-803d-613dfabcfaf7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.239651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913176-ff58-4cee-803d-613dfabcfaf7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.324429 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:47.353657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454db05-e614-4b31-8a61-2a4895845e5a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.367254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.371336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.371824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.372398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] PATH_INFO: `/v3/projects/12be6f89b04341538cb2d73cce43060c/users/dd15610fd0c34c4aa070e4e8f638856a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.398918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=12be6f89b04341538cb2d73cce43060c, user_id=dd15610fd0c34c4aa070e4e8f638856a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.401980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.405474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.406113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.406392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.406701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.407961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:47.407961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.410356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.429276 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 886/1754] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:47.430704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.440215 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 869/1755] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:47 2022] PUT /identity/v3/projects/12be6f89b04341538cb2d73cce43060c/users/dd15610fd0c34c4aa070e4e8f638856a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:47.441247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.451474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2057312-7d92-4d0e-904b-85bcd273967a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.528933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.529554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.529832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.530104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.530737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.533929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.539774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0df64-228a-4fa6-aaaa-3ab7c63c71ee admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.546246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.547362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.548057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.548336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.549258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.552220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.567087 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 887/1756] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:47.567087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.582902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16ccc-ef68-44b5-b311-4d4abf41518a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.589924 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 870/1757] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:47.589924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.590181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.590560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.591846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.592147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.593185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.595707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.615333 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 888/1758] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:47.616245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.627716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003086b6-cb82-4433-a489-cac1910a30ea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.670820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa0276-10da-4069-bd13-1b4e96eb473b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.673036 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:47.678856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.679576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.679854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.681578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.682594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.685399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.702518 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 871/1759] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:47.702518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.713613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dd14b-a48c-45cb-b053-c450b68d5245 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.719168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.719567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f25bf-cf22-4ee3-ae88-77adf30078fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.720293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f25bf-cf22-4ee3-ae88-77adf30078fc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.720434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.720633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.720944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] PATH_INFO: `/v3/projects/12be6f89b04341538cb2d73cce43060c/users/dd15610fd0c34c4aa070e4e8f638856a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.722159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f25bf-cf22-4ee3-ae88-77adf30078fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.722672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f25bf-cf22-4ee3-ae88-77adf30078fc admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.723386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f25bf-cf22-4ee3-ae88-77adf30078fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.723497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12be6f89b04341538cb2d73cce43060c, user_id=dd15610fd0c34c4aa070e4e8f638856a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.726285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f25bf-cf22-4ee3-ae88-77adf30078fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.727699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.744872 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 872/1760] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:47 2022] PUT /identity/v3/projects/12be6f89b04341538cb2d73cce43060c/users/dd15610fd0c34c4aa070e4e8f638856a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:47.746021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.768881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 889/1761] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:47.768881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb509ed-0ace-4b97-b38d-40b32902267b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.768881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb509ed-0ace-4b97-b38d-40b32902267b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.770116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb509ed-0ace-4b97-b38d-40b32902267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.806759 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:47.832744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3eb509ed-0ace-4b97-b38d-40b32902267b None None] MFA Rules not processed for user `dd15610fd0c34c4aa070e4e8f638856a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.834010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3eb509ed-0ace-4b97-b38d-40b32902267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.838110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3611b-8700-4308-ae31-cbdea2054c77 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.849824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.850787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.851209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.851485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.855898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.857586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.873009 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 873/1762] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:47.873009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.884843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93f46-905c-4ddc-9e93-96aa8581b07f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.890109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518dd4c-06fc-4e10-831f-a75af48e5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.890735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518dd4c-06fc-4e10-831f-a75af48e5d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.891016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518dd4c-06fc-4e10-831f-a75af48e5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.891491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518dd4c-06fc-4e10-831f-a75af48e5d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.893470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518dd4c-06fc-4e10-831f-a75af48e5d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.895090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518dd4c-06fc-4e10-831f-a75af48e5d8e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.909851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 874/1763] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:47.909851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.909851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.909851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.963950 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 890/1764] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:47.965159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb509ed-0ace-4b97-b38d-40b32902267b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.983370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.984360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb509ed-0ace-4b97-b38d-40b32902267b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.984801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.990317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.991170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.991454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.991788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] PATH_INFO: `/v3/projects/c5c5a179f61040508ffbe0334c910749/users/687ce8586bc042aea9bd78f5565af188/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.012115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c5a179f61040508ffbe0334c910749, user_id=687ce8586bc042aea9bd78f5565af188, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.020108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.046362 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 891/1765] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:47 2022] PUT /identity/v3/projects/c5c5a179f61040508ffbe0334c910749/users/687ce8586bc042aea9bd78f5565af188/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:48.047886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.137879 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 875/1766] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:48.139463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.144800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.235927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf02d1-1c3a-4de4-aa42-b0bad5b675da admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.250472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe4b1c-7b34-45c7-b52c-2313315cf0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.251196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4b1c-7b34-45c7-b52c-2313315cf0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.252755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4b1c-7b34-45c7-b52c-2313315cf0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.253277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4b1c-7b34-45c7-b52c-2313315cf0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.253978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe4b1c-7b34-45c7-b52c-2313315cf0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.257818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe4b1c-7b34-45c7-b52c-2313315cf0dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.269917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ef430-587f-4668-ac8c-e03f0bb6d222 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.282292 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 892/1767] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:48.284324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54981cd-6250-44cb-bb5b-8b341787ad4a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.284651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54981cd-6250-44cb-bb5b-8b341787ad4a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.284985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54981cd-6250-44cb-bb5b-8b341787ad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.343590 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:48.358962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c54981cd-6250-44cb-bb5b-8b341787ad4a None None] MFA Rules not processed for user `687ce8586bc042aea9bd78f5565af188`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:48.360440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c54981cd-6250-44cb-bb5b-8b341787ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.391927 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:48.396889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.397671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.398053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.398421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.493017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.495037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.503061 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 893/1768] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:48.504061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54981cd-6250-44cb-bb5b-8b341787ad4a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.525545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54981cd-6250-44cb-bb5b-8b341787ad4a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.533261 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 876/1769] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:48.534425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.537140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.554582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.555294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.555572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.555842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] PATH_INFO: `/v3/projects/01a478281683432a80ad47494488ff22/users/f03aaefdae344369a0d956a423559a0c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.594177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a478281683432a80ad47494488ff22, user_id=f03aaefdae344369a0d956a423559a0c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.596939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.622319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 894/1770] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:48 2022] PUT /identity/v3/projects/01a478281683432a80ad47494488ff22/users/f03aaefdae344369a0d956a423559a0c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:48.624471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.631599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.731617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd72fc9-75b6-4a20-a401-31359ba04e6b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.733448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6221a23-9500-4528-b0f1-c4641ccc5d19 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.742592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12da6f-b8e1-4089-b210-fdc17101afe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.743391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12da6f-b8e1-4089-b210-fdc17101afe2 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.743667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12da6f-b8e1-4089-b210-fdc17101afe2 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.743939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12da6f-b8e1-4089-b210-fdc17101afe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.808947 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:48.823455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.824151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.824401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.824820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.827883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12da6f-b8e1-4089-b210-fdc17101afe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.832478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12da6f-b8e1-4089-b210-fdc17101afe2 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.845143 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 895/1771] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:48.853169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596df9-a9ec-4195-b8cd-0e8b72ae45a0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.853630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596df9-a9ec-4195-b8cd-0e8b72ae45a0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.854190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596df9-a9ec-4195-b8cd-0e8b72ae45a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.896037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-11596df9-a9ec-4195-b8cd-0e8b72ae45a0 None None] MFA Rules not processed for user `f03aaefdae344369a0d956a423559a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:48.898363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11596df9-a9ec-4195-b8cd-0e8b72ae45a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.917646 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:48.964757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.967078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.982732 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 877/1772] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:48.984835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:49.001070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0909a-0dab-45c4-999a-2e2fa310c007 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:49.013130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:49.013532 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 896/1773] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:49.014328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.015241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.015445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.015654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54acd6-d56e-45a8-b481-735903477e2d None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.017141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54acd6-d56e-45a8-b481-735903477e2d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.017141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54acd6-d56e-45a8-b481-735903477e2d None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.018608 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 897/1774] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:49.019420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:49.024623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54acd6-d56e-45a8-b481-735903477e2d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:49.132409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:49.136808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:49.152783 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 878/1775] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:49.154002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:49.177509 n-d-master-1 devstack@keystone.service[81886]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 21 01:06:49.177896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:49.199439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24072518-768a-45a8-82f4-145c2d31e356 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:49.202696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65af41-2f1a-4ac6-8def-f9d4d7e25ba0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33427f6bd4bb4ba29cdc179966e9a09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877e38f15766473b9c3047efe6a901e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:49.203644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65af41-2f1a-4ac6-8def-f9d4d7e25ba0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.204658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65af41-2f1a-4ac6-8def-f9d4d7e25ba0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.213228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65af41-2f1a-4ac6-8def-f9d4d7e25ba0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] PATH_INFO: `/v3/projects/16579e1e520e472a9ff663e210931c5d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.215107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65af41-2f1a-4ac6-8def-f9d4d7e25ba0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorizing `identity:get_project(project_id=16579e1e520e472a9ff663e210931c5d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:49.218047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65af41-2f1a-4ac6-8def-f9d4d7e25ba0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:49.219932 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 879/1776] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:49 2022] GET /identity/v3/projects/16579e1e520e472a9ff663e210931c5d => generated 395 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:49.289275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54acd6-d56e-45a8-b481-735903477e2d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:49.300081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:49.301581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.302037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.302495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.303563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:49.306414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:49.320360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef5e-2efa-43de-bb89-1afa3846eecf None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.321050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef5e-2efa-43de-bb89-1afa3846eecf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.321755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef5e-2efa-43de-bb89-1afa3846eecf None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.324710 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 880/1777] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:06:49.333029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef5e-2efa-43de-bb89-1afa3846eecf None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:49.356443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef5e-2efa-43de-bb89-1afa3846eecf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:49.374351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef5e-2efa-43de-bb89-1afa3846eecf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:49.382876 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 898/1778] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:49 2022] POST /identity/v3/projects => generated 375 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:49.384301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:49.563291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33427f6bd4bb4ba29cdc179966e9a09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877e38f15766473b9c3047efe6a901e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:49.563968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.564332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.564614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] PATH_INFO: `/v3/projects/16579e1e520e472a9ff663e210931c5d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.569817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorizing `identity:get_project(project_id=16579e1e520e472a9ff663e210931c5d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:49.572196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:49.574257 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 881/1779] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:49 2022] GET /identity/v3/projects/16579e1e520e472a9ff663e210931c5d => generated 395 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:49.588547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d61091-d459-4907-b6f0-e2fb983c12db admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:49.615925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8acacc-c2a2-4ea5-bca5-35e44514f329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:49.617289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8acacc-c2a2-4ea5-bca5-35e44514f329 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.617594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8acacc-c2a2-4ea5-bca5-35e44514f329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.620893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8acacc-c2a2-4ea5-bca5-35e44514f329 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.621692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8acacc-c2a2-4ea5-bca5-35e44514f329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:49.645663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8acacc-c2a2-4ea5-bca5-35e44514f329 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:49.688346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 899/1780] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:49 2022] POST /identity/v3/users => generated 294 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:49.695576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:49.714240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff01f01-1884-4aeb-ad32-defd8e615fcd tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:49.731895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:49.732643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.732926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.733194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.733884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:49.735585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:49.745597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90413502-0a6d-49b4-b3ae-444d3e23f6b8 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.745890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90413502-0a6d-49b4-b3ae-444d3e23f6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.746210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90413502-0a6d-49b4-b3ae-444d3e23f6b8 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.747940 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 900/1781] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:49.762420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90413502-0a6d-49b4-b3ae-444d3e23f6b8 None None] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:49.769103 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 882/1782] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:06:49.773564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:49.804665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955eb6c-d188-43e8-b665-7d0f4ebb6994 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:49.820301 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:49.825783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:49.827519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:49.827802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:49.828074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] PATH_INFO: `/v3/projects/d3f474c73bce4c92ac392bb5083a23d7/users/4205454ef7ab4b7bbfbb069b255b1c56/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:49.860132 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:49.887529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f474c73bce4c92ac392bb5083a23d7, user_id=4205454ef7ab4b7bbfbb069b255b1c56, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:49.895517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:49.936079 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 883/1783] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:49 2022] PUT /identity/v3/projects/d3f474c73bce4c92ac392bb5083a23d7/users/4205454ef7ab4b7bbfbb069b255b1c56/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:49.941137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:50.032452 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-90413502-0a6d-49b4-b3ae-444d3e23f6b8 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 21 01:06:50.033008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90413502-0a6d-49b4-b3ae-444d3e23f6b8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:50.055462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90413502-0a6d-49b4-b3ae-444d3e23f6b8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:50.161445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba6479-a588-494c-b863-7886b4f2af18 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:50.181763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6497c9-2a13-41f6-83f5-114e49f057dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:50.182564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6497c9-2a13-41f6-83f5-114e49f057dc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:50.182892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6497c9-2a13-41f6-83f5-114e49f057dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:50.183165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6497c9-2a13-41f6-83f5-114e49f057dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:50.183868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6497c9-2a13-41f6-83f5-114e49f057dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:50.192400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6497c9-2a13-41f6-83f5-114e49f057dc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:50.205312 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 884/1784] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:06:50.207027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:50.207308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:50.207604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:50.252873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33427f6bd4bb4ba29cdc179966e9a09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877e38f15766473b9c3047efe6a901e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:50.253596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:50.256339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:50.256620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] PATH_INFO: `/v3/projects/16579e1e520e472a9ff663e210931c5d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:50.271652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorizing `identity:get_project(project_id=16579e1e520e472a9ff663e210931c5d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:50.278964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:50.288303 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 901/1785] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:49 2022] GET /identity/v3/projects/16579e1e520e472a9ff663e210931c5d => generated 395 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:50.289269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:50.327512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25bce6-46b6-45ee-a657-02fa5d2d5248 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:50.348739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:50.352381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:50.389425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71a536-26c0-461b-967f-86bd4ba33fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:50.392675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71a536-26c0-461b-967f-86bd4ba33fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:50.393188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71a536-26c0-461b-967f-86bd4ba33fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:50.393332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71a536-26c0-461b-967f-86bd4ba33fb5 admin admin] PATH_INFO: `/v3/projects/d3f474c73bce4c92ac392bb5083a23d7/users/4205454ef7ab4b7bbfbb069b255b1c56/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:50.399373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71a536-26c0-461b-967f-86bd4ba33fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f474c73bce4c92ac392bb5083a23d7, user_id=4205454ef7ab4b7bbfbb069b255b1c56, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:50.411555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71a536-26c0-461b-967f-86bd4ba33fb5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:50.438742 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 902/1786] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:50 2022] PUT /identity/v3/projects/d3f474c73bce4c92ac392bb5083a23d7/users/4205454ef7ab4b7bbfbb069b255b1c56/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:50.452201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27611f6-e996-41e0-819a-874ca67ddae2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:50.452500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27611f6-e996-41e0-819a-874ca67ddae2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:50.453123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27611f6-e996-41e0-819a-874ca67ddae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:50.517496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 885/1787] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Aug 21 01:06:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:50.587524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a27611f6-e996-41e0-819a-874ca67ddae2 None None] MFA Rules not processed for user `4205454ef7ab4b7bbfbb069b255b1c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:50.589035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a27611f6-e996-41e0-819a-874ca67ddae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:50.687004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:50.688824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:50.706876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994c0a0-6df3-4862-9878-fdb7d555a137 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:50.852291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:50.853197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:50.853633 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 903/1788] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:50.857416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27611f6-e996-41e0-819a-874ca67ddae2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:50.859813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:50.860233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:50.885931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:50.888307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:50.911418 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 886/1789] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:06:50.916220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:50.968960 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:51.002889 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:51.077980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27611f6-e996-41e0-819a-874ca67ddae2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:51.085165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:51.097749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.099554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.099934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] PATH_INFO: `/v3/users/a0ebb6aa35a7482d888d8e59cb29b891` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.105411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ebb6aa35a7482d888d8e59cb29b891)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:51.108572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:51.114665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0efc9-cef6-423a-a81b-ad96ae1bf029 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:51.140092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:51.140737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.141039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.141319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.176319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:51.178071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:51.199002 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 887/1790] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:51.225395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:51.241088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ebb6aa35a7482d888d8e59cb29b891'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:51.253552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ebb6aa35a7482d888d8e59cb29b891'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:51.265385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead7f6-531b-4bba-803a-ffd718795da2 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:51.293537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45165806-539e-42e5-af73-d596461cdd89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:51.294722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165806-539e-42e5-af73-d596461cdd89 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.295234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165806-539e-42e5-af73-d596461cdd89 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.295662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165806-539e-42e5-af73-d596461cdd89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.303167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ebb6aa35a7482d888d8e59cb29b891'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:51.304034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ebb6aa35a7482d888d8e59cb29b891'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:51.304623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-45165806-539e-42e5-af73-d596461cdd89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:51.327491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1445a390-2329-4ff8-b50c-d5d1491a83a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ebb6aa35a7482d888d8e59cb29b891'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:51.336159 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 904/1791] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:50 2022] DELETE /identity/v3/users/a0ebb6aa35a7482d888d8e59cb29b891 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:51.354504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.357405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.358006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.425005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:51.426914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:51.546687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45165806-539e-42e5-af73-d596461cdd89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:51.549522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45165806-539e-42e5-af73-d596461cdd89 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:51.579659 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 888/1792] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:51 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:51.691564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.691971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.692399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.694543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 889/1793] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:06:51.700074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:51.700955 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 905/1794] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:51.710437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:51.720944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:51.723005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:51.908501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7af5ae-9e7b-47f6-9a23-fe8ad29dabb7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:51.914187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:51.915830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.916185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.916729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.931364 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:51.934994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:51.937933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:51.956850 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 906/1795] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:52.006935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:52.009766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:52.160833 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:52.234746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285563f-1b73-4597-99de-87aa55511de8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:52.252686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ae837-5b4a-444b-a468-fcd481f92602 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4205454ef7ab4b7bbfbb069b255b1c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f474c73bce4c92ac392bb5083a23d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:52.254023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae837-5b4a-444b-a468-fcd481f92602 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:52.254544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae837-5b4a-444b-a468-fcd481f92602 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:52.254993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae837-5b4a-444b-a468-fcd481f92602 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] PATH_INFO: `/v3/projects/01a478281683432a80ad47494488ff22` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:52.258077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ae837-5b4a-444b-a468-fcd481f92602 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] RBAC: Authorizing `identity:get_project(project_id=01a478281683432a80ad47494488ff22)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:52.262399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ae837-5b4a-444b-a468-fcd481f92602 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:52.270075 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 890/1796] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:51 2022] GET /identity/v3/projects/01a478281683432a80ad47494488ff22 => generated 379 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:52.407469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:52.431261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd9b54-2370-41c8-a853-305283e5a46f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:52.447433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:52.448110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:52.448393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:52.448664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:52.455483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:52.607968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:52.611563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:52.640888 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 907/1797] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:52.772412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5643cc-238b-41d1-960f-2a092087f4b6 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:52.773544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5643cc-238b-41d1-960f-2a092087f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:52.778422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5643cc-238b-41d1-960f-2a092087f4b6 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:52.781259 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 891/1798] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:52.786444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:52.788004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:52.792435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5643cc-238b-41d1-960f-2a092087f4b6 None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:52.833765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5643cc-238b-41d1-960f-2a092087f4b6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:52.839537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850623d6-b2f9-4dbc-9af8-c66e67f5d026 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:52.848151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:52.849020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:52.849459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:52.849883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] PATH_INFO: `/v3/projects/7eb2b61108224266b050a58ffbf0c445` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:52.851702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb2b61108224266b050a58ffbf0c445)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:52.853988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:52.879933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5643cc-238b-41d1-960f-2a092087f4b6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:52.896196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4205454ef7ab4b7bbfbb069b255b1c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f474c73bce4c92ac392bb5083a23d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:52.897205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:52.897655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:52.898070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] PATH_INFO: `/v3/projects/01a478281683432a80ad47494488ff22` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:52.905511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] RBAC: Authorizing `identity:get_project(project_id=01a478281683432a80ad47494488ff22)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:52.908622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:52.912713 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 892/1799] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:52 2022] GET /identity/v3/projects/01a478281683432a80ad47494488ff22 => generated 379 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:06:52.968499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb2b61108224266b050a58ffbf0c445', 'request_id': 'req-20b1d411-ff90-4b25-a4d9-04fda922d994'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:52.978602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb2b61108224266b050a58ffbf0c445', 'request_id': 'req-20b1d411-ff90-4b25-a4d9-04fda922d994'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.009071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb2b61108224266b050a58ffbf0c445', 'request_id': 'req-20b1d411-ff90-4b25-a4d9-04fda922d994'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.032495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] The token cache is being invalidate because project 7eb2b61108224266b050a58ffbf0c445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:53.033032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.034084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b1d411-ff90-4b25-a4d9-04fda922d994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.054040 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 908/1800] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:52 2022] DELETE /identity/v3/projects/7eb2b61108224266b050a58ffbf0c445 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:53.055686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:53.060217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:53.090458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371ceec-1abe-4fa7-b40b-a9938f65c15e tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:53.116035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:53.116548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:53.117493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:53.120541 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 909/1801] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:06:53.135665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:53.145325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:53.295785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:53.296718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:53.296718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:53.296992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] PATH_INFO: `/v3/users/dd15610fd0c34c4aa070e4e8f638856a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:53.301563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd15610fd0c34c4aa070e4e8f638856a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:53.303500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:53.343017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:53.360384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:53.409275 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:53.434159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd15610fd0c34c4aa070e4e8f638856a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.455039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd15610fd0c34c4aa070e4e8f638856a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.456148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd15610fd0c34c4aa070e4e8f638856a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.472113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd15610fd0c34c4aa070e4e8f638856a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.472934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd15610fd0c34c4aa070e4e8f638856a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:53.509072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 893/1802] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:53 2022] DELETE /identity/v3/users/dd15610fd0c34c4aa070e4e8f638856a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:53.592813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c78a2d-02e7-4368-8fb0-ae830511154a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:53.734329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:53.738400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:53.866257 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:53.890617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01511f-7087-4867-9c04-5222aaf63398 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:53.897672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:53.898603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:53.899046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:53.899642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] PATH_INFO: `/v3/users/f03aaefdae344369a0d956a423559a0c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:53.901322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03aaefdae344369a0d956a423559a0c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:53.905604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:53.946698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747db481-dad9-46b5-b2fb-bfa2686a4808 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33427f6bd4bb4ba29cdc179966e9a09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877e38f15766473b9c3047efe6a901e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:53.947871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db481-dad9-46b5-b2fb-bfa2686a4808 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:53.948515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db481-dad9-46b5-b2fb-bfa2686a4808 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:53.949186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db481-dad9-46b5-b2fb-bfa2686a4808 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] PATH_INFO: `/v3/projects/16579e1e520e472a9ff663e210931c5d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:53.956582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747db481-dad9-46b5-b2fb-bfa2686a4808 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorizing `identity:get_project(project_id=16579e1e520e472a9ff663e210931c5d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:53.985552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747db481-dad9-46b5-b2fb-bfa2686a4808 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:53.991794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 910/1803] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:53 2022] GET /identity/v3/projects/16579e1e520e472a9ff663e210931c5d => generated 395 bytes in 857 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:06:54.027591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03aaefdae344369a0d956a423559a0c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.042356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03aaefdae344369a0d956a423559a0c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.043026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03aaefdae344369a0d956a423559a0c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.064817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03aaefdae344369a0d956a423559a0c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.067160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f451a1a-4c73-463c-a155-850c251289f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03aaefdae344369a0d956a423559a0c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.127285 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 894/1804] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:53 2022] DELETE /identity/v3/users/f03aaefdae344369a0d956a423559a0c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:54.129346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:54.129621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:54.129895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:54.206435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:54.214549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:54.271252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48684dbd-daaa-4424-a045-861464406233 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:54.271779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48684dbd-daaa-4424-a045-861464406233 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:54.272246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48684dbd-daaa-4424-a045-861464406233 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:54.274479 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 895/1805] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:54.284542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48684dbd-daaa-4424-a045-861464406233 None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:54.288170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48684dbd-daaa-4424-a045-861464406233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:54.440003 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 911/1806] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:54.441478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:54.444826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:54.470729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78bc00-685f-4826-b54f-9927a1615f3b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:54.507915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:54.508696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:54.509064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:54.509428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] PATH_INFO: `/v3/projects/12be6f89b04341538cb2d73cce43060c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:54.513550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12be6f89b04341538cb2d73cce43060c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:54.515592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:54.539325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48684dbd-daaa-4424-a045-861464406233 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:54.541178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48684dbd-daaa-4424-a045-861464406233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:54.648941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12be6f89b04341538cb2d73cce43060c', 'request_id': 'req-385cbfb7-df8e-4ef9-bb48-add380b453c9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.661875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12be6f89b04341538cb2d73cce43060c', 'request_id': 'req-385cbfb7-df8e-4ef9-bb48-add380b453c9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.674406 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:54.683806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12be6f89b04341538cb2d73cce43060c', 'request_id': 'req-385cbfb7-df8e-4ef9-bb48-add380b453c9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.718039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] The token cache is being invalidate because project 12be6f89b04341538cb2d73cce43060c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:54.718407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.720477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:54.722565 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 912/1807] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:54 2022] DELETE /identity/v3/projects/12be6f89b04341538cb2d73cce43060c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:54.724074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:54.725615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:54.753749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48684dbd-daaa-4424-a045-861464406233 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:54.802080 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:54.857136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbfb7-df8e-4ef9-bb48-add380b453c9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:54.862851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d2fee-6c86-4a57-ae41-9f4ae334111c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:54.865144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d2fee-6c86-4a57-ae41-9f4ae334111c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:54.865651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d2fee-6c86-4a57-ae41-9f4ae334111c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:54.866200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d2fee-6c86-4a57-ae41-9f4ae334111c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:54.868861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-750d2fee-6c86-4a57-ae41-9f4ae334111c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:54.981703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a841f5-ed6b-434a-9883-0c33fceb7a9e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33427f6bd4bb4ba29cdc179966e9a09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877e38f15766473b9c3047efe6a901e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:54.983529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a841f5-ed6b-434a-9883-0c33fceb7a9e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:54.985088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a841f5-ed6b-434a-9883-0c33fceb7a9e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:54.985479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a841f5-ed6b-434a-9883-0c33fceb7a9e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] PATH_INFO: `/v3/projects/16579e1e520e472a9ff663e210931c5d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:54.989852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a841f5-ed6b-434a-9883-0c33fceb7a9e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorizing `identity:get_project(project_id=16579e1e520e472a9ff663e210931c5d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.001398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a841f5-ed6b-434a-9883-0c33fceb7a9e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.004586 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 896/1808] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:54 2022] GET /identity/v3/projects/16579e1e520e472a9ff663e210931c5d => generated 395 bytes in 720 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:06:55.006021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d2fee-6c86-4a57-ae41-9f4ae334111c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.007483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d2fee-6c86-4a57-ae41-9f4ae334111c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.007603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ecc10-4ca3-4fea-9883-fa3cb2d50d4f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.008961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ecc10-4ca3-4fea-9883-fa3cb2d50d4f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.009238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ecc10-4ca3-4fea-9883-fa3cb2d50d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.028243 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 913/1809] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:55.124276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9c3ecc10-4ca3-4fea-9883-fa3cb2d50d4f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:55.140543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c3ecc10-4ca3-4fea-9883-fa3cb2d50d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:55.179272 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 897/1810] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:55.185060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc73355-9b1a-4af4-85f7-6f1a35ce7954 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.185495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc73355-9b1a-4af4-85f7-6f1a35ce7954 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.185913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc73355-9b1a-4af4-85f7-6f1a35ce7954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.249594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8dc73355-9b1a-4af4-85f7-6f1a35ce7954 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:55.273008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8dc73355-9b1a-4af4-85f7-6f1a35ce7954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:55.293521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 914/1811] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:55.298834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ecc10-4ca3-4fea-9883-fa3cb2d50d4f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:55.314482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ecc10-4ca3-4fea-9883-fa3cb2d50d4f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:55.329758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:55.331047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.331047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.331317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.331979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:55.332277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.339857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.345853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.346303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.346687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.349803 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 915/1812] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:06:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:06:55.364672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:06:55.366970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:55.407175 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 898/1813] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:55.410354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:55.451638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855d159-2b61-4f4d-9fc9-ec56630f7648 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:55.474187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:55.476343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.477025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.478281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.479246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.484111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.561939 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 899/1814] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:55 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:55.566137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:55.683990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:55.691942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:55.737145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5b18e-5975-40b4-86e9-c373809f62b3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:55.762316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d136db7-4dc9-4d98-97b8-27076b370283 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:55.775732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:55.776820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.777259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.777674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.778576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.781756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.812161 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:55.838061 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 900/1815] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:55 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:55.842021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:55.845142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:55.868701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0890-1b71-476d-b737-8b08681d342c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:55.878873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:55.879735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.880322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.880661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] PATH_INFO: `/v3/projects/01a478281683432a80ad47494488ff22` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.882061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a478281683432a80ad47494488ff22)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.886332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.897345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d8bdb-f17c-4a45-b9a9-e4eee0eb7dd6 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33427f6bd4bb4ba29cdc179966e9a09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877e38f15766473b9c3047efe6a901e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:55.898000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8bdb-f17c-4a45-b9a9-e4eee0eb7dd6 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.898280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8bdb-f17c-4a45-b9a9-e4eee0eb7dd6 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.898556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8bdb-f17c-4a45-b9a9-e4eee0eb7dd6 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] PATH_INFO: `/v3/projects/c5c5a179f61040508ffbe0334c910749` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.899737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d8bdb-f17c-4a45-b9a9-e4eee0eb7dd6 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorizing `identity:get_project(project_id=c5c5a179f61040508ffbe0334c910749)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.901889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d8bdb-f17c-4a45-b9a9-e4eee0eb7dd6 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.908407 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 916/1816] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:06:55 2022] GET /identity/v3/projects/c5c5a179f61040508ffbe0334c910749 => generated 395 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:06:55.915549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f61b2f-e8de-4066-8a46-846afa0af85f None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.915867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f61b2f-e8de-4066-8a46-846afa0af85f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.916108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f61b2f-e8de-4066-8a46-846afa0af85f None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.917920 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 917/1817] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:06:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:55.918669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f61b2f-e8de-4066-8a46-846afa0af85f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:55.941557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f61b2f-e8de-4066-8a46-846afa0af85f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:55.949084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926707-d3af-4f8b-aed4-1f64e543692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:55.949365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926707-d3af-4f8b-aed4-1f64e543692b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.949532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926707-d3af-4f8b-aed4-1f64e543692b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.949810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926707-d3af-4f8b-aed4-1f64e543692b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:55.950667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926707-d3af-4f8b-aed4-1f64e543692b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:55.954916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926707-d3af-4f8b-aed4-1f64e543692b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:55.967850 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 918/1818] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:55.969887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:55.970711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:55.970996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:56.003171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a478281683432a80ad47494488ff22', 'request_id': 'req-74cabae4-a16b-4771-8546-6d22cffef919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.006762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:56.008821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.021139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a478281683432a80ad47494488ff22', 'request_id': 'req-74cabae4-a16b-4771-8546-6d22cffef919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.024954 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:56.044748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a478281683432a80ad47494488ff22', 'request_id': 'req-74cabae4-a16b-4771-8546-6d22cffef919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.092795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] The token cache is being invalidate because project 01a478281683432a80ad47494488ff22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:56.093393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.094957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.101551 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 901/1819] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:55 2022] DELETE /identity/v3/projects/01a478281683432a80ad47494488ff22 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:56.102939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:56.105471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.181132 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 919/1820] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:56.181999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:56.183514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.256842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cabae4-a16b-4771-8546-6d22cffef919 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:56.261478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a906-de2d-4917-9dc7-68072061b279 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:56.274677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:56.277959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:56.278732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:56.279571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:56.280682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:56.281057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:56.281805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:56.282093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:56.282368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] PATH_INFO: `/v3/users/bcc3be52ed8a47a39d124500df3681de` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:56.284092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:56.284233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc3be52ed8a47a39d124500df3681de)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:56.286197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:56.312847 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 902/1821] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:56.320714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:56.328469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.371321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a8e7a-0370-45dc-89e0-24c0522828d8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:56.384413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:56.385138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc3be52ed8a47a39d124500df3681de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.385275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:56.385594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:56.385931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] PATH_INFO: `/v3/users/4205454ef7ab4b7bbfbb069b255b1c56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:56.387649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4205454ef7ab4b7bbfbb069b255b1c56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:56.387962 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:56.391265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:56.403432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc3be52ed8a47a39d124500df3681de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.433738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc3be52ed8a47a39d124500df3681de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.434504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc3be52ed8a47a39d124500df3681de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.444622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc3be52ed8a47a39d124500df3681de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.459772 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 920/1822] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:56 2022] DELETE /identity/v3/users/bcc3be52ed8a47a39d124500df3681de => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:56.461136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:56.463359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.503063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4205454ef7ab4b7bbfbb069b255b1c56'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.518066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4205454ef7ab4b7bbfbb069b255b1c56'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.520522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4205454ef7ab4b7bbfbb069b255b1c56'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.531844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4205454ef7ab4b7bbfbb069b255b1c56'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.537401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4205454ef7ab4b7bbfbb069b255b1c56'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:56.629834 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 903/1823] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:56 2022] DELETE /identity/v3/users/4205454ef7ab4b7bbfbb069b255b1c56 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:56.631369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:56.633058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.669924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de762f1-a5a0-4d3c-852c-ca405e5d704e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:56.766779 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:56.781412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046034be-92ec-4b20-82ef-f7799938bfaa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:56.791440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86df010-7286-47dc-99f9-203d45836de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:56.792549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86df010-7286-47dc-99f9-203d45836de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:56.793129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86df010-7286-47dc-99f9-203d45836de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:56.793763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86df010-7286-47dc-99f9-203d45836de5 admin admin] PATH_INFO: `/v3/projects/aa388d025cac48ada2e632d0df0b4cad/users/22500a157cbb43eab8e92270d59a2f2a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:56.817880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86df010-7286-47dc-99f9-203d45836de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa388d025cac48ada2e632d0df0b4cad, user_id=22500a157cbb43eab8e92270d59a2f2a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:56.822054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86df010-7286-47dc-99f9-203d45836de5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:56.860814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 904/1824] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:56 2022] PUT /identity/v3/projects/aa388d025cac48ada2e632d0df0b4cad/users/22500a157cbb43eab8e92270d59a2f2a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:56.860814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:56.860814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:56.860814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:56.882848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce4783-8d16-4584-a05c-5b327ae52cdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:56.885156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4783-8d16-4584-a05c-5b327ae52cdb service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:56.886347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4783-8d16-4584-a05c-5b327ae52cdb service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:56.887427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4783-8d16-4584-a05c-5b327ae52cdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:56.892825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ebce4783-8d16-4584-a05c-5b327ae52cdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.913908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:56.919075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:56.920904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce4783-8d16-4584-a05c-5b327ae52cdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:56.924631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce4783-8d16-4584-a05c-5b327ae52cdb service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:56.942152 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 921/1825] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:56.944453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c649-c151-43f9-8cd5-793d6837db90 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:56.944758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c649-c151-43f9-8cd5-793d6837db90 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:56.945556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c649-c151-43f9-8cd5-793d6837db90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.018736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8175c649-c151-43f9-8cd5-793d6837db90 None None] MFA Rules not processed for user `22500a157cbb43eab8e92270d59a2f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:57.020536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8175c649-c151-43f9-8cd5-793d6837db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:57.083518 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 905/1826] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:57.125363 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:57.127940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:57.129224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:57.218173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 922/1827] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:57.219531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c649-c151-43f9-8cd5-793d6837db90 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:57.241901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c649-c151-43f9-8cd5-793d6837db90 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:57.268329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:57.269110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.269448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.270126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.270489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:57.272777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:57.318689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7a7d6-167c-4166-b9c6-e54494c4e2fa None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:57.340693 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 923/1828] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:57 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:57.344907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:57.346199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:57.347432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.347884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.348313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.367074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:57.369018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:57.386187 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 906/1829] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:57.442153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:57.446260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:57.500062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61f82d-29aa-479d-8978-637c9842a487 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:57.529736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:57.530614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.531002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.531413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] PATH_INFO: `/v3/projects/d3f474c73bce4c92ac392bb5083a23d7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.533276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f474c73bce4c92ac392bb5083a23d7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:57.538529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:57.541467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661107-5d48-49be-90c3-5971b1a3e3d9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:57.550565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:57.550789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.551194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.552348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.553199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:57.555509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:57.611990 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 924/1830] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:57 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:57.617966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:57.639816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302554c-27dd-4eb1-8b5e-9f62f3bd90c4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:57.680358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f474c73bce4c92ac392bb5083a23d7', 'request_id': 'req-68b877bf-555c-4ac3-b0c7-3a57761724a1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:57.705233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f474c73bce4c92ac392bb5083a23d7', 'request_id': 'req-68b877bf-555c-4ac3-b0c7-3a57761724a1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:57.715685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f474c73bce4c92ac392bb5083a23d7', 'request_id': 'req-68b877bf-555c-4ac3-b0c7-3a57761724a1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:57.732030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] The token cache is being invalidate because project d3f474c73bce4c92ac392bb5083a23d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:57.732451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:57.733367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-68b877bf-555c-4ac3-b0c7-3a57761724a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:57.736814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 907/1831] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:57 2022] DELETE /identity/v3/projects/d3f474c73bce4c92ac392bb5083a23d7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:57.743919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c7a6-5562-48b6-a177-6e7bcea8f414 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.745046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c7a6-5562-48b6-a177-6e7bcea8f414 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.745594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0c7a6-5562-48b6-a177-6e7bcea8f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.760279 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:57.792344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fcf0c7a6-5562-48b6-a177-6e7bcea8f414 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:57.793948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fcf0c7a6-5562-48b6-a177-6e7bcea8f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:57.798868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:57.812827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.813124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.814813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.815894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:57.817855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:57.825245 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 908/1832] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:57.839107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6f53-cfb1-4004-8ad7-7ce64725df43 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.840217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6f53-cfb1-4004-8ad7-7ce64725df43 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.841212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6f53-cfb1-4004-8ad7-7ce64725df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.860610 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 925/1833] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:57.864449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:57.866242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:57.888073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c522f3-da5d-43f4-bbc7-96125ebfac3a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:57.893677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9abb6f53-cfb1-4004-8ad7-7ce64725df43 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:57.894776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9abb6f53-cfb1-4004-8ad7-7ce64725df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:57.901578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb7f65-c7b2-493d-85c1-69197a216bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:57.902976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb7f65-c7b2-493d-85c1-69197a216bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.903571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb7f65-c7b2-493d-85c1-69197a216bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.904041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb7f65-c7b2-493d-85c1-69197a216bfc admin admin] PATH_INFO: `/v3/projects/aa7ed056a25f4e0eac5fb20571f85a61/users/9163e0cbd5ae479cb49905b804c3dbba/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.926115 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 909/1834] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:57.926115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6f53-cfb1-4004-8ad7-7ce64725df43 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:57.936508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6f53-cfb1-4004-8ad7-7ce64725df43 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:57.952750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb7f65-c7b2-493d-85c1-69197a216bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7ed056a25f4e0eac5fb20571f85a61, user_id=9163e0cbd5ae479cb49905b804c3dbba, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:57.965640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb7f65-c7b2-493d-85c1-69197a216bfc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:57.968956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:57.969690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:57.969914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:57.970247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:57.973623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:57.973959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:57.978678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:58.018332 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 926/1835] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:57 2022] PUT /identity/v3/projects/aa7ed056a25f4e0eac5fb20571f85a61/users/9163e0cbd5ae479cb49905b804c3dbba/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:06:58.018562 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 910/1836] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:58.018952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:58.019266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:58.020063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:58.021560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:58.044476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592399-476a-4b6d-9cd6-686b84644393 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:58.091622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] MFA Rules not processed for user `52db969e85344bb6a40150cedc205df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:58.096256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:58.103753 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:58.176589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:58.177275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:58.177561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:58.177833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:58.178691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:58.180824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:58.260754 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 911/1837] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:58 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:58.262017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:58.266562 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 927/1838] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:58 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:58.272611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:58.274483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:58.309938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb2af-b9b7-41a7-b151-2f5e8a65b547 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:58.452665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:58.453447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:58.453729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:58.454004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] PATH_INFO: `/v3/projects/16579e1e520e472a9ff663e210931c5d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:58.460019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16579e1e520e472a9ff663e210931c5d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:58.462247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3a4c3-08ce-4fc8-9f0a-e0e34bc0d278 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:58.463301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:58.484752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:58.485953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:58.486864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:58.487454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:58.488510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:58.490811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:58.514894 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 912/1839] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:58.517063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:58.539140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddaece-bb2d-4759-913a-4bf42b4ee9fd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:58.552080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:58.553232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:58.553775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:58.554401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:58.555416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:58.562290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:58.592844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16579e1e520e472a9ff663e210931c5d', 'request_id': 'req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:58.606628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16579e1e520e472a9ff663e210931c5d', 'request_id': 'req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:58.629530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16579e1e520e472a9ff663e210931c5d', 'request_id': 'req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:58.652676 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 913/1840] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:58 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:58.655672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:58.662346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:58.685431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] The token cache is being invalidate because project 16579e1e520e472a9ff663e210931c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:06:58.685759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:58.689095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5590ad-40e9-461e-ae45-705b6207000e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:58.690417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:58.700185 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 928/1841] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:06:58 2022] DELETE /identity/v3/projects/16579e1e520e472a9ff663e210931c5d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:58.708926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:58.717766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:58.790761 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:58.814395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:58.815145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:58.815425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:58.815696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:58.816476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:58.818696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:58.824386 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:58.879104 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 914/1842] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:58 2022] POST /identity/v3/projects => generated 403 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:58.880148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:58.884363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:58.885696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa9e1-5fc6-456c-9e2d-72300c9f81b0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.025993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70140c-26c0-4d81-9af9-c80a6b3e66fd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.033618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.037303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.037682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.038745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.040710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.047492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:59.080976 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 915/1843] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:59.080976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:59.085980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.086837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:59.086955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.087250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.087619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] PATH_INFO: `/v3/projects/aa7ed056a25f4e0eac5fb20571f85a61/users/9163e0cbd5ae479cb49905b804c3dbba/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.100048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7ed056a25f4e0eac5fb20571f85a61, user_id=9163e0cbd5ae479cb49905b804c3dbba, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.104228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:59.130113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dac94-10dd-4896-854f-00edaf2db81d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.133661 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 929/1844] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:58 2022] PUT /identity/v3/projects/aa7ed056a25f4e0eac5fb20571f85a61/users/9163e0cbd5ae479cb49905b804c3dbba/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:59.134785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:59.150828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:59.252243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.252899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.253131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.253398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] PATH_INFO: `/v3/users/33427f6bd4bb4ba29cdc179966e9a09d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.254615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33427f6bd4bb4ba29cdc179966e9a09d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.256801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:59.308920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed58d-968b-412a-8b8b-707a4fd0fca3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.316023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.316636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33427f6bd4bb4ba29cdc179966e9a09d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:59.317196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.317567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.317949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.318683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.320718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:59.328602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33427f6bd4bb4ba29cdc179966e9a09d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:59.329699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33427f6bd4bb4ba29cdc179966e9a09d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:59.355535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33427f6bd4bb4ba29cdc179966e9a09d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:59.357614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a096ba17-bf28-40b0-9f16-11219996c923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33427f6bd4bb4ba29cdc179966e9a09d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:06:59.365063 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:59.371640 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 930/1845] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:59 2022] POST /identity/v3/users => generated 308 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:59.374123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:59.378175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:59.415770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bda68-d437-4ec0-9906-7b58dde60624 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.421266 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 916/1846] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:06:59 2022] DELETE /identity/v3/users/33427f6bd4bb4ba29cdc179966e9a09d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:59.425669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65b39-ede3-42cb-8a22-a29467f5f64a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.425954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65b39-ede3-42cb-8a22-a29467f5f64a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.426232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65b39-ede3-42cb-8a22-a29467f5f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.511108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fac65b39-ede3-42cb-8a22-a29467f5f64a None None] MFA Rules not processed for user `9163e0cbd5ae479cb49905b804c3dbba`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:59.514862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fac65b39-ede3-42cb-8a22-a29467f5f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:59.592193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.593337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.593775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.594407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.595706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.599018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:59.619162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 931/1847] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:59.629653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:59.631752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:59.645919 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:59.652476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb5fc4-a83a-4317-8ef1-ce41358f2d7b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.660235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4cc13-cc36-419b-bca9-fa4a3cd98126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.661156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cc13-cc36-419b-bca9-fa4a3cd98126 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.661570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cc13-cc36-419b-bca9-fa4a3cd98126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.662023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cc13-cc36-419b-bca9-fa4a3cd98126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.662824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4cc13-cc36-419b-bca9-fa4a3cd98126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.666151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4cc13-cc36-419b-bca9-fa4a3cd98126 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:59.688631 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 917/1848] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:59.689563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac65b39-ede3-42cb-8a22-a29467f5f64a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:59.699480 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 932/1849] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:59.702433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30cb89-0f69-4e27-be8e-b8b6ab9ebbd8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.705388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30cb89-0f69-4e27-be8e-b8b6ab9ebbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.705990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30cb89-0f69-4e27-be8e-b8b6ab9ebbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.728057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5f30cb89-0f69-4e27-be8e-b8b6ab9ebbd8 None None] MFA Rules not processed for user `22500a157cbb43eab8e92270d59a2f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:59.729332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5f30cb89-0f69-4e27-be8e-b8b6ab9ebbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:59.733982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac65b39-ede3-42cb-8a22-a29467f5f64a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.749893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.750861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.753301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.753627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] PATH_INFO: `/v3/projects/6eed3f7b123848a28ec1270686cc51ee/users/899c649509d541798793e9c4d09709ec/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.800263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eed3f7b123848a28ec1270686cc51ee, user_id=899c649509d541798793e9c4d09709ec, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.805026 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 933/1850] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:59.805852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30cb89-0f69-4e27-be8e-b8b6ab9ebbd8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:59.814490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:59.864632 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 918/1851] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:59 2022] PUT /identity/v3/projects/6eed3f7b123848a28ec1270686cc51ee/users/899c649509d541798793e9c4d09709ec/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:59.865900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30cb89-0f69-4e27-be8e-b8b6ab9ebbd8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:59.866046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:59.868754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:59.963103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7ab22-f085-4dab-8871-545cfb65ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:59.964272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ab22-f085-4dab-8871-545cfb65ef79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:59.964805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ab22-f085-4dab-8871-545cfb65ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:59.965516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ab22-f085-4dab-8871-545cfb65ef79 admin admin] PATH_INFO: `/v3/projects/7303254fe7a344ea8dc2697340085f57/users/6f0a23308def48b3864933b57cd0108b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:59.987071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7ab22-f085-4dab-8871-545cfb65ef79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7303254fe7a344ea8dc2697340085f57, user_id=6f0a23308def48b3864933b57cd0108b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:59.990910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7ab22-f085-4dab-8871-545cfb65ef79 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:00.017645 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 934/1852] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:59 2022] PUT /identity/v3/projects/7303254fe7a344ea8dc2697340085f57/users/6f0a23308def48b3864933b57cd0108b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:00.019634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf8e9-0ed7-4c09-bad3-944ff18ca8e8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.020069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf8e9-0ed7-4c09-bad3-944ff18ca8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.020700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf8e9-0ed7-4c09-bad3-944ff18ca8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.021825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a8c41-379e-4bf0-b62c-fe35decbdcfd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:00.070672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f5ebf8e9-0ed7-4c09-bad3-944ff18ca8e8 None None] MFA Rules not processed for user `899c649509d541798793e9c4d09709ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:00.072992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f5ebf8e9-0ed7-4c09-bad3-944ff18ca8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:00.155951 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:00.222876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:00.223697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.224100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.224704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.227314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:00.250956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 935/1853] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:00.258826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf8e9-0ed7-4c09-bad3-944ff18ca8e8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:00.291678 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:00.336543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:00.339296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:00.356909 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 919/1854] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:00.358046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:00.359435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:00.460434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf8e9-0ed7-4c09-bad3-944ff18ca8e8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:00.473793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:00.474531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.474784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.474958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.475599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:00.477292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:00.500842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8689d59-c91f-40d7-b0d8-95e83c157121 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:00.509400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:00.511635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.512479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.513162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] PATH_INFO: `/v3/projects/877e38f15766473b9c3047efe6a901e1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.515257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877e38f15766473b9c3047efe6a901e1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:00.518983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:00.525229 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 936/1855] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:00.525229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:00.563595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887cfdc-6158-4bdd-b1bf-0948d88040eb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:00.572266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:00.572923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.573206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.575200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.575887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:00.579548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:00.621316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877e38f15766473b9c3047efe6a901e1', 'request_id': 'req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:00.640866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877e38f15766473b9c3047efe6a901e1', 'request_id': 'req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:00.658638 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 937/1856] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:00 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:00.659707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:00.664171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877e38f15766473b9c3047efe6a901e1', 'request_id': 'req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:00.709959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] The token cache is being invalidate because project 877e38f15766473b9c3047efe6a901e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:00.714483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:00.717344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:00.738926 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 920/1857] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:00 2022] DELETE /identity/v3/projects/877e38f15766473b9c3047efe6a901e1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:00.742089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:00.743623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:00.771587 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:00.787114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f1c7-3991-423f-8977-73c71e046f83 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:00.805755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:00.806790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.806790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.806992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] PATH_INFO: `/v3/projects/7303254fe7a344ea8dc2697340085f57/users/6f0a23308def48b3864933b57cd0108b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.808969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7303254fe7a344ea8dc2697340085f57, user_id=6f0a23308def48b3864933b57cd0108b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:00.811617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:00.829005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 938/1858] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:00 2022] PUT /identity/v3/projects/7303254fe7a344ea8dc2697340085f57/users/6f0a23308def48b3864933b57cd0108b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:00.830130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:00.832343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:00.861199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca17ac-3ef9-492c-98e4-ab42eb99d2d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:00.957092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:00.957876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.958218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.958602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.959407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:00.962013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:00.983009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4348a2-4d78-473f-b344-c156b4b2fff7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:00.993206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:00.994127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.994391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.994689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] PATH_INFO: `/v3/users/687ce8586bc042aea9bd78f5565af188` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.997808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=687ce8586bc042aea9bd78f5565af188)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:01.002286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:01.006293 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 921/1859] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:00 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:01.010018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:01.024106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c154c2b-7a2a-424d-902b-d0e78d61674a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:01.030662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:01.031348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:01.031761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:01.032251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:01.033695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:01.035866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:01.054006 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 922/1860] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:01.055097 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:01.058060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:01.073801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f28b-160a-4c98-b110-dc3f79832373 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:01.080858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:01.081873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:01.082093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:01.082503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] PATH_INFO: `/v3/projects/df6eb4aaf4bf4c389dba2e5acc5a2d0b/users/ef05c3e8fb444d9b986f616abd8a74e7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:01.099695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687ce8586bc042aea9bd78f5565af188'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:01.104788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6eb4aaf4bf4c389dba2e5acc5a2d0b, user_id=ef05c3e8fb444d9b986f616abd8a74e7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:01.112806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:01.144820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687ce8586bc042aea9bd78f5565af188'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:01.155227 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 923/1861] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:01 2022] PUT /identity/v3/projects/df6eb4aaf4bf4c389dba2e5acc5a2d0b/users/ef05c3e8fb444d9b986f616abd8a74e7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:01.159817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:01.174016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687ce8586bc042aea9bd78f5565af188'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:01.175380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687ce8586bc042aea9bd78f5565af188'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:01.193571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687ce8586bc042aea9bd78f5565af188'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:01.204145 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 939/1862] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:00 2022] DELETE /identity/v3/users/687ce8586bc042aea9bd78f5565af188 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:01.384437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998b19d-44a9-4644-b4b5-63fa645beadb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:01.426230 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:01.579128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7baa0-3a14-43d9-bd2a-946fb083b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:01.582753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7baa0-3a14-43d9-bd2a-946fb083b1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:01.583057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7baa0-3a14-43d9-bd2a-946fb083b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:01.583339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7baa0-3a14-43d9-bd2a-946fb083b1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:01.584458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7baa0-3a14-43d9-bd2a-946fb083b1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:01.589590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7baa0-3a14-43d9-bd2a-946fb083b1a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:01.623276 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 924/1863] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:01.624942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:01.626988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:01.649932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fd35d-273e-4057-b3ea-5b502b99b26e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:01.665511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:01.666370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:01.666651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:01.666923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] PATH_INFO: `/v3/projects/df6eb4aaf4bf4c389dba2e5acc5a2d0b/users/ef05c3e8fb444d9b986f616abd8a74e7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:01.675531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6eb4aaf4bf4c389dba2e5acc5a2d0b, user_id=ef05c3e8fb444d9b986f616abd8a74e7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:01.687096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:01.729038 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 940/1864] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:01 2022] PUT /identity/v3/projects/df6eb4aaf4bf4c389dba2e5acc5a2d0b/users/ef05c3e8fb444d9b986f616abd8a74e7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:01.730960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:01.731792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:01.732213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:01.807875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] MFA Rules not processed for user `ef05c3e8fb444d9b986f616abd8a74e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:01.809202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:01.977801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 925/1865] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:01.989696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:01.991595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.107744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:02.109594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.168310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b34c50-53a7-419b-be74-a48fed7bfadb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:02.177428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:02.178074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.178358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.178629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.188751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:02.191160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:02.221307 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 941/1866] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:02.288728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4bb8-5028-4395-8b98-8bfda33cfb12 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:02.304592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:02.305281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.305561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.305833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] PATH_INFO: `/v3/projects/c5c5a179f61040508ffbe0334c910749` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.311587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c5a179f61040508ffbe0334c910749)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:02.313750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:02.417817 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:02.435147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c5a179f61040508ffbe0334c910749', 'request_id': 'req-1e32918f-e3c1-43cd-88f3-98a253e7107e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.454563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c5a179f61040508ffbe0334c910749', 'request_id': 'req-1e32918f-e3c1-43cd-88f3-98a253e7107e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.470872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:02.474985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c5a179f61040508ffbe0334c910749', 'request_id': 'req-1e32918f-e3c1-43cd-88f3-98a253e7107e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.486846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2462-b17e-49c3-b8b6-fafd3e1ccefe service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:02.498152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] The token cache is being invalidate because project c5c5a179f61040508ffbe0334c910749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:02.499330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.505186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e32918f-e3c1-43cd-88f3-98a253e7107e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.513759 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 926/1867] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:02 2022] DELETE /identity/v3/projects/c5c5a179f61040508ffbe0334c910749 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:02.517157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a331-5580-48e7-9f20-738a4e980f33 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.517497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a331-5580-48e7-9f20-738a4e980f33 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.517774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a331-5580-48e7-9f20-738a4e980f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.554802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5c21a331-5580-48e7-9f20-738a4e980f33 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:02.556115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5c21a331-5580-48e7-9f20-738a4e980f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.654729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:02.656476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.657031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.657832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] PATH_INFO: `/v3/users/899c649509d541798793e9c4d09709ec` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.659681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=899c649509d541798793e9c4d09709ec)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:02.665306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:02.696921 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:02.719637 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 927/1868] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:02.721835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220749e4-e2fd-4328-9578-d29564c892fa None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.722152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220749e4-e2fd-4328-9578-d29564c892fa None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.725642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220749e4-e2fd-4328-9578-d29564c892fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.777758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-220749e4-e2fd-4328-9578-d29564c892fa None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:02.779228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-220749e4-e2fd-4328-9578-d29564c892fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.781032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899c649509d541798793e9c4d09709ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.798474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899c649509d541798793e9c4d09709ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.802636 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 928/1869] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:02.803790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220749e4-e2fd-4328-9578-d29564c892fa None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:02.821049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899c649509d541798793e9c4d09709ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.822192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899c649509d541798793e9c4d09709ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.835818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f961503-eaab-407f-8f25-2d6c3a7f4f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899c649509d541798793e9c4d09709ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:02.836055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220749e4-e2fd-4328-9578-d29564c892fa None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:02.846905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:02.847529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.847797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.848058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.848710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:02.849046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:02.849568 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 942/1870] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:02 2022] DELETE /identity/v3/users/899c649509d541798793e9c4d09709ec => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:02.854314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:02.854940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.855381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.855669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.887803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:02.889783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.890452 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 929/1871] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:02.891394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:02.894497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.928318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24f94-6d56-4101-bb02-bccb973ca956 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:03.059391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:03.060285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:03.060632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:03.061036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:03.061737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:03.064091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:03.077203 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 943/1872] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:03.094079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:03.097947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:03.112593 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 930/1873] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:02 2022] POST /identity/v3/projects => generated 403 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:03.117005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:03.224508 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:03.326017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385c9fa-84fe-4cf9-84f9-f022f1e40021 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:03.357152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:03.357347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:03.357596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:03.358101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:03.358617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd5c12-2792-4405-ac75-8baef0977c37 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:03.358776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:03.371271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:03.434495 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 931/1874] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:03 2022] POST /identity/v3/users => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:03.447745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:03.481779 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:03.485305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a434-b467-4d7d-86b2-1899046bbb74 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:03.497558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:03.498318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:03.498694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:03.498969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:03.499683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:03.500257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:03.501330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:03.501619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:03.504268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:03.505398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:03.522409 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 932/1875] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:03.524346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:03.527393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:03.530267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:03.553646 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 944/1876] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:07:03.555342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756304-2360-46c3-9cb8-851a7a43248a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:03.564693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cec7f-c02a-4fb2-9a09-fce034de6069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:03.565463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cec7f-c02a-4fb2-9a09-fce034de6069 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:03.565872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cec7f-c02a-4fb2-9a09-fce034de6069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:03.566211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cec7f-c02a-4fb2-9a09-fce034de6069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:03.567090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cec7f-c02a-4fb2-9a09-fce034de6069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:03.568811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cec7f-c02a-4fb2-9a09-fce034de6069 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:03.591405 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 933/1877] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:03.595776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:03.608139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84f591-94be-42f1-af5d-c2f9dfba2721 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:03.614184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:03.615441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:03.615721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:03.615990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] PATH_INFO: `/v3/projects/15476e1aff4949d392ef4f1cd6f43bbc/users/c4bc3ac4ef7c4c5fa2004e8cfdd83115/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:03.675619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=15476e1aff4949d392ef4f1cd6f43bbc, user_id=c4bc3ac4ef7c4c5fa2004e8cfdd83115, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:03.685314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:03.732796 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 945/1878] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:03 2022] PUT /identity/v3/projects/15476e1aff4949d392ef4f1cd6f43bbc/users/c4bc3ac4ef7c4c5fa2004e8cfdd83115/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:03.734031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:03.734382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:03.734723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:03.796706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] MFA Rules not processed for user `c4bc3ac4ef7c4c5fa2004e8cfdd83115`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:03.799219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:03.927871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:03.930675 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 934/1879] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:04.050714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a02cb-0c38-4871-89ee-073e73f92bfd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.056428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.057232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.057649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.061029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.062567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:04.062885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.064154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:04.065793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.087958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50034b3-660c-4cc2-a9db-c3930ef3ecaa None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.093987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.094896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.095099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.095360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] PATH_INFO: `/v3/projects/6eed3f7b123848a28ec1270686cc51ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.096826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eed3f7b123848a28ec1270686cc51ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.099224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.123856 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 946/1880] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:03 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:04.127714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:04.170561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eed3f7b123848a28ec1270686cc51ee', 'request_id': 'req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.185756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eed3f7b123848a28ec1270686cc51ee', 'request_id': 'req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.196167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eed3f7b123848a28ec1270686cc51ee', 'request_id': 'req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.214872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] The token cache is being invalidate because project 6eed3f7b123848a28ec1270686cc51ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:04.215063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.217352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.220309 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 935/1881] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:04 2022] DELETE /identity/v3/projects/6eed3f7b123848a28ec1270686cc51ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:04.224697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263ecc4-1ff1-4c40-a9d4-df51341a5609 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.227854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:04.229562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:04.273562 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:04.326397 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:04.334847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.335463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.336105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.336432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.337448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.340405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.389929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 947/1882] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:04 2022] POST /identity/v3/users => generated 307 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:04.391193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:04.392157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4919-0d0b-4c71-a7f6-5666e00b6110 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.393390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:04.406680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db6c8-c0e0-47a7-a7a3-bc7ea4cd604d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.409067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.410166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.410660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.411766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] PATH_INFO: `/v3/users/ef05c3e8fb444d9b986f616abd8a74e7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.413294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef05c3e8fb444d9b986f616abd8a74e7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.415766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.421591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.422514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.422956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.423528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.429948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.432797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.447723 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 948/1883] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:04.453582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:04.490884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea885e-05f5-43cf-988a-d3321e3cffc2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.498212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.499096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.499477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.499765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] PATH_INFO: `/v3/projects/48cebb60caa745d5ad461530cc84ae5c/users/72038a4480324c5795e55f10fb928b69/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.508995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef05c3e8fb444d9b986f616abd8a74e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.534076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef05c3e8fb444d9b986f616abd8a74e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.534778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef05c3e8fb444d9b986f616abd8a74e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.541913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cebb60caa745d5ad461530cc84ae5c, user_id=72038a4480324c5795e55f10fb928b69, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.544628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.551906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef05c3e8fb444d9b986f616abd8a74e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.553587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef05c3e8fb444d9b986f616abd8a74e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:04.569990 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 949/1884] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:04 2022] PUT /identity/v3/projects/48cebb60caa745d5ad461530cc84ae5c/users/72038a4480324c5795e55f10fb928b69/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:04.570957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:04.572757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:04.609907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 936/1885] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:04 2022] DELETE /identity/v3/users/ef05c3e8fb444d9b986f616abd8a74e7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:04.674896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4517bb-d9b6-4649-90c4-99ca9f56c472 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.795990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0f3f9-5bba-4b72-bc70-dd5a79c057e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.797528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f3f9-5bba-4b72-bc70-dd5a79c057e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.798177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f3f9-5bba-4b72-bc70-dd5a79c057e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.801483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0f3f9-5bba-4b72-bc70-dd5a79c057e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.803196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0f3f9-5bba-4b72-bc70-dd5a79c057e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.816543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0f3f9-5bba-4b72-bc70-dd5a79c057e3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.839167 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 950/1886] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:04.840495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:04.855948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8a75a-e301-4675-8bda-31d1dc658c7a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:04.866199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:04.866902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.867187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.867466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] PATH_INFO: `/v3/projects/48cebb60caa745d5ad461530cc84ae5c/users/72038a4480324c5795e55f10fb928b69/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:04.890699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cebb60caa745d5ad461530cc84ae5c, user_id=72038a4480324c5795e55f10fb928b69, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:04.893881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:04.929711 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 937/1887] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:04 2022] PUT /identity/v3/projects/48cebb60caa745d5ad461530cc84ae5c/users/72038a4480324c5795e55f10fb928b69/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:04.942015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:04.945316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:04.945869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:05.016839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] MFA Rules not processed for user `72038a4480324c5795e55f10fb928b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:05.018466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:05.203907 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:05.255614 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 951/1888] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:05.267322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:05.275909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:05.416731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:05.418610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:05.494341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974775-6223-4d05-b4e5-29367485ee38 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:05.525922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:05.526569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:05.526846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:05.529546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:05.558367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:05.561259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:05.576254 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 938/1889] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:05 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:05.585879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584102-b6ad-44bc-8075-2dbf24f70fa0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:05.592349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:05.593051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:05.593327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:05.593596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] PATH_INFO: `/v3/projects/df6eb4aaf4bf4c389dba2e5acc5a2d0b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:05.595192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6eb4aaf4bf4c389dba2e5acc5a2d0b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:05.597192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:05.635755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:05.637202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:05.671720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3bb8-f5ab-4f03-9962-97420bd41103 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:05.680410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc175c13-6dd4-45df-91db-d435b990623f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:05.681405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175c13-6dd4-45df-91db-d435b990623f service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:05.681676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175c13-6dd4-45df-91db-d435b990623f service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:05.681947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175c13-6dd4-45df-91db-d435b990623f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:05.685374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dc175c13-6dd4-45df-91db-d435b990623f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:05.697760 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:05.698877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6eb4aaf4bf4c389dba2e5acc5a2d0b', 'request_id': 'req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:05.716815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6eb4aaf4bf4c389dba2e5acc5a2d0b', 'request_id': 'req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:05.739061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6eb4aaf4bf4c389dba2e5acc5a2d0b', 'request_id': 'req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:05.762993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] The token cache is being invalidate because project df6eb4aaf4bf4c389dba2e5acc5a2d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:05.763439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:05.764309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c4fc27f-0ccb-4ea5-90ac-0d7f0ab1a75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:05.769454 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 952/1890] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:05 2022] DELETE /identity/v3/projects/df6eb4aaf4bf4c389dba2e5acc5a2d0b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:05.774325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bdd0e-9740-427e-a47f-2c308d709c83 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:05.774606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bdd0e-9740-427e-a47f-2c308d709c83 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:05.774877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bdd0e-9740-427e-a47f-2c308d709c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:05.828690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-884bdd0e-9740-427e-a47f-2c308d709c83 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:05.830118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-884bdd0e-9740-427e-a47f-2c308d709c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:05.855709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc175c13-6dd4-45df-91db-d435b990623f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:05.859242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc175c13-6dd4-45df-91db-d435b990623f service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:05.884629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 939/1891] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:05 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:05.972587 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 953/1892] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:05.980370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e4541-ae00-4af7-ad27-4b8a32ce3e1e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:05.980951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e4541-ae00-4af7-ad27-4b8a32ce3e1e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:05.981499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e4541-ae00-4af7-ad27-4b8a32ce3e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.018929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-950e4541-ae00-4af7-ad27-4b8a32ce3e1e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:06.023960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-950e4541-ae00-4af7-ad27-4b8a32ce3e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:06.056561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 940/1893] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:06.060881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bdd0e-9740-427e-a47f-2c308d709c83 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.081611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bdd0e-9740-427e-a47f-2c308d709c83 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.099489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.101746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.102200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.102908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.105033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:06.106141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.111994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.125110 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:06.153316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e4541-ae00-4af7-ad27-4b8a32ce3e1e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.156719 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 954/1894] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:07:06.165940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e4541-ae00-4af7-ad27-4b8a32ce3e1e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.171408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.172230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.172843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.173600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.174864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.177065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.247708 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 941/1895] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:06 2022] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:06.252496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.269082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90aca1-8853-45ac-ac9d-4e89583b29eb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.379320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.380165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.380444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.380793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.381446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.383692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.413104 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 955/1896] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:06 2022] POST /identity/v3/users => generated 304 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:06.414204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.428912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035abe5-ed1d-4363-8ac4-c26d1db6403e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.442597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.443312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.443784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.444273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.448426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.450546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.470303 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 942/1897] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:07:06.486751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.494017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.500545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:06.508665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b87cb-f075-48ea-b290-5e84b04ed500 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.521977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.524125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.524243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646097cf-2755-4273-b85b-40c487e3598c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.524418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.524705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.525420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.527737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.530149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.530964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.531337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.531680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] PATH_INFO: `/v3/users/c4bc3ac4ef7c4c5fa2004e8cfdd83115` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.533206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4bc3ac4ef7c4c5fa2004e8cfdd83115)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.535469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.546592 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 956/1898] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:06.548140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.575140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958f40-82a4-4641-b17f-79ae4015ac6a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.596342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440414b-a39b-44d4-b338-13c99112a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.597428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440414b-a39b-44d4-b338-13c99112a15d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.597718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440414b-a39b-44d4-b338-13c99112a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.597995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440414b-a39b-44d4-b338-13c99112a15d admin admin] PATH_INFO: `/v3/projects/3e1d812cc34240d8995ecd6dd936e3cb/users/3e42e5d5c3384acda7fb872e35a918e2/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.629160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:06.639650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440414b-a39b-44d4-b338-13c99112a15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1d812cc34240d8995ecd6dd936e3cb, user_id=3e42e5d5c3384acda7fb872e35a918e2, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.643567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:06.646296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:06.649805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440414b-a39b-44d4-b338-13c99112a15d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.667463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:06.672246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cf46e523-3b65-4b0c-8686-fed57175b076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:06.709706 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 957/1899] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:06 2022] PUT /identity/v3/projects/3e1d812cc34240d8995ecd6dd936e3cb/users/3e42e5d5c3384acda7fb872e35a918e2/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:06.711486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.711851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.712200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.742957 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 943/1900] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:06 2022] DELETE /identity/v3/users/c4bc3ac4ef7c4c5fa2004e8cfdd83115 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:06.747454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.747738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.748014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.752306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] MFA Rules not processed for user `3e42e5d5c3384acda7fb872e35a918e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:06.753689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:06.785147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:06.786837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:06.851274 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:06.908537 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 944/1901] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:06.920019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.921540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:06.925794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 958/1902] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:06.928068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.942685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:06.987648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68a353-c860-49cb-9cd9-62236fd702d4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.999178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.000845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.001502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.001889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.002446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.009861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.068257 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 959/1903] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:06 2022] POST /identity/v3/projects => generated 409 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:07.072108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:07.103685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ff17c-0671-4326-9b86-0f8cbcb2f807 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:07.153659 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:07.199643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.200385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.200741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.201142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.298384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97a7ff-4ecf-4e70-8672-bf64ddd809fe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:07.323688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.325618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.326097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.326563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.327452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.330006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.334495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.336572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.385547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 945/1904] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:07.417579 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 960/1905] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:07 2022] POST /identity/v3/users => generated 311 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:07.421717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:07.436890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc13ed-d230-451a-b55e-25a8347c9f6e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:07.444547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.446049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.446543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.447010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.448399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.451297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.478304 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 946/1906] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:07.482139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:07.496043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3304-0011-47b8-af0b-0caa3a34e161 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:07.515071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.516846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.517238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.519839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] PATH_INFO: `/v3/projects/f20051e18286402b8f75acb97060dd77/users/7e6dcdc432d94f469d1d6d78495f8ca3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.562626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20051e18286402b8f75acb97060dd77, user_id=7e6dcdc432d94f469d1d6d78495f8ca3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.567203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.598624 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 961/1907] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:07 2022] PUT /identity/v3/projects/f20051e18286402b8f75acb97060dd77/users/7e6dcdc432d94f469d1d6d78495f8ca3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:07.600965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:07.643973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb039d-a0cb-485b-b5e0-c8bb72fb948f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:07.779457 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:07.846039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a18e2-577a-4de8-96e1-9c74f34cd6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.847058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a18e2-577a-4de8-96e1-9c74f34cd6cb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.847519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a18e2-577a-4de8-96e1-9c74f34cd6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.847968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a18e2-577a-4de8-96e1-9c74f34cd6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.848982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a18e2-577a-4de8-96e1-9c74f34cd6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.851228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a18e2-577a-4de8-96e1-9c74f34cd6cb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.875774 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 947/1908] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:07.878924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:07.898580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb72c-cb10-4021-8602-6c036ab99ec4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:07.912704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.914051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.914671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.915143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] PATH_INFO: `/v3/projects/f20051e18286402b8f75acb97060dd77/users/7e6dcdc432d94f469d1d6d78495f8ca3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.923893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20051e18286402b8f75acb97060dd77, user_id=7e6dcdc432d94f469d1d6d78495f8ca3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.927342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.950484 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 962/1909] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:07 2022] PUT /identity/v3/projects/f20051e18286402b8f75acb97060dd77/users/7e6dcdc432d94f469d1d6d78495f8ca3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:07.962127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cdab0-0b56-445f-8fba-2b751b2453c9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.963140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cdab0-0b56-445f-8fba-2b751b2453c9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.963599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cdab0-0b56-445f-8fba-2b751b2453c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.998303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:08.000056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.040482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3a0cdab0-0b56-445f-8fba-2b751b2453c9 None None] MFA Rules not processed for user `7e6dcdc432d94f469d1d6d78495f8ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:08.041978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a0cdab0-0b56-445f-8fba-2b751b2453c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.149335 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 948/1910] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:08.149335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f516-d439-480a-9618-8cba580bdf2a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.149335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f516-d439-480a-9618-8cba580bdf2a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.149335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f516-d439-480a-9618-8cba580bdf2a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.149335 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 949/1911] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:08.160195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f516-d439-480a-9618-8cba580bdf2a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:08.162024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0151f516-d439-480a-9618-8cba580bdf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.176241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350499ab-b907-4ffa-8ade-34a901caa54d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:08.192661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:08.193362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.193640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.193904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] PATH_INFO: `/v3/projects/15476e1aff4949d392ef4f1cd6f43bbc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.195282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=15476e1aff4949d392ef4f1cd6f43bbc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:08.197247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:08.279668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15476e1aff4949d392ef4f1cd6f43bbc', 'request_id': 'req-44511b1e-761a-40c8-b165-4224ca17bdbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.298668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15476e1aff4949d392ef4f1cd6f43bbc', 'request_id': 'req-44511b1e-761a-40c8-b165-4224ca17bdbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.307259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15476e1aff4949d392ef4f1cd6f43bbc', 'request_id': 'req-44511b1e-761a-40c8-b165-4224ca17bdbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.315348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f516-d439-480a-9618-8cba580bdf2a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:08.326655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] The token cache is being invalidate because project 15476e1aff4949d392ef4f1cd6f43bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:08.327877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.328683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44511b1e-761a-40c8-b165-4224ca17bdbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.331557 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 963/1912] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:07 2022] DELETE /identity/v3/projects/15476e1aff4949d392ef4f1cd6f43bbc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:08.334197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.334573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.334922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.362749 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:08.383452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:08.384831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.406785 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:08.434626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:08.435263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.435540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.435804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.437688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.516635 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 964/1913] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:08.517561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:08.522858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.536984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:08.538764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:08.550692 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 950/1914] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:08 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:08.551555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:08.556818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.570149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc218c-e308-46dd-a2f1-7275f661cb2d service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:08.578474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672a93-d197-477a-8f5b-a6b28fae3d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:08.579216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672a93-d197-477a-8f5b-a6b28fae3d38 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.579504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672a93-d197-477a-8f5b-a6b28fae3d38 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.579780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672a93-d197-477a-8f5b-a6b28fae3d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.592444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d672a93-d197-477a-8f5b-a6b28fae3d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:08.594199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d672a93-d197-477a-8f5b-a6b28fae3d38 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:08.606862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 951/1915] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:08.608490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785745e-3da0-4c28-91f0-270edc170b3b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.609213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785745e-3da0-4c28-91f0-270edc170b3b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.609499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785745e-3da0-4c28-91f0-270edc170b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.644366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb1d78-3270-4d9d-a0bc-eb6412a6b5ec None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:08.649351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:08.650054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.650568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.650900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] PATH_INFO: `/v3/users/72038a4480324c5795e55f10fb928b69` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.652305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72038a4480324c5795e55f10fb928b69)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:08.655946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:08.687270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2785745e-3da0-4c28-91f0-270edc170b3b None None] MFA Rules not processed for user `6f0a23308def48b3864933b57cd0108b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:08.688925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2785745e-3da0-4c28-91f0-270edc170b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:08.769133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72038a4480324c5795e55f10fb928b69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.785330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72038a4480324c5795e55f10fb928b69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.800217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72038a4480324c5795e55f10fb928b69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.801187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72038a4480324c5795e55f10fb928b69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.808380 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 952/1916] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:08.809674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785745e-3da0-4c28-91f0-270edc170b3b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:08.813806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72038a4480324c5795e55f10fb928b69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:08.825892 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 965/1917] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:08 2022] DELETE /identity/v3/users/72038a4480324c5795e55f10fb928b69 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:08.826158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785745e-3da0-4c28-91f0-270edc170b3b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:08.912260 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:08.933092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:08.934228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:08.934557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:08.935154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:08.937220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.038340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.040424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.051336 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 953/1918] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:08 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:09.076364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:09.079996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.103589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246e429-cf6c-4811-9908-dda3df6a23d3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:09.109815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:09.110586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.111506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.111895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.114488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.136866 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:09.243456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.245015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.261885 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 966/1919] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:09 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:09.314473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:09.338100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:09.339383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.339629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c776a-3050-4ea7-850d-0adf955f1fde service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:09.349094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:09.349738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.350010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.356648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.358625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.430839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad61e4-9d91-4dcd-a3f7-40008fdd291e service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:09.431981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.433950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.437947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:09.438889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.439165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.439498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] PATH_INFO: `/v3/projects/48cebb60caa745d5ad461530cc84ae5c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.440634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cebb60caa745d5ad461530cc84ae5c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.442627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.445071 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 954/1920] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:09 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:09.445814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:09.447137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.464209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b08b6c-f324-410c-9555-2891c452d9da service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:09.470207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:09.471435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.472064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.472523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] PATH_INFO: `/v3/users/3e42e5d5c3384acda7fb872e35a918e2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.474947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e42e5d5c3384acda7fb872e35a918e2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.477358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.515643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cebb60caa745d5ad461530cc84ae5c', 'request_id': 'req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.527492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cebb60caa745d5ad461530cc84ae5c', 'request_id': 'req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.536180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cebb60caa745d5ad461530cc84ae5c', 'request_id': 'req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.549384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e42e5d5c3384acda7fb872e35a918e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.562599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e42e5d5c3384acda7fb872e35a918e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.565491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] The token cache is being invalidate because project 48cebb60caa745d5ad461530cc84ae5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:09.566145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e42e5d5c3384acda7fb872e35a918e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.567635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.568344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70d754bb-4f04-4e4b-9b4f-0a68d8338c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.573728 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 967/1921] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:09 2022] DELETE /identity/v3/projects/48cebb60caa745d5ad461530cc84ae5c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:09.577186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e42e5d5c3384acda7fb872e35a918e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.577703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4cf38-b3d2-4238-a304-44040f75a09d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.578094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6671446f-defa-4473-9879-7b08aac27645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e42e5d5c3384acda7fb872e35a918e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:09.578299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4cf38-b3d2-4238-a304-44040f75a09d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.578713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4cf38-b3d2-4238-a304-44040f75a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.611846 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:09.622253 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 955/1922] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:09 2022] DELETE /identity/v3/users/3e42e5d5c3384acda7fb872e35a918e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:09.628736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.629150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.629502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.632374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-10d4cf38-b3d2-4238-a304-44040f75a09d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:09.634594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10d4cf38-b3d2-4238-a304-44040f75a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.657344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:09.660135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.707124 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:09.749525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 956/1923] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:09.752784 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 968/1924] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:09.760124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:09.760532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477414-dd3a-4f53-b7d6-c81dc84cd64f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.760858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477414-dd3a-4f53-b7d6-c81dc84cd64f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.761137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477414-dd3a-4f53-b7d6-c81dc84cd64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.762196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.807707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d8477414-dd3a-4f53-b7d6-c81dc84cd64f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:09.810566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d8477414-dd3a-4f53-b7d6-c81dc84cd64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:09.829235 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 969/1925] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:09.833593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477414-dd3a-4f53-b7d6-c81dc84cd64f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:09.855364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477414-dd3a-4f53-b7d6-c81dc84cd64f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:09.875718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:09.877011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.877490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.877960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.879893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:09.880427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.883459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.896870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98a155-0c0e-4196-984f-c49e30d7b219 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:09.911935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:09.912866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.913447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.913730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.921112 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 970/1926] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:07:09.928735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:09.949454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89a3a3-6d62-4eb0-bb15-304ea276b00b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:09.957735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.961149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.967636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:09.968344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:09.968629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:09.968924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:09.969743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:09.971717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:09.983823 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 957/1927] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:10.063432 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 971/1928] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:09 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:10.069568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.088400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340902-be68-4ac1-904f-cf1bae2347a4 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.220677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.221528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.221911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.223910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.224799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.228914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:10.260509 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 958/1929] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:10 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:10.266177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.282802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65a34-2b0c-416e-b8fd-38e3f282d35c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.296142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.296825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.297097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.297348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.298252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.299853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:10.316691 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 972/1930] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:10.320982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.332565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c2b91-422e-4e3e-a463-06f28559e542 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.338614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f9d6a-0b7c-44e2-9cbf-32d2c2fbb9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.338818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f9d6a-0b7c-44e2-9cbf-32d2c2fbb9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.339023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f9d6a-0b7c-44e2-9cbf-32d2c2fbb9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.339290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f9d6a-0b7c-44e2-9cbf-32d2c2fbb9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.340053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f9d6a-0b7c-44e2-9cbf-32d2c2fbb9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.341940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f9d6a-0b7c-44e2-9cbf-32d2c2fbb9f4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:10.354084 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 959/1931] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:10.359806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.373241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d433c-e19f-4f1c-b491-7f467beec545 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.378480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.379160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.379451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.379762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] PATH_INFO: `/v3/projects/b3f9c09d3ec344818b4af84732583f85/users/279eb7f7967f42dfa9675bc531931c8d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.396304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f9c09d3ec344818b4af84732583f85, user_id=279eb7f7967f42dfa9675bc531931c8d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.399495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:10.417851 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 973/1932] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:10 2022] PUT /identity/v3/projects/b3f9c09d3ec344818b4af84732583f85/users/279eb7f7967f42dfa9675bc531931c8d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:10.429379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.429651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.430314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.461616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] MFA Rules not processed for user `279eb7f7967f42dfa9675bc531931c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:10.462838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:10.476717 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:10.581466 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 960/1933] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:10.585603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.690143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.692014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:10.697577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c2b66-177f-47c1-9649-ae20348824f8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.704521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.707260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.707597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.707813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.708470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.711340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:10.714330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6d276-b69d-41f0-8176-754a960c0cb5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.719470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.720373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.720865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.721129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] PATH_INFO: `/v3/projects/3e1d812cc34240d8995ecd6dd936e3cb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.722290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1d812cc34240d8995ecd6dd936e3cb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.725020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:10.748822 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 974/1934] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:10 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:10.752308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.809423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1d812cc34240d8995ecd6dd936e3cb', 'request_id': 'req-d7e6ceb6-e4db-4218-b775-0342635dae79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:10.818918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1d812cc34240d8995ecd6dd936e3cb', 'request_id': 'req-d7e6ceb6-e4db-4218-b775-0342635dae79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:10.826258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1d812cc34240d8995ecd6dd936e3cb', 'request_id': 'req-d7e6ceb6-e4db-4218-b775-0342635dae79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:10.841706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] The token cache is being invalidate because project 3e1d812cc34240d8995ecd6dd936e3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:10.841999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:10.842742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:10.844803 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 961/1935] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:10 2022] DELETE /identity/v3/projects/3e1d812cc34240d8995ecd6dd936e3cb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:10.852850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:10.854645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:10.859324 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:10.878738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bffac3-1b79-4e2d-9c7d-c466ebfc5677 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.939239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6ceb6-e4db-4218-b775-0342635dae79 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:10.945235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.946186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.946467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.946789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] PATH_INFO: `/v3/users/7e6dcdc432d94f469d1d6d78495f8ca3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.947943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6dcdc432d94f469d1d6d78495f8ca3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.950123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:10.950379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:10.950876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:10.951265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:10.952590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:10.953470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:10.956505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:11.005902 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:11.012603 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 975/1936] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:10 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:11.016291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:11.025141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6dcdc432d94f469d1d6d78495f8ca3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.034329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:11.042323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6dcdc432d94f469d1d6d78495f8ca3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.043660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6dcdc432d94f469d1d6d78495f8ca3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.062810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a829038-fb5b-4129-a545-5edd9fcbaae5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:11.066743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6dcdc432d94f469d1d6d78495f8ca3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.067718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6dcdc432d94f469d1d6d78495f8ca3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.079948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:11.080932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.081208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.081476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.082124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:11.083793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:11.107926 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 976/1937] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:11.108570 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 962/1938] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:10 2022] DELETE /identity/v3/users/7e6dcdc432d94f469d1d6d78495f8ca3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:11.109233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:11.113266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:11.128319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f90d1-f0b9-454b-ad85-d4a2888431ca admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:11.217640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:11.218515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.218679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.219075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] PATH_INFO: `/v3/projects/ee1eea0eb92940c1b711ef679b3e1c11/users/8a85b9b86fc142b48871b17e0b7283da/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.248104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1eea0eb92940c1b711ef679b3e1c11, user_id=8a85b9b86fc142b48871b17e0b7283da, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:11.252585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:11.269340 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 977/1939] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:11 2022] PUT /identity/v3/projects/ee1eea0eb92940c1b711ef679b3e1c11/users/8a85b9b86fc142b48871b17e0b7283da/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:11.273488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:11.287687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965533-abd6-48e6-95db-2a7aa52e7bf8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:11.373534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b2ae-4b73-43ef-8e19-651d2b53daa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:11.374500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b2ae-4b73-43ef-8e19-651d2b53daa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.374955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b2ae-4b73-43ef-8e19-651d2b53daa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.375422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b2ae-4b73-43ef-8e19-651d2b53daa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.377093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b2ae-4b73-43ef-8e19-651d2b53daa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:11.380028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b2ae-4b73-43ef-8e19-651d2b53daa3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:11.406460 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 963/1940] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:11.407477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:11.445968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024d49-e44b-4fab-8c53-0ae960618a00 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:11.465557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:11.467381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.467628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.467864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] PATH_INFO: `/v3/projects/ee1eea0eb92940c1b711ef679b3e1c11/users/8a85b9b86fc142b48871b17e0b7283da/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.474658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1eea0eb92940c1b711ef679b3e1c11, user_id=8a85b9b86fc142b48871b17e0b7283da, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:11.485467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:11.522938 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 978/1941] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:11 2022] PUT /identity/v3/projects/ee1eea0eb92940c1b711ef679b3e1c11/users/8a85b9b86fc142b48871b17e0b7283da/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:11.527214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.528108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.528462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.587400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] MFA Rules not processed for user `8a85b9b86fc142b48871b17e0b7283da`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:11.589729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:11.607889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:11.609795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:11.704917 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:11.739715 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 964/1942] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:11.747566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddbe25-e04d-4416-baf3-34fa5fea8b63 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:11.751030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:11.752542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:11.760139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:11.764263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.765334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.765619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] PATH_INFO: `/v3/projects/f20051e18286402b8f75acb97060dd77` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.767136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20051e18286402b8f75acb97060dd77)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:11.769259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:11.815366 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:11.868490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20051e18286402b8f75acb97060dd77', 'request_id': 'req-fa28ffed-786a-4327-9174-1dc0c4c23f19'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.877824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20051e18286402b8f75acb97060dd77', 'request_id': 'req-fa28ffed-786a-4327-9174-1dc0c4c23f19'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.890844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20051e18286402b8f75acb97060dd77', 'request_id': 'req-fa28ffed-786a-4327-9174-1dc0c4c23f19'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.899678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8981d7-3bc4-412b-8ebc-2e2d78638dc2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:11.922446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] The token cache is being invalidate because project f20051e18286402b8f75acb97060dd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:11.922789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.934189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa28ffed-786a-4327-9174-1dc0c4c23f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:11.936065 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 979/1943] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:11 2022] DELETE /identity/v3/projects/f20051e18286402b8f75acb97060dd77 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:11.937167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269de68-eb1e-4cec-af9c-1731dd075bad None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.937446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269de68-eb1e-4cec-af9c-1731dd075bad None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.937722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269de68-eb1e-4cec-af9c-1731dd075bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.973051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0269de68-eb1e-4cec-af9c-1731dd075bad None None] MFA Rules not processed for user `52db969e85344bb6a40150cedc205df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:11.974556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0269de68-eb1e-4cec-af9c-1731dd075bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:12.010053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930f5df-e30b-4992-9e5d-32918410d21d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.010955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930f5df-e30b-4992-9e5d-32918410d21d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.011403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930f5df-e30b-4992-9e5d-32918410d21d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.011823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930f5df-e30b-4992-9e5d-32918410d21d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.013778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e930f5df-e30b-4992-9e5d-32918410d21d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:12.039120 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 980/1944] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:12.040749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf856-c2e6-448f-a414-87f23e6fda88 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.041066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf856-c2e6-448f-a414-87f23e6fda88 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.041334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf856-c2e6-448f-a414-87f23e6fda88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.073976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d70cf856-c2e6-448f-a414-87f23e6fda88 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:12.075387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d70cf856-c2e6-448f-a414-87f23e6fda88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:12.100867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930f5df-e30b-4992-9e5d-32918410d21d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.102905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930f5df-e30b-4992-9e5d-32918410d21d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.119774 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 965/1945] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:07:12.164332 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 981/1946] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:12.172749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026724-e1fa-4746-8e5d-4fda4852466f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.173112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026724-e1fa-4746-8e5d-4fda4852466f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.173411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026724-e1fa-4746-8e5d-4fda4852466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.207824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1e026724-e1fa-4746-8e5d-4fda4852466f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:12.209182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e026724-e1fa-4746-8e5d-4fda4852466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:12.218405 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 966/1947] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:12.223748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf856-c2e6-448f-a414-87f23e6fda88 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.237711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf856-c2e6-448f-a414-87f23e6fda88 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.243047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.243754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.244089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.244480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.245289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:12.245647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.247574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.272681 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 982/1948] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:12.273484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e026724-e1fa-4746-8e5d-4fda4852466f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.284397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e026724-e1fa-4746-8e5d-4fda4852466f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.303200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.303867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.304125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.304400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.306163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.308094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.354958 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 967/1949] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:12 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:12.359074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.371497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec7103-e8e5-44b4-bb3f-5e7f6200c511 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.378123 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:12.461650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.462712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.463051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.463391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.464081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.466102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.497606 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 983/1950] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:12 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:12.502743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.518557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb8f8-87fe-455a-a095-44804c822183 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.533774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.533774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.533774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.534161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.534576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.536217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.556585 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 968/1951] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:12.557717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.580716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03623-57ef-4373-b1d1-de6663ed4d0a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.586551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c49bc-297f-4b64-9148-9abec5d98455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.587284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c49bc-297f-4b64-9148-9abec5d98455 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.587631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c49bc-297f-4b64-9148-9abec5d98455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.588018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c49bc-297f-4b64-9148-9abec5d98455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.588943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c49bc-297f-4b64-9148-9abec5d98455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.590985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c49bc-297f-4b64-9148-9abec5d98455 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.610725 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 984/1952] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:07:12.611954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.622895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14fe8f-ce31-4281-ad0b-7f5c068604f3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.628639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa3e06-9b51-4e94-b367-5ad1c096d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.629408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa3e06-9b51-4e94-b367-5ad1c096d74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.629683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa3e06-9b51-4e94-b367-5ad1c096d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.629950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa3e06-9b51-4e94-b367-5ad1c096d74f admin admin] PATH_INFO: `/v3/projects/d60812eaf31d420eba0055dd7f7f340a/users/59a632e1f05948618a876398b898be16/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.653916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa3e06-9b51-4e94-b367-5ad1c096d74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60812eaf31d420eba0055dd7f7f340a, user_id=59a632e1f05948618a876398b898be16, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.657648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa3e06-9b51-4e94-b367-5ad1c096d74f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.694853 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 969/1953] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:12 2022] PUT /identity/v3/projects/d60812eaf31d420eba0055dd7f7f340a/users/59a632e1f05948618a876398b898be16/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:12.698888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d1d1-3370-41c7-b951-4005e3de2ec2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.700103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d1d1-3370-41c7-b951-4005e3de2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.700513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d1d1-3370-41c7-b951-4005e3de2ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.746804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de0e7-eac8-4b46-9885-3c57b6ddab0b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.747072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de0e7-eac8-4b46-9885-3c57b6ddab0b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.747338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de0e7-eac8-4b46-9885-3c57b6ddab0b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.748694 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 970/1954] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:07:12.759595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.759870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.760136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.760648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8581d1d1-3370-41c7-b951-4005e3de2ec2 None None] MFA Rules not processed for user `59a632e1f05948618a876398b898be16`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:12.762105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8581d1d1-3370-41c7-b951-4005e3de2ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:12.768822 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:12.793868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:12.795648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:12.888816 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 985/1955] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:12.894002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581d1d1-3370-41c7-b951-4005e3de2ec2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.909746 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 971/1956] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:12.921568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:12.924197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:12.936146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d506b-b51b-4bea-8f99-b7c814fab736 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.940633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.941290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.941595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.941872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.951349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.955914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:12.964829 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 972/1957] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:07:12.976847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581d1d1-3370-41c7-b951-4005e3de2ec2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:12.982298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:12.983047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:12.983498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:12.983765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:12.984594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:12.988270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.032349 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 986/1958] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:12 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:13.035838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.052329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66774ca-cefb-456b-a2ce-2c2e560b38da service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:13.144364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:13.145081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.145359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.145794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.146440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:13.148706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.190762 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 973/1959] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:13 2022] POST /identity/v3/users => generated 301 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:13.192133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.198679 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:13.218016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f25580-7ad4-4e9c-bc3a-c48c0056a431 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:13.231368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:13.232133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.232410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.232683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.233653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:13.236100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.258892 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 987/1960] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:13.260177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.280901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55c0d-547f-472f-b138-d3ef04931c6f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:13.286128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:13.286811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.287086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.287359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] PATH_INFO: `/v3/projects/8acac1573a90461983d1b43a75df07a6/users/8b6166b68a00448b80d2de29a28c8dc6/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.313794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acac1573a90461983d1b43a75df07a6, user_id=8b6166b68a00448b80d2de29a28c8dc6, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:13.316941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.341817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 974/1961] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:13 2022] PUT /identity/v3/projects/8acac1573a90461983d1b43a75df07a6/users/8b6166b68a00448b80d2de29a28c8dc6/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:13.346324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.359362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f38e5-5fcb-415d-9da0-3728356e3d3d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:13.500107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573df437-4d7b-4814-8233-e2aca6a5243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:13.501260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573df437-4d7b-4814-8233-e2aca6a5243a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.501782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573df437-4d7b-4814-8233-e2aca6a5243a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.502037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573df437-4d7b-4814-8233-e2aca6a5243a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.509341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573df437-4d7b-4814-8233-e2aca6a5243a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:13.513937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573df437-4d7b-4814-8233-e2aca6a5243a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.540721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.541574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 988/1962] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:07:13.559005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421739-456d-4080-b58f-cd12ef730984 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:13.566956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:13.567646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.567929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.568810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] PATH_INFO: `/v3/projects/8acac1573a90461983d1b43a75df07a6/users/8b6166b68a00448b80d2de29a28c8dc6/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.573583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acac1573a90461983d1b43a75df07a6, user_id=8b6166b68a00448b80d2de29a28c8dc6, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:13.576245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.606198 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 975/1963] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:13 2022] PUT /identity/v3/projects/8acac1573a90461983d1b43a75df07a6/users/8b6166b68a00448b80d2de29a28c8dc6/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:13.618713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.619341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.619880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.684636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] MFA Rules not processed for user `8b6166b68a00448b80d2de29a28c8dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:13.686887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:13.812228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.814204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:13.831611 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 989/1964] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:13.841027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.845583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:13.890841 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:13.917499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7578-b93c-476b-9a15-41e3cd492e40 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:13.922271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:13.923374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.923749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.924116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] PATH_INFO: `/v3/users/279eb7f7967f42dfa9675bc531931c8d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.925623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279eb7f7967f42dfa9675bc531931c8d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:13.928232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.996012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b464a0-65a5-471b-80f8-7b0194e01a76 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:14.002687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3503e6-a109-4304-84ce-0236ab768ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:14.003403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3503e6-a109-4304-84ce-0236ab768ccd service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.003675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3503e6-a109-4304-84ce-0236ab768ccd service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.003935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3503e6-a109-4304-84ce-0236ab768ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.014233 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:14.017742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279eb7f7967f42dfa9675bc531931c8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:14.030171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279eb7f7967f42dfa9675bc531931c8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:14.033224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279eb7f7967f42dfa9675bc531931c8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:14.053753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279eb7f7967f42dfa9675bc531931c8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:14.055205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fbadeea-a21d-407e-9cab-545e1e8c2af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279eb7f7967f42dfa9675bc531931c8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:14.083043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3503e6-a109-4304-84ce-0236ab768ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:14.085519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3503e6-a109-4304-84ce-0236ab768ccd service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:14.098146 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 990/1965] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:14.113103 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 976/1966] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:13 2022] DELETE /identity/v3/users/279eb7f7967f42dfa9675bc531931c8d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:14.116511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.117048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.117492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.145604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:14.147662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:14.156924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.157497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.157836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.197254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:14.198639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:14.278897 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 977/1967] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Aug 21 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:14.289992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:14.291932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:14.298007 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 991/1968] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:14.304617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449fda-f66b-48e9-8236-a755976015ee None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:14.309833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:14.310472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.310814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.314005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.321779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:14.323179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:14.335057 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 978/1969] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:14.335602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:14.337450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:14.351418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bfbeb-4747-43d5-aa71-0e9f2a453634 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:14.361150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:14.362187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.362709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.363194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.379705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:14.381344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:14.397681 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 992/1970] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:15.543562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:15.545658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:15.592430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e676-9831-4c32-a2b8-dadadf152132 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:15.601883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:15.602984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:15.603301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:15.603581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] PATH_INFO: `/v3/projects/b3f9c09d3ec344818b4af84732583f85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:15.617071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:15.620326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:15.629416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f9c09d3ec344818b4af84732583f85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:15.637483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:15.755689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f9c09d3ec344818b4af84732583f85', 'request_id': 'req-5dd28b2d-3679-4023-8193-00b9221fb12b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:15.767268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafa473-7481-49e8-adc5-aef478eaab53 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:15.771843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f9c09d3ec344818b4af84732583f85', 'request_id': 'req-5dd28b2d-3679-4023-8193-00b9221fb12b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:15.779852 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:15.785572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f9c09d3ec344818b4af84732583f85', 'request_id': 'req-5dd28b2d-3679-4023-8193-00b9221fb12b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:15.808496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] The token cache is being invalidate because project b3f9c09d3ec344818b4af84732583f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:15.808912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:15.809815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5dd28b2d-3679-4023-8193-00b9221fb12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:15.818318 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 979/1971] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:15 2022] DELETE /identity/v3/projects/b3f9c09d3ec344818b4af84732583f85 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:15.820146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce051-44f9-4616-b552-15f209aa3af0 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:15.820675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce051-44f9-4616-b552-15f209aa3af0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:15.821043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce051-44f9-4616-b552-15f209aa3af0 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:15.822855 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 980/1972] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:15.829124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce051-44f9-4616-b552-15f209aa3af0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:15.838878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b8ce051-44f9-4616-b552-15f209aa3af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:15.862234 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:15.927521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5463a-7413-494f-a4dc-d4d371a9a1da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:15.929670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5463a-7413-494f-a4dc-d4d371a9a1da service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:15.932555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5463a-7413-494f-a4dc-d4d371a9a1da service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:15.933084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5463a-7413-494f-a4dc-d4d371a9a1da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:15.938259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8dc5463a-7413-494f-a4dc-d4d371a9a1da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:15.939048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce051-44f9-4616-b552-15f209aa3af0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:15.945375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:15.945698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:15.945977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:15.946332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] PATH_INFO: `/v3/users/8a85b9b86fc142b48871b17e0b7283da` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:15.947970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a85b9b86fc142b48871b17e0b7283da)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:15.950879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:16.015609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a85b9b86fc142b48871b17e0b7283da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:16.027181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a85b9b86fc142b48871b17e0b7283da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:16.028576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a85b9b86fc142b48871b17e0b7283da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:16.040356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a85b9b86fc142b48871b17e0b7283da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:16.041890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a85b9b86fc142b48871b17e0b7283da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:16.049207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5463a-7413-494f-a4dc-d4d371a9a1da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:16.051970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5463a-7413-494f-a4dc-d4d371a9a1da service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:16.066640 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 993/1973] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:16.068164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:16.069163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:16.069466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:16.079319 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 981/1974] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:15 2022] DELETE /identity/v3/users/8a85b9b86fc142b48871b17e0b7283da => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:16.110852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:16.112529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:16.224810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 994/1975] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:07:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:16.645929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:16.648314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:16.673209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad67a14-7d91-4839-93ea-f61c4befc761 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:16.679396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9082ce-3523-4ebb-b674-8c8235c34faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:16.680312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9082ce-3523-4ebb-b674-8c8235c34faf service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:16.680737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9082ce-3523-4ebb-b674-8c8235c34faf service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:16.681211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9082ce-3523-4ebb-b674-8c8235c34faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:16.691929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9082ce-3523-4ebb-b674-8c8235c34faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:16.693768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9082ce-3523-4ebb-b674-8c8235c34faf service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:16.711157 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 982/1976] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:16.886093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:16.887889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:17.030696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f330146-298f-462e-af8e-a1b895fd110e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:17.040396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:17.040955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.041226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.041494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] PATH_INFO: `/v3/projects/ee1eea0eb92940c1b711ef679b3e1c11` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.043232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1eea0eb92940c1b711ef679b3e1c11)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:17.045554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:17.047812 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:17.104533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1eea0eb92940c1b711ef679b3e1c11', 'request_id': 'req-537039a8-5e85-48ad-a77b-0e8afcdca8f9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:17.112221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1eea0eb92940c1b711ef679b3e1c11', 'request_id': 'req-537039a8-5e85-48ad-a77b-0e8afcdca8f9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:17.121057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1eea0eb92940c1b711ef679b3e1c11', 'request_id': 'req-537039a8-5e85-48ad-a77b-0e8afcdca8f9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:17.163106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] The token cache is being invalidate because project ee1eea0eb92940c1b711ef679b3e1c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:17.163548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:17.164352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-537039a8-5e85-48ad-a77b-0e8afcdca8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:17.168823 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 995/1977] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:16 2022] DELETE /identity/v3/projects/ee1eea0eb92940c1b711ef679b3e1c11 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:17.171581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c8585-e863-4453-9ee3-44446eb0c806 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.172713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c8585-e863-4453-9ee3-44446eb0c806 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.173240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c8585-e863-4453-9ee3-44446eb0c806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.221555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-436c8585-e863-4453-9ee3-44446eb0c806 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:17.222810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-436c8585-e863-4453-9ee3-44446eb0c806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:17.320740 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:17.341718 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 983/1978] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:17.349639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f89b-0c75-4a97-b29c-06b4654a58b2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.349923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f89b-0c75-4a97-b29c-06b4654a58b2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.350195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f89b-0c75-4a97-b29c-06b4654a58b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.378110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fed4f89b-0c75-4a97-b29c-06b4654a58b2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:17.379413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fed4f89b-0c75-4a97-b29c-06b4654a58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:17.388819 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 996/1979] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:17.393747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c8585-e863-4453-9ee3-44446eb0c806 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:17.405000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c8585-e863-4453-9ee3-44446eb0c806 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:17.409831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:17.410451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.410725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.411634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.411896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:17.412299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:17.414170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:17.428550 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 984/1980] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:07:17.432809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f89b-0c75-4a97-b29c-06b4654a58b2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:17.445365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f89b-0c75-4a97-b29c-06b4654a58b2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:17.451665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:17.452374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.452653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.453264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.454650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:17.456988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:17.495419 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 997/1981] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:17 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:17.496686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:17.508895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac97c8-3b17-4967-8ef3-d1d3eb15d728 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:17.598342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:17.599164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.600216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.600216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.600385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:17.603877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:17.637984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 985/1982] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:17 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:17.638591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:17.650483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cac22-46dc-4c59-90c9-2cd0d55ba139 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:17.660731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:17.661488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.661851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.662311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.663642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:17.666116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:17.681553 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 998/1983] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:17.687827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:17.711620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a3f90-ad9c-408a-b58b-1adfa1eb1705 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:17.719019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5cc3c-8f3d-4baa-a8e6-2c5a390e8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:17.719698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cc3c-8f3d-4baa-a8e6-2c5a390e8a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.720020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cc3c-8f3d-4baa-a8e6-2c5a390e8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.720287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cc3c-8f3d-4baa-a8e6-2c5a390e8a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.721155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5cc3c-8f3d-4baa-a8e6-2c5a390e8a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:17.722958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5cc3c-8f3d-4baa-a8e6-2c5a390e8a8c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:17.737823 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 986/1984] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:17.742138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:17.759372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726adead-5d30-4c8c-90c6-00e37ddf474b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:17.764620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:17.765428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.765784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.766238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] PATH_INFO: `/v3/projects/69f296e8c10e44e1a08ac7524a4c4bfc/users/a6034a5b15ab4978ab1c5f49ef69bc06/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.794730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f296e8c10e44e1a08ac7524a4c4bfc, user_id=a6034a5b15ab4978ab1c5f49ef69bc06, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:17.797717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:17.820353 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 999/1985] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:17 2022] PUT /identity/v3/projects/69f296e8c10e44e1a08ac7524a4c4bfc/users/a6034a5b15ab4978ab1c5f49ef69bc06/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:17.832228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84cdba-7e61-4eb4-ae11-8cf7bb743abd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:17.832516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84cdba-7e61-4eb4-ae11-8cf7bb743abd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:17.832814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84cdba-7e61-4eb4-ae11-8cf7bb743abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:17.871849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ac84cdba-7e61-4eb4-ae11-8cf7bb743abd None None] MFA Rules not processed for user `a6034a5b15ab4978ab1c5f49ef69bc06`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:17.873934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac84cdba-7e61-4eb4-ae11-8cf7bb743abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:17.984361 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 987/1986] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:17.986170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:18.081546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b603e8-2bcc-4434-a0c2-664f2f3ff957 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:18.088635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:18.089476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.089756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.090025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.090680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:18.092607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:18.129619 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1000/1987] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:17 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:18.133449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84cdba-7e61-4eb4-ae11-8cf7bb743abd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:18.156338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84cdba-7e61-4eb4-ae11-8cf7bb743abd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:18.234900 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:18.249469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:18.250070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.250408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.250716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.251577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:18.253763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:18.284640 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 988/1988] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:18 2022] POST /identity/v3/users => generated 303 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:18.286574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:18.305013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0ac5-343b-4e98-b08f-b14c37ecf18a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:18.313306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:18.314855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.315281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.315563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.316228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:18.318403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:18.325601 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:18.343074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1001/1989] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:18.343486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:18.352464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a62e9-fa7b-487e-81cb-9cccd2fea921 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:18.359344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:18.361048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.361048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.362046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] PATH_INFO: `/v3/projects/458a0cd42acd407b894161e5bfc57e36/users/75bd7943214d41b2a31c42084d0b3237/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.396538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458a0cd42acd407b894161e5bfc57e36, user_id=75bd7943214d41b2a31c42084d0b3237, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:18.399237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:18.429396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 989/1990] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:18 2022] PUT /identity/v3/projects/458a0cd42acd407b894161e5bfc57e36/users/75bd7943214d41b2a31c42084d0b3237/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:18.430846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:18.441720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8bdb5-8ca0-4495-9f4d-bbe75de710cc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:18.511333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb63e26-945c-4f3c-bf09-2288a072a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:18.511987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63e26-945c-4f3c-bf09-2288a072a35d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.512264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63e26-945c-4f3c-bf09-2288a072a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.512582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63e26-945c-4f3c-bf09-2288a072a35d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.513214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb63e26-945c-4f3c-bf09-2288a072a35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:18.514811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb63e26-945c-4f3c-bf09-2288a072a35d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:18.530032 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1002/1991] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:18.531248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:18.551505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb959d-5689-446f-af04-7ce1cf4e6156 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:18.557599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:18.558280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.558549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.558819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] PATH_INFO: `/v3/projects/458a0cd42acd407b894161e5bfc57e36/users/75bd7943214d41b2a31c42084d0b3237/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.560739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=458a0cd42acd407b894161e5bfc57e36, user_id=75bd7943214d41b2a31c42084d0b3237, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:18.563773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:18.584801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 990/1992] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:18 2022] PUT /identity/v3/projects/458a0cd42acd407b894161e5bfc57e36/users/75bd7943214d41b2a31c42084d0b3237/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:18.593893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c477a-bf8e-47b2-b49a-73c0db8191cc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.594217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c477a-bf8e-47b2-b49a-73c0db8191cc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.594522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c477a-bf8e-47b2-b49a-73c0db8191cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.627066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-611c477a-bf8e-47b2-b49a-73c0db8191cc None None] MFA Rules not processed for user `75bd7943214d41b2a31c42084d0b3237`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:18.628842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-611c477a-bf8e-47b2-b49a-73c0db8191cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:18.710690 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1003/1993] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:18.930723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:18.934384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:19.027517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299eae-7c1f-43b5-b0d4-109dc37c0f0b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:19.033706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a5d7-8fb6-45b0-9d04-a1f129f2c455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:19.034511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a5d7-8fb6-45b0-9d04-a1f129f2c455 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:19.034847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a5d7-8fb6-45b0-9d04-a1f129f2c455 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:19.035173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a5d7-8fb6-45b0-9d04-a1f129f2c455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:19.043943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a5d7-8fb6-45b0-9d04-a1f129f2c455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:19.045584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a5d7-8fb6-45b0-9d04-a1f129f2c455 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:19.055953 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 991/1994] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:19.087336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e28711-64e3-47e9-bcfc-4723e3152308 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:19.087824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e28711-64e3-47e9-bcfc-4723e3152308 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:19.087915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e28711-64e3-47e9-bcfc-4723e3152308 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:19.089255 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1004/1995] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:19.094646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdc4b-8f9a-46d4-bf74-b4576a24e0b6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:19.094997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdc4b-8f9a-46d4-bf74-b4576a24e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:19.095293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdc4b-8f9a-46d4-bf74-b4576a24e0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:19.119364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-56abdc4b-8f9a-46d4-bf74-b4576a24e0b6 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:19.120576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56abdc4b-8f9a-46d4-bf74-b4576a24e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:19.188807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 992/1996] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:19.214351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e28711-64e3-47e9-bcfc-4723e3152308 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:19.216320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f9e28711-64e3-47e9-bcfc-4723e3152308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:19.239925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e28711-64e3-47e9-bcfc-4723e3152308 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:19.245594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08c97-c4ef-40bb-a638-1d9d43722dbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:19.246208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08c97-c4ef-40bb-a638-1d9d43722dbf service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:19.246481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08c97-c4ef-40bb-a638-1d9d43722dbf service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:19.246749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08c97-c4ef-40bb-a638-1d9d43722dbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:19.255683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08c97-c4ef-40bb-a638-1d9d43722dbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:19.257325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08c97-c4ef-40bb-a638-1d9d43722dbf service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:19.269093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1005/1997] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:19.835001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdc4b-8f9a-46d4-bf74-b4576a24e0b6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:19.916590 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:19.994221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdc4b-8f9a-46d4-bf74-b4576a24e0b6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:19.999802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:20.000818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:20.001037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:20.001253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] PATH_INFO: `/v3/users/a6034a5b15ab4978ab1c5f49ef69bc06` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:20.002511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6034a5b15ab4978ab1c5f49ef69bc06)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:20.004437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:20.082436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6034a5b15ab4978ab1c5f49ef69bc06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.092692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6034a5b15ab4978ab1c5f49ef69bc06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.094475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6034a5b15ab4978ab1c5f49ef69bc06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.109906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6034a5b15ab4978ab1c5f49ef69bc06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.110941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6034a5b15ab4978ab1c5f49ef69bc06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.160454 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 993/1998] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:19 2022] DELETE /identity/v3/users/a6034a5b15ab4978ab1c5f49ef69bc06 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:20.162169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:20.162620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:20.162705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:20.189610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:20.190851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:20.261084 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1006/1999] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:20.275307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:20.283844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:20.357274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540b1a1-f222-4a55-bcd4-887e08a289d2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:20.361739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:20.362363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:20.362640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:20.362912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:20.373145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:20.374591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:20.385191 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 994/2000] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:07:20.549843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:20.551769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:20.577380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931bd9-a724-4e35-a9ba-9c63e3a6103e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:20.619384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:20.623932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:20.625610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:20.627260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] PATH_INFO: `/v3/users/59a632e1f05948618a876398b898be16` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:20.631003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a632e1f05948618a876398b898be16)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:20.633383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:20.637110 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:20.645442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:20.647233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:20.678981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4824c52-5a0a-4f6c-90a7-47ff3857fd16 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:20.686465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:20.687294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:20.688135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:20.688488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] PATH_INFO: `/v3/users/ac4d7fcf06e646e48e9d615a5098e1c1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:20.689902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4d7fcf06e646e48e9d615a5098e1c1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:20.692281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:20.742384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a632e1f05948618a876398b898be16'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.757920 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:20.758724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a632e1f05948618a876398b898be16'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.764612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4d7fcf06e646e48e9d615a5098e1c1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.774902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4d7fcf06e646e48e9d615a5098e1c1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.775306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a632e1f05948618a876398b898be16'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.777284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a632e1f05948618a876398b898be16'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.782152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4d7fcf06e646e48e9d615a5098e1c1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.791569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59cc2d27-be01-47be-83de-64ae4554ee52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a632e1f05948618a876398b898be16'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.795341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4d7fcf06e646e48e9d615a5098e1c1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.796063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c56a021-7ae2-49a0-a31e-a5e753fcb0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4d7fcf06e646e48e9d615a5098e1c1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:20.800190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1007/2001] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:20 2022] DELETE /identity/v3/users/59a632e1f05948618a876398b898be16 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:20.804747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:20.805298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:20.805770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:20.837298 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 995/2002] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:20 2022] DELETE /identity/v3/users/ac4d7fcf06e646e48e9d615a5098e1c1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:20.839370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:20.840057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:20.840344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:20.840615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:20.841018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:20.877257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:20.878534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:20.977808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1008/2003] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:20.990460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:20.992368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.000323 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 996/2004] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:21.008779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:21.015409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.089790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c5fdc-936e-40a0-83ac-27c48e600677 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.093728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.094392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.094780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.095105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.113489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.115247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.128909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1009/2005] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:21.130643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:21.132348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.147418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37bf65-b958-4465-9304-47c6ddde2217 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.160396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8e5ff-7326-4b47-9fef-3f8ec8f9c89d service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.162748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.163401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.163674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.163939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.177318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.179312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.180057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.180336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] PATH_INFO: `/v3/projects/69f296e8c10e44e1a08ac7524a4c4bfc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.181875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f296e8c10e44e1a08ac7524a4c4bfc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.186602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.188589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.190260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.209623 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 997/2006] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:21.239044 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:21.284198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f296e8c10e44e1a08ac7524a4c4bfc', 'request_id': 'req-bd715ee9-e199-4778-bf1a-1da7f8242c60'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.302898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f296e8c10e44e1a08ac7524a4c4bfc', 'request_id': 'req-bd715ee9-e199-4778-bf1a-1da7f8242c60'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.310535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:21.312177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.315106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f296e8c10e44e1a08ac7524a4c4bfc', 'request_id': 'req-bd715ee9-e199-4778-bf1a-1da7f8242c60'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.341834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] The token cache is being invalidate because project 69f296e8c10e44e1a08ac7524a4c4bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:21.343407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.346365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.350344 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1010/2007] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:21 2022] DELETE /identity/v3/projects/69f296e8c10e44e1a08ac7524a4c4bfc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:21.354455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:21.357323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.428962 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:21.468626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2776f-5b35-49ca-8d29-b4551a8f3c6f service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.509410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd715ee9-e199-4778-bf1a-1da7f8242c60 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.515196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.515983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.516264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.517180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] PATH_INFO: `/v3/users/75bd7943214d41b2a31c42084d0b3237` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.518307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bd7943214d41b2a31c42084d0b3237)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.533998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.610994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.611626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.611913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.612178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.614109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.621336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bd7943214d41b2a31c42084d0b3237'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.632278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bd7943214d41b2a31c42084d0b3237'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.651674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bd7943214d41b2a31c42084d0b3237'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.652464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bd7943214d41b2a31c42084d0b3237'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.660522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bd7943214d41b2a31c42084d0b3237'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.671242 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1011/2008] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:21 2022] DELETE /identity/v3/users/75bd7943214d41b2a31c42084d0b3237 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:21.671242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:21.671757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.707706 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:21.720254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.724689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.742055 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 998/2009] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:21.742986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:21.746950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.763856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95ffeb-92b7-4287-a492-8506bd6a097a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.774355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.775672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.776217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.776557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] PATH_INFO: `/v3/projects/d60812eaf31d420eba0055dd7f7f340a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.778065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60812eaf31d420eba0055dd7f7f340a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.780484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.783741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1928a-6bcd-43f6-a922-9e0b7e787327 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.790302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.792195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.792630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.793095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] PATH_INFO: `/v3/projects/d0add9174f0a4d94af45b509a5258ed5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.796220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0add9174f0a4d94af45b509a5258ed5)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.800676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.894219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60812eaf31d420eba0055dd7f7f340a', 'request_id': 'req-3743a059-674e-4cbd-ac87-c7a706bf9242'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.924417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0add9174f0a4d94af45b509a5258ed5', 'request_id': 'req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.930490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60812eaf31d420eba0055dd7f7f340a', 'request_id': 'req-3743a059-674e-4cbd-ac87-c7a706bf9242'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.948230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0add9174f0a4d94af45b509a5258ed5', 'request_id': 'req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.950519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60812eaf31d420eba0055dd7f7f340a', 'request_id': 'req-3743a059-674e-4cbd-ac87-c7a706bf9242'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.965897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0add9174f0a4d94af45b509a5258ed5', 'request_id': 'req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.992903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] The token cache is being invalidate because project d60812eaf31d420eba0055dd7f7f340a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:21.993149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.993800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:21.995891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1012/2010] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:21 2022] DELETE /identity/v3/projects/d60812eaf31d420eba0055dd7f7f340a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:22.007247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:22.007898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:22.024427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] The token cache is being invalidate because project d0add9174f0a4d94af45b509a5258ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:22.024932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.025848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.031253 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 999/2011] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:21 2022] DELETE /identity/v3/projects/d0add9174f0a4d94af45b509a5258ed5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:22.032939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:22.035419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:22.072596 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:22.173769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743a059-674e-4cbd-ac87-c7a706bf9242 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:22.217319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef31ad-2fb1-4f88-b4a6-9d1c3faaece0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:22.227773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:22.228789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:22.229197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:22.229569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] PATH_INFO: `/v3/users/e4c44b6830de460a944c2faffc2daefa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:22.231141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c44b6830de460a944c2faffc2daefa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:22.236384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:22.309775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:22.311365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:22.314506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:22.315101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] PATH_INFO: `/v3/users/8b6166b68a00448b80d2de29a28c8dc6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:22.318349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6166b68a00448b80d2de29a28c8dc6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:22.332797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:22.342294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c44b6830de460a944c2faffc2daefa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.349884 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:22.369049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c44b6830de460a944c2faffc2daefa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.370107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c44b6830de460a944c2faffc2daefa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.381341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c44b6830de460a944c2faffc2daefa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.382146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c44b6830de460a944c2faffc2daefa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.408617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1000/2012] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:22 2022] DELETE /identity/v3/users/e4c44b6830de460a944c2faffc2daefa => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:22.408617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:22.429430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:22.453828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6166b68a00448b80d2de29a28c8dc6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.479797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6166b68a00448b80d2de29a28c8dc6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.502317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6166b68a00448b80d2de29a28c8dc6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.503753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6166b68a00448b80d2de29a28c8dc6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.513040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6166b68a00448b80d2de29a28c8dc6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.523741 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1013/2013] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:21 2022] DELETE /identity/v3/users/8b6166b68a00448b80d2de29a28c8dc6 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:22.526533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:22.533255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:22.615862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5fa81-57a1-47ff-863b-76ab0b6042c0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:22.701689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6e77-cfb7-4347-81d8-c69e2c93b21a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:22.709665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:22.710364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:22.710788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:22.711182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] PATH_INFO: `/v3/users/f83dfdbfecd9420dbc75d1d1dfcb59f8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:22.712926 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:22.713264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83dfdbfecd9420dbc75d1d1dfcb59f8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:22.715691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:22.743771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:22.744431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:22.744716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:22.745047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] PATH_INFO: `/v3/projects/458a0cd42acd407b894161e5bfc57e36` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:22.747163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=458a0cd42acd407b894161e5bfc57e36)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:22.749633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:22.867730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83dfdbfecd9420dbc75d1d1dfcb59f8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.886726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458a0cd42acd407b894161e5bfc57e36', 'request_id': 'req-b53c5482-df84-4027-979d-05caf288f73a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.898538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458a0cd42acd407b894161e5bfc57e36', 'request_id': 'req-b53c5482-df84-4027-979d-05caf288f73a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.905856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83dfdbfecd9420dbc75d1d1dfcb59f8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.908591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458a0cd42acd407b894161e5bfc57e36', 'request_id': 'req-b53c5482-df84-4027-979d-05caf288f73a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.928615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] The token cache is being invalidate because project 458a0cd42acd407b894161e5bfc57e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:22.929227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.932078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.940735 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1001/2014] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:22 2022] DELETE /identity/v3/projects/458a0cd42acd407b894161e5bfc57e36 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:22.942065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:22.944303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83dfdbfecd9420dbc75d1d1dfcb59f8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.947655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83dfdbfecd9420dbc75d1d1dfcb59f8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.950251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:22.968071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83dfdbfecd9420dbc75d1d1dfcb59f8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:22.987475 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1014/2015] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:22 2022] DELETE /identity/v3/users/f83dfdbfecd9420dbc75d1d1dfcb59f8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:22.988309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:22.991504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.003580 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:23.062045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c5482-df84-4027-979d-05caf288f73a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.138928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0592a-60d6-4d76-a03c-1345021a2676 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.151166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.152799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.153413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.154650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] PATH_INFO: `/v3/projects/8acac1573a90461983d1b43a75df07a6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.155324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acac1573a90461983d1b43a75df07a6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.157894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.161421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.162180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.162548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.163255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] PATH_INFO: `/v3/users/8ed40211c03744929209e6d4f029bb44` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.164707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed40211c03744929209e6d4f029bb44)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.167850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.204150 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:23.241011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed40211c03744929209e6d4f029bb44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.245597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acac1573a90461983d1b43a75df07a6', 'request_id': 'req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.250778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed40211c03744929209e6d4f029bb44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.253264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed40211c03744929209e6d4f029bb44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.253775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acac1573a90461983d1b43a75df07a6', 'request_id': 'req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.260429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acac1573a90461983d1b43a75df07a6', 'request_id': 'req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.262103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed40211c03744929209e6d4f029bb44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.262820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-700dacc6-7594-45c5-b121-9ba9fc8927f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed40211c03744929209e6d4f029bb44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.278417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] The token cache is being invalidate because project 8acac1573a90461983d1b43a75df07a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:23.279035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.280140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-89acb5c9-4dbf-4e0d-887a-74ec82ba8cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.282286 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1015/2016] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:22 2022] DELETE /identity/v3/projects/8acac1573a90461983d1b43a75df07a6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:23.287093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1002/2017] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:22 2022] DELETE /identity/v3/users/8ed40211c03744929209e6d4f029bb44 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:23.288214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.292488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.293721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b60ca-a1b0-49c5-b426-f4d09cbcafa4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.293959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b60ca-a1b0-49c5-b426-f4d09cbcafa4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.294272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b60ca-a1b0-49c5-b426-f4d09cbcafa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.297095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.327934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.327934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.344901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-949b60ca-a1b0-49c5-b426-f4d09cbcafa4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.346292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-949b60ca-a1b0-49c5-b426-f4d09cbcafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.404239 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1003/2018] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.408319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.409821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.428930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f061e-dff6-42da-9774-3e7d10176469 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.435374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.436128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.436474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.436840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] PATH_INFO: `/v3/projects/671fb99e61c841dca797cb670c12d178` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.438132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=671fb99e61c841dca797cb670c12d178)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.440574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.447534 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1016/2019] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.449133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.449692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.450492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.477310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.478595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.498370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671fb99e61c841dca797cb670c12d178', 'request_id': 'req-497b5652-97e3-40b4-9195-e9e6c32e0c7a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.507509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671fb99e61c841dca797cb670c12d178', 'request_id': 'req-497b5652-97e3-40b4-9195-e9e6c32e0c7a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.520098 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:23.531771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671fb99e61c841dca797cb670c12d178', 'request_id': 'req-497b5652-97e3-40b4-9195-e9e6c32e0c7a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.537561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] The token cache is being invalidate because project 671fb99e61c841dca797cb670c12d178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:23.537859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.538920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-497b5652-97e3-40b4-9195-e9e6c32e0c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.540928 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1004/2020] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:23 2022] DELETE /identity/v3/projects/671fb99e61c841dca797cb670c12d178 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:23.546422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7517-a27b-42bf-90aa-f8b1b1334a3f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.546697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7517-a27b-42bf-90aa-f8b1b1334a3f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.546963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7517-a27b-42bf-90aa-f8b1b1334a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.559775 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1017/2021] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.560749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.564437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.572651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e94d7517-a27b-42bf-90aa-f8b1b1334a3f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.573506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e94d7517-a27b-42bf-90aa-f8b1b1334a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.582706 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1005/2022] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.583927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33997f55-8663-4cb1-88b8-c97ead8a6c6b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.584211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33997f55-8663-4cb1-88b8-c97ead8a6c6b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.584483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33997f55-8663-4cb1-88b8-c97ead8a6c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.610201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-33997f55-8663-4cb1-88b8-c97ead8a6c6b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.610201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33997f55-8663-4cb1-88b8-c97ead8a6c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.622128 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1006/2023] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.626342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c37c5-159a-4cfa-b61a-63ee3354ed80 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.626734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c37c5-159a-4cfa-b61a-63ee3354ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.627631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c37c5-159a-4cfa-b61a-63ee3354ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.642560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb020694-a601-46a7-abf4-c4a0b805a132 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.646637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.648654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.648654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.648654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.654515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-524c37c5-159a-4cfa-b61a-63ee3354ed80 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.654515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-524c37c5-159a-4cfa-b61a-63ee3354ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.655846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.662080 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1007/2024] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.662080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e02350-e020-417f-b110-5d281db4ddbb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.662080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e02350-e020-417f-b110-5d281db4ddbb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.662080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e02350-e020-417f-b110-5d281db4ddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.673794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.675353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.690389 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:23.695057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-99e02350-e020-417f-b110-5d281db4ddbb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.695372 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1018/2025] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:23.696998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-99e02350-e020-417f-b110-5d281db4ddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.697815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.706007 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1008/2026] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.709462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1357d1-4eff-49bd-bcdc-ebe2eb3b2805 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.710539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e02350-e020-417f-b110-5d281db4ddbb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.713882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025065-00de-484e-89d9-ab8ee7c1633f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.714509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025065-00de-484e-89d9-ab8ee7c1633f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.714787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025065-00de-484e-89d9-ab8ee7c1633f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.715061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025065-00de-484e-89d9-ab8ee7c1633f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.720737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e02350-e020-417f-b110-5d281db4ddbb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.727409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.727997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.729386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025065-00de-484e-89d9-ab8ee7c1633f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.730474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025065-00de-484e-89d9-ab8ee7c1633f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.733038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.733834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.734550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:23.735084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.737574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.742507 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1019/2027] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:23.743854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2860e4-460a-4706-8f0d-f092547ec730 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.744115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2860e4-460a-4706-8f0d-f092547ec730 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.744393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2860e4-460a-4706-8f0d-f092547ec730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.756945 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1009/2028] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:23.758184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.759932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.783073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-af2860e4-460a-4706-8f0d-f092547ec730 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:23.784575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-af2860e4-460a-4706-8f0d-f092547ec730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.784686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a55b12-4994-4be7-84d2-b65b37cb5e54 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.789933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.790688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.790985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.791252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] PATH_INFO: `/v3/users/907073f9a3fa44869bced2e46ed909fb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.792817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] RBAC: Authorizing `identity:delete_user(user_id=907073f9a3fa44869bced2e46ed909fb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.795118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.799420 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1020/2029] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:23.799420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2860e4-460a-4706-8f0d-f092547ec730 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.816555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2860e4-460a-4706-8f0d-f092547ec730 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.829079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.830086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.830604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.830729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.831362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:23.831841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.834022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.854924 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1021/2030] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:23.855576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.866792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbba3da-2084-4fba-9e3e-44a65707a191 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:23.872469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907073f9a3fa44869bced2e46ed909fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.872617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:23.873406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:23.873406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:23.873656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:23.874435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:23.878254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:23.886215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907073f9a3fa44869bced2e46ed909fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.886918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907073f9a3fa44869bced2e46ed909fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.903235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907073f9a3fa44869bced2e46ed909fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.904234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907073f9a3fa44869bced2e46ed909fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:23.925162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1022/2031] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:23.927173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.932534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:23.940687 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1010/2032] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:23 2022] DELETE /identity/v3/users/907073f9a3fa44869bced2e46ed909fb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:23.941737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:23.945472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.011475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456caf24-84ca-4782-aa83-3b4327b9c98d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.018009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.018009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.018009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.018009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.018456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:24.018793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.020654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.022907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947075-0eac-4ec9-a22f-f641de43305c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.028913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.029530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.029806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.030078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.030714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.033247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.038167 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1023/2033] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:24.038167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.038167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.050072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d421e-f345-4fbf-8d8b-fdb883152171 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.058985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.061646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.062098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.062511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] PATH_INFO: `/v3/projects/7969fbfe11204268ba47c497448be0dc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.066529 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1011/2034] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:23 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:24.066999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7969fbfe11204268ba47c497448be0dc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.067092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.067092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.067271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.080951 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.128280 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.132649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7969fbfe11204268ba47c497448be0dc', 'request_id': 'req-262453ec-ca51-478c-b6cc-07606f5518df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.148340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7969fbfe11204268ba47c497448be0dc', 'request_id': 'req-262453ec-ca51-478c-b6cc-07606f5518df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.151213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c0b9c-c0ed-4bb3-a290-8dc13e2e2324 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.155830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7969fbfe11204268ba47c497448be0dc', 'request_id': 'req-262453ec-ca51-478c-b6cc-07606f5518df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.175605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] The token cache is being invalidate because project 7969fbfe11204268ba47c497448be0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:24.176042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.176869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262453ec-ca51-478c-b6cc-07606f5518df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.182858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1024/2035] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:24 2022] DELETE /identity/v3/projects/7969fbfe11204268ba47c497448be0dc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:24.182858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.182858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.182858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.203040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:24.209011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.260433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.261096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.261378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.261650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.262286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.264463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.293983 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1025/2037] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:24.293983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.294451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1012/2037] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:24 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:24.294749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.295493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.297859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.309472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e21135-ee03-457c-948b-eeabe936bd4b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.313463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40595ec-bfaa-479e-9a90-d2124bac8c7b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.316020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.316653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.317062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.317343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.318272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.320433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.323409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.324894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.324894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.325106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.325865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.327689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.362675 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1013/2038] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:24 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:24.363727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.366056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.382219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2fa30-cc4a-4c5d-8751-0b281ec7cccb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.386562 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1026/2039] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:24 2022] POST /identity/v3/projects => generated 409 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:24.386562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.389587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.452257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.452257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.452511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.452807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] PATH_INFO: `/v3/projects/80fa6743ec83465ea48c22c0d8ce07f7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.454315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fa6743ec83465ea48c22c0d8ce07f7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.457810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.466667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d141-62e5-4d3a-8976-a233885b4b6e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.471763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.472405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.472724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.473050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] PATH_INFO: `/v3/users/5f0e210ad13e4a8988a425d272f3f6b8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.474180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0e210ad13e4a8988a425d272f3f6b8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.476078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.500905 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.512481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fa6743ec83465ea48c22c0d8ce07f7', 'request_id': 'req-09c53605-1a21-4019-b1e8-d6b1f7112102'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.523073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fa6743ec83465ea48c22c0d8ce07f7', 'request_id': 'req-09c53605-1a21-4019-b1e8-d6b1f7112102'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.529454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fa6743ec83465ea48c22c0d8ce07f7', 'request_id': 'req-09c53605-1a21-4019-b1e8-d6b1f7112102'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.530561 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.535677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0e210ad13e4a8988a425d272f3f6b8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.547580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] The token cache is being invalidate because project 80fa6743ec83465ea48c22c0d8ce07f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:24.547874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.548813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0e210ad13e4a8988a425d272f3f6b8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.550283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.555538 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1014/2040] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:24 2022] DELETE /identity/v3/projects/80fa6743ec83465ea48c22c0d8ce07f7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:24.555538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.557246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.567073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0e210ad13e4a8988a425d272f3f6b8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.567776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0e210ad13e4a8988a425d272f3f6b8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.575208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0e210ad13e4a8988a425d272f3f6b8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.582373 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1027/2041] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:24 2022] DELETE /identity/v3/users/5f0e210ad13e4a8988a425d272f3f6b8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:24.583113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.584473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.651903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53605-1a21-4019-b1e8-d6b1f7112102 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.663060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121d81a-9bd3-4f8e-8ba5-573adcc7f6a2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.666800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.667411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.667685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.667951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.669901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.732030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.732832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.733639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.734004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.734845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.736761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.751348 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1015/2042] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:24.752575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.754919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.755997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.756405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.769997 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1028/2043] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:24.770704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.772123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294886-d44a-4141-a884-597dcb0ed4d3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.772470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.777255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.777978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.778348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.778707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.779516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.781231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.785619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eda77-a10d-4dc2-b6cb-54fecf40ee57 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.791582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.796261 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1016/2044] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:24.796524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.796524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.796524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.796755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.796862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.796862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.797709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.811646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73720d0f-7973-47f6-b26f-f075038c8ada admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.818945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.818945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.818945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.819283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] PATH_INFO: `/v3/users/54743c1f0b7146999d405b79dbb584b1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.820474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54743c1f0b7146999d405b79dbb584b1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.822585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.828502 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1029/2045] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:24 2022] POST /identity/v3/users => generated 305 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:24.830498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.832292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.845455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e770-dd74-4c7f-8849-2a02f5ddf874 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.850286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.850904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.851792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.852112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.852739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.854385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.866456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1030/2046] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:24.867904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.880573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bd00-1ac1-4345-906d-2d608f8f1ce0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.885860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.886430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.886791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.887135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.888222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.890159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.902788 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1031/2047] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:24.903741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.914355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74dad-d616-4a2d-aee2-33f38b51de5d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:24.918794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54743c1f0b7146999d405b79dbb584b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.919894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:24.920723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:24.921112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:24.921477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:24.922599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:24.924544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:24.926406 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.928592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54743c1f0b7146999d405b79dbb584b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.929472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54743c1f0b7146999d405b79dbb584b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.938274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54743c1f0b7146999d405b79dbb584b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.938982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54743c1f0b7146999d405b79dbb584b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:24.940899 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1032/2048] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:24.941856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.945599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.954587 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.963061 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1017/2049] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:24 2022] DELETE /identity/v3/users/54743c1f0b7146999d405b79dbb584b1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:24.967835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:24.970666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:24.980197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344c045-f4c1-477f-af1f-657b107340f2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.048384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b02b-fd10-4fde-ad2e-1e0181f7e136 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.054344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.054890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.055406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.055688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] PATH_INFO: `/v3/projects/7c9dc94c03e04a97bc67b4be79912d18/users/08b0e93dc59a4024b6ff32c7f9f24b81/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.065880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.066563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.066923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.067243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] PATH_INFO: `/v3/projects/ba8597f8fa994c60b4eb65f99799c313` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.068716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8597f8fa994c60b4eb65f99799c313)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.071121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.074563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9dc94c03e04a97bc67b4be79912d18, user_id=08b0e93dc59a4024b6ff32c7f9f24b81, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.079227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.114324 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1018/2050] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:24 2022] PUT /identity/v3/projects/7c9dc94c03e04a97bc67b4be79912d18/users/08b0e93dc59a4024b6ff32c7f9f24b81/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:25.115540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.118228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.150410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8597f8fa994c60b4eb65f99799c313', 'request_id': 'req-925e68ab-97a4-47ac-90eb-17600f59698b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.163688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8597f8fa994c60b4eb65f99799c313', 'request_id': 'req-925e68ab-97a4-47ac-90eb-17600f59698b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.175582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8597f8fa994c60b4eb65f99799c313', 'request_id': 'req-925e68ab-97a4-47ac-90eb-17600f59698b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.195454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] The token cache is being invalidate because project ba8597f8fa994c60b4eb65f99799c313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:25.196020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.196680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.199356 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1033/2051] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:24 2022] DELETE /identity/v3/projects/ba8597f8fa994c60b4eb65f99799c313 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:25.200197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.201542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.220810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b388990-1918-4aa3-8811-def674b0199a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.275548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e68ab-97a4-47ac-90eb-17600f59698b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.282189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ddb7f-34c0-48db-901f-791a76c934a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.282872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ddb7f-34c0-48db-901f-791a76c934a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.283153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ddb7f-34c0-48db-901f-791a76c934a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.283424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ddb7f-34c0-48db-901f-791a76c934a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.284075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ddb7f-34c0-48db-901f-791a76c934a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.285723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ddb7f-34c0-48db-901f-791a76c934a2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.295124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93ec9f-e30d-42cd-8450-2c5b4a0fbbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.296024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93ec9f-e30d-42cd-8450-2c5b4a0fbbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.296301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93ec9f-e30d-42cd-8450-2c5b4a0fbbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.296572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93ec9f-e30d-42cd-8450-2c5b4a0fbbf3 admin admin] PATH_INFO: `/v3/projects/ee9e0038aadf42e8be2911efd9bfb896/users/dd9f99d20b344589961aa679179adbb1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.297133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1034/2052] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:25.298735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.298960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.299227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.322585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:25.323407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93ec9f-e30d-42cd-8450-2c5b4a0fbbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9e0038aadf42e8be2911efd9bfb896, user_id=dd9f99d20b344589961aa679179adbb1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.324089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.326966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93ec9f-e30d-42cd-8450-2c5b4a0fbbf3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.333802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1035/2053] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:25.334751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.338053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.351610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021454c9-79cc-4297-8ec9-07bf29c550fc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.353962 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1019/2054] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:25 2022] PUT /identity/v3/projects/ee9e0038aadf42e8be2911efd9bfb896/users/dd9f99d20b344589961aa679179adbb1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:25.364873 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:25.366160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72bdf-b5a6-4939-a119-c86e35700ea0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.366506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72bdf-b5a6-4939-a119-c86e35700ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.366749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72bdf-b5a6-4939-a119-c86e35700ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.389527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-def72bdf-b5a6-4939-a119-c86e35700ea0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:25.390884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-def72bdf-b5a6-4939-a119-c86e35700ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.397761 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:25.419980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.420618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.420926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.422253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] PATH_INFO: `/v3/projects/34bacf2fc234419fa36f2f38a3208acf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.423237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bacf2fc234419fa36f2f38a3208acf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.425883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.469821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1020/2055] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:25.470868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72bdf-b5a6-4939-a119-c86e35700ea0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.481053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72bdf-b5a6-4939-a119-c86e35700ea0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.488154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bacf2fc234419fa36f2f38a3208acf', 'request_id': 'req-32255098-3fd7-4852-a023-cae33dca65db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.495370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bacf2fc234419fa36f2f38a3208acf', 'request_id': 'req-32255098-3fd7-4852-a023-cae33dca65db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.501911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bacf2fc234419fa36f2f38a3208acf', 'request_id': 'req-32255098-3fd7-4852-a023-cae33dca65db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.530211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] The token cache is being invalidate because project 34bacf2fc234419fa36f2f38a3208acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:25.530556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.531225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.533397 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1036/2056] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:25 2022] DELETE /identity/v3/projects/34bacf2fc234419fa36f2f38a3208acf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:25.533950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.535262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.553602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.554296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.554641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.554976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] PATH_INFO: `/v3/projects/546bf89d982a47ab86c0cb0088e86d61/users/cc05807e58484524907c3641929b0e12/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.570695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546bf89d982a47ab86c0cb0088e86d61, user_id=cc05807e58484524907c3641929b0e12, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.573509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.587682 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1021/2057] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:25 2022] PUT /identity/v3/projects/546bf89d982a47ab86c0cb0088e86d61/users/cc05807e58484524907c3641929b0e12/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:25.593641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.595395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.610595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255098-3fd7-4852-a023-cae33dca65db admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.668758 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:25.670670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548c9a8-3eb0-4545-8406-a3db8b91d794 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.675946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481e2ba-51c7-4d99-a0a9-67e66455f56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.680691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481e2ba-51c7-4d99-a0a9-67e66455f56d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.680691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481e2ba-51c7-4d99-a0a9-67e66455f56d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.680691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481e2ba-51c7-4d99-a0a9-67e66455f56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.681045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.681045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.681045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.681450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3481e2ba-51c7-4d99-a0a9-67e66455f56d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.681570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] PATH_INFO: `/v3/projects/51d7159686d44d0cb556570431c8c70c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.682372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d7159686d44d0cb556570431c8c70c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.684517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.693333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481e2ba-51c7-4d99-a0a9-67e66455f56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.694770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481e2ba-51c7-4d99-a0a9-67e66455f56d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.705426 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1022/2058] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:25.710406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.710406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.710406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.750087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] MFA Rules not processed for user `dd9f99d20b344589961aa679179adbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:25.751414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.808374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d7159686d44d0cb556570431c8c70c', 'request_id': 'req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.810718 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:25.819677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d7159686d44d0cb556570431c8c70c', 'request_id': 'req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.832093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d7159686d44d0cb556570431c8c70c', 'request_id': 'req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.850090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] The token cache is being invalidate because project 51d7159686d44d0cb556570431c8c70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:25.850351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.850936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae5a6970-6b42-46ca-bf6f-b4f5434ba7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:25.853768 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1037/2059] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:25 2022] DELETE /identity/v3/projects/51d7159686d44d0cb556570431c8c70c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:25.854725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b937d-45f9-41d5-ad79-928a17c1bd55 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.855007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b937d-45f9-41d5-ad79-928a17c1bd55 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.855267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b937d-45f9-41d5-ad79-928a17c1bd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.860470 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1023/2060] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:25.861360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.862760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.877074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0e075-136e-410d-a01c-1af4274c1444 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.877345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5e2b937d-45f9-41d5-ad79-928a17c1bd55 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:25.878818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5e2b937d-45f9-41d5-ad79-928a17c1bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.946825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.947626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.948018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.948381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] PATH_INFO: `/v3/users/9b87749d407d4ddc92ad45d7bd34ed1d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.951991 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1038/2061] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:25.952149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b87749d407d4ddc92ad45d7bd34ed1d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.952260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.952260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.952260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.952517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.980492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] MFA Rules not processed for user `cc05807e58484524907c3641929b0e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:25.981801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:26.011689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b87749d407d4ddc92ad45d7bd34ed1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.022015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b87749d407d4ddc92ad45d7bd34ed1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.022870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b87749d407d4ddc92ad45d7bd34ed1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.031923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b87749d407d4ddc92ad45d7bd34ed1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.032678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0dc24d0-67bb-465c-baa1-a4aa8837cf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b87749d407d4ddc92ad45d7bd34ed1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.058810 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1024/2062] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:25 2022] DELETE /identity/v3/users/9b87749d407d4ddc92ad45d7bd34ed1d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:26.058810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.058810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.058810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.080146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:26.081658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:26.088619 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1039/2063] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:26.089734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.091529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:26.110230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1abad8-6d35-4bfd-ac9f-6822dcd4667a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.120630 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:26.156630 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:26.188391 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1025/2064] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:26.189865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.197885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:26.216620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.217525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.217917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.218181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.218847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.221023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.229157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9371b4-3bc4-4450-ba52-9fb8b40b2c54 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.241450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6b689-29fc-4dda-8093-5051c7eb259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.242470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6b689-29fc-4dda-8093-5051c7eb259d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.244119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6b689-29fc-4dda-8093-5051c7eb259d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.245227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6b689-29fc-4dda-8093-5051c7eb259d admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.246361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6b689-29fc-4dda-8093-5051c7eb259d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:26.246738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6b689-29fc-4dda-8093-5051c7eb259d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.248473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6b689-29fc-4dda-8093-5051c7eb259d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.260295 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1040/2065] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:26.261755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.265817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1026/2066] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:26.267480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c6db1-17bc-40d5-9468-4e9b7be7202f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.267764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c6db1-17bc-40d5-9468-4e9b7be7202f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.268037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c6db1-17bc-40d5-9468-4e9b7be7202f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.270686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:26.294164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d46c6db1-17bc-40d5-9468-4e9b7be7202f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:26.300118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d46c6db1-17bc-40d5-9468-4e9b7be7202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:26.391522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1027/2067] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:26.395910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c6db1-17bc-40d5-9468-4e9b7be7202f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.411136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c6db1-17bc-40d5-9468-4e9b7be7202f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.416809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.418193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.418545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.418882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.421214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.425221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcef7b-5df2-41d8-8448-29ad48ec0a49 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.425718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.438683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.439711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.439993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.440265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.440937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.443366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.477661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1028/2068] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/users => generated 303 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:26.478762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.500340 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1041/2069] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/projects => generated 409 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:26.501597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.503453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043fb47-22ff-42b2-ad33-b4d58f97f337 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.626767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.627396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.627702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.627946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.628760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.631067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.671308 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1029/2070] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:26.671308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.674668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec80600-06c2-471b-bdfa-1edadc508687 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.733476 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:26.737235 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:26.769421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401d9c6-9f20-4896-a546-f734f14d5e4f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.777477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.779241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.780735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.781053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.782480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.784315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.789698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.790789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.791752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.792088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.792858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:26.793228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.795104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.802717 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1030/2071] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:26.803997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.815173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1042/2072] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:26.816105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.818537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:26.819148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0f1c0-4333-4a14-b84f-26372b7c92b5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.826330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.827017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.827299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.828183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.829990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.832349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.838588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736b3e-12dc-4227-87a2-73597f4f0913 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.843426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:26.844118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:26.844400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:26.844670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] PATH_INFO: `/v3/projects/7826447993f745a192767a8f573df304` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:26.845829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7826447993f745a192767a8f573df304)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:26.847723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:26.885129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1031/2073] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/users => generated 311 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:26.885913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.899793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58cc52-7f02-46f1-909b-faa6b794e27e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:26.916673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7826447993f745a192767a8f573df304', 'request_id': 'req-90354d97-e9c7-4e17-a122-72c3a5440189'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.925337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7826447993f745a192767a8f573df304', 'request_id': 'req-90354d97-e9c7-4e17-a122-72c3a5440189'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.937930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7826447993f745a192767a8f573df304', 'request_id': 'req-90354d97-e9c7-4e17-a122-72c3a5440189'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.958496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] The token cache is being invalidate because project 7826447993f745a192767a8f573df304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:26.958803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.959757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:26.963290 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1043/2074] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:26 2022] DELETE /identity/v3/projects/7826447993f745a192767a8f573df304 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:26.964455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:26.967240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.002787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.003638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.003933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.004252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.005070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.007224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.047238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1032/2075] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:26 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:27.048292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.051192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.084580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167920b-4846-46b2-af56-66bf78c0ffc6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.099843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.102294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.103324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.103605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.104487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.106907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.176308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90354d97-e9c7-4e17-a122-72c3a5440189 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.188556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1033/2076] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:27 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:27.188556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.190446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5dd56-b8ec-4954-b1a0-dd4078b31a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.190991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.192555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5dd56-b8ec-4954-b1a0-dd4078b31a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.193063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5dd56-b8ec-4954-b1a0-dd4078b31a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.193970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5dd56-b8ec-4954-b1a0-dd4078b31a32 admin admin] PATH_INFO: `/v3/projects/10f23780bf3c4f72ac6dddf6159f3cde/users/cb645a105adb4bb2b6796f92156ba299/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.214346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5dd56-b8ec-4954-b1a0-dd4078b31a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f23780bf3c4f72ac6dddf6159f3cde, user_id=cb645a105adb4bb2b6796f92156ba299, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.217190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5dd56-b8ec-4954-b1a0-dd4078b31a32 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.245545 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1044/2077] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:26 2022] PUT /identity/v3/projects/10f23780bf3c4f72ac6dddf6159f3cde/users/cb645a105adb4bb2b6796f92156ba299/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:27.247472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.248096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.248567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.276888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:27.279728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.316067 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:27.342945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ec9f-a897-4e94-ac5d-6e7617e10480 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.367303 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1045/2078] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:27.375485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.375485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.387675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c57d3-3dc6-4d01-962e-6e836aa9e37e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.390599 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:27.394513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.395757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.396265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.396877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.397800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.400371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.413542 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1046/2079] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:27.415086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.427809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.428443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.428799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.429988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.431908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.433560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.440439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0a87-8493-41e1-b047-7fa2588b5805 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.446861 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1034/2080] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:27.447001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.447538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.447995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.448339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.448680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.449459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.451719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.473436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0044ea-fb4a-4e6a-a545-ede41501618a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.480096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ba9be-37f5-4ef6-8b83-317b68ec07ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.481023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba9be-37f5-4ef6-8b83-317b68ec07ad admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.481477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba9be-37f5-4ef6-8b83-317b68ec07ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.481969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba9be-37f5-4ef6-8b83-317b68ec07ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.482874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ba9be-37f5-4ef6-8b83-317b68ec07ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.485542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ba9be-37f5-4ef6-8b83-317b68ec07ad admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.488527 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1047/2081] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:27 2022] POST /identity/v3/users => generated 294 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:27.489453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.496678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.504085 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1035/2082] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:27.506091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b1b3c-a949-4a22-841a-38f3241a4652 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.506462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b1b3c-a949-4a22-841a-38f3241a4652 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.507092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b1b3c-a949-4a22-841a-38f3241a4652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.531312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2e1b1b3c-a949-4a22-841a-38f3241a4652 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:27.532826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e1b1b3c-a949-4a22-841a-38f3241a4652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.542581 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1036/2083] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:27.543658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b1b3c-a949-4a22-841a-38f3241a4652 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.558298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b1b3c-a949-4a22-841a-38f3241a4652 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.566052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.567350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.567831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.568253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.569009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.571742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.583619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1037/2084] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:27.584740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.597032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e581d-668f-4f46-928e-10fe50d722ef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.602284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.603085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.603653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.603653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] PATH_INFO: `/v3/projects/31f6466c5f544de08b54adf5dc999fda/users/aee9627e48c74ff28d7de1eef3d0684f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.617548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99314a77-eac9-410e-aea1-f494edcff107 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.622506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f6466c5f544de08b54adf5dc999fda, user_id=aee9627e48c74ff28d7de1eef3d0684f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.626052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.632477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.633831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.634172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.635167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.638520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.646655 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1038/2085] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:27 2022] PUT /identity/v3/projects/31f6466c5f544de08b54adf5dc999fda/users/aee9627e48c74ff28d7de1eef3d0684f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:27.647987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.736615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e03db-0e78-46f4-9a1e-a414e77fda2b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.738599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.740456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.751430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.753643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.754155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.754895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1048/2086] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:27.756472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.768152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.769367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.770136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04002ef4-cc17-492a-b120-544605cc27c8 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.772301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.776994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.777689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.778143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.778429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] PATH_INFO: `/v3/projects/10f23780bf3c4f72ac6dddf6159f3cde/users/cb645a105adb4bb2b6796f92156ba299/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.780803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f23780bf3c4f72ac6dddf6159f3cde, user_id=cb645a105adb4bb2b6796f92156ba299, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.784561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.798721 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1049/2087] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:27 2022] PUT /identity/v3/projects/10f23780bf3c4f72ac6dddf6159f3cde/users/cb645a105adb4bb2b6796f92156ba299/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:27.800243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.801606 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1039/2088] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:27.803425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.839019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc59655-110c-4660-a5c8-8e4d25d971bf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.862432 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:27.923493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609fe8-eb72-4fe2-ab94-2a92029f807d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:27.930384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.931112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.931436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.931750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] PATH_INFO: `/v3/projects/22000e002f6b48659361dc5826d7a02b/users/d82a7f3def694ba7a8cf265a74fd44f2/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.946632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:27.949800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.950136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.950415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.951125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:27.951407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.953448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=22000e002f6b48659361dc5826d7a02b, user_id=d82a7f3def694ba7a8cf265a74fd44f2, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:27.957538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.967352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:27.971186 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:27.989895 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1040/2089] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:27 2022] PUT /identity/v3/projects/22000e002f6b48659361dc5826d7a02b/users/d82a7f3def694ba7a8cf265a74fd44f2/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:27.991266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:27.994918 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1050/2090] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:27.995937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.015324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ddb8b-ea59-4460-8475-7cba92093736 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.075012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2dfe3-0dd3-4921-bbc4-9c8d07dc1bcb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.082913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5678973-2fd7-46f1-b471-e7dd58192907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.083467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5678973-2fd7-46f1-b471-e7dd58192907 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.083745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5678973-2fd7-46f1-b471-e7dd58192907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.084168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5678973-2fd7-46f1-b471-e7dd58192907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.085180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5678973-2fd7-46f1-b471-e7dd58192907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.087062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5678973-2fd7-46f1-b471-e7dd58192907 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.092280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c225589-8c58-4e87-9f8c-281e139fb07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.097094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c225589-8c58-4e87-9f8c-281e139fb07d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.097910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c225589-8c58-4e87-9f8c-281e139fb07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.097910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c225589-8c58-4e87-9f8c-281e139fb07d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.098202 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1041/2091] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:28.100064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a72d64-6b06-4374-83aa-3bcff55b99da None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.100422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a72d64-6b06-4374-83aa-3bcff55b99da None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.100870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a72d64-6b06-4374-83aa-3bcff55b99da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.101466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c225589-8c58-4e87-9f8c-281e139fb07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.103402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c225589-8c58-4e87-9f8c-281e139fb07d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.120256 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1051/2092] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:28.121724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a210-8d19-4616-8261-9474c93f575e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.121953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a210-8d19-4616-8261-9474c93f575e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.122210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a210-8d19-4616-8261-9474c93f575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.150606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8422a210-8d19-4616-8261-9474c93f575e None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:28.152139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8422a210-8d19-4616-8261-9474c93f575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.156496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-69a72d64-6b06-4374-83aa-3bcff55b99da None None] MFA Rules not processed for user `cb645a105adb4bb2b6796f92156ba299`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:28.158097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-69a72d64-6b06-4374-83aa-3bcff55b99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.235391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1052/2093] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:28.238460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71867cfd-5f81-478c-b4f1-d287a292328b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.238916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71867cfd-5f81-478c-b4f1-d287a292328b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.239356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71867cfd-5f81-478c-b4f1-d287a292328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.282130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-71867cfd-5f81-478c-b4f1-d287a292328b None None] MFA Rules not processed for user `d82a7f3def694ba7a8cf265a74fd44f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:28.285477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-71867cfd-5f81-478c-b4f1-d287a292328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.315221 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1042/2094] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:28.316369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a72d64-6b06-4374-83aa-3bcff55b99da None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.330608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a72d64-6b06-4374-83aa-3bcff55b99da None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.346263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.346918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.347227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.347570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.348218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.352089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.358788 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:28.394415 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1043/2095] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/projects => generated 391 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:28.395659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.412504 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1053/2096] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:28.413754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71867cfd-5f81-478c-b4f1-d287a292328b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.432199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71867cfd-5f81-478c-b4f1-d287a292328b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.475483 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:28.480998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e2c9f-ad5e-4e06-83e9-442e640c755b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.495706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.496713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.497222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.497664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] PATH_INFO: `/v3/projects/31f6466c5f544de08b54adf5dc999fda/users/aee9627e48c74ff28d7de1eef3d0684f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.500529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f6466c5f544de08b54adf5dc999fda, user_id=aee9627e48c74ff28d7de1eef3d0684f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.505686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.524954 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1044/2097] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:28 2022] PUT /identity/v3/projects/31f6466c5f544de08b54adf5dc999fda/users/aee9627e48c74ff28d7de1eef3d0684f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:28.524954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.529978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.530941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bfaf4-8561-49bc-a557-d6c571c45c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.532370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bfaf4-8561-49bc-a557-d6c571c45c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.532967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bfaf4-8561-49bc-a557-d6c571c45c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.533507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bfaf4-8561-49bc-a557-d6c571c45c3a admin admin] PATH_INFO: `/v3/projects/58c64f1c2dba41298be11cd0772e8792/users/49f609273d3d4d18a9ef755ed5359da9/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.564386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bfaf4-8561-49bc-a557-d6c571c45c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c64f1c2dba41298be11cd0772e8792, user_id=49f609273d3d4d18a9ef755ed5359da9, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.570096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bfaf4-8561-49bc-a557-d6c571c45c3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.600733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1054/2098] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:28 2022] PUT /identity/v3/projects/58c64f1c2dba41298be11cd0772e8792/users/49f609273d3d4d18a9ef755ed5359da9/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:28.611504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.612020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.612577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.617530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ffdb8-d7ab-4b3c-93b6-ebf89f16afb1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.667022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] MFA Rules not processed for user `dd9f99d20b344589961aa679179adbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:28.669888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.688449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.689279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.689552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.689850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.699201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.700857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.711291 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1045/2099] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:28.713028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.749031 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1055/2100] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:28.749031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.749031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.766767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92018c86-b7af-43d7-bbd8-0a16cc73a227 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.771480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6b00-ffeb-4f8c-9522-68a61edef1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.772103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6b00-ffeb-4f8c-9522-68a61edef1ba service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.772382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6b00-ffeb-4f8c-9522-68a61edef1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.772683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6b00-ffeb-4f8c-9522-68a61edef1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.895210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441b9d5-348e-4784-9ace-570ddf8e4cd4 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.898556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6b00-ffeb-4f8c-9522-68a61edef1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.901035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6b00-ffeb-4f8c-9522-68a61edef1ba service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.907400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b41c4-7177-497d-888c-bb5926a49726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.908043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b41c4-7177-497d-888c-bb5926a49726 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.908319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b41c4-7177-497d-888c-bb5926a49726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.908592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b41c4-7177-497d-888c-bb5926a49726 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.910527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b41c4-7177-497d-888c-bb5926a49726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.912474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b41c4-7177-497d-888c-bb5926a49726 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.924536 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1056/2101] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:28.925910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.926176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.926452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.960119 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1046/2102] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:28.966408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f144a-daaf-4388-8568-fb549a977640 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.966975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f144a-daaf-4388-8568-fb549a977640 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.967447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f144a-daaf-4388-8568-fb549a977640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.974143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] MFA Rules not processed for user `aee9627e48c74ff28d7de1eef3d0684f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:28.975561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.991565 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:29.022750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9e4f144a-daaf-4388-8568-fb549a977640 None None] MFA Rules not processed for user `49f609273d3d4d18a9ef755ed5359da9`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:29.024184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e4f144a-daaf-4388-8568-fb549a977640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:29.067665 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:29.132830 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1057/2103] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:29.132830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.138784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:29.151092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1047/2104] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:29.153507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f144a-daaf-4388-8568-fb549a977640 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.177693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f144a-daaf-4388-8568-fb549a977640 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.189432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.191221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.193621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.193992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.194813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.198533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.224809 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1048/2105] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:29.226321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.252889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f6c81-b9d9-4caa-a5d9-e1ab199972ce admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.281148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.281627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.282345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.282670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.283378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.285752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.345560 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1049/2106] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:29 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:29.346489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.355705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd4243-ce2f-4f23-97a0-9664e76b1b98 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.487486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd837cc1-4dbb-41d1-b316-d424cbb2f1f7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.493400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c0da6-6370-4c8b-aaaf-5ca0268af863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.494173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c0da6-6370-4c8b-aaaf-5ca0268af863 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.494467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c0da6-6370-4c8b-aaaf-5ca0268af863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.494739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c0da6-6370-4c8b-aaaf-5ca0268af863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.495558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c0da6-6370-4c8b-aaaf-5ca0268af863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.497737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c0da6-6370-4c8b-aaaf-5ca0268af863 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.520477 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1050/2107] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:29.522034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb01ca-e62e-4708-b144-bea30a167b87 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.522346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb01ca-e62e-4708-b144-bea30a167b87 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.522760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb01ca-e62e-4708-b144-bea30a167b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.530621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.532818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.533421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.533421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.543638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dbeb01ca-e62e-4708-b144-bea30a167b87 None None] MFA Rules not processed for user `22500a157cbb43eab8e92270d59a2f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:29.544929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dbeb01ca-e62e-4708-b144-bea30a167b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:29.548457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:29.637273 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:29.679669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.681279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.682731 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1051/2108] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:29.683657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb01ca-e62e-4708-b144-bea30a167b87 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.696974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1058/2109] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:29.697654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.710857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07538-141d-44ac-a92f-5a7359f52c66 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.715376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb01ca-e62e-4708-b144-bea30a167b87 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.718130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.718931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.719408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.720427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.726260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.726877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.727153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.729065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.729734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.731726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.806780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1052/2110] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:29 2022] POST /identity/v3/users => generated 301 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:29.811289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.838850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f1c2-6a79-47cd-a981-c186e31a4527 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.845666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.848066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.848066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.848066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] PATH_INFO: `/v3/users/d82a7f3def694ba7a8cf265a74fd44f2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.851047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82a7f3def694ba7a8cf265a74fd44f2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.853049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.866434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.868341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.888718 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:29.901575 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1059/2111] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:29.904043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:29.936006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea197d-d102-4eb5-bb8f-1c66b7286b60 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:29.943970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:29.944823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:29.945111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:29.945408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] PATH_INFO: `/v3/projects/859b3715a9b646fe82564fb3e0b19eae/users/cc2309d88f1f4761b32c65fb28780c71/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:29.959356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82a7f3def694ba7a8cf265a74fd44f2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:29.974049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82a7f3def694ba7a8cf265a74fd44f2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:29.974733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82a7f3def694ba7a8cf265a74fd44f2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:29.981706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859b3715a9b646fe82564fb3e0b19eae, user_id=cc2309d88f1f4761b32c65fb28780c71, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:29.989296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:29.995985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82a7f3def694ba7a8cf265a74fd44f2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:29.996986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2217c37f-fd7c-4f66-b377-c1ab6a389d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82a7f3def694ba7a8cf265a74fd44f2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:30.033418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1060/2112] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:29 2022] PUT /identity/v3/projects/859b3715a9b646fe82564fb3e0b19eae/users/cc2309d88f1f4761b32c65fb28780c71/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:30.033418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.036441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.038291 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1053/2113] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:29 2022] DELETE /identity/v3/users/d82a7f3def694ba7a8cf265a74fd44f2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:30.039713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae10e7f-f975-4502-9c5d-c610f019e1a6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.040222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae10e7f-f975-4502-9c5d-c610f019e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.046170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae10e7f-f975-4502-9c5d-c610f019e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.119371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3ae10e7f-f975-4502-9c5d-c610f019e1a6 None None] MFA Rules not processed for user `cc2309d88f1f4761b32c65fb28780c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:30.125841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3ae10e7f-f975-4502-9c5d-c610f019e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.253572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dcddf-0c34-4b0e-b9d4-0e1e305bf4b9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:30.256617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1054/2114] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:30.258290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.258719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.259904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.296721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:30.298434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.390195 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1055/2115] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:30.390195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.390195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.404363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603d01-206e-4de2-9f04-f6289d77f722 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:30.409436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:30.410356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.410761 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:30.418917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.423746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.425727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:30.427798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:30.428575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.428977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.429403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.430254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:30.432979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:30.434767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:30.464824 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1061/2116] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:30.466057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.468628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.489157 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:30.508069 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1056/2117] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:30 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:30.509263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.569252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c548ee-dfba-4231-a06f-f4bb667afbb1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:30.659826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:30.660599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.660996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.661455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.683525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:30.689187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:30.694223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad6e8-afe2-4796-bd0a-c10f6d8f25eb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:30.710239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:30.712523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.712872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.714015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] PATH_INFO: `/v3/projects/f1938b6301cd4787b78f35925d0290e0/users/94440802e03e4106877aedf6dd94d388/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.724458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1062/2118] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:30.725629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.760341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5c5f3-ab20-496c-95cd-7f87e87b8443 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:30.766866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1938b6301cd4787b78f35925d0290e0, user_id=94440802e03e4106877aedf6dd94d388, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:30.778097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:30.779011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:30.779772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.782368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.782727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.783430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:30.786609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:30.812580 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1057/2119] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:30 2022] PUT /identity/v3/projects/f1938b6301cd4787b78f35925d0290e0/users/94440802e03e4106877aedf6dd94d388/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:30.812580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.834662 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1063/2120] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:30 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:30.837930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.841606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.983049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c4cb-0a72-4553-b152-e790c863d3d9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:30.997592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:30.998521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.998937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.999524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.001136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:31.003648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:31.019121 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1058/2121] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:31.020268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:31.035772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3136-b4a7-4413-9819-920ec349128f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:31.057744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:31.060628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.061039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.061817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.065725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:31.068078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cfc4-2e90-490b-9253-2b215b0edd54 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:31.068203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:31.090217 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1059/2122] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:31.091273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:31.108024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ad0f4-8f96-4ffd-8b0a-10a1c0c078ca admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:31.116288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:31.129869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.132157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.132466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] PATH_INFO: `/v3/projects/f1938b6301cd4787b78f35925d0290e0/users/94440802e03e4106877aedf6dd94d388/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.142498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1938b6301cd4787b78f35925d0290e0, user_id=94440802e03e4106877aedf6dd94d388, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:31.146419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:31.147383 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:31.187728 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1060/2123] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:31 2022] PUT /identity/v3/projects/f1938b6301cd4787b78f35925d0290e0/users/94440802e03e4106877aedf6dd94d388/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:31.189843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:31.236241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb497-7250-4a9a-9d30-b770a8160c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:31.236806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb497-7250-4a9a-9d30-b770a8160c08 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.237096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb497-7250-4a9a-9d30-b770a8160c08 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.237361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb497-7250-4a9a-9d30-b770a8160c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.243281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bc9eb497-7250-4a9a-9d30-b770a8160c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:31.333931 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:31.354225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e827514-a4e7-49aa-90fe-a2e8c0d86e88 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:31.363083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:31.364126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.365210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.365966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] PATH_INFO: `/v3/projects/2fe55756b0114abe9de310dcc790d66c/users/baaee7e28d1d43cd9bf86ee58fc24334/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.402570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb497-7250-4a9a-9d30-b770a8160c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:31.404456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe55756b0114abe9de310dcc790d66c, user_id=baaee7e28d1d43cd9bf86ee58fc24334, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:31.406560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb497-7250-4a9a-9d30-b770a8160c08 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:31.409549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:31.431543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1064/2124] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:31.438191 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1061/2125] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:31 2022] PUT /identity/v3/projects/2fe55756b0114abe9de310dcc790d66c/users/baaee7e28d1d43cd9bf86ee58fc24334/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:31.438472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c708ff-a2d0-4bb8-9b37-751a62befb25 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.438472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c708ff-a2d0-4bb8-9b37-751a62befb25 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.438472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c708ff-a2d0-4bb8-9b37-751a62befb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.438674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:31.441799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:31.513991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-07c708ff-a2d0-4bb8-9b37-751a62befb25 None None] MFA Rules not processed for user `94440802e03e4106877aedf6dd94d388`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:31.515230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07c708ff-a2d0-4bb8-9b37-751a62befb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:31.607195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23c9f2-38b3-4780-80bd-d75da29a77cd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:31.619083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:31.620260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.620260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.620260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] PATH_INFO: `/v3/projects/22000e002f6b48659361dc5826d7a02b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.621427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22000e002f6b48659361dc5826d7a02b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:31.624443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:31.693588 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1065/2126] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:31.694465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c708ff-a2d0-4bb8-9b37-751a62befb25 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:31.713326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c708ff-a2d0-4bb8-9b37-751a62befb25 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:31.721419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717f85f-d269-4755-9433-82d5a8406520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:31.722300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717f85f-d269-4755-9433-82d5a8406520 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.722733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717f85f-d269-4755-9433-82d5a8406520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.723017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717f85f-d269-4755-9433-82d5a8406520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.723852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717f85f-d269-4755-9433-82d5a8406520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:31.741349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717f85f-d269-4755-9433-82d5a8406520 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:31.769122 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1066/2127] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:31.769122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312462e-944b-4eef-9937-aef59991f507 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:31.769122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312462e-944b-4eef-9937-aef59991f507 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:31.769122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312462e-944b-4eef-9937-aef59991f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:31.802583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22000e002f6b48659361dc5826d7a02b', 'request_id': 'req-05119298-7fe1-4aa7-b5f5-d77e31243dc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:31.815740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2312462e-944b-4eef-9937-aef59991f507 None None] MFA Rules not processed for user `49f609273d3d4d18a9ef755ed5359da9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:31.815857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22000e002f6b48659361dc5826d7a02b', 'request_id': 'req-05119298-7fe1-4aa7-b5f5-d77e31243dc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:31.817107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2312462e-944b-4eef-9937-aef59991f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:31.854627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22000e002f6b48659361dc5826d7a02b', 'request_id': 'req-05119298-7fe1-4aa7-b5f5-d77e31243dc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:31.900158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] The token cache is being invalidate because project 22000e002f6b48659361dc5826d7a02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:31.901191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:31.902181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:31.911921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1062/2128] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:31 2022] DELETE /identity/v3/projects/22000e002f6b48659361dc5826d7a02b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:31.913023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:31.914998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:32.000205 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:32.077164 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1067/2129] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:32.078458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312462e-944b-4eef-9937-aef59991f507 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:32.080336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2312462e-944b-4eef-9937-aef59991f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:32.091459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119298-7fe1-4aa7-b5f5-d77e31243dc6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:32.103714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312462e-944b-4eef-9937-aef59991f507 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:32.116087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:32.116882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:32.120091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:32.121317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] PATH_INFO: `/v3/users/cc05807e58484524907c3641929b0e12` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:32.122128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a3652-70f0-4845-8731-5ca685e78d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:32.125185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc05807e58484524907c3641929b0e12)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:32.133370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:32.133741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a3652-70f0-4845-8731-5ca685e78d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:32.135098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a3652-70f0-4845-8731-5ca685e78d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:32.135098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a3652-70f0-4845-8731-5ca685e78d6b admin admin] PATH_INFO: `/v3/projects/2fe55756b0114abe9de310dcc790d66c/users/baaee7e28d1d43cd9bf86ee58fc24334/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:32.155162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a3652-70f0-4845-8731-5ca685e78d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe55756b0114abe9de310dcc790d66c, user_id=baaee7e28d1d43cd9bf86ee58fc24334, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:32.166947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a3652-70f0-4845-8731-5ca685e78d6b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:32.196734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1063/2130] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:31 2022] PUT /identity/v3/projects/2fe55756b0114abe9de310dcc790d66c/users/baaee7e28d1d43cd9bf86ee58fc24334/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:32.197550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6411-913f-4a79-9bd5-bdf5415569f8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:32.200292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6411-913f-4a79-9bd5-bdf5415569f8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:32.200595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6411-913f-4a79-9bd5-bdf5415569f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:32.222078 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:32.276780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc05807e58484524907c3641929b0e12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:32.282236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-561b6411-913f-4a79-9bd5-bdf5415569f8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:32.283502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-561b6411-913f-4a79-9bd5-bdf5415569f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:32.312197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc05807e58484524907c3641929b0e12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:32.332600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc05807e58484524907c3641929b0e12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:32.333493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc05807e58484524907c3641929b0e12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:32.353549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc05807e58484524907c3641929b0e12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:32.370753 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1068/2131] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:32 2022] DELETE /identity/v3/users/cc05807e58484524907c3641929b0e12 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:32.371029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:32.373907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:32.410542 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1064/2132] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:32.411939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436d211-da53-43b2-a136-5e1db0603037 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:32.412304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436d211-da53-43b2-a136-5e1db0603037 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:32.412651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436d211-da53-43b2-a136-5e1db0603037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:32.496760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a436d211-da53-43b2-a136-5e1db0603037 None None] MFA Rules not processed for user `baaee7e28d1d43cd9bf86ee58fc24334`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:32.498075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a436d211-da53-43b2-a136-5e1db0603037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:32.615756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633d8b-cc4d-4a33-a434-6db52934597e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:32.647640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf71aa-10c3-4197-a338-2c152d8293c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:32.648792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf71aa-10c3-4197-a338-2c152d8293c2 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:32.649250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf71aa-10c3-4197-a338-2c152d8293c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:32.649537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf71aa-10c3-4197-a338-2c152d8293c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:32.658219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cecf71aa-10c3-4197-a338-2c152d8293c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:32.768087 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1065/2133] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:32.773185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97483-7654-42ae-8d39-50c5561de2f3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:32.773477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97483-7654-42ae-8d39-50c5561de2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:32.773751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97483-7654-42ae-8d39-50c5561de2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:32.813223 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:32.826737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf71aa-10c3-4197-a338-2c152d8293c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:32.828463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf71aa-10c3-4197-a338-2c152d8293c2 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:32.842820 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1069/2134] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:32.845175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d680ab-8473-4356-9050-90ea8c5e506f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:32.845633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d680ab-8473-4356-9050-90ea8c5e506f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:32.846155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d680ab-8473-4356-9050-90ea8c5e506f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:32.867790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1dd97483-7654-42ae-8d39-50c5561de2f3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:32.872126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1dd97483-7654-42ae-8d39-50c5561de2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:32.877582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f1d680ab-8473-4356-9050-90ea8c5e506f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:32.879315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f1d680ab-8473-4356-9050-90ea8c5e506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:33.023210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1070/2135] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:33.027940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d680ab-8473-4356-9050-90ea8c5e506f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.047870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d680ab-8473-4356-9050-90ea8c5e506f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.051127 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1066/2136] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:33.057934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.058580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.058860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.059132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.060072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:33.060072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.062238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.080836 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1071/2137] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:33.093884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd97483-7654-42ae-8d39-50c5561de2f3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.096216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.098072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:33.111002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd97483-7654-42ae-8d39-50c5561de2f3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.132188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.132985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.133364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.133729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.134463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.136720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.248865 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1067/2138] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:33 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:33.250028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.257086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:33.262173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c85d-3cf8-4e36-bbc1-f81fa1a95c88 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.275121 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:33.374625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.375604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.375897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.376172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.380521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d89eb-b4c8-4723-ac6d-c86712248b52 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.385548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.386260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.386543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.386817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] PATH_INFO: `/v3/users/cc2309d88f1f4761b32c65fb28780c71` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.388230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2309d88f1f4761b32c65fb28780c71)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.390108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.399174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.401520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.430172 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1072/2139] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:33.431051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.455425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0495-cee0-470e-b44f-8f1f46e9002b service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.462808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2309d88f1f4761b32c65fb28780c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:33.466578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.467192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.467467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.467739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.468361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.470523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.480159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2309d88f1f4761b32c65fb28780c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:33.482028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2309d88f1f4761b32c65fb28780c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:33.509898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2309d88f1f4761b32c65fb28780c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:33.513610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff506202-5127-43ea-95c1-016f36add8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2309d88f1f4761b32c65fb28780c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:33.513978 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1073/2140] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:33 2022] POST /identity/v3/users => generated 293 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:33.519031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.532884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:33.559185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55df9f-3fe7-484a-a030-d5872ee23b44 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.576951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.577581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.577862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.578214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.578922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.580012 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1068/2141] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:33 2022] DELETE /identity/v3/users/cc2309d88f1f4761b32c65fb28780c71 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:33.582896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.584858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1045-cf99-4d60-8571-3c8bc93d690b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.585149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1045-cf99-4d60-8571-3c8bc93d690b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.585424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1045-cf99-4d60-8571-3c8bc93d690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.604574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1074/2142] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:33.608399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.627713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897dd4-dfba-4bb6-8ad0-5d08be768c55 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.652336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e4fe1045-cf99-4d60-8571-3c8bc93d690b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:33.658620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e4fe1045-cf99-4d60-8571-3c8bc93d690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:33.663176 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:33.785625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.787263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.787789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.788323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.790284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.793758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.811434 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1069/2143] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:33.815680 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1075/2144] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:07:33.821334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe1045-cf99-4d60-8571-3c8bc93d690b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.836023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe1045-cf99-4d60-8571-3c8bc93d690b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:33.843123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b3f95-3126-4893-b565-fab98b921fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:33.844148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b3f95-3126-4893-b565-fab98b921fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.844514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b3f95-3126-4893-b565-fab98b921fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.844969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b3f95-3126-4893-b565-fab98b921fe7 admin admin] PATH_INFO: `/v3/projects/461bdd9914f948deadd26f9b98ea24ed/users/0550ded54d04407889d5cf342b20a03c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.880175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b3f95-3126-4893-b565-fab98b921fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461bdd9914f948deadd26f9b98ea24ed, user_id=0550ded54d04407889d5cf342b20a03c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:33.884249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:33.889263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:33.903351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b3f95-3126-4893-b565-fab98b921fe7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:33.972543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1070/2145] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:33 2022] PUT /identity/v3/projects/461bdd9914f948deadd26f9b98ea24ed/users/0550ded54d04407889d5cf342b20a03c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:33.975352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676af2-d55d-4ced-940d-65b5270eb070 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:33.975642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676af2-d55d-4ced-940d-65b5270eb070 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:33.976264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676af2-d55d-4ced-940d-65b5270eb070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:33.993090 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:34.002646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369925d-34d2-40b5-b5a3-a42e3ef05a24 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.036599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-85676af2-d55d-4ced-940d-65b5270eb070 None None] MFA Rules not processed for user `0550ded54d04407889d5cf342b20a03c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:34.038187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-85676af2-d55d-4ced-940d-65b5270eb070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:34.158990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.159981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.160239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.160516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.267903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1071/2146] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:34.269322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29d06-a38a-4d52-b569-674d1fea3b91 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.269609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29d06-a38a-4d52-b569-674d1fea3b91 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.269882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29d06-a38a-4d52-b569-674d1fea3b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.286555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.289149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.321206 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1076/2147] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:34.322734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.348694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-79b29d06-a38a-4d52-b569-674d1fea3b91 None None] MFA Rules not processed for user `08b0e93dc59a4024b6ff32c7f9f24b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:34.350003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79b29d06-a38a-4d52-b569-674d1fea3b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:34.352674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f0b4-0ce4-499f-af93-f546e1191645 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.373488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.374122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.374398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.374965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.376594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.381776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.417331 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:34.442981 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1077/2148] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:34 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:34.444072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.451680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:34.520629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1072/2149] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:34.521929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b29d06-a38a-4d52-b569-674d1fea3b91 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.558880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b29d06-a38a-4d52-b569-674d1fea3b91 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.570339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f826d-2ed7-4467-a381-68074a49f01d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.570605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.571256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.571552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.571829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.575851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.576369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.577279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.577755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.578387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.580189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] PATH_INFO: `/v3/projects/546bf89d982a47ab86c0cb0088e86d61` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.583327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=546bf89d982a47ab86c0cb0088e86d61)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.586874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.642791 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1073/2150] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:34 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:34.644925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.647133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:34.669158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead35e-6a98-4a2b-8a32-a3987d29d7cb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.680567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.681376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.681821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.682116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.683219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.686211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.704604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546bf89d982a47ab86c0cb0088e86d61', 'request_id': 'req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:34.718304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546bf89d982a47ab86c0cb0088e86d61', 'request_id': 'req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:34.727134 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1074/2151] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:34 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:34.728073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.737378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546bf89d982a47ab86c0cb0088e86d61', 'request_id': 'req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:34.756816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] The token cache is being invalidate because project 546bf89d982a47ab86c0cb0088e86d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:34.757283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:34.758057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:34.762814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1078/2152] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:34 2022] DELETE /identity/v3/projects/546bf89d982a47ab86c0cb0088e86d61 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:34.762814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.763072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:34.788326 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:34.832845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec528-6bc5-4d3f-a919-4a43a4329789 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.847650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.848589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.848901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.849178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.849863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.851681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.867179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ec3a-e25e-48ac-a9f8-6938e83959bc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.874431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.876397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.877700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.878191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.881094 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1075/2153] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:34.882251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.885659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:34.886223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.892744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.927408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448dbd-283a-4573-8454-4beee8d4b0c9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.940347 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1079/2154] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:34 2022] POST /identity/v3/users => generated 309 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:34.941671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:34.943351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.944032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.944275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:34.944392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.944569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] PATH_INFO: `/v3/users/aee9627e48c74ff28d7de1eef3d0684f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.950674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee9627e48c74ff28d7de1eef3d0684f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:34.952787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:34.962238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385afac5-02b6-42c5-878f-efe644063be8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:34.970176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:34.971591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:34.971975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:34.972325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] PATH_INFO: `/v3/projects/611a0e5e4fa348d680809c8e73966925/users/7b9ac839a8194c2db1b29414d14ff1d3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:34.994102 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:34.999888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=611a0e5e4fa348d680809c8e73966925, user_id=7b9ac839a8194c2db1b29414d14ff1d3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:35.007033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:35.038334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1080/2155] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:34 2022] PUT /identity/v3/projects/611a0e5e4fa348d680809c8e73966925/users/7b9ac839a8194c2db1b29414d14ff1d3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:35.044700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:35.047548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee9627e48c74ff28d7de1eef3d0684f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:35.064965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee9627e48c74ff28d7de1eef3d0684f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:35.065624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee9627e48c74ff28d7de1eef3d0684f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:35.083596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee9627e48c74ff28d7de1eef3d0684f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:35.086424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee9627e48c74ff28d7de1eef3d0684f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:35.138630 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1076/2156] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:34 2022] DELETE /identity/v3/users/aee9627e48c74ff28d7de1eef3d0684f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:35.142274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:35.143933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:35.180678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e04ed-038a-4ee6-afe8-4c9b39b49f7c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:35.285177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899d59-e9c8-4284-9999-54d2003f4879 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:35.298146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:35.298829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:35.299108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:35.299374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:35.300213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:35.301927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:35.314115 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1077/2157] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:35.318451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:35.320742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:35.322152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:35.322561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:35.322937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:35.324021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:35.326358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:35.330754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa52e6-fbad-4019-88d0-43a3dbdbb2cd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:35.336412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92e5f-ae72-4efd-95eb-74f2fc15edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:35.336872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92e5f-ae72-4efd-95eb-74f2fc15edb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:35.337139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92e5f-ae72-4efd-95eb-74f2fc15edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:35.337414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92e5f-ae72-4efd-95eb-74f2fc15edb6 admin admin] PATH_INFO: `/v3/projects/611a0e5e4fa348d680809c8e73966925/users/7b9ac839a8194c2db1b29414d14ff1d3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:35.340042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92e5f-ae72-4efd-95eb-74f2fc15edb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=611a0e5e4fa348d680809c8e73966925, user_id=7b9ac839a8194c2db1b29414d14ff1d3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:35.344370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92e5f-ae72-4efd-95eb-74f2fc15edb6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:35.361945 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1081/2158] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:35.364302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:35.364583 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1078/2159] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:35 2022] PUT /identity/v3/projects/611a0e5e4fa348d680809c8e73966925/users/7b9ac839a8194c2db1b29414d14ff1d3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:35.377685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:35.378138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:35.378500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:35.378723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:35.403318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bb89c-b434-4e8d-8a2d-b1536cf9e438 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:35.458233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] MFA Rules not processed for user `7b9ac839a8194c2db1b29414d14ff1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:35.459494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:35.507428 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:35.570126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:35.570750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:35.571025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:35.571295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] PATH_INFO: `/v3/projects/1beee884e63a4d048a6575f1722c949a/users/f17302ce11834fcb8cf2eedac685dfb3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:35.622828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1beee884e63a4d048a6575f1722c949a, user_id=f17302ce11834fcb8cf2eedac685dfb3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:35.624805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:35.662197 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1082/2160] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:35 2022] PUT /identity/v3/projects/1beee884e63a4d048a6575f1722c949a/users/f17302ce11834fcb8cf2eedac685dfb3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:35.676700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:35.686050 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1079/2161] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:35.725484 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:35.752167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:35.753691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:35.791382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52781cf-11ef-49c5-9ddc-d033e4eade50 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:35.842740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10129be-cc55-4db4-ac52-d32e6e0c3161 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:35.861694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:35.863360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:35.864667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:35.867816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:35.870192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:35.873286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:35.891830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:35.891830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:35.891830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:35.891830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] PATH_INFO: `/v3/projects/31f6466c5f544de08b54adf5dc999fda` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:35.892415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f6466c5f544de08b54adf5dc999fda)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:35.892415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:35.916479 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1083/2162] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:35.917530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:35.919965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:35.986621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f6466c5f544de08b54adf5dc999fda', 'request_id': 'req-b1c06768-4fd2-456c-bd41-0a59324ed492'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:35.998864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f6466c5f544de08b54adf5dc999fda', 'request_id': 'req-b1c06768-4fd2-456c-bd41-0a59324ed492'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.011942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f6466c5f544de08b54adf5dc999fda', 'request_id': 'req-b1c06768-4fd2-456c-bd41-0a59324ed492'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.035298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] The token cache is being invalidate because project 31f6466c5f544de08b54adf5dc999fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:36.035590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.037436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.043067 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1080/2163] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:35 2022] DELETE /identity/v3/projects/31f6466c5f544de08b54adf5dc999fda => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:36.043067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:36.044703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544273b0-7b6e-44a3-a5ca-78a1987319b1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:36.045872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.162855 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:36.191108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c06768-4fd2-456c-bd41-0a59324ed492 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:36.207451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb75973-1b5e-4d34-9f8c-e6c03b89b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:36.208139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75973-1b5e-4d34-9f8c-e6c03b89b627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.208416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75973-1b5e-4d34-9f8c-e6c03b89b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.208730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75973-1b5e-4d34-9f8c-e6c03b89b627 admin admin] PATH_INFO: `/v3/projects/1beee884e63a4d048a6575f1722c949a/users/f17302ce11834fcb8cf2eedac685dfb3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.212879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb75973-1b5e-4d34-9f8c-e6c03b89b627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1beee884e63a4d048a6575f1722c949a, user_id=f17302ce11834fcb8cf2eedac685dfb3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:36.215548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb75973-1b5e-4d34-9f8c-e6c03b89b627 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:36.242938 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1081/2164] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:36 2022] PUT /identity/v3/projects/1beee884e63a4d048a6575f1722c949a/users/f17302ce11834fcb8cf2eedac685dfb3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:36.244380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.244662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.244956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.294166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1002-a3ca-4f71-9f91-f2671f2fd8b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:36.295098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1002-a3ca-4f71-9f91-f2671f2fd8b1 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.296087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1002-a3ca-4f71-9f91-f2671f2fd8b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.296513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1002-a3ca-4f71-9f91-f2671f2fd8b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.298013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:36.299273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.301715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b41a1002-a3ca-4f71-9f91-f2671f2fd8b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.450948 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1082/2165] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:36.451792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:36.457493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.479267 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:36.491382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ab841-6a23-4c11-8af4-9f2b0a21a9e1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:36.506682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:36.507394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.507644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1002-a3ca-4f71-9f91-f2671f2fd8b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:36.507761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.507917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] PATH_INFO: `/v3/projects/859b3715a9b646fe82564fb3e0b19eae` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.510869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=859b3715a9b646fe82564fb3e0b19eae)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:36.511270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:36.514127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1002-a3ca-4f71-9f91-f2671f2fd8b1 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:36.529817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1084/2166] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:36.531582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfad70-e552-4f5c-b3ba-427e15a60e3e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.532031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfad70-e552-4f5c-b3ba-427e15a60e3e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.532522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfad70-e552-4f5c-b3ba-427e15a60e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.570102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-10cfad70-e552-4f5c-b3ba-427e15a60e3e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:36.573553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10cfad70-e552-4f5c-b3ba-427e15a60e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.596887 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1085/2167] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:36.600813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfad70-e552-4f5c-b3ba-427e15a60e3e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:36.616749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfad70-e552-4f5c-b3ba-427e15a60e3e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:36.640992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859b3715a9b646fe82564fb3e0b19eae', 'request_id': 'req-67560c19-a3c9-4b36-b713-74e3921159ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.655896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859b3715a9b646fe82564fb3e0b19eae', 'request_id': 'req-67560c19-a3c9-4b36-b713-74e3921159ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.664088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859b3715a9b646fe82564fb3e0b19eae', 'request_id': 'req-67560c19-a3c9-4b36-b713-74e3921159ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.699975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] The token cache is being invalidate because project 859b3715a9b646fe82564fb3e0b19eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:36.700566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.701366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.706534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1083/2168] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:36 2022] DELETE /identity/v3/projects/859b3715a9b646fe82564fb3e0b19eae => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:36.706534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:36.708380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.753602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:36.754596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.755075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.756672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.758036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:36.758500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:36.763797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:36.785472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1086/2169] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:36.786605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:36.789036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.809755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c6440-6811-44d6-abb0-26ac600ecb5b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:36.817057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:36.817780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.818094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.818365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] PATH_INFO: `/v3/users/baaee7e28d1d43cd9bf86ee58fc24334` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.820338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=baaee7e28d1d43cd9bf86ee58fc24334)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:36.823426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:36.901608 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:36.915034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560c19-a3c9-4b36-b713-74e3921159ba admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:36.932489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:36.933403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:36.934591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:36.935340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:36.938052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaee7e28d1d43cd9bf86ee58fc24334'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.941606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:36.955854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaee7e28d1d43cd9bf86ee58fc24334'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.983891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaee7e28d1d43cd9bf86ee58fc24334'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:36.988044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaee7e28d1d43cd9bf86ee58fc24334'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:37.026129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaee7e28d1d43cd9bf86ee58fc24334'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:37.086279 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1087/2170] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:36 2022] DELETE /identity/v3/users/baaee7e28d1d43cd9bf86ee58fc24334 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:37.088319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:37.100741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:37.182209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:37.183864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:37.217930 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1084/2171] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:37.316924 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:37.361292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929439ea-439d-400c-9912-46fb794a21bc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:37.374275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:37.375332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:37.375615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:37.375883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:37.376626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:37.383877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:37.440885 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1088/2172] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:37 2022] POST /identity/v3/projects => generated 377 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:37.445185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:37.446852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:37.469740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebc70e-21a0-4e33-ad61-6808a0204680 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:37.599389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:37.600514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:37.601076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:37.601197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:37.606706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:37.608958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:37.672401 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1085/2173] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:37 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:37.673649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:37.695252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff29599-9b91-49bb-a697-1869fd771251 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:37.715308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:37.717078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:37.717360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:37.717705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:37.720611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:37.729746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:37.782379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:37.799583 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1089/2174] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:37.813401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a521-f965-4fcc-887f-ef1f1957ebe0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:37.823113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998653c6-9bb0-4a19-b29c-be2b405e7784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:37.823805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998653c6-9bb0-4a19-b29c-be2b405e7784 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:37.824095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998653c6-9bb0-4a19-b29c-be2b405e7784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:37.824357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998653c6-9bb0-4a19-b29c-be2b405e7784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:37.826816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998653c6-9bb0-4a19-b29c-be2b405e7784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:37.828747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998653c6-9bb0-4a19-b29c-be2b405e7784 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:37.861438 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1086/2175] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:37.862979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:37.880734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cf653-7bff-4dd7-b760-9135f8f70db4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:37.930481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:37.935354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:37.935832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:37.935970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] PATH_INFO: `/v3/projects/03141dfcf7e94dd4a36930429bae7fb7/users/bbd3e55d2c7241df93b25250f3f077ab/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:37.997542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03141dfcf7e94dd4a36930429bae7fb7, user_id=bbd3e55d2c7241df93b25250f3f077ab, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:38.006866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:38.048932 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1090/2176] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:37 2022] PUT /identity/v3/projects/03141dfcf7e94dd4a36930429bae7fb7/users/bbd3e55d2c7241df93b25250f3f077ab/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:38.059776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:38.060203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:38.060492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:38.167183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] MFA Rules not processed for user `bbd3e55d2c7241df93b25250f3f077ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:38.168450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:38.393918 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1087/2177] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:38.397902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:38.574965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bca32a-dfe6-4714-99aa-671a9e2e2c0c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:38.585158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:38.585385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:38.585738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:38.585977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:38.587302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:38.589272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:38.636220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:38.638396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:38.650520 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1091/2178] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:38 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:38.651575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:38.672889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babe5c3-4832-41eb-8b79-4a0fb60fb436 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:38.697601 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:38.786085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80417856-149d-485f-b0ed-f35629c7e633 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:38.798284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:38.798915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:38.801830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:38.802156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:38.804836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:38.811247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:38.812632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:38.816104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:38.816601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:38.817055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] PATH_INFO: `/v3/projects/2fe55756b0114abe9de310dcc790d66c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:38.818664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe55756b0114abe9de310dcc790d66c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:38.844119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:38.861304 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1092/2179] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:38 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:38.864938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:38.884587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd767-7ba5-44c0-9c1a-0ca314fa1e00 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:38.899163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:38.899787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:38.900060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:38.900790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:38.900995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:38.902602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:38.906258 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:38.928558 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1093/2180] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:07:38.932585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:38.958224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe55756b0114abe9de310dcc790d66c', 'request_id': 'req-41e79ee9-80eb-425d-bef1-b92acff71416'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:38.963905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f697-4a49-4426-a2c5-19825c92060a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:38.977806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe55756b0114abe9de310dcc790d66c', 'request_id': 'req-41e79ee9-80eb-425d-bef1-b92acff71416'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:38.990809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe55756b0114abe9de310dcc790d66c', 'request_id': 'req-41e79ee9-80eb-425d-bef1-b92acff71416'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.045282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] The token cache is being invalidate because project 2fe55756b0114abe9de310dcc790d66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:39.045721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.048438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.052547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1088/2181] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:38 2022] DELETE /identity/v3/projects/2fe55756b0114abe9de310dcc790d66c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:39.052547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:39.054063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:39.106612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328749-0c68-4798-8e0b-dadc7911451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:39.111711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328749-0c68-4798-8e0b-dadc7911451d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:39.112352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328749-0c68-4798-8e0b-dadc7911451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:39.113148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328749-0c68-4798-8e0b-dadc7911451d admin admin] PATH_INFO: `/v3/projects/c91c594d418c401f9f86a81de3205bf4/users/d72e959103ed4c6fbe0c6053abf40171/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:39.170965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328749-0c68-4798-8e0b-dadc7911451d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91c594d418c401f9f86a81de3205bf4, user_id=d72e959103ed4c6fbe0c6053abf40171, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:39.184458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328749-0c68-4798-8e0b-dadc7911451d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:39.240166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e79ee9-80eb-425d-bef1-b92acff71416 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:39.242444 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1094/2182] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:38 2022] PUT /identity/v3/projects/c91c594d418c401f9f86a81de3205bf4/users/d72e959103ed4c6fbe0c6053abf40171/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:39.245541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:39.245828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:39.246211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:39.309617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:39.311359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:39.381077 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:39.444477 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1095/2183] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:39.444477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:39.444477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:39.462391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:39.463061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:39.463343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:39.463605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] PATH_INFO: `/v3/users/0550ded54d04407889d5cf342b20a03c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:39.466929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0550ded54d04407889d5cf342b20a03c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:39.469328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:39.495037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee3d4-5030-4cce-8a0c-9ad66b961b55 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:39.526768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e4c3a-1f8d-4a02-aa7e-5f0a93f4dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:39.532588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e4c3a-1f8d-4a02-aa7e-5f0a93f4dd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:39.534242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e4c3a-1f8d-4a02-aa7e-5f0a93f4dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:39.535504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e4c3a-1f8d-4a02-aa7e-5f0a93f4dd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:39.540536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e4c3a-1f8d-4a02-aa7e-5f0a93f4dd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:39.550851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e4c3a-1f8d-4a02-aa7e-5f0a93f4dd03 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:39.574199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0550ded54d04407889d5cf342b20a03c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.592818 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1096/2184] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:39.592818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a25ab-9fc8-41ef-a455-a570d2b5bd00 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:39.592818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a25ab-9fc8-41ef-a455-a570d2b5bd00 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:39.592818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a25ab-9fc8-41ef-a455-a570d2b5bd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:39.595142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0550ded54d04407889d5cf342b20a03c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.595815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0550ded54d04407889d5cf342b20a03c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.609718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0550ded54d04407889d5cf342b20a03c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.610799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0550ded54d04407889d5cf342b20a03c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:39.644526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1089/2185] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:39 2022] DELETE /identity/v3/users/0550ded54d04407889d5cf342b20a03c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:39.648020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:39.650048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:39.669244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-539a25ab-9fc8-41ef-a455-a570d2b5bd00 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:39.671829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-539a25ab-9fc8-41ef-a455-a570d2b5bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:39.811907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e3c0-2737-4089-ab13-36244ba89012 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:39.823060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:39.823753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:39.824025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:39.825030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] PATH_INFO: `/v3/projects/c91c594d418c401f9f86a81de3205bf4/users/d72e959103ed4c6fbe0c6053abf40171/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:39.827783 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1097/2186] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:39.830554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97d99c-cec9-42d7-9dbe-269a99b837c2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:39.830858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97d99c-cec9-42d7-9dbe-269a99b837c2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:39.831257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97d99c-cec9-42d7-9dbe-269a99b837c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:39.834535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91c594d418c401f9f86a81de3205bf4, user_id=d72e959103ed4c6fbe0c6053abf40171, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:39.837608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:39.866577 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1090/2187] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:39 2022] PUT /identity/v3/projects/c91c594d418c401f9f86a81de3205bf4/users/d72e959103ed4c6fbe0c6053abf40171/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:39.867439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:39.868728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4a97d99c-cec9-42d7-9dbe-269a99b837c2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:39.870799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a97d99c-cec9-42d7-9dbe-269a99b837c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:39.885807 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:40.041265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1098/2188] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:40.042910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.043241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.043562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.054743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe663942-6011-413a-bc7e-cf2448d445f7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.065999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.066631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.066911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.067207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.067837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:40.068122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.070917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.078390 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:40.086788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] MFA Rules not processed for user `d72e959103ed4c6fbe0c6053abf40171`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:40.088626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:40.105446 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1091/2189] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:40.109933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.133892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a67f7-0d5f-455d-88ab-ed189e1bc633 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.148954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.148954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.148954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.149309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.149734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.152403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.189532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1092/2190] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:40 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:40.193602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.239859 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1099/2191] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:40.240907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.242741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:40.282388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113a474-2206-4fe6-8a69-4c7243bbb07a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.287553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.288283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.288651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.289457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.297035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.299193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.348231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1093/2192] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:40 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:40.348575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.372741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bb682-d8d8-4258-8fd6-2aec0e019327 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.389148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.389786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.390065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.390373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.391187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.392739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.397239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e01e6-4009-47fb-a07b-e9692e89fbfc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.425527 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1094/2193] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:40.432909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.452448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19d094-3406-4d1a-ba07-9945cfb17d2f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.464741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.465293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.465802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.466078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.466843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.468554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.499475 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1095/2194] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:40.501711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.525472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c43c-d7cc-4865-963e-625b810b5cc9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.528090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8f1f4-c36c-42ed-b713-fb94e44dea91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.529455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8f1f4-c36c-42ed-b713-fb94e44dea91 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.529963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8f1f4-c36c-42ed-b713-fb94e44dea91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.530482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8f1f4-c36c-42ed-b713-fb94e44dea91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.544508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.545226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.545504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.545777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] PATH_INFO: `/v3/projects/d680d2800d324818a3e66b3b0798c1af/users/dc45d4d6402545bbafa124eb63677795/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.552198 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:40.564111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8f1f4-c36c-42ed-b713-fb94e44dea91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.574455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8f1f4-c36c-42ed-b713-fb94e44dea91 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.575061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d680d2800d324818a3e66b3b0798c1af, user_id=dc45d4d6402545bbafa124eb63677795, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.578242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.597643 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1100/2195] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:40.618509 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1096/2196] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:40 2022] PUT /identity/v3/projects/d680d2800d324818a3e66b3b0798c1af/users/dc45d4d6402545bbafa124eb63677795/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:40.620715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d3008-1ec6-4f32-9426-a8b348e46cae None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.621036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d3008-1ec6-4f32-9426-a8b348e46cae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.621311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d3008-1ec6-4f32-9426-a8b348e46cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.650159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.652271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:40.695454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6e9d3008-1ec6-4f32-9426-a8b348e46cae None None] MFA Rules not processed for user `dc45d4d6402545bbafa124eb63677795`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:40.699050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e9d3008-1ec6-4f32-9426-a8b348e46cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:40.821162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b47e9-8a42-452a-b48f-e03f81fc19d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.834969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.835607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.836234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.836508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.859777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1101/2197] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:40.864255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d3008-1ec6-4f32-9426-a8b348e46cae None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:40.873961 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:40.976202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d3008-1ec6-4f32-9426-a8b348e46cae None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:40.990344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:40.991100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:40.992254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:40.993810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:40.994568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:40.997739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:40.999976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.002383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.027565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1097/2198] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:41.049174 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1102/2199] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:40 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:41.057026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.076632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c0f57-cf4a-44c3-820e-4b4eb4fa343a service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.248246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.249805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.250041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.250651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.250913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.256655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.303663 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1098/2200] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:41 2022] POST /identity/v3/users => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:41.305474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.320318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52ca3d-982d-4835-8561-bae810b72ce5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.348620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.349054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.349334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.349606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.350273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.352861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.382581 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1103/2201] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:41.385934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.405077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016f17e-7f0f-4fc1-8f53-a0b862cf37ce admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.414160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.415291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.415782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.416264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] PATH_INFO: `/v3/projects/b651e4a40bdf410fa1bb1d9cd9e5fb78/users/dff1ca341a7c4e52b70a495c3f80e538/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.472060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651e4a40bdf410fa1bb1d9cd9e5fb78, user_id=dff1ca341a7c4e52b70a495c3f80e538, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.489490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.556597 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1099/2202] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:41 2022] PUT /identity/v3/projects/b651e4a40bdf410fa1bb1d9cd9e5fb78/users/dff1ca341a7c4e52b70a495c3f80e538/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:41.558263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.580005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db31c6-40fd-462c-9b70-d953717c99be admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.687859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.740856 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:41.752332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.753111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.753402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.753660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.754320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.756195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.777174 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1104/2203] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:41.781394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.797419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07f6c-c345-463a-9ef0-9dbae1861d21 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.808912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.809649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.809921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.810188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] PATH_INFO: `/v3/projects/b651e4a40bdf410fa1bb1d9cd9e5fb78/users/dff1ca341a7c4e52b70a495c3f80e538/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.814823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651e4a40bdf410fa1bb1d9cd9e5fb78, user_id=dff1ca341a7c4e52b70a495c3f80e538, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.817535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.823752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073cfd-0c89-4e64-8615-d9d45c7c74bc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.834441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.835281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.835843 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1105/2204] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:41 2022] PUT /identity/v3/projects/b651e4a40bdf410fa1bb1d9cd9e5fb78/users/dff1ca341a7c4e52b70a495c3f80e538/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:41.835947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.836145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] PATH_INFO: `/v3/users/bbd3e55d2c7241df93b25250f3f077ab` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.836271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.838174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd3e55d2c7241df93b25250f3f077ab)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.838321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:41.840496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.870414 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:41.946334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bd4f2-6e8c-498d-8387-cf3040f183aa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.952644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.955273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.955700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.956131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] PATH_INFO: `/v3/projects/461bdd9914f948deadd26f9b98ea24ed` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.957635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461bdd9914f948deadd26f9b98ea24ed)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.959777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.962017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd3e55d2c7241df93b25250f3f077ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:41.983701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd3e55d2c7241df93b25250f3f077ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:41.985142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd3e55d2c7241df93b25250f3f077ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:41.996582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd3e55d2c7241df93b25250f3f077ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:41.997506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5b1ec7dc-60a5-48f6-a216-7b102bc1d396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd3e55d2c7241df93b25250f3f077ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.027809 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1100/2205] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:41 2022] DELETE /identity/v3/users/bbd3e55d2c7241df93b25250f3f077ab => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:42.031877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:42.032294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:42.032732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:42.036306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461bdd9914f948deadd26f9b98ea24ed', 'request_id': 'req-3c80c6b8-38a1-4095-99b0-4f8272e15be3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.043730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461bdd9914f948deadd26f9b98ea24ed', 'request_id': 'req-3c80c6b8-38a1-4095-99b0-4f8272e15be3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.052563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461bdd9914f948deadd26f9b98ea24ed', 'request_id': 'req-3c80c6b8-38a1-4095-99b0-4f8272e15be3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.069664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] The token cache is being invalidate because project 461bdd9914f948deadd26f9b98ea24ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:42.069957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.070852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c80c6b8-38a1-4095-99b0-4f8272e15be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.073185 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1106/2206] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:41 2022] DELETE /identity/v3/projects/461bdd9914f948deadd26f9b98ea24ed => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:42.074745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:42.075070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:42.075340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:42.078017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] MFA Rules not processed for user `dff1ca341a7c4e52b70a495c3f80e538`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:42.080231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:42.102344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:42.103581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:42.186381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1107/2207] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:42.187405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:42.190129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:42.204995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ab3c3-f271-4c17-a2f7-aaa210e95d5d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:42.211006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:42.211754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:42.212091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:42.212431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] PATH_INFO: `/v3/users/7b9ac839a8194c2db1b29414d14ff1d3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:42.214201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9ac839a8194c2db1b29414d14ff1d3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:42.216874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:42.226031 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:42.229149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1101/2208] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:42.230464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:42.233439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:42.322214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9ac839a8194c2db1b29414d14ff1d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.341306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9ac839a8194c2db1b29414d14ff1d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.361400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700ef9d-f432-4682-ad7a-b291c39579eb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:42.372044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:42.373149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:42.373570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:42.373967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:42.374295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9ac839a8194c2db1b29414d14ff1d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.376000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9ac839a8194c2db1b29414d14ff1d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.392340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:42.393840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:42.401675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9ac839a8194c2db1b29414d14ff1d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:42.408255 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1102/2209] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:42.409306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:42.414222 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1108/2210] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:42 2022] DELETE /identity/v3/users/7b9ac839a8194c2db1b29414d14ff1d3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:42.415322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:42.447332 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:42.523119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165286-3a78-47cb-b61d-4a28629c59b2 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:42.601922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdb03f-4b32-441f-87a7-93a5734175ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:42.602554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb03f-4b32-441f-87a7-93a5734175ec service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:42.602827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb03f-4b32-441f-87a7-93a5734175ec service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:42.603095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb03f-4b32-441f-87a7-93a5734175ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:42.606028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ddcdb03f-4b32-441f-87a7-93a5734175ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:42.698890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdb03f-4b32-441f-87a7-93a5734175ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:42.701469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdb03f-4b32-441f-87a7-93a5734175ec service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:42.715510 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1103/2211] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:43.212838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:43.216387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:43.322648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb374-a692-4793-a5ca-8d6eb62bddcf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:43.329623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:43.330586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:43.331403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:43.331964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] PATH_INFO: `/v3/users/dc45d4d6402545bbafa124eb63677795` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:43.332890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc45d4d6402545bbafa124eb63677795)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:43.334843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:43.451956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc45d4d6402545bbafa124eb63677795'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:43.478465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc45d4d6402545bbafa124eb63677795'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:43.507573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc45d4d6402545bbafa124eb63677795'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:43.508392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc45d4d6402545bbafa124eb63677795'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:43.523040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc45d4d6402545bbafa124eb63677795'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:43.535745 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1109/2212] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:43 2022] DELETE /identity/v3/users/dc45d4d6402545bbafa124eb63677795 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:43.537400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:43.537889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:43.537987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:43.563920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:43.566226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:43.635442 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:43.655884 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1104/2213] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:43.698764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:43.701130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:43.709414 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:43.793647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e704ded-71c7-4cf3-bb80-2446202ba500 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:43.799116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:43.800256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:43.800256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:43.800451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:43.814841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:43.816136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:43.827925 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1110/2214] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:44.053907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:44.055915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:44.082580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca59606-0e58-4091-8674-57cb6ca87a03 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:44.090725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:44.091398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:44.091676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:44.092407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] PATH_INFO: `/v3/projects/03141dfcf7e94dd4a36930429bae7fb7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:44.094915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03141dfcf7e94dd4a36930429bae7fb7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:44.096979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:44.163342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:44.165337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:44.194531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf744-c610-4e48-b365-a1fdc8a1c17a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:44.221272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:44.221939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:44.222340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:44.222620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] PATH_INFO: `/v3/projects/611a0e5e4fa348d680809c8e73966925` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:44.224331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611a0e5e4fa348d680809c8e73966925)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:44.230413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:44.270835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03141dfcf7e94dd4a36930429bae7fb7', 'request_id': 'req-36c14e60-36a2-4580-9ac4-600afd2b400e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.285056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03141dfcf7e94dd4a36930429bae7fb7', 'request_id': 'req-36c14e60-36a2-4580-9ac4-600afd2b400e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.297093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03141dfcf7e94dd4a36930429bae7fb7', 'request_id': 'req-36c14e60-36a2-4580-9ac4-600afd2b400e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.317012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] The token cache is being invalidate because project 03141dfcf7e94dd4a36930429bae7fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:44.319037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.321193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.330439 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1105/2215] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:44 2022] DELETE /identity/v3/projects/03141dfcf7e94dd4a36930429bae7fb7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:44.333515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:44.336173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:44.353468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611a0e5e4fa348d680809c8e73966925', 'request_id': 'req-eff0bc11-3008-4432-bb48-0baf41825689'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.369437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611a0e5e4fa348d680809c8e73966925', 'request_id': 'req-eff0bc11-3008-4432-bb48-0baf41825689'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.382870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611a0e5e4fa348d680809c8e73966925', 'request_id': 'req-eff0bc11-3008-4432-bb48-0baf41825689'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.411435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] The token cache is being invalidate because project 611a0e5e4fa348d680809c8e73966925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:44.411807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.415434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eff0bc11-3008-4432-bb48-0baf41825689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.418974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1111/2216] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:44 2022] DELETE /identity/v3/projects/611a0e5e4fa348d680809c8e73966925 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:44.433099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:44.433677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:44.433969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:44.460587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c14e60-36a2-4580-9ac4-600afd2b400e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:44.462656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:44.464596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:44.570475 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1112/2217] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:44.572519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:44.574067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:44.588552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ef45-35d9-473e-af00-861804e1f3ea None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:44.595502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:44.596161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:44.596438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:44.596708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] PATH_INFO: `/v3/projects/d680d2800d324818a3e66b3b0798c1af` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:44.598012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d680d2800d324818a3e66b3b0798c1af)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:44.598910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:44.599645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:44.599995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:44.600302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:44.600418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] PATH_INFO: `/v3/users/d72e959103ed4c6fbe0c6053abf40171` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:44.602426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72e959103ed4c6fbe0c6053abf40171)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:44.606503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:44.641448 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:44.684657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd680d2800d324818a3e66b3b0798c1af', 'request_id': 'req-507960ab-dba5-43f1-97b9-64f97a0879ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.689897 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:44.694012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd680d2800d324818a3e66b3b0798c1af', 'request_id': 'req-507960ab-dba5-43f1-97b9-64f97a0879ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.708823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd680d2800d324818a3e66b3b0798c1af', 'request_id': 'req-507960ab-dba5-43f1-97b9-64f97a0879ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.735235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72e959103ed4c6fbe0c6053abf40171'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.743932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] The token cache is being invalidate because project d680d2800d324818a3e66b3b0798c1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:44.744758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.746911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-507960ab-dba5-43f1-97b9-64f97a0879ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.751377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72e959103ed4c6fbe0c6053abf40171'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.751679 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1113/2218] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:44 2022] DELETE /identity/v3/projects/d680d2800d324818a3e66b3b0798c1af => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:44.752029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72e959103ed4c6fbe0c6053abf40171'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.755017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc493f-a7b6-4fb4-a0a2-a66429e34f2a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:44.756193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc493f-a7b6-4fb4-a0a2-a66429e34f2a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:44.757569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc493f-a7b6-4fb4-a0a2-a66429e34f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:44.773606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72e959103ed4c6fbe0c6053abf40171'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.776053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72e959103ed4c6fbe0c6053abf40171'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:44.803944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f6bc493f-a7b6-4fb4-a0a2-a66429e34f2a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:44.806705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6bc493f-a7b6-4fb4-a0a2-a66429e34f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:44.830732 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1106/2219] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:44 2022] DELETE /identity/v3/users/d72e959103ed4c6fbe0c6053abf40171 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:44.833061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:44.834488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:44.900551 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1114/2220] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:44.906288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc493f-a7b6-4fb4-a0a2-a66429e34f2a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:44.920596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc493f-a7b6-4fb4-a0a2-a66429e34f2a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:44.998014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:44.998848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:44.999918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.000584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.001543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:45.001814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a179cc6-d940-4baa-913d-fbcea14daaaa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.002036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.004022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.018037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.018720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.018995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.019263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] PATH_INFO: `/v3/users/dff1ca341a7c4e52b70a495c3f80e538` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.021604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff1ca341a7c4e52b70a495c3f80e538)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.023472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.044600 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1115/2221] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:45.050515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.063873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a148-24b5-4465-94df-d82d29226875 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.072286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.073427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.073810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.074228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.075420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.082046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.122496 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1116/2222] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:45 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:45.126341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.146983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff1ca341a7c4e52b70a495c3f80e538'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:45.162421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff1ca341a7c4e52b70a495c3f80e538'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:45.163955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff1ca341a7c4e52b70a495c3f80e538'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:45.177388 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:45.180873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff1ca341a7c4e52b70a495c3f80e538'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:45.181910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff1ca341a7c4e52b70a495c3f80e538'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:45.225412 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1107/2223] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:44 2022] DELETE /identity/v3/users/dff1ca341a7c4e52b70a495c3f80e538 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:45.278111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729595b-e159-49b3-96a1-1c614d8cb77b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.379933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.379933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.384019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.384019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.384019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.384019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.413179 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1117/2224] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:45 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:45.417025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.418788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:45.438370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725acb9-dea0-4eb3-9ee1-5c7dfd479438 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.445750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.447722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.448386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.448761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.449601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.451493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.468240 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1108/2225] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:07:45.472221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.487927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f698-5830-4f94-aa0b-3d9f7ff37189 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.499634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3b71-e887-4558-81b9-aaad1be800c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.500828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3b71-e887-4558-81b9-aaad1be800c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.501305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3b71-e887-4558-81b9-aaad1be800c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.501754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3b71-e887-4558-81b9-aaad1be800c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.503062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c3b71-e887-4558-81b9-aaad1be800c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.505007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c3b71-e887-4558-81b9-aaad1be800c9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.516808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1118/2226] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:45.520468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.535783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b691-6dcd-4eb9-9651-844ea7bde408 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.543729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.544457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.545931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.546268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] PATH_INFO: `/v3/projects/baf0c0d9bc794c1aaaf33285e555f5ec/users/7acce21e97f34900a3d6d303c03c0a5f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.557111 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:45.568089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf0c0d9bc794c1aaaf33285e555f5ec, user_id=7acce21e97f34900a3d6d303c03c0a5f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.571667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.590072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1109/2227] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:45 2022] PUT /identity/v3/projects/baf0c0d9bc794c1aaaf33285e555f5ec/users/7acce21e97f34900a3d6d303c03c0a5f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:45.600132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.600790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.601257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.638785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] MFA Rules not processed for user `7acce21e97f34900a3d6d303c03c0a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:45.639943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:45.744727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.753649 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1119/2228] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:45.822957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.825271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:45.841855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb424039-fc5f-4886-ac14-88c4a3838d3b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.848926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.851268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.851268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.851268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.851268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.854284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.855457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6a380-205f-4dc5-956a-df761a942dd1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:45.871442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:45.871889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:45.872185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:45.872526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] PATH_INFO: `/v3/projects/c91c594d418c401f9f86a81de3205bf4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:45.875296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91c594d418c401f9f86a81de3205bf4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:45.877806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:45.894701 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1110/2229] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:45 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:45.895677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:45.900573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:45.989278 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:46.005078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91c594d418c401f9f86a81de3205bf4', 'request_id': 'req-bf348f9d-ac15-4952-ab3e-513e9db230fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.017587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91c594d418c401f9f86a81de3205bf4', 'request_id': 'req-bf348f9d-ac15-4952-ab3e-513e9db230fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.026055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1cc0-c1b7-48fb-904a-9dec1db3f34c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.027180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91c594d418c401f9f86a81de3205bf4', 'request_id': 'req-bf348f9d-ac15-4952-ab3e-513e9db230fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.057949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] The token cache is being invalidate because project c91c594d418c401f9f86a81de3205bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:46.057949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.058789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.063209 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1120/2230] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:45 2022] DELETE /identity/v3/projects/c91c594d418c401f9f86a81de3205bf4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:46.064092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.067173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:46.117521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.118307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.118590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.118862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] PATH_INFO: `/v3/projects/b651e4a40bdf410fa1bb1d9cd9e5fb78` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.120719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b651e4a40bdf410fa1bb1d9cd9e5fb78)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.122933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.168534 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:46.221852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b651e4a40bdf410fa1bb1d9cd9e5fb78', 'request_id': 'req-056ebffe-67c4-494c-a45c-c6a6ce19115b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.226254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf348f9d-ac15-4952-ab3e-513e9db230fd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.238186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b651e4a40bdf410fa1bb1d9cd9e5fb78', 'request_id': 'req-056ebffe-67c4-494c-a45c-c6a6ce19115b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.254378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b651e4a40bdf410fa1bb1d9cd9e5fb78', 'request_id': 'req-056ebffe-67c4-494c-a45c-c6a6ce19115b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.288391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] The token cache is being invalidate because project b651e4a40bdf410fa1bb1d9cd9e5fb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:46.288861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.289634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-056ebffe-67c4-494c-a45c-c6a6ce19115b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:46.292005 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1111/2231] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:45 2022] DELETE /identity/v3/projects/b651e4a40bdf410fa1bb1d9cd9e5fb78 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:46.294060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca936f3d-1c83-42d3-955a-7b62e0b9eea0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.294622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca936f3d-1c83-42d3-955a-7b62e0b9eea0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.294985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca936f3d-1c83-42d3-955a-7b62e0b9eea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.336946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eebd32-8898-49fd-a875-cb8f03d7b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.337690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eebd32-8898-49fd-a875-cb8f03d7b758 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.337962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eebd32-8898-49fd-a875-cb8f03d7b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.338231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eebd32-8898-49fd-a875-cb8f03d7b758 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.338871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eebd32-8898-49fd-a875-cb8f03d7b758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.338981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ca936f3d-1c83-42d3-955a-7b62e0b9eea0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:46.340358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca936f3d-1c83-42d3-955a-7b62e0b9eea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:46.340929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eebd32-8898-49fd-a875-cb8f03d7b758 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.366162 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1112/2232] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:46.367834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.368742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.369123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.384829 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1121/2233] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/users => generated 294 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:46.386180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7966ac-493a-472b-9d4b-60dcfe2f9899 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.386295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7966ac-493a-472b-9d4b-60dcfe2f9899 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.386561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7966ac-493a-472b-9d4b-60dcfe2f9899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.407740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:46.409176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:46.425306 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1113/2234] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:46.426190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3a7966ac-493a-472b-9d4b-60dcfe2f9899 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:46.427515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3a7966ac-493a-472b-9d4b-60dcfe2f9899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:46.428954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.432329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:46.460014 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1122/2235] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:46.460440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3874f-cd50-4738-a079-ccd7dad8e291 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.462147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f12a7-e11e-4d4c-8914-2960ab3f0c6a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.462429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f12a7-e11e-4d4c-8914-2960ab3f0c6a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.462699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f12a7-e11e-4d4c-8914-2960ab3f0c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.478118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.482186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.482727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.483518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.484497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.487654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.493326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-462f12a7-e11e-4d4c-8914-2960ab3f0c6a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:46.494539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-462f12a7-e11e-4d4c-8914-2960ab3f0c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:46.505067 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1114/2236] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:46.507018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.514639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1123/2237] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:46.514639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f12a7-e11e-4d4c-8914-2960ab3f0c6a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.528245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f12a7-e11e-4d4c-8914-2960ab3f0c6a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.530676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e18a8-8462-4ff1-af4e-76cae07d8c57 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.540457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.542316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.542742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.543200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.544043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:46.544575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.547507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.548421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.550386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.550666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.554454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] PATH_INFO: `/v3/projects/662e751a23d848268db9cae5839f8f18/users/0de29726ac1d4a7780247230fbfa6906/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.566453 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1115/2238] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:46.566453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.583559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd936-df9d-4186-907c-7bf7ad405903 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.593218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.593874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.597796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.598403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.599184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:46.599311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=662e751a23d848268db9cae5839f8f18, user_id=0de29726ac1d4a7780247230fbfa6906, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.599500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.601585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.605372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.639127 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1124/2239] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:46 2022] PUT /identity/v3/projects/662e751a23d848268db9cae5839f8f18/users/0de29726ac1d4a7780247230fbfa6906/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:46.641769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.642535 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1116/2240] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:46.643533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.665091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74803e1-978b-4fec-a9dd-d1b0cad76d27 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.692979 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:46.792553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae81a61-1e5e-4b30-a9ac-e3846afceaae admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.800166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.800933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.801303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.801665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.803429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.806951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.832578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.833474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.833803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.834116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.835004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.837150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.855200 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1117/2241] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:46.856270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.859967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1125/2242] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:46.861083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:46.868220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3b4f-2c91-459f-9954-79068c38ca94 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:46.950523 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:46.977228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:46.978256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:46.978695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:46.979119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:46.979958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:46.982230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:46.997866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53a3d-54a0-45e0-817b-a21737ee4a64 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.004941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.005759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.006133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.006814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.008072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.010183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.042017 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1118/2243] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:47.043042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.046638 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1126/2244] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:46 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:47.053122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.068357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7f032-24fe-470e-8849-4f2d2fab4126 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.187991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bf259-f91b-4f81-a32f-6bfbb2f17d83 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.191269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e074d-c48a-4117-9e1f-493f3e511862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.192133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e074d-c48a-4117-9e1f-493f3e511862 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.192405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e074d-c48a-4117-9e1f-493f3e511862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.192687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e074d-c48a-4117-9e1f-493f3e511862 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.193926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e074d-c48a-4117-9e1f-493f3e511862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.194043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.194786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.195160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.196954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] PATH_INFO: `/v3/projects/662e751a23d848268db9cae5839f8f18/users/0de29726ac1d4a7780247230fbfa6906/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.199112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=662e751a23d848268db9cae5839f8f18, user_id=0de29726ac1d4a7780247230fbfa6906, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.200798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e074d-c48a-4117-9e1f-493f3e511862 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.202262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.249208 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1119/2246] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:47 2022] PUT /identity/v3/projects/662e751a23d848268db9cae5839f8f18/users/0de29726ac1d4a7780247230fbfa6906/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:47.249763 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1127/2246] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:47 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:47.251208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a8d1-2003-4ff8-9f7d-1d89e720633a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.251504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a8d1-2003-4ff8-9f7d-1d89e720633a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.251778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a8d1-2003-4ff8-9f7d-1d89e720633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.253572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.296946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9e29a8d1-2003-4ff8-9f7d-1d89e720633a None None] MFA Rules not processed for user `0de29726ac1d4a7780247230fbfa6906`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:47.299029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9e29a8d1-2003-4ff8-9f7d-1d89e720633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:47.319860 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:47.346441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea7cd-a49a-483f-816f-29983343d75a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.352974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.354031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.354997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.355506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.356486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.358544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.378755 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1120/2247] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:47.380128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.412917 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1128/2248] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:47.412917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a8d1-2003-4ff8-9f7d-1d89e720633a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.417464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1cd08-b5d2-4453-97f2-73e9839cc85c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.422863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a8d1-2003-4ff8-9f7d-1d89e720633a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.428314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.428890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.429021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.429246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.429517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.430180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.431709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.431831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.432259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.432678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.433527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.436113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.448727 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1129/2249] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:47.448727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.450523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:47.464090 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1121/2250] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:47.465836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.483032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67384ec-53b0-47af-b3ee-cdac538b5450 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.496696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.498220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.498656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.500019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] PATH_INFO: `/v3/projects/10a30211c0624285b0d861b43a2036c4/users/1c396660456743b19abe19dccdb9ba2e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.529589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a30211c0624285b0d861b43a2036c4, user_id=1c396660456743b19abe19dccdb9ba2e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.537722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.563645 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1122/2251] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:47 2022] PUT /identity/v3/projects/10a30211c0624285b0d861b43a2036c4/users/1c396660456743b19abe19dccdb9ba2e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:47.574749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.615286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbb21-0c05-4aa0-999d-116bec171f11 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.650266 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:47.698626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64760ae-e0bd-4bda-acd5-d92ccc428901 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.705011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670e606-e4d7-48e6-aafb-1e5eb1c9e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.705688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670e606-e4d7-48e6-aafb-1e5eb1c9e652 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.705975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670e606-e4d7-48e6-aafb-1e5eb1c9e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.706249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670e606-e4d7-48e6-aafb-1e5eb1c9e652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.706924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670e606-e4d7-48e6-aafb-1e5eb1c9e652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.708580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670e606-e4d7-48e6-aafb-1e5eb1c9e652 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.725667 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1123/2252] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:47.727555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e508-9761-4f97-a6b4-71ef7c5f67db None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.727993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e508-9761-4f97-a6b4-71ef7c5f67db None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.728122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.728546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e508-9761-4f97-a6b4-71ef7c5f67db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.728697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.728998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.729275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.764436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0647e508-9761-4f97-a6b4-71ef7c5f67db None None] MFA Rules not processed for user `1c396660456743b19abe19dccdb9ba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:47.766638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0647e508-9761-4f97-a6b4-71ef7c5f67db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:47.774750 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:47.817631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.820184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.844534 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1130/2253] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:47.846283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.861601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ff6c-cc99-4e5d-bfe3-b9db48537169 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.871876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53c41-dcbc-499e-a873-fff9a2518a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.874526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53c41-dcbc-499e-a873-fff9a2518a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.874920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53c41-dcbc-499e-a873-fff9a2518a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.875420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53c41-dcbc-499e-a873-fff9a2518a48 admin admin] PATH_INFO: `/v3/projects/a6b3284e864347c6820cda0dbbb1541d/users/d48188578b564213b80f3598eae2700e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.894199 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1124/2254] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:47.898782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e508-9761-4f97-a6b4-71ef7c5f67db None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.917903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e508-9761-4f97-a6b4-71ef7c5f67db None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:47.922552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a53c41-dcbc-499e-a873-fff9a2518a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b3284e864347c6820cda0dbbb1541d, user_id=d48188578b564213b80f3598eae2700e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.927033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:47.928156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.928803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.929282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:47.930127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:47.932310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.935538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a53c41-dcbc-499e-a873-fff9a2518a48 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:47.969890 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1125/2255] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:47 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:47.973997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:47.976538 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1131/2256] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:47 2022] PUT /identity/v3/projects/a6b3284e864347c6820cda0dbbb1541d/users/d48188578b564213b80f3598eae2700e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:47.987565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac240-d2d3-48c5-bcf0-d37f3c22834a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:47.987906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac240-d2d3-48c5-bcf0-d37f3c22834a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:47.988133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac240-d2d3-48c5-bcf0-d37f3c22834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.028017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bceac240-d2d3-48c5-bcf0-d37f3c22834a None None] MFA Rules not processed for user `d48188578b564213b80f3598eae2700e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:48.033578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bceac240-d2d3-48c5-bcf0-d37f3c22834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:48.168558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39dd08-8966-4afe-a509-bccbfa5c468d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.175243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.175874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.176153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.176423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.177284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.180012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.193752 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1132/2257] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:48.194723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac240-d2d3-48c5-bcf0-d37f3c22834a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.225039 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1126/2258] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:47 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:48.227714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.244544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dc3a2-9a85-4ad2-b458-b75890763cd0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.251915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.252885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.253557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.254069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.255229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.266331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.312464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac240-d2d3-48c5-bcf0-d37f3c22834a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.325500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.325967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.328075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.330811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.333771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:48.341089 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1127/2259] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:48 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:48.343897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.365678 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:48.388521 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:48.438537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.445599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.467821 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1133/2260] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:48.468092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c16aa6-270b-4456-afc3-ecf6178e02af admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.470078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.480048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.480813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.480813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.481178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.481881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.485473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.495164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a3f9e-da7e-4976-be36-51fa4b09b961 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.506363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.507164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.507441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.507707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.508332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.512372 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1128/2261] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:48.512522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.513437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.533392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a46fe-ef86-4728-81da-0b3e9eec2bc3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.541347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d522-d6b6-4cb8-b9ac-ef54232192ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.542416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d522-d6b6-4cb8-b9ac-ef54232192ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.544385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d522-d6b6-4cb8-b9ac-ef54232192ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.545591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d522-d6b6-4cb8-b9ac-ef54232192ec admin admin] PATH_INFO: `/v3/projects/2f0ba949f8dc4b7494c13a0fa7b387fb/users/b36f8a6bf3fd4cde8092f575873acf08/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.559190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1134/2262] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:48 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:48.559396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.581116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbaa1f-782a-448a-a493-a609a0910d20 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.585925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215d522-d6b6-4cb8-b9ac-ef54232192ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0ba949f8dc4b7494c13a0fa7b387fb, user_id=b36f8a6bf3fd4cde8092f575873acf08, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.588272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215d522-d6b6-4cb8-b9ac-ef54232192ec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.591797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.592476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.592789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.593306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.594665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.596545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.608142 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1129/2263] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:48 2022] PUT /identity/v3/projects/2f0ba949f8dc4b7494c13a0fa7b387fb/users/b36f8a6bf3fd4cde8092f575873acf08/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:48.611174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75048c-37c7-4f75-a088-b5c1bd1f727b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.611300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75048c-37c7-4f75-a088-b5c1bd1f727b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.611557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75048c-37c7-4f75-a088-b5c1bd1f727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.617698 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1135/2264] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:48.619058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.635996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33044b0-df01-4dc3-bcfc-39070264326b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.673798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4c75048c-37c7-4f75-a088-b5c1bd1f727b None None] MFA Rules not processed for user `f17302ce11834fcb8cf2eedac685dfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:48.675063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c75048c-37c7-4f75-a088-b5c1bd1f727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:48.727439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.728057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.728338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.728611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.729438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.733031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.745101 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1136/2265] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:48.746469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.756873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513438-8232-4e40-a2ca-995dfceec0d1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.763862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.764817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.765167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.765655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] PATH_INFO: `/v3/projects/14a2405fed8645d298c23d2e27af9c8b/users/05d8134557a14871a5730649c3b1bfb0/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.783904 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1130/2266] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:48 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:48.785184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75048c-37c7-4f75-a088-b5c1bd1f727b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.797790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a2405fed8645d298c23d2e27af9c8b, user_id=05d8134557a14871a5730649c3b1bfb0, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.809949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.817809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75048c-37c7-4f75-a088-b5c1bd1f727b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:48.823759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:48.825253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:48.825731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:48.826519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] PATH_INFO: `/v3/projects/2f0ba949f8dc4b7494c13a0fa7b387fb/users/b36f8a6bf3fd4cde8092f575873acf08/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:48.829396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0ba949f8dc4b7494c13a0fa7b387fb, user_id=b36f8a6bf3fd4cde8092f575873acf08, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:48.830446 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1137/2267] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:48 2022] PUT /identity/v3/projects/14a2405fed8645d298c23d2e27af9c8b/users/05d8134557a14871a5730649c3b1bfb0/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:48.831372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.833225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:48.862998 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1131/2268] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:48 2022] PUT /identity/v3/projects/2f0ba949f8dc4b7494c13a0fa7b387fb/users/b36f8a6bf3fd4cde8092f575873acf08/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:48.863880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:48.994164 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:49.010658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9d305-875a-4991-8020-92ef6b9fd6d9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:49.019856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabce13-91a8-418c-83cb-45b4a7de8220 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:49.023583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:49.024473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.024970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.025457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] PATH_INFO: `/v3/users/7acce21e97f34900a3d6d303c03c0a5f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.027033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acce21e97f34900a3d6d303c03c0a5f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:49.030190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:49.035965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43e8c-164d-498b-a345-6e2c3fb49dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:49.037350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43e8c-164d-498b-a345-6e2c3fb49dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.037868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43e8c-164d-498b-a345-6e2c3fb49dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.038283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43e8c-164d-498b-a345-6e2c3fb49dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.040075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb43e8c-164d-498b-a345-6e2c3fb49dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:49.041759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb43e8c-164d-498b-a345-6e2c3fb49dd1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:49.067133 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:49.071904 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1132/2269] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:49.073571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1ce3-8882-4d79-b810-3ef4ad764ce1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.073866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1ce3-8882-4d79-b810-3ef4ad764ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.074136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1ce3-8882-4d79-b810-3ef4ad764ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.119669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acce21e97f34900a3d6d303c03c0a5f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:49.135823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b95b1ce3-8882-4d79-b810-3ef4ad764ce1 None None] MFA Rules not processed for user `b36f8a6bf3fd4cde8092f575873acf08`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:49.138964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b95b1ce3-8882-4d79-b810-3ef4ad764ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.157396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acce21e97f34900a3d6d303c03c0a5f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:49.204714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acce21e97f34900a3d6d303c03c0a5f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:49.206214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acce21e97f34900a3d6d303c03c0a5f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:49.231871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acce21e97f34900a3d6d303c03c0a5f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:49.248967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1138/2270] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:48 2022] DELETE /identity/v3/users/7acce21e97f34900a3d6d303c03c0a5f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:49.250613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:49.254085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.306880 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1133/2271] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:49.308251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5582-7911-4630-b570-2e36279bc49c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.308782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5582-7911-4630-b570-2e36279bc49c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.309333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5582-7911-4630-b570-2e36279bc49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.340386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ab5d5582-7911-4630-b570-2e36279bc49c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:49.342750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab5d5582-7911-4630-b570-2e36279bc49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.377883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e7510-d2d0-4c1e-9087-80f0fc6ba5fb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:49.385458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396e916-e5bd-4d0d-8901-dddcc5860084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:49.386619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e916-e5bd-4d0d-8901-dddcc5860084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.387106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e916-e5bd-4d0d-8901-dddcc5860084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.388550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e916-e5bd-4d0d-8901-dddcc5860084 admin admin] PATH_INFO: `/v3/projects/14a2405fed8645d298c23d2e27af9c8b/users/05d8134557a14871a5730649c3b1bfb0/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.391980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396e916-e5bd-4d0d-8901-dddcc5860084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a2405fed8645d298c23d2e27af9c8b, user_id=05d8134557a14871a5730649c3b1bfb0, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:49.397115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396e916-e5bd-4d0d-8901-dddcc5860084 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:49.420972 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1139/2272] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:49 2022] PUT /identity/v3/projects/14a2405fed8645d298c23d2e27af9c8b/users/05d8134557a14871a5730649c3b1bfb0/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:49.422844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.423509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.423943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.445779 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1134/2273] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:49.450328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.450633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.451044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.455421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] MFA Rules not processed for user `1c396660456743b19abe19dccdb9ba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:49.456946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.525899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] MFA Rules not processed for user `05d8134557a14871a5730649c3b1bfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:49.527143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.552155 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1140/2274] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:49.553374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:49.557206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.643742 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:49.668880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0042-a11e-445d-ba35-b96fdd66d8c1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:49.670178 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:49.684192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:49.685013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.685301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.686256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.692944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1135/2275] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:49.710652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:49.714607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.777522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:49.779673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:49.814565 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1141/2276] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:49.815697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:49.818711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.834034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5f8ec-4a91-4c80-a489-c23885d41395 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:49.841361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:49.842697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.843607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.845001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.848824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:49.852914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13ffa5-eae7-48ca-8efa-16234c830a92 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:49.863182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:49.863794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:49.864648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:49.865300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:49.865778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:49.865886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:49.878594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:49.880785 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1136/2277] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:49.881278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:49.894778 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1142/2278] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:50.514323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:50.514323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:50.547605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ae774-388a-41ac-8731-8b75e3cdf2ba service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:50.583535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:50.583535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:50.583535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:50.583535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] PATH_INFO: `/v3/projects/baf0c0d9bc794c1aaaf33285e555f5ec` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:50.586776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf0c0d9bc794c1aaaf33285e555f5ec)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:50.591972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:50.685398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf0c0d9bc794c1aaaf33285e555f5ec', 'request_id': 'req-f1ddb5fd-0714-4623-a25e-c726761f4266'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:50.717494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf0c0d9bc794c1aaaf33285e555f5ec', 'request_id': 'req-f1ddb5fd-0714-4623-a25e-c726761f4266'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:50.764089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf0c0d9bc794c1aaaf33285e555f5ec', 'request_id': 'req-f1ddb5fd-0714-4623-a25e-c726761f4266'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:50.818257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:50.821368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] The token cache is being invalidate because project baf0c0d9bc794c1aaaf33285e555f5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:50.821670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:50.825296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:50.829726 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1137/2279] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:50 2022] DELETE /identity/v3/projects/baf0c0d9bc794c1aaaf33285e555f5ec => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:50.834240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3d9e-c1a4-406c-9864-7ba02b6327c1 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:50.837482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:50.839281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:50.929313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:50.930475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:50.930892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:50.931521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] PATH_INFO: `/v3/users/d48188578b564213b80f3598eae2700e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:50.933242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48188578b564213b80f3598eae2700e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:50.935512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:51.026500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48188578b564213b80f3598eae2700e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.036107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddb5fd-0714-4623-a25e-c726761f4266 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:51.043578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48188578b564213b80f3598eae2700e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.051037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:51.052565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:51.054204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:51.054754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] PATH_INFO: `/v3/users/0de29726ac1d4a7780247230fbfa6906` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:51.058499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de29726ac1d4a7780247230fbfa6906)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:51.063529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:51.077957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48188578b564213b80f3598eae2700e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.080179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48188578b564213b80f3598eae2700e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.085793 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:51.086665 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:51.111474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4688e3c-685b-475d-8f8d-a5ca4c8cf748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48188578b564213b80f3598eae2700e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.138491 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1143/2280] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:50 2022] DELETE /identity/v3/users/d48188578b564213b80f3598eae2700e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:51.146490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:51.146807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:51.147044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:51.223394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de29726ac1d4a7780247230fbfa6906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.232817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:51.233462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:51.240371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de29726ac1d4a7780247230fbfa6906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.241867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de29726ac1d4a7780247230fbfa6906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.257314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de29726ac1d4a7780247230fbfa6906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.259137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de29726ac1d4a7780247230fbfa6906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:51.320110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1138/2281] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:50 2022] DELETE /identity/v3/users/0de29726ac1d4a7780247230fbfa6906 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:51.329475 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1144/2282] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:51.345317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:51.347763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:51.442556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb996d8-8d87-4074-b424-768e6f431a56 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:51.447586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f78fb-769f-4b0b-b3e4-1518c25ea78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:51.448506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f78fb-769f-4b0b-b3e4-1518c25ea78b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:51.449001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f78fb-769f-4b0b-b3e4-1518c25ea78b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:51.449427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f78fb-769f-4b0b-b3e4-1518c25ea78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:51.554789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f78fb-769f-4b0b-b3e4-1518c25ea78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:51.561064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f78fb-769f-4b0b-b3e4-1518c25ea78b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:51.585923 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1139/2283] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:52.179084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:52.180519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:52.197281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b659c0-4810-4df5-9e03-bd09158e7810 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:52.210080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:52.210869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:52.211149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:52.212458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] PATH_INFO: `/v3/projects/662e751a23d848268db9cae5839f8f18` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:52.214129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662e751a23d848268db9cae5839f8f18)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:52.218480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:52.372266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662e751a23d848268db9cae5839f8f18', 'request_id': 'req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:52.380391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662e751a23d848268db9cae5839f8f18', 'request_id': 'req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:52.395692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662e751a23d848268db9cae5839f8f18', 'request_id': 'req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:52.415796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] The token cache is being invalidate because project 662e751a23d848268db9cae5839f8f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:52.416092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:52.420351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ccdcb14f-b7c8-48c9-bb7a-10422fd63be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:52.428237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79029784-7e6c-4951-b562-bd1fde8f4ef9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:52.428525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79029784-7e6c-4951-b562-bd1fde8f4ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:52.428792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79029784-7e6c-4951-b562-bd1fde8f4ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:52.432425 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1145/2284] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:52 2022] DELETE /identity/v3/projects/662e751a23d848268db9cae5839f8f18 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:52.464014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-79029784-7e6c-4951-b562-bd1fde8f4ef9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:52.465304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79029784-7e6c-4951-b562-bd1fde8f4ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:52.539953 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:52.604543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1140/2285] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:52.613019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fabbf8-8c03-4e0e-8763-67090ad2f7af None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:52.613349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fabbf8-8c03-4e0e-8763-67090ad2f7af None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:52.613558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fabbf8-8c03-4e0e-8763-67090ad2f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:52.650343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-52fabbf8-8c03-4e0e-8763-67090ad2f7af None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:52.651200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-52fabbf8-8c03-4e0e-8763-67090ad2f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:52.668840 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1146/2286] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:52.673560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79029784-7e6c-4951-b562-bd1fde8f4ef9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:52.686559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79029784-7e6c-4951-b562-bd1fde8f4ef9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:52.699823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:52.700475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:52.700751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:52.701057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:52.701808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:52.702113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:52.704298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:52.738297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fabbf8-8c03-4e0e-8763-67090ad2f7af None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:52.745251 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1141/2287] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:52.756807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fabbf8-8c03-4e0e-8763-67090ad2f7af None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:52.767787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:52.769664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:52.770585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:52.773022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:52.774532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:52.777550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:52.865518 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1147/2288] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:52 2022] POST /identity/v3/projects => generated 397 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:52.866941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:52.892011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48f9d-6dcf-41b8-91f9-8e2be7343920 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:52.902575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:52.904608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:53.015895 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:53.039543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2040526-8931-4eeb-a9eb-27391576f696 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:53.059277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:53.060228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.061397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.063053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] PATH_INFO: `/v3/projects/a6b3284e864347c6820cda0dbbb1541d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:53.068186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b3284e864347c6820cda0dbbb1541d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:53.074615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:53.082248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:53.082907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.083188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.083470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:53.084408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:53.092186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:53.158329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b3284e864347c6820cda0dbbb1541d', 'request_id': 'req-3614107a-64d5-41b7-9a25-bd594199e03d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.162704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1142/2289] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:52 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:53.163767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:53.166308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b3284e864347c6820cda0dbbb1541d', 'request_id': 'req-3614107a-64d5-41b7-9a25-bd594199e03d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.173643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b3284e864347c6820cda0dbbb1541d', 'request_id': 'req-3614107a-64d5-41b7-9a25-bd594199e03d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.183240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e992cac-47db-4ee9-bcee-fd90f6eb32d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:53.219378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] The token cache is being invalidate because project a6b3284e864347c6820cda0dbbb1541d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:53.219993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.221590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.225926 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1148/2290] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:52 2022] DELETE /identity/v3/projects/a6b3284e864347c6820cda0dbbb1541d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:53.229075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:53.233175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:53.316223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:53.317266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.317812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.318284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:53.319499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:53.321554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:53.354831 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1143/2291] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:07:53.363512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614107a-64d5-41b7-9a25-bd594199e03d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:53.369214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:53.369364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:53.369889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.370310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.370590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] PATH_INFO: `/v3/users/05d8134557a14871a5730649c3b1bfb0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:53.371835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d8134557a14871a5730649c3b1bfb0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:53.373857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:53.385135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:53.406404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed36b8b-58f3-49f4-9452-905448f2bbf4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:53.412038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:53.412657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.412963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.413253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:53.413887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:53.415594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:53.427653 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1144/2292] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:53.431858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:53.438272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d8134557a14871a5730649c3b1bfb0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.442530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fdbfe-afc2-434c-8a17-ddc0e102766e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:53.448642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d8134557a14871a5730649c3b1bfb0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.448849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:53.449734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.450157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.450495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] PATH_INFO: `/v3/projects/ce70f9ff025c4666be942f9399ae72dc/users/547522b0b07f472a91ec83f15a36bb90/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:53.467561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d8134557a14871a5730649c3b1bfb0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.468643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d8134557a14871a5730649c3b1bfb0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.469154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce70f9ff025c4666be942f9399ae72dc, user_id=547522b0b07f472a91ec83f15a36bb90, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:53.471925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:53.475959 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:53.479268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b94d6c15-1fe6-4a9f-8702-b01093413a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d8134557a14871a5730649c3b1bfb0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:53.492199 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1145/2294] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:53 2022] PUT /identity/v3/projects/ce70f9ff025c4666be942f9399ae72dc/users/547522b0b07f472a91ec83f15a36bb90/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:53.492521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1149/2294] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:53 2022] DELETE /identity/v3/users/05d8134557a14871a5730649c3b1bfb0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:53.494619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.494943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.495318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:53.531409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:53.533748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:53.692668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1150/2295] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:53.760814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:53.763181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:53.805574 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:53.904433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83b80-ff48-421e-afb5-d8f2811a82ca admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:53.982368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e106f9-ef7f-4226-8d58-91ff3348f172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:53.983134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e106f9-ef7f-4226-8d58-91ff3348f172 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:53.983621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e106f9-ef7f-4226-8d58-91ff3348f172 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:53.984075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e106f9-ef7f-4226-8d58-91ff3348f172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:54.006458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e106f9-ef7f-4226-8d58-91ff3348f172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:54.008227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e106f9-ef7f-4226-8d58-91ff3348f172 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:54.038532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1146/2296] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:54.489959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:54.492851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:54.512172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad360513-42e3-477d-a99c-7578e16f63ec None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:54.525866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:54.526554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:54.526824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:54.527872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] PATH_INFO: `/v3/projects/14a2405fed8645d298c23d2e27af9c8b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:54.540686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a2405fed8645d298c23d2e27af9c8b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:54.542771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:54.652037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a2405fed8645d298c23d2e27af9c8b', 'request_id': 'req-56f8de72-4140-49f9-b998-bf0ee4ca7527'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:54.662991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a2405fed8645d298c23d2e27af9c8b', 'request_id': 'req-56f8de72-4140-49f9-b998-bf0ee4ca7527'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:54.683380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a2405fed8645d298c23d2e27af9c8b', 'request_id': 'req-56f8de72-4140-49f9-b998-bf0ee4ca7527'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:54.706950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] The token cache is being invalidate because project 14a2405fed8645d298c23d2e27af9c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:07:54.708412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:54.709932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56f8de72-4140-49f9-b998-bf0ee4ca7527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:07:54.718419 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1151/2297] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:07:54 2022] DELETE /identity/v3/projects/14a2405fed8645d298c23d2e27af9c8b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:54.720276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4fd6-da62-4fb2-b67b-aec8f9b620de None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:54.720564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4fd6-da62-4fb2-b67b-aec8f9b620de None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:54.720866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4fd6-da62-4fb2-b67b-aec8f9b620de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:54.768022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b4ba4fd6-da62-4fb2-b67b-aec8f9b620de None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:54.772899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b4ba4fd6-da62-4fb2-b67b-aec8f9b620de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:55.006727 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1147/2298] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:55.014856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4f1ff-e12e-4b5e-b9c3-5fda29c04bdb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.015255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4f1ff-e12e-4b5e-b9c3-5fda29c04bdb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.015634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4f1ff-e12e-4b5e-b9c3-5fda29c04bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.053153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-08f4f1ff-e12e-4b5e-b9c3-5fda29c04bdb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:55.058026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08f4f1ff-e12e-4b5e-b9c3-5fda29c04bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:55.069455 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1152/2299] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:55.073986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba4fd6-da62-4fb2-b67b-aec8f9b620de None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:55.086985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba4fd6-da62-4fb2-b67b-aec8f9b620de None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:55.094087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:55.095153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.095583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.095903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.096646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:07:55.096985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:55.098599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:55.123667 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1148/2300] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:07:55.128444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4f1ff-e12e-4b5e-b9c3-5fda29c04bdb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:55.141671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4f1ff-e12e-4b5e-b9c3-5fda29c04bdb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:55.153946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:55.154587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.154860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.155125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.155985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:55.157925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:55.228616 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1153/2301] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:55 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:55.232951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:55.248463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4cf0-5679-4ab5-8569-4efd47aa0c75 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:55.293578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:55.295387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:55.401479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:55.402150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.402426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.402692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.403352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:55.407315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:55.427723 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:55.443257 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:55.451079 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1149/2302] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:55 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:55.455888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:55.477495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69d0f-99eb-49da-b9d1-a22b0a68a127 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:55.486346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:55.487693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.488134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.488598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.488747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb990ae-a56a-4634-adc3-afdd4da5711c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:55.489862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:55.491691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:55.502301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6bfb6-91b5-4326-88ac-b410bf27b901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:55.502955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6bfb6-91b5-4326-88ac-b410bf27b901 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.503235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6bfb6-91b5-4326-88ac-b410bf27b901 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.503503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6bfb6-91b5-4326-88ac-b410bf27b901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.507583 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1150/2303] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:55.512083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:55.512436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6af6bfb6-91b5-4326-88ac-b410bf27b901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:55.527602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0d75-3d42-4a13-85fc-814fa2c2461b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:55.546188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:55.546830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.547111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.547385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.548049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:55.549905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:55.576807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1151/2304] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:55.580560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:55.604081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b96c-241b-4d2a-a6ce-7c9ba5633b4c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:55.614852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:55.615541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.615879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.616234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] PATH_INFO: `/v3/projects/74a87c21538344c7ac51835993e5839d/users/9ebc6e77ecbc4a61a6f13803cd1a1589/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.664068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a87c21538344c7ac51835993e5839d, user_id=9ebc6e77ecbc4a61a6f13803cd1a1589, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:55.672547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6bfb6-91b5-4326-88ac-b410bf27b901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:55.673047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:55.676048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6bfb6-91b5-4326-88ac-b410bf27b901 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:55.719685 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1154/2306] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:55.722700 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1152/2306] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:55 2022] PUT /identity/v3/projects/74a87c21538344c7ac51835993e5839d/users/9ebc6e77ecbc4a61a6f13803cd1a1589/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:55.741458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20e9f9-195c-4bfa-878b-64ba455fcf2e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:55.741786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20e9f9-195c-4bfa-878b-64ba455fcf2e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:55.742037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20e9f9-195c-4bfa-878b-64ba455fcf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:55.826296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ce20e9f9-195c-4bfa-878b-64ba455fcf2e None None] MFA Rules not processed for user `9ebc6e77ecbc4a61a6f13803cd1a1589`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:55.827827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ce20e9f9-195c-4bfa-878b-64ba455fcf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:55.990165 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1155/2307] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:55.994658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:56.178325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b0c0-9ca7-49f0-bd70-79aa8fc68b4a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:56.189684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:56.190962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:56.191517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:56.191813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:56.197138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:56.208627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:56.335035 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1153/2308] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:07:55 2022] POST /identity/v3/projects => generated 391 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:07:56.339697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20e9f9-195c-4bfa-878b-64ba455fcf2e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:56.358429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20e9f9-195c-4bfa-878b-64ba455fcf2e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:56.479726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:56.480475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:56.480759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:56.481250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:56.481913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:56.485311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:56.549634 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1156/2309] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:07:56 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:07:56.553594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:56.585842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61f7a-5bfa-4d5f-b39b-2bcd658a0889 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:56.613531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:56.614229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:56.614508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:56.614779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:56.618152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:56.619838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:56.674921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1154/2310] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:56.679023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:56.687976 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:56.699537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3f189-73d5-4312-9eff-362e2b88825d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:56.724555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64e1e8-af77-4151-8b77-a64dffc25e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:56.728296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e1e8-af77-4151-8b77-a64dffc25e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:56.729081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e1e8-af77-4151-8b77-a64dffc25e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:56.729325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e1e8-af77-4151-8b77-a64dffc25e2e admin admin] PATH_INFO: `/v3/projects/a420e5cee9a64a2db8b85ce4a4158bf8/users/7abd7dd96a1e4264ba8b374857d1ef89/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:56.771838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64e1e8-af77-4151-8b77-a64dffc25e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a420e5cee9a64a2db8b85ce4a4158bf8, user_id=7abd7dd96a1e4264ba8b374857d1ef89, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:56.774570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64e1e8-af77-4151-8b77-a64dffc25e2e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:56.803372 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1157/2311] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:56 2022] PUT /identity/v3/projects/a420e5cee9a64a2db8b85ce4a4158bf8/users/7abd7dd96a1e4264ba8b374857d1ef89/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:07:56.803965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:56.824919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d9fce-b259-4d52-8d93-3d645b82a3e0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:56.832575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14870d8-68c4-4932-b716-47b8d1613dfe None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:56.833075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14870d8-68c4-4932-b716-47b8d1613dfe None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:56.833503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14870d8-68c4-4932-b716-47b8d1613dfe None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:56.835265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1158/2312] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:56.847187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:56.847650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:56.848035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:56.881116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:56.889400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:56.971982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:56.972605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:56.973040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:56.973596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:56.974445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:56.976907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:56.992554 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1155/2313] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:07:56.999597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:57.017333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c61ea-4187-426d-a111-59e39f5b1948 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:57.024727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efac5b-1789-484b-a221-22be2f178555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:57.025784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efac5b-1789-484b-a221-22be2f178555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:57.026219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efac5b-1789-484b-a221-22be2f178555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:57.026569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efac5b-1789-484b-a221-22be2f178555 admin admin] PATH_INFO: `/v3/projects/a420e5cee9a64a2db8b85ce4a4158bf8/users/7abd7dd96a1e4264ba8b374857d1ef89/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:57.030641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efac5b-1789-484b-a221-22be2f178555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a420e5cee9a64a2db8b85ce4a4158bf8, user_id=7abd7dd96a1e4264ba8b374857d1ef89, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:57.033815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efac5b-1789-484b-a221-22be2f178555 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:57.042519 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:57.050051 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1156/2314] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:07:56 2022] PUT /identity/v3/projects/a420e5cee9a64a2db8b85ce4a4158bf8/users/7abd7dd96a1e4264ba8b374857d1ef89/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:07:57.065181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b59da-0e20-4cad-ab70-3ad410b2a754 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:57.065643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b59da-0e20-4cad-ab70-3ad410b2a754 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:57.065943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b59da-0e20-4cad-ab70-3ad410b2a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:57.111817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1159/2315] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:07:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:57.145364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-785b59da-0e20-4cad-ab70-3ad410b2a754 None None] MFA Rules not processed for user `7abd7dd96a1e4264ba8b374857d1ef89`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:57.147907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-785b59da-0e20-4cad-ab70-3ad410b2a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:57.208588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:57.210287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:57.258620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5cbf0-fcec-4acf-b98e-9aacc1adf30a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:57.426492 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1157/2316] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:57.445961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:57.446194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:57.446575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:57.499041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:57.499826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:57.500218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:57.500476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:57.505320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] MFA Rules not processed for user `9ebc6e77ecbc4a61a6f13803cd1a1589`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:57.516088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:57.521753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:57.523351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:57.572998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1160/2317] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:07:57.743704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1158/2318] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:07:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:57.755539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:57.757004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:57.871658 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:57.881802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718f403-bf3e-4d4d-9520-d0fb74dd1d91 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:57.888004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637b25-7256-4c44-bd67-3f2648604d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:57.889205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637b25-7256-4c44-bd67-3f2648604d5c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:57.889205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637b25-7256-4c44-bd67-3f2648604d5c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:57.889412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637b25-7256-4c44-bd67-3f2648604d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:57.898852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637b25-7256-4c44-bd67-3f2648604d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:57.900536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637b25-7256-4c44-bd67-3f2648604d5c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:57.911573 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1161/2319] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:00.295057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:00.297053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:00.467353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79693ff4-d6f2-4672-bbe9-0039fb4bdf5f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:00.483534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:00.484178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:00.485221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:00.486409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] PATH_INFO: `/v3/users/dd9f99d20b344589961aa679179adbb1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:00.489159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9f99d20b344589961aa679179adbb1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:00.493658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:00.562153 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:00.580174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9f99d20b344589961aa679179adbb1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:00.591137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9f99d20b344589961aa679179adbb1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:00.592335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9f99d20b344589961aa679179adbb1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:00.622907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9f99d20b344589961aa679179adbb1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:00.624846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f1601a-fe16-4eae-ae63-146ea7199a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9f99d20b344589961aa679179adbb1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:00.654007 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1159/2320] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:00 2022] DELETE /identity/v3/users/dd9f99d20b344589961aa679179adbb1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:00.658799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862415-b551-4c69-8480-21617aaa50ab None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:00.659353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862415-b551-4c69-8480-21617aaa50ab None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:00.659353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862415-b551-4c69-8480-21617aaa50ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:00.691187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-30862415-b551-4c69-8480-21617aaa50ab None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:00.692970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-30862415-b551-4c69-8480-21617aaa50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:00.762590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:00.762994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:00.763278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:00.816191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] MFA Rules not processed for user `49f609273d3d4d18a9ef755ed5359da9`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:00.819204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:00.849345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1162/2321] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:00.882456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30862415-b551-4c69-8480-21617aaa50ab None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:00.884124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-30862415-b551-4c69-8480-21617aaa50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:00.983476 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1160/2322] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:00.983696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30862415-b551-4c69-8480-21617aaa50ab None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:00.988393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:00.989077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:00.989352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:00.989629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:01.010159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:01.011771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:01.024421 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1163/2323] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:02.168678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:02.170046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:02.205673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d73256-cd35-46d2-80fe-e231cbe55b26 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:02.227620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:02.230490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:02.230807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:02.231126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] PATH_INFO: `/v3/projects/ee9e0038aadf42e8be2911efd9bfb896` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:02.239050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9e0038aadf42e8be2911efd9bfb896)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:02.241430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:02.394634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9e0038aadf42e8be2911efd9bfb896', 'request_id': 'req-50dba242-210a-4450-b507-c66f0d391e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.413837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9e0038aadf42e8be2911efd9bfb896', 'request_id': 'req-50dba242-210a-4450-b507-c66f0d391e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.428558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9e0038aadf42e8be2911efd9bfb896', 'request_id': 'req-50dba242-210a-4450-b507-c66f0d391e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.465543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] The token cache is being invalidate because project ee9e0038aadf42e8be2911efd9bfb896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:02.465862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.467269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.469975 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1161/2324] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:02 2022] DELETE /identity/v3/projects/ee9e0038aadf42e8be2911efd9bfb896 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:02.474071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:02.489386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcaec2-937b-493c-a8c6-80938fe38444 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:02.688949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:02.689627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:02.700196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:02.700584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] PATH_INFO: `/v3/users/cb645a105adb4bb2b6796f92156ba299` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:02.702017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb645a105adb4bb2b6796f92156ba299)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:02.704545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:02.762913 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:02.785216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb645a105adb4bb2b6796f92156ba299'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.805137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb645a105adb4bb2b6796f92156ba299'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.821018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb645a105adb4bb2b6796f92156ba299'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.822527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb645a105adb4bb2b6796f92156ba299'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.839633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7b9f0f-c37a-41cf-a876-b79859852b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb645a105adb4bb2b6796f92156ba299'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:02.861262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1164/2325] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:02 2022] DELETE /identity/v3/users/cb645a105adb4bb2b6796f92156ba299 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:04.176529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:04.178554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:04.208824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dba242-210a-4450-b507-c66f0d391e8d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:04.272640 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:04.318864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:04.319706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:04.319986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:04.320254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] PATH_INFO: `/v3/projects/10f23780bf3c4f72ac6dddf6159f3cde` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:04.327057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f23780bf3c4f72ac6dddf6159f3cde)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:04.329413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:04.481236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f23780bf3c4f72ac6dddf6159f3cde', 'request_id': 'req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:04.491822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f23780bf3c4f72ac6dddf6159f3cde', 'request_id': 'req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:04.502232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f23780bf3c4f72ac6dddf6159f3cde', 'request_id': 'req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:04.549753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] The token cache is being invalidate because project 10f23780bf3c4f72ac6dddf6159f3cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:04.550200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:04.551358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0ad1fe57-329e-4e01-98bb-0ceaa148ad9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:04.553405 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1162/2326] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:04 2022] DELETE /identity/v3/projects/10f23780bf3c4f72ac6dddf6159f3cde => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:04.560178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187781fd-4401-42ad-9dd6-7a811af0af61 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:04.561584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187781fd-4401-42ad-9dd6-7a811af0af61 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:04.562158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187781fd-4401-42ad-9dd6-7a811af0af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:04.611371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-187781fd-4401-42ad-9dd6-7a811af0af61 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:04.614291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-187781fd-4401-42ad-9dd6-7a811af0af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:04.734595 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1165/2327] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:04.742355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cc92-e7bf-44cf-b8fe-5d0df902d312 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:04.742658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cc92-e7bf-44cf-b8fe-5d0df902d312 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:04.743620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cc92-e7bf-44cf-b8fe-5d0df902d312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:04.787895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e7c0cc92-e7bf-44cf-b8fe-5d0df902d312 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:04.791261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e7c0cc92-e7bf-44cf-b8fe-5d0df902d312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:04.806538 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1163/2328] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:04.807378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187781fd-4401-42ad-9dd6-7a811af0af61 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:04.818812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187781fd-4401-42ad-9dd6-7a811af0af61 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:04.824706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:04.826513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:04.826663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:04.827207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:04.827968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:04.828669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:04.834267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:04.870048 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1166/2329] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:08:04.874434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cc92-e7bf-44cf-b8fe-5d0df902d312 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:04.887879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cc92-e7bf-44cf-b8fe-5d0df902d312 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:04.893462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:04.894603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:04.894884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:04.895154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:04.895801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:04.898661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:04.945472 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1164/2330] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:04 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:04.949621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:04.966782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7b970-f38f-4309-983a-25fac2adacb9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:05.102793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:05.103754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:05.104407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:05.105773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:05.106629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:05.113777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:05.174438 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1167/2331] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:04 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:05.176071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:05.187827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459bd1-1bb4-4449-ad9f-fd07d120ea16 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:05.194020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:05.213629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:05.214156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:05.214577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:05.215918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:05.219196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:05.252206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:05.252451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1165/2332] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:08:05.277460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612308f-5650-47ee-949c-b19e56059257 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:05.297109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242eaf4-aa5f-4bc1-9a49-ff9274061adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:05.300467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242eaf4-aa5f-4bc1-9a49-ff9274061adf admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:05.300980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242eaf4-aa5f-4bc1-9a49-ff9274061adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:05.301750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242eaf4-aa5f-4bc1-9a49-ff9274061adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:05.303381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242eaf4-aa5f-4bc1-9a49-ff9274061adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:05.305769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242eaf4-aa5f-4bc1-9a49-ff9274061adf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:05.326814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1168/2333] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:05.332101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:05.352117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9883c7-3604-47ff-a1e8-8ebdac54e1d1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:05.371931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:05.373406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:05.377076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:05.377855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] PATH_INFO: `/v3/projects/cc27cc6473f245f3a9a23a05d0033a02/users/0d6319c7317f4d85b3e50ad26384e3e9/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:05.427699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc27cc6473f245f3a9a23a05d0033a02, user_id=0d6319c7317f4d85b3e50ad26384e3e9, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:05.434960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:05.473986 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1166/2334] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:05 2022] PUT /identity/v3/projects/cc27cc6473f245f3a9a23a05d0033a02/users/0d6319c7317f4d85b3e50ad26384e3e9/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:05.484542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f5f5-26aa-42ea-8bca-795a1d4105ea None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:05.485008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f5f5-26aa-42ea-8bca-795a1d4105ea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:05.485295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f5f5-26aa-42ea-8bca-795a1d4105ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:05.558633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-61d4f5f5-26aa-42ea-8bca-795a1d4105ea None None] MFA Rules not processed for user `0d6319c7317f4d85b3e50ad26384e3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:05.559901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-61d4f5f5-26aa-42ea-8bca-795a1d4105ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:05.574902 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:05.704992 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1169/2335] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:05.705328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:05.793986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:05.794353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:05.794590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:05.871884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] MFA Rules not processed for user `547522b0b07f472a91ec83f15a36bb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:05.873653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:05.909536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7a2c9-6553-4145-a10f-863de702b436 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:05.924686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:05.925436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:05.925715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:05.925980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:05.926617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:05.930966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:05.974252 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:06.006103 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1170/2336] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:06.018323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.022611 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1167/2337] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:05 2022] POST /identity/v3/projects => generated 393 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:06.023370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:06.023790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.047182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c8f51-6e13-4518-8cfb-53a81334db77 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.136919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9eceb-da3e-4d49-bc80-89ef9bbd17a4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.147516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.148306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.148591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.148900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.149903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.152643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.168201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.170729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.171216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.171322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.171969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.174020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.182205 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1168/2338] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:06 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:06.186108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.201199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef36f2-a3b7-48f7-a68b-32e31ec1bc16 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.208335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.209272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.209649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.210966 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1171/2339] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:06 2022] POST /identity/v3/projects => generated 397 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:06.213067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.214883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.215454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.217895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.235251 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1169/2340] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:06.239498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.255632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b75675-0702-4cf9-8aef-c33f5ef37ffa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.278913 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:06.363845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188efd0-de27-4aae-a386-b2108ca70d40 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.375750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.377570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.377889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.378182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.379275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.384954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.421359 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1172/2341] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:06 2022] POST /identity/v3/users => generated 305 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:06.422335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.424524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.425244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.425517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.425836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] PATH_INFO: `/v3/projects/2e2b44ce465e4588b54b238cb766582f/users/351aa6435f3243388739d58e960facf7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.435607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156f07-b377-4d52-8479-766b3d6a9806 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.441491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.442290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.442808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.443753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.444605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.447650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.479920 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1173/2342] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:06.479920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.487678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:06.488961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2b44ce465e4588b54b238cb766582f, user_id=351aa6435f3243388739d58e960facf7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.496062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.530985 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1170/2343] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:06 2022] PUT /identity/v3/projects/2e2b44ce465e4588b54b238cb766582f/users/351aa6435f3243388739d58e960facf7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:06.530985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.533347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb7a0-e0a5-44e7-b270-27edc27b4a66 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.659865 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:06.675963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.676737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.677168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.677439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] PATH_INFO: `/v3/users/08b0e93dc59a4024b6ff32c7f9f24b81` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.680027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b0e93dc59a4024b6ff32c7f9f24b81)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.681993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.687290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2140d-16b2-4761-9932-a0d89daf16aa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.697899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.698475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.698750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.699020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] PATH_INFO: `/v3/projects/14f437a323e14d4587abeaf218a30361/users/1ed19f30606d407b9ae85394340246a8/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.731254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f437a323e14d4587abeaf218a30361, user_id=1ed19f30606d407b9ae85394340246a8, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.734373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.762803 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1171/2344] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:06 2022] PUT /identity/v3/projects/14f437a323e14d4587abeaf218a30361/users/1ed19f30606d407b9ae85394340246a8/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:06.763907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.812104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b0e93dc59a4024b6ff32c7f9f24b81'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:06.833319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b0e93dc59a4024b6ff32c7f9f24b81'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:06.874452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b0e93dc59a4024b6ff32c7f9f24b81'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:06.876732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b0e93dc59a4024b6ff32c7f9f24b81'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:06.887240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46781e08-d7de-4483-909a-96e99b7905c5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.898028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:06.898260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:06.898354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:06.898629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:06.900026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:06.902220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:06.904989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b0e93dc59a4024b6ff32c7f9f24b81'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:06.915812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1172/2345] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:06.916825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.920262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:06.927756 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1174/2346] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:06 2022] DELETE /identity/v3/users/08b0e93dc59a4024b6ff32c7f9f24b81 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:06.928869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:06.931776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:06.938064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cf7e6-8ec2-42d9-80c0-d6e446bdffd3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:06.968533 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:07.035349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:07.037637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:07.038384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:07.038811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:07.039620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:07.042633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:07.059198 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1173/2347] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:07.063372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:07.080007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b468-524b-4923-8794-04f47af45c48 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:07.085489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a6705-4c42-4138-8768-004f05abb3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:07.086321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6705-4c42-4138-8768-004f05abb3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:07.086694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6705-4c42-4138-8768-004f05abb3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:07.087066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6705-4c42-4138-8768-004f05abb3ca admin admin] PATH_INFO: `/v3/projects/14f437a323e14d4587abeaf218a30361/users/1ed19f30606d407b9ae85394340246a8/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:07.093221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a6705-4c42-4138-8768-004f05abb3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f437a323e14d4587abeaf218a30361, user_id=1ed19f30606d407b9ae85394340246a8, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:07.098718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896838-4a7f-4b22-aa80-6fe276bf3c3f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:07.104504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a6705-4c42-4138-8768-004f05abb3ca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:07.106138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:07.107056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:07.107387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:07.107755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] PATH_INFO: `/v3/projects/2e2b44ce465e4588b54b238cb766582f/users/351aa6435f3243388739d58e960facf7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:07.113655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2b44ce465e4588b54b238cb766582f, user_id=351aa6435f3243388739d58e960facf7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:07.119019 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1174/2348] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:07 2022] PUT /identity/v3/projects/14f437a323e14d4587abeaf218a30361/users/1ed19f30606d407b9ae85394340246a8/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:07.120284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:07.151281 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1175/2349] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:06 2022] PUT /identity/v3/projects/2e2b44ce465e4588b54b238cb766582f/users/351aa6435f3243388739d58e960facf7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:07.165348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:07.165794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:07.166165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:07.216667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] MFA Rules not processed for user `351aa6435f3243388739d58e960facf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:07.218135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:07.294509 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:07.350297 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1175/2350] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:07.679970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:07.681718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:07.855971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f994fb-251d-4856-b08c-95ced689210a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:07.875221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:07.875938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:07.876959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:07.876959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:07.893116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:07.895512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:07.911429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:07.913105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:07.917851 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1176/2351] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:07.979822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:08.000894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201023-1af3-4b25-80fd-06d8d45b3a72 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:08.019700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:08.020584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:08.020960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:08.021320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:08.024719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:08.052163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa7021-a993-4c99-9b71-815f28461699 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:08.058560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:08.058785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:08.059338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:08.059792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] PATH_INFO: `/v3/projects/7c9dc94c03e04a97bc67b4be79912d18` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:08.061539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9dc94c03e04a97bc67b4be79912d18)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:08.063845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:08.206549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:08.208667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:08.226605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9dc94c03e04a97bc67b4be79912d18', 'request_id': 'req-8251cf40-258e-4729-8ad1-c45195e28d90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.238017 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1177/2352] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:08.241727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9dc94c03e04a97bc67b4be79912d18', 'request_id': 'req-8251cf40-258e-4729-8ad1-c45195e28d90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.257372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9dc94c03e04a97bc67b4be79912d18', 'request_id': 'req-8251cf40-258e-4729-8ad1-c45195e28d90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.262982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:08.275951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] The token cache is being invalidate because project 7c9dc94c03e04a97bc67b4be79912d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:08.277003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.290225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28130b3-a61c-418b-8c25-02474ee49e5b service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:08.292680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.299393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1176/2353] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:07 2022] DELETE /identity/v3/projects/7c9dc94c03e04a97bc67b4be79912d18 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:08.300922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:08.302661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:08.395697 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:08.414001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251cf40-258e-4729-8ad1-c45195e28d90 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:08.425063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:08.429496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:08.430122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:08.432411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] PATH_INFO: `/v3/users/f17302ce11834fcb8cf2eedac685dfb3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:08.435138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17302ce11834fcb8cf2eedac685dfb3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:08.441057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:08.454913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:08.457655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:08.457991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:08.458485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] PATH_INFO: `/v3/users/0d6319c7317f4d85b3e50ad26384e3e9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:08.463059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6319c7317f4d85b3e50ad26384e3e9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:08.466959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:08.470552 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:08.561871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17302ce11834fcb8cf2eedac685dfb3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.575251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6319c7317f4d85b3e50ad26384e3e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.578291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17302ce11834fcb8cf2eedac685dfb3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.580902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17302ce11834fcb8cf2eedac685dfb3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.588559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6319c7317f4d85b3e50ad26384e3e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.590981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17302ce11834fcb8cf2eedac685dfb3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.592009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5d369f6-81b9-463d-b52f-9cbb844b85a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17302ce11834fcb8cf2eedac685dfb3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.609019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6319c7317f4d85b3e50ad26384e3e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.609636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6319c7317f4d85b3e50ad26384e3e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.616149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1177/2354] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:08 2022] DELETE /identity/v3/users/f17302ce11834fcb8cf2eedac685dfb3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:08.624420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6319c7317f4d85b3e50ad26384e3e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:08.635453 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1178/2355] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:08 2022] DELETE /identity/v3/users/0d6319c7317f4d85b3e50ad26384e3e9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:08.636931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:08.637237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:08.637483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:08.682008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:08.683462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:08.807514 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1178/2356] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:08.824543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:08.826193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:08.954192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a95f1-c6d7-4290-9035-2383b227f259 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:08.968128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb1a4-277d-4666-9729-e6b45630238f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:08.968805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb1a4-277d-4666-9729-e6b45630238f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:08.969082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb1a4-277d-4666-9729-e6b45630238f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:08.969346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb1a4-277d-4666-9729-e6b45630238f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:08.988936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb1a4-277d-4666-9729-e6b45630238f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:08.992223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb1a4-277d-4666-9729-e6b45630238f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:09.010054 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1179/2357] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:09.122457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:09.125304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:09.162668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff2446-66cf-4f4f-9830-9c89a5e24aed None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:09.169011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:09.169760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:09.170102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:09.170531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] PATH_INFO: `/v3/projects/1beee884e63a4d048a6575f1722c949a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:09.171995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1beee884e63a4d048a6575f1722c949a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:09.174498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:09.253610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1beee884e63a4d048a6575f1722c949a', 'request_id': 'req-a6a3ee4a-39fc-403d-b759-145214d1c084'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:09.270680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1beee884e63a4d048a6575f1722c949a', 'request_id': 'req-a6a3ee4a-39fc-403d-b759-145214d1c084'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:09.286268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1beee884e63a4d048a6575f1722c949a', 'request_id': 'req-a6a3ee4a-39fc-403d-b759-145214d1c084'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:09.304050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] The token cache is being invalidate because project 1beee884e63a4d048a6575f1722c949a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:09.304386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:09.305134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a6a3ee4a-39fc-403d-b759-145214d1c084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:09.310337 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1179/2358] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:09 2022] DELETE /identity/v3/projects/1beee884e63a4d048a6575f1722c949a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:09.313284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c3cb-c34c-4188-836d-d2e251dc8552 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:09.314317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c3cb-c34c-4188-836d-d2e251dc8552 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:09.314317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c3cb-c34c-4188-836d-d2e251dc8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:09.343484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-36e2c3cb-c34c-4188-836d-d2e251dc8552 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:09.345093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-36e2c3cb-c34c-4188-836d-d2e251dc8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:09.459123 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:09.481893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1180/2359] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:09.483567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf619cfb-edcd-4824-8799-c677e5c1dd0e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:09.484039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf619cfb-edcd-4824-8799-c677e5c1dd0e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:09.484320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf619cfb-edcd-4824-8799-c677e5c1dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:09.538271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bf619cfb-edcd-4824-8799-c677e5c1dd0e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:09.539643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bf619cfb-edcd-4824-8799-c677e5c1dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:09.558787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1180/2360] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:09.560103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2c3cb-c34c-4188-836d-d2e251dc8552 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:09.574139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2c3cb-c34c-4188-836d-d2e251dc8552 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:09.591077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:09.591743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:09.592023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:09.592615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:09.593126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:09.593436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:09.595140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:09.620332 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1181/2361] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:09.622582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf619cfb-edcd-4824-8799-c677e5c1dd0e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:09.630093 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:09.637917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf619cfb-edcd-4824-8799-c677e5c1dd0e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:09.647198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:09.651741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:09.652403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:09.652940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:09.654440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:09.658161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:09.724919 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1181/2362] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:09 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:09.725972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:09.743891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223d20-1ef8-4897-ac9a-b9297b58f487 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:09.859514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:09.862358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:09.915510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:09.916148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:09.916907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:09.916907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:09.923924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:09.930340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:09.979806 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1182/2363] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:09 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:09.981105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:10.016011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403a0b3-fbee-45ef-97ff-e35f8f7a95dc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:10.035876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c12c3-5616-4f9d-a8a0-79179261e13f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:10.036293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:10.037252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:10.037936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:10.038371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:10.039210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:10.042171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:10.056296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:10.059638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:10.060114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:10.060543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] PATH_INFO: `/v3/projects/cc27cc6473f245f3a9a23a05d0033a02` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:10.064363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc27cc6473f245f3a9a23a05d0033a02)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:10.072423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1183/2364] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:10.073897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:10.075528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:10.091791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59907-7357-4c50-a455-272245cc45fc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:10.105352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:10.107262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:10.110931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:10.112319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:10.113993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:10.117354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:10.175152 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1184/2365] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:10.176012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:10.192566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564e3fd-eeb9-4b82-971d-e4d5c9fc31f6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:10.235956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc27cc6473f245f3a9a23a05d0033a02', 'request_id': 'req-5f191247-ce0b-4424-b293-90e08ba87b4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.251882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc27cc6473f245f3a9a23a05d0033a02', 'request_id': 'req-5f191247-ce0b-4424-b293-90e08ba87b4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.267226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc27cc6473f245f3a9a23a05d0033a02', 'request_id': 'req-5f191247-ce0b-4424-b293-90e08ba87b4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.284512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] The token cache is being invalidate because project cc27cc6473f245f3a9a23a05d0033a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:10.284875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.285949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.288819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1182/2366] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:09 2022] DELETE /identity/v3/projects/cc27cc6473f245f3a9a23a05d0033a02 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:10.292636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:10.298854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:10.386779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c424b-5483-42ce-8929-adc592477b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:10.387657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c424b-5483-42ce-8929-adc592477b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:10.388026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c424b-5483-42ce-8929-adc592477b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:10.388407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c424b-5483-42ce-8929-adc592477b57 admin admin] PATH_INFO: `/v3/projects/f8905ebcf94b46da8aad6632c78b4881/users/72250431a7f44bff83c1881ff733f2de/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:10.431579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c424b-5483-42ce-8929-adc592477b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8905ebcf94b46da8aad6632c78b4881, user_id=72250431a7f44bff83c1881ff733f2de, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:10.434560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c424b-5483-42ce-8929-adc592477b57 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:10.469561 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1185/2367] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:10 2022] PUT /identity/v3/projects/f8905ebcf94b46da8aad6632c78b4881/users/72250431a7f44bff83c1881ff733f2de/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:10.471217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:10.472276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:10.475906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:10.489113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f191247-ce0b-4424-b293-90e08ba87b4b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:10.525207 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:10.552722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] MFA Rules not processed for user `72250431a7f44bff83c1881ff733f2de`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:10.555053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:10.591010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:10.591710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:10.591993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:10.618427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] PATH_INFO: `/v3/users/351aa6435f3243388739d58e960facf7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:10.620014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=351aa6435f3243388739d58e960facf7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:10.625396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:10.669713 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:10.752260 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1186/2368] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:10.757182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:10.759434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:10.778220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02579bd-2558-4595-b9d1-fd365b8ca3dd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:10.785304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:10.785995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:10.786284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:10.786545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:10.787189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:10.788214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351aa6435f3243388739d58e960facf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.792803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:10.803298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351aa6435f3243388739d58e960facf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.805183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351aa6435f3243388739d58e960facf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.826148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351aa6435f3243388739d58e960facf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.828195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351aa6435f3243388739d58e960facf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:10.848829 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1187/2369] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:10 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:10.852798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:10.856133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:10.858795 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1183/2370] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:10 2022] DELETE /identity/v3/users/351aa6435f3243388739d58e960facf7 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:10.935022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71ac4-ce25-41ec-94a3-0a816924730c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.000595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.001389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.001590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.001825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.002455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.004443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.029334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1188/2371] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:10 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:11.034277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.053680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ad91-0d5c-45f0-82e7-609cf7e4c4bd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.059006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.059839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.060281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.060689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.062198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.064501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.080156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1184/2372] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:08:11.084503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.096828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3de7-d8ba-4410-89f6-8fc13d50de55 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.102413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.103199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.103645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.104032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] PATH_INFO: `/v3/projects/c27f9d1ac44947208d478968f0ced360/users/b35f092e6bfa489c910de20007267a75/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.123173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27f9d1ac44947208d478968f0ced360, user_id=b35f092e6bfa489c910de20007267a75, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.126214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.160146 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1189/2373] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:11 2022] PUT /identity/v3/projects/c27f9d1ac44947208d478968f0ced360/users/b35f092e6bfa489c910de20007267a75/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:11.163975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.177698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c64c-b16d-4eec-b63d-d30e87183016 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.199680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.201784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:11.238742 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:11.340898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f11b1a-8bd3-4a5d-8c0c-da466fdbb068 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.353502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.354185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.354467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.354745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] PATH_INFO: `/v3/projects/2e2b44ce465e4588b54b238cb766582f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.359663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2b44ce465e4588b54b238cb766582f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.362600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.363669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.364433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.364832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.365200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.366013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.367819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.394263 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1185/2374] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:08:11.396717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.416570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5690f5-54bf-4275-954b-7b1b73599532 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.422295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bdeab-d41e-48fc-ba28-7b137aa469ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.422990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdeab-d41e-48fc-ba28-7b137aa469ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.423274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdeab-d41e-48fc-ba28-7b137aa469ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.423547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdeab-d41e-48fc-ba28-7b137aa469ae admin admin] PATH_INFO: `/v3/projects/c27f9d1ac44947208d478968f0ced360/users/b35f092e6bfa489c910de20007267a75/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.425732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bdeab-d41e-48fc-ba28-7b137aa469ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27f9d1ac44947208d478968f0ced360, user_id=b35f092e6bfa489c910de20007267a75, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.428636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bdeab-d41e-48fc-ba28-7b137aa469ae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.458702 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1186/2375] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:11 2022] PUT /identity/v3/projects/c27f9d1ac44947208d478968f0ced360/users/b35f092e6bfa489c910de20007267a75/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:11.469912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9a35a-7722-4f5d-b8f5-08249f65c2a2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.470534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9a35a-7722-4f5d-b8f5-08249f65c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.471214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9a35a-7722-4f5d-b8f5-08249f65c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.504403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2b44ce465e4588b54b238cb766582f', 'request_id': 'req-eec48adb-95ad-4279-86d6-b26c63061994'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:11.516483 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:11.522585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2b44ce465e4588b54b238cb766582f', 'request_id': 'req-eec48adb-95ad-4279-86d6-b26c63061994'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:11.530457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dad9a35a-7722-4f5d-b8f5-08249f65c2a2 None None] MFA Rules not processed for user `b35f092e6bfa489c910de20007267a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:11.534612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dad9a35a-7722-4f5d-b8f5-08249f65c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:11.542790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2b44ce465e4588b54b238cb766582f', 'request_id': 'req-eec48adb-95ad-4279-86d6-b26c63061994'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:11.572851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] The token cache is being invalidate because project 2e2b44ce465e4588b54b238cb766582f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:11.572851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:11.572851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-eec48adb-95ad-4279-86d6-b26c63061994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:11.580005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1190/2376] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:11 2022] DELETE /identity/v3/projects/2e2b44ce465e4588b54b238cb766582f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:11.581731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425ec9b-0a2c-4476-9d0b-0a5d7b363f1c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.582042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425ec9b-0a2c-4476-9d0b-0a5d7b363f1c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.582339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425ec9b-0a2c-4476-9d0b-0a5d7b363f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.632494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a425ec9b-0a2c-4476-9d0b-0a5d7b363f1c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:11.633834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a425ec9b-0a2c-4476-9d0b-0a5d7b363f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:11.746575 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1187/2377] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:11.761555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.762997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.763425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.769747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1191/2378] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:11.778341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e688a-9cd7-4db8-9abd-95b7df6627fd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.778834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e688a-9cd7-4db8-9abd-95b7df6627fd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.779215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e688a-9cd7-4db8-9abd-95b7df6627fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.815197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3c3e688a-9cd7-4db8-9abd-95b7df6627fd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:11.816585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3c3e688a-9cd7-4db8-9abd-95b7df6627fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:11.828459 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1192/2379] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:11.832651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e688a-9cd7-4db8-9abd-95b7df6627fd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.844045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e688a-9cd7-4db8-9abd-95b7df6627fd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.849956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.850612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.850896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.851197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.851969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:11.852417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.854299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.859945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] MFA Rules not processed for user `72250431a7f44bff83c1881ff733f2de`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:11.861238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:11.876576 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1193/2380] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:11.877635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.893706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07775-a1e9-4e32-b8c5-dcef0ef19119 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:11.900496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:11.901306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:11.901648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:11.901987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:11.902698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:11.905737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:11.953679 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1194/2381] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:11 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:11.955312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:11.980666 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:12.028950 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1188/2382] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:12.040518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:12.042141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:12.097222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eadeca-1f3f-47b8-bad9-207c744bc729 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:12.105076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:12.106069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:12.106654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:12.107034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:12.107911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:12.111117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:12.161247 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1195/2383] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:11 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:12.162824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:12.178650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b959269-7e0f-407c-9394-5138d7c60ebf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:12.185179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:12.187203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:12.187597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:12.187972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:12.189079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:12.191115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:12.208720 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1196/2384] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:12.209789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:12.223345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b961-b43a-4ee3-9498-1cb56eedff13 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:12.228888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e32b0-5a6f-4d65-a41c-d4340324bf07 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:12.239036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:12.240980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:12.241463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:12.241979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:12.242744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:12.245561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:12.269110 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1197/2385] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:12.273153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:12.291063 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:12.293786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4825df-daf3-4c79-9ba4-f0903ca28c63 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:12.301165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93520617-2a96-4c76-bfd0-ab0d85ffa527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:12.302324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520617-2a96-4c76-bfd0-ab0d85ffa527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:12.303268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520617-2a96-4c76-bfd0-ab0d85ffa527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:12.303639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520617-2a96-4c76-bfd0-ab0d85ffa527 admin admin] PATH_INFO: `/v3/projects/0ca9a15019fa4648a678781cbaf227bb/users/698cee4e0a2a441c86037db6194eb603/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:12.325928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:12.326668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:12.327096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:12.327647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:12.329984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:12.330663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93520617-2a96-4c76-bfd0-ab0d85ffa527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca9a15019fa4648a678781cbaf227bb, user_id=698cee4e0a2a441c86037db6194eb603, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:12.334381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93520617-2a96-4c76-bfd0-ab0d85ffa527 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:12.356257 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1198/2386] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:12 2022] PUT /identity/v3/projects/0ca9a15019fa4648a678781cbaf227bb/users/698cee4e0a2a441c86037db6194eb603/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:12.373796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb4f0e-8453-493c-8ec7-d583a80b4696 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:12.375904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb4f0e-8453-493c-8ec7-d583a80b4696 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:12.377883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb4f0e-8453-493c-8ec7-d583a80b4696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:12.477184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fcfb4f0e-8453-493c-8ec7-d583a80b4696 None None] MFA Rules not processed for user `698cee4e0a2a441c86037db6194eb603`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:12.478383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fcfb4f0e-8453-493c-8ec7-d583a80b4696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:12.511218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:12.513326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:12.528497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1189/2387] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:12.591533 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1199/2388] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:13.117780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:13.121498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:13.151449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae95d8-8900-4140-b997-4dbaea991d24 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:13.287650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca8514-b503-47c9-8426-563637b15d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:13.288784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8514-b503-47c9-8426-563637b15d22 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:13.289078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8514-b503-47c9-8426-563637b15d22 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:13.289355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8514-b503-47c9-8426-563637b15d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:13.304904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca8514-b503-47c9-8426-563637b15d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:13.307589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca8514-b503-47c9-8426-563637b15d22 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:13.325093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1190/2389] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:14.960717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb4f0e-8453-493c-8ec7-d583a80b4696 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:15.107388 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:15.173057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb4f0e-8453-493c-8ec7-d583a80b4696 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:15.186212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:15.187108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:15.187461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:15.187737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] PATH_INFO: `/v3/users/698cee4e0a2a441c86037db6194eb603` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:15.190133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698cee4e0a2a441c86037db6194eb603)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:15.192106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:15.301407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698cee4e0a2a441c86037db6194eb603'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:15.319832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698cee4e0a2a441c86037db6194eb603'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:15.349880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698cee4e0a2a441c86037db6194eb603'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:15.352401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698cee4e0a2a441c86037db6194eb603'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:15.369598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698cee4e0a2a441c86037db6194eb603'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:15.398531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1200/2390] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:14 2022] DELETE /identity/v3/users/698cee4e0a2a441c86037db6194eb603 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:15.403132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:15.404153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:15.404788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:15.462827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:15.468915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:15.646337 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1191/2391] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:15.668494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:15.670407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:15.905559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848871db-a655-42cf-870e-1ffa9b388fc3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:15.919063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee032-4958-4fdb-956b-90698f38e349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:15.919991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee032-4958-4fdb-956b-90698f38e349 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:15.920742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee032-4958-4fdb-956b-90698f38e349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:15.921301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee032-4958-4fdb-956b-90698f38e349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:15.936928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee032-4958-4fdb-956b-90698f38e349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:15.939243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee032-4958-4fdb-956b-90698f38e349 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:15.986398 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1201/2392] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:16.808091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:16.809599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:16.823730 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:16.842134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6077d8b-c4fb-4053-901c-3eaa1cfa9f3d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:16.849397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:16.849542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:16.849783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:16.850354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] PATH_INFO: `/v3/projects/0ca9a15019fa4648a678781cbaf227bb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:16.875006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca9a15019fa4648a678781cbaf227bb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:16.876996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:16.955799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776eb4e-a9a8-4007-b918-fcf5bc8d6c8c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:16.956089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776eb4e-a9a8-4007-b918-fcf5bc8d6c8c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:16.956372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776eb4e-a9a8-4007-b918-fcf5bc8d6c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:16.996026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca9a15019fa4648a678781cbaf227bb', 'request_id': 'req-02e822d2-d756-45c0-8cb0-f024cf756cb9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.003898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6776eb4e-a9a8-4007-b918-fcf5bc8d6c8c None None] MFA Rules not processed for user `1ed19f30606d407b9ae85394340246a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:17.005577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6776eb4e-a9a8-4007-b918-fcf5bc8d6c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.006194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca9a15019fa4648a678781cbaf227bb', 'request_id': 'req-02e822d2-d756-45c0-8cb0-f024cf756cb9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.014404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca9a15019fa4648a678781cbaf227bb', 'request_id': 'req-02e822d2-d756-45c0-8cb0-f024cf756cb9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.026783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] The token cache is being invalidate because project 0ca9a15019fa4648a678781cbaf227bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:17.027165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.028006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-02e822d2-d756-45c0-8cb0-f024cf756cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.030081 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1192/2393] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:16 2022] DELETE /identity/v3/projects/0ca9a15019fa4648a678781cbaf227bb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:17.035141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fbddc-1368-41f2-a1b7-157197d81fe8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.035451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fbddc-1368-41f2-a1b7-157197d81fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.035755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fbddc-1368-41f2-a1b7-157197d81fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.079852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-630fbddc-1368-41f2-a1b7-157197d81fe8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:17.081509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-630fbddc-1368-41f2-a1b7-157197d81fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.100798 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:17.132154 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1202/2394] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:16 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:17.146853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.147144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.147419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.178409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] MFA Rules not processed for user `547522b0b07f472a91ec83f15a36bb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:17.179834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.182176 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1193/2395] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:17.256065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d921fb9-62b7-4da0-9dc9-1b272b5e1fa6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.256818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d921fb9-62b7-4da0-9dc9-1b272b5e1fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.257408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d921fb9-62b7-4da0-9dc9-1b272b5e1fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.273635 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1203/2396] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:17.281429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1d921fb9-62b7-4da0-9dc9-1b272b5e1fa6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:17.283503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1d921fb9-62b7-4da0-9dc9-1b272b5e1fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.285192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.286990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.293832 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1194/2397] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:17.298475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d921fb9-62b7-4da0-9dc9-1b272b5e1fa6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.312202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d921fb9-62b7-4da0-9dc9-1b272b5e1fa6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:17.317265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:17.318167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.319030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.319655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.320613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:17.321135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:17.323025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:17.344889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1195/2398] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:17.346006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.365154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372931b2-cf48-4b57-b9e5-1b2318ed942f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:17.376751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:17.377507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.377875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.378239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.379013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:17.381239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:17.444846 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1196/2399] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:17 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:17.444846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.445575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.461809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213263df-40c5-4aac-b611-5d3e88c95be0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:17.523406 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:17.564070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49305e-c36e-4763-b31d-19d780580e4a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:17.573716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:17.574105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.574691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.575148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] PATH_INFO: `/v3/users/22500a157cbb43eab8e92270d59a2f2a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.577020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22500a157cbb43eab8e92270d59a2f2a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:17.581960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:17.626302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fbec0-2b1c-4207-9554-836b39c9cc30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:17.626948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbec0-2b1c-4207-9554-836b39c9cc30 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.627399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbec0-2b1c-4207-9554-836b39c9cc30 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.627681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbec0-2b1c-4207-9554-836b39c9cc30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.633657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-539fbec0-2b1c-4207-9554-836b39c9cc30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.670499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22500a157cbb43eab8e92270d59a2f2a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.685822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22500a157cbb43eab8e92270d59a2f2a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.687372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22500a157cbb43eab8e92270d59a2f2a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.696670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22500a157cbb43eab8e92270d59a2f2a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.698395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22500a157cbb43eab8e92270d59a2f2a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:17.703617 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:17.724843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1197/2400] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:17 2022] DELETE /identity/v3/users/22500a157cbb43eab8e92270d59a2f2a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:17.726170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.727915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.777184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fbec0-2b1c-4207-9554-836b39c9cc30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:17.790397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fbec0-2b1c-4207-9554-836b39c9cc30 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:17.794987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1204/2401] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:17.796481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.796920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.797363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.823612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:17.825549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.830969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd0dd-f0bd-4463-87b7-af67d7d4697d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:17.837498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:17.838133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.838538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.838708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.840077 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1205/2402] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:17.846567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:17.847908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.849468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:17.853829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:17.886897 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1198/2403] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:17 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:17.893258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.921914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0fdb-40bc-4444-9e26-28b2fa357d89 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:17.936916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:17.941218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:17.941602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:17.941987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:17.942772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:17.945893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:17.993857 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1199/2404] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:17.996835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:17.999075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae2c44-5452-4086-9278-7a897a658f75 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:18.011256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7da3a-77c8-49da-a376-0771e39bbe93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:18.012142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7da3a-77c8-49da-a376-0771e39bbe93 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:18.012142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7da3a-77c8-49da-a376-0771e39bbe93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:18.012575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7da3a-77c8-49da-a376-0771e39bbe93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:18.028715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b576de-dd30-4c33-a52c-57891a066c93 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:18.044555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:18.045482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:18.045850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:18.046680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:18.049828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:18.054648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:18.055091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7da3a-77c8-49da-a376-0771e39bbe93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:18.060589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7da3a-77c8-49da-a376-0771e39bbe93 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:18.095320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1200/2405] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:18.099771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:18.104292 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1206/2406] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:18.116317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab0da-da75-4271-8762-f5670559d8d5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:18.123090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:18.124152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:18.124526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:18.124936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] PATH_INFO: `/v3/projects/5f1cb43a57c442fda7d778cac048765a/users/857c9f7c3ced41ff88104ae41ea3427e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:18.166776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1cb43a57c442fda7d778cac048765a, user_id=857c9f7c3ced41ff88104ae41ea3427e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:18.171048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:18.203527 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1201/2407] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:18 2022] PUT /identity/v3/projects/5f1cb43a57c442fda7d778cac048765a/users/857c9f7c3ced41ff88104ae41ea3427e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:18.209164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:18.209585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:18.209976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:18.236236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:18.238476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:18.332284 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1207/2408] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:18.353329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:18.366892 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:18.433486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700b707-0bb5-42db-bc54-669d6e21adc9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:18.440557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:18.442139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:18.442605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:18.443209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:18.459899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:18.469252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:18.485517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1202/2409] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:18.549206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:18.551138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:18.568066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6813ac9-f4cb-4134-926b-6d835a313c50 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:18.574070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:18.574720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:18.574996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:18.575268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] PATH_INFO: `/v3/projects/aa388d025cac48ada2e632d0df0b4cad` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:18.576712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa388d025cac48ada2e632d0df0b4cad)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:18.579635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:18.676747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa388d025cac48ada2e632d0df0b4cad', 'request_id': 'req-4eb2c611-5498-4e90-b377-5215a1a3a10d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:18.691127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa388d025cac48ada2e632d0df0b4cad', 'request_id': 'req-4eb2c611-5498-4e90-b377-5215a1a3a10d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:18.696750 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:18.699253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa388d025cac48ada2e632d0df0b4cad', 'request_id': 'req-4eb2c611-5498-4e90-b377-5215a1a3a10d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:18.719776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] The token cache is being invalidate because project aa388d025cac48ada2e632d0df0b4cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:18.719776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:18.720754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:18.725147 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1208/2410] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:18 2022] DELETE /identity/v3/projects/aa388d025cac48ada2e632d0df0b4cad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:18.729252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:18.744003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae029c-bdeb-4692-bdc9-151840e0905b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:18.900905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:18.913157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:18.926614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:18.927182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] PATH_INFO: `/v3/users/9163e0cbd5ae479cb49905b804c3dbba` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:18.934451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9163e0cbd5ae479cb49905b804c3dbba)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:18.940688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:19.064578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:19.066239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:19.116979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9163e0cbd5ae479cb49905b804c3dbba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:19.150309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9163e0cbd5ae479cb49905b804c3dbba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:19.153945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9163e0cbd5ae479cb49905b804c3dbba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:19.186015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9163e0cbd5ae479cb49905b804c3dbba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:19.188087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f6957885-c35c-41cd-b49b-708659523deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9163e0cbd5ae479cb49905b804c3dbba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:19.271618 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1203/2411] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:18 2022] DELETE /identity/v3/users/9163e0cbd5ae479cb49905b804c3dbba => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:19.318333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c611-5498-4e90-b377-5215a1a3a10d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:19.468224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:19.469853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:19.469853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:19.469853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:19.471252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:19.579051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:19.582893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:19.607441 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1209/2412] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:19.664725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d9654-f299-4bb6-ba77-88196f92f28c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:19.666410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d9654-f299-4bb6-ba77-88196f92f28c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:19.667388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d9654-f299-4bb6-ba77-88196f92f28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:19.720218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-824d9654-f299-4bb6-ba77-88196f92f28c None None] MFA Rules not processed for user `9ebc6e77ecbc4a61a6f13803cd1a1589`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:19.721802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-824d9654-f299-4bb6-ba77-88196f92f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:19.774412 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:19.817819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1204/2413] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:20.197361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:20.205232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:20.285879 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:20.397551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda907-cd77-4cf0-b81c-53c8fe687b59 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:20.415609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:20.416285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:20.416606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:20.417005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] PATH_INFO: `/v3/projects/aa7ed056a25f4e0eac5fb20571f85a61` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:20.418282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7ed056a25f4e0eac5fb20571f85a61)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:20.420788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:20.507596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7ed056a25f4e0eac5fb20571f85a61', 'request_id': 'req-b64f7834-6ad2-40f1-997a-bae0f74b195e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:20.515812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7ed056a25f4e0eac5fb20571f85a61', 'request_id': 'req-b64f7834-6ad2-40f1-997a-bae0f74b195e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:20.522582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7ed056a25f4e0eac5fb20571f85a61', 'request_id': 'req-b64f7834-6ad2-40f1-997a-bae0f74b195e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:20.543927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] The token cache is being invalidate because project aa7ed056a25f4e0eac5fb20571f85a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:20.544363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:20.545365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b64f7834-6ad2-40f1-997a-bae0f74b195e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:20.548815 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1210/2414] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:20 2022] DELETE /identity/v3/projects/aa7ed056a25f4e0eac5fb20571f85a61 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:20.553860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e9007-7e33-4a5c-ac6a-0c2a4ea2a61d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:20.554359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e9007-7e33-4a5c-ac6a-0c2a4ea2a61d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:20.554479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e9007-7e33-4a5c-ac6a-0c2a4ea2a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:20.588946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e44e9007-7e33-4a5c-ac6a-0c2a4ea2a61d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:20.596257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e44e9007-7e33-4a5c-ac6a-0c2a4ea2a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:20.754649 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1205/2415] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:20.762266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7cfd-0707-4601-96a8-3c131719a807 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:20.762547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7cfd-0707-4601-96a8-3c131719a807 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:20.762819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7cfd-0707-4601-96a8-3c131719a807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:20.801569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-be0b7cfd-0707-4601-96a8-3c131719a807 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:20.804800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-be0b7cfd-0707-4601-96a8-3c131719a807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:20.826790 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1211/2416] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:20.830731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e9007-7e33-4a5c-ac6a-0c2a4ea2a61d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:20.868628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e9007-7e33-4a5c-ac6a-0c2a4ea2a61d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:20.877833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:20.881083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:20.881716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:20.885268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:20.894654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:20.895679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:20.898645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:20.975765 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1206/2417] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:20.979527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b7cfd-0707-4601-96a8-3c131719a807 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:21.007707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b7cfd-0707-4601-96a8-3c131719a807 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:21.016822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:21.017457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:21.017731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:21.018004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:21.022772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:21.025683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:21.093606 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1212/2418] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:20 2022] POST /identity/v3/projects => generated 359 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:21.097861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:21.114301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57404a-65ff-4fcd-8611-5ef514819d78 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:21.242165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:21.242983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:21.243712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:21.243990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:21.244759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:21.247664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:21.296230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:21.299972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1207/2419] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:21 2022] POST /identity/v3/users => generated 280 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:21.335836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a1fed-c82f-4681-a41b-047ea2a867c7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:21.347505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:21.348184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:21.348403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:21.348666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:21.349770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:21.351778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:21.372573 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1213/2420] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:21.374751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:21.388892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9a4e5-6d25-4aee-88e5-1d9af762cac1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:21.396819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d198e7-971e-42cf-ba2e-5bcc155ddcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:21.397859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198e7-971e-42cf-ba2e-5bcc155ddcda admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:21.398566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198e7-971e-42cf-ba2e-5bcc155ddcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:21.399043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198e7-971e-42cf-ba2e-5bcc155ddcda admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:21.400557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d198e7-971e-42cf-ba2e-5bcc155ddcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:21.402524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d198e7-971e-42cf-ba2e-5bcc155ddcda admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:21.420140 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1208/2421] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:08:21.424436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:21.476585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011d7b8-1ce7-4932-93e9-cec3f84f450d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:21.499306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:21.500140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:21.501651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:21.503225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] PATH_INFO: `/v3/projects/831d06d1afd7429588320e98a7f76939/users/8d263f05de09454eaeffed67fc9a3f22/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:21.558272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831d06d1afd7429588320e98a7f76939, user_id=8d263f05de09454eaeffed67fc9a3f22, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:21.566520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:21.599332 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1214/2422] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:21 2022] PUT /identity/v3/projects/831d06d1afd7429588320e98a7f76939/users/8d263f05de09454eaeffed67fc9a3f22/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:21.612748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ce78e-6ada-4221-9211-566e3b584450 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:21.613325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ce78e-6ada-4221-9211-566e3b584450 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:21.613406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ce78e-6ada-4221-9211-566e3b584450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:21.688304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c62ce78e-6ada-4221-9211-566e3b584450 None None] MFA Rules not processed for user `8d263f05de09454eaeffed67fc9a3f22`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:21.689629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c62ce78e-6ada-4221-9211-566e3b584450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:21.781459 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:21.885021 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1209/2423] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:21.910834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:22.121122 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:22.191774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d080-7ba8-4d7b-97b3-bffc444d7446 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:22.205701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:22.206499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:22.206867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:22.207228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:22.209482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:22.213383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:22.284613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ce78e-6ada-4221-9211-566e3b584450 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:22.286033 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1215/2424] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:21 2022] POST /identity/v3/projects => generated 361 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:22.317062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ce78e-6ada-4221-9211-566e3b584450 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:22.457917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:22.458723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:22.459106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:22.459481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:22.461368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:22.463510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:22.521615 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1210/2425] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:22 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:22.525255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:22.547193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5eb69-078b-4e90-9f0d-b7d9f82cdda6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:22.563508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:22.564452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:22.564972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:22.565406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:22.566243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:22.568877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:22.610232 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1216/2426] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:08:22.610886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:22.658078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803675-8e80-42cc-adfd-9729c2553fba admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:22.671795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:22.672889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:22.673368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:22.673866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] PATH_INFO: `/v3/projects/bb8f9dcc7ec544f7afcdc06ef4f977ea/users/a589bec512da4d9bb8322f00d242dbf7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:22.724795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8f9dcc7ec544f7afcdc06ef4f977ea, user_id=a589bec512da4d9bb8322f00d242dbf7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:22.727691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:22.755883 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1211/2427] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:22 2022] PUT /identity/v3/projects/bb8f9dcc7ec544f7afcdc06ef4f977ea/users/a589bec512da4d9bb8322f00d242dbf7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:22.760256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:22.776481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b80bef-f6c3-4b56-87ce-0d60b9e379c0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:22.933437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16faaa7-4291-4b95-a6a9-597cd1e60c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:22.934077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16faaa7-4291-4b95-a6a9-597cd1e60c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:22.934358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16faaa7-4291-4b95-a6a9-597cd1e60c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:22.934653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16faaa7-4291-4b95-a6a9-597cd1e60c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:22.935283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16faaa7-4291-4b95-a6a9-597cd1e60c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:22.937338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16faaa7-4291-4b95-a6a9-597cd1e60c8a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:22.964541 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1217/2428] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:22.965885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:22.985824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeff981-7d89-4c20-a92a-c7a2ac656b4e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:23.000864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:23.004092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:23.004405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:23.004632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] PATH_INFO: `/v3/projects/bb8f9dcc7ec544f7afcdc06ef4f977ea/users/a589bec512da4d9bb8322f00d242dbf7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:23.010335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8f9dcc7ec544f7afcdc06ef4f977ea, user_id=a589bec512da4d9bb8322f00d242dbf7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:23.013050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:23.063640 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1212/2429] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:22 2022] PUT /identity/v3/projects/bb8f9dcc7ec544f7afcdc06ef4f977ea/users/a589bec512da4d9bb8322f00d242dbf7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:23.065393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95eb8f-3b6a-43ce-9c57-df804366105b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:23.065686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95eb8f-3b6a-43ce-9c57-df804366105b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:23.065966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95eb8f-3b6a-43ce-9c57-df804366105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:23.123019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5b95eb8f-3b6a-43ce-9c57-df804366105b None None] MFA Rules not processed for user `a589bec512da4d9bb8322f00d242dbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:23.124582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b95eb8f-3b6a-43ce-9c57-df804366105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:23.253856 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1218/2430] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:23.264895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:23.267362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:23.409385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411b970-523a-43dc-bf31-c0b420a03f54 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:23.422015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996a216-c120-4ae9-ab2a-406422ab554f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:23.426159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996a216-c120-4ae9-ab2a-406422ab554f service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:23.427935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996a216-c120-4ae9-ab2a-406422ab554f service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:23.428310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996a216-c120-4ae9-ab2a-406422ab554f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:23.449639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996a216-c120-4ae9-ab2a-406422ab554f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:23.451989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996a216-c120-4ae9-ab2a-406422ab554f service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:23.467414 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1213/2431] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:24.694698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95eb8f-3b6a-43ce-9c57-df804366105b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:24.765488 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:24.797515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95eb8f-3b6a-43ce-9c57-df804366105b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:24.806197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:24.807742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:24.808347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:24.808779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] PATH_INFO: `/v3/users/8d263f05de09454eaeffed67fc9a3f22` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:24.810528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d263f05de09454eaeffed67fc9a3f22)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:24.815836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:24.895074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d263f05de09454eaeffed67fc9a3f22'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:24.915505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d263f05de09454eaeffed67fc9a3f22'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:24.961736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d263f05de09454eaeffed67fc9a3f22'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:24.963268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d263f05de09454eaeffed67fc9a3f22'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:24.982057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d263f05de09454eaeffed67fc9a3f22'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:24.996195 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1219/2432] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:24 2022] DELETE /identity/v3/users/8d263f05de09454eaeffed67fc9a3f22 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:24.997150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:24.997596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:24.997699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:25.019513 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:25.032656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:25.034121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:25.120942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1214/2433] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:25.151127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:25.151127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:25.250115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c0e2-00c0-48cc-84aa-d2752c0e10ce admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:25.255725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:25.256612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:25.257782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:25.258222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:25.270521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:25.272581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:25.291084 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1220/2434] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:27.075996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:27.077978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:27.095669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d4504-6126-4b5b-aaf5-9cb32b637cce None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:27.114844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:27.115508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:27.115850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:27.116031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] PATH_INFO: `/v3/projects/831d06d1afd7429588320e98a7f76939` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:27.120368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831d06d1afd7429588320e98a7f76939)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:27.126821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:27.236756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831d06d1afd7429588320e98a7f76939', 'request_id': 'req-73614bb9-3f86-464e-a15c-249a24fa00a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.258876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831d06d1afd7429588320e98a7f76939', 'request_id': 'req-73614bb9-3f86-464e-a15c-249a24fa00a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.288314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831d06d1afd7429588320e98a7f76939', 'request_id': 'req-73614bb9-3f86-464e-a15c-249a24fa00a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.321663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] The token cache is being invalidate because project 831d06d1afd7429588320e98a7f76939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:27.321958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.326165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73614bb9-3f86-464e-a15c-249a24fa00a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.345301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:27.351528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1215/2435] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:27 2022] DELETE /identity/v3/projects/831d06d1afd7429588320e98a7f76939 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:27.361342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7562e-e204-41ca-b4bd-d2fce56894a5 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:27.513268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:27.515240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:27.515240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:27.515240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] PATH_INFO: `/v3/users/a589bec512da4d9bb8322f00d242dbf7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:27.516606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a589bec512da4d9bb8322f00d242dbf7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:27.518669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:27.521825 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:27.569015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29521132-071d-4559-9ac5-2801580bc896 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:27.570143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29521132-071d-4559-9ac5-2801580bc896 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:27.570641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29521132-071d-4559-9ac5-2801580bc896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:27.595150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a589bec512da4d9bb8322f00d242dbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.607673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a589bec512da4d9bb8322f00d242dbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.626520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-29521132-071d-4559-9ac5-2801580bc896 None None] MFA Rules not processed for user `857c9f7c3ced41ff88104ae41ea3427e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:27.627731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-29521132-071d-4559-9ac5-2801580bc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:27.635518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a589bec512da4d9bb8322f00d242dbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.637227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a589bec512da4d9bb8322f00d242dbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.651921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a589bec512da4d9bb8322f00d242dbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:27.662955 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1221/2436] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:27 2022] DELETE /identity/v3/users/a589bec512da4d9bb8322f00d242dbf7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:27.792830 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1216/2437] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:28.011299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:28.012883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:28.123814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29521132-071d-4559-9ac5-2801580bc896 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:28.125365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-29521132-071d-4559-9ac5-2801580bc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:28.147373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5598f-ceca-4c30-9551-676d649536f6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:28.155904 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:28.157723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:28.158551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:28.158945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:28.159743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:28.260116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:28.261070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:28.271779 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1222/2438] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:28.272790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:28.274137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:28.296688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29521132-071d-4559-9ac5-2801580bc896 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:28.309611 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:28.314790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b7243-4a63-4732-bae4-d178c26729c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:28.315578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b7243-4a63-4732-bae4-d178c26729c7 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:28.315867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b7243-4a63-4732-bae4-d178c26729c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:28.316139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b7243-4a63-4732-bae4-d178c26729c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:28.322003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d42b7243-4a63-4732-bae4-d178c26729c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:28.393377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5bbe2-18ff-4800-8a4b-93bb4e48e582 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:28.401754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:28.402999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:28.403460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:28.403831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] PATH_INFO: `/v3/projects/bb8f9dcc7ec544f7afcdc06ef4f977ea` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:28.405274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8f9dcc7ec544f7afcdc06ef4f977ea)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:28.408369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:28.411496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b7243-4a63-4732-bae4-d178c26729c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:28.413727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b7243-4a63-4732-bae4-d178c26729c7 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:28.429801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1217/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:28.509333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8f9dcc7ec544f7afcdc06ef4f977ea', 'request_id': 'req-a6d7ecff-d68b-4dc3-ba34-7c180b120797'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:28.518229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8f9dcc7ec544f7afcdc06ef4f977ea', 'request_id': 'req-a6d7ecff-d68b-4dc3-ba34-7c180b120797'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:28.524997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8f9dcc7ec544f7afcdc06ef4f977ea', 'request_id': 'req-a6d7ecff-d68b-4dc3-ba34-7c180b120797'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:28.551798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] The token cache is being invalidate because project bb8f9dcc7ec544f7afcdc06ef4f977ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:28.556504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:28.557074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6d7ecff-d68b-4dc3-ba34-7c180b120797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:28.558814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1223/2440] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:28 2022] DELETE /identity/v3/projects/bb8f9dcc7ec544f7afcdc06ef4f977ea => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:28.564288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2ade-b38a-4971-a069-c6d73d045dfb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:28.564425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2ade-b38a-4971-a069-c6d73d045dfb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:28.564688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2ade-b38a-4971-a069-c6d73d045dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:28.610488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-651a2ade-b38a-4971-a069-c6d73d045dfb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:28.612812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-651a2ade-b38a-4971-a069-c6d73d045dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:28.723383 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1218/2441] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:28.724688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac523-b36a-4348-ad74-bcf77b3522a0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:28.725122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac523-b36a-4348-ad74-bcf77b3522a0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:28.725774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac523-b36a-4348-ad74-bcf77b3522a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:28.763010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-757ac523-b36a-4348-ad74-bcf77b3522a0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:28.764617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-757ac523-b36a-4348-ad74-bcf77b3522a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:28.786973 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1224/2442] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:28.793419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a2ade-b38a-4971-a069-c6d73d045dfb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:28.806142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a2ade-b38a-4971-a069-c6d73d045dfb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:28.812239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:28.812919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:28.813198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:28.813515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:28.814175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:28.814475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:28.816125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:28.833440 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1219/2443] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:28.835235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ac523-b36a-4348-ad74-bcf77b3522a0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:28.846552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ac523-b36a-4348-ad74-bcf77b3522a0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:28.853924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:28.855039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:28.855477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:28.856039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:28.857027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:28.859838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:28.931182 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1225/2444] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:28 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:28.931744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:28.946121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e5c33-848a-451a-800f-bbb98d0c46c6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:29.008582 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:29.034305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:29.035023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:29.035369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:29.035710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:29.036550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:29.038609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:29.081096 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1220/2445] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:28 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:29.085231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:29.096476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf71fd-5447-4e17-bbd0-14f56974408d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:29.101860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:29.102764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:29.103048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:29.103496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:29.104378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:29.106157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:29.155879 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1226/2446] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:29.157518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:29.174026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113385c-8680-4a2a-af25-aeaf72d27c0b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:29.188094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c039259-9f4f-4278-b253-f19a5372f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:29.189382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039259-9f4f-4278-b253-f19a5372f280 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:29.189903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039259-9f4f-4278-b253-f19a5372f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:29.190506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039259-9f4f-4278-b253-f19a5372f280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:29.191465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c039259-9f4f-4278-b253-f19a5372f280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:29.193778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c039259-9f4f-4278-b253-f19a5372f280 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:29.221303 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1221/2447] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:29.224906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:29.251288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973377-f460-41cf-825c-e73b3af402dc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:29.272420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:29.277754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:29.278776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:29.279251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] PATH_INFO: `/v3/projects/b0c60f4d25f340e38920b223b711dc8f/users/7347c7b70cd84a7ba7bb8181fa80d5ea/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:29.314991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c60f4d25f340e38920b223b711dc8f, user_id=7347c7b70cd84a7ba7bb8181fa80d5ea, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:29.317888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:29.381355 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1227/2448] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:29 2022] PUT /identity/v3/projects/b0c60f4d25f340e38920b223b711dc8f/users/7347c7b70cd84a7ba7bb8181fa80d5ea/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:29.390887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d563-8d8d-40aa-8d08-92ac669994e7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:29.391304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d563-8d8d-40aa-8d08-92ac669994e7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:29.391584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d563-8d8d-40aa-8d08-92ac669994e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:29.453368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e7f0d563-8d8d-40aa-8d08-92ac669994e7 None None] MFA Rules not processed for user `7347c7b70cd84a7ba7bb8181fa80d5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:29.457132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e7f0d563-8d8d-40aa-8d08-92ac669994e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:29.612295 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1222/2449] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:29.617247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:29.730350 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:29.759354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6541-2720-4086-9806-b06718f867f5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:29.766445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:29.767363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:29.767784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:29.768207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:29.771676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:29.774078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:29.824974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1228/2450] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:29 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:29.829431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0d563-8d8d-40aa-8d08-92ac669994e7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:29.843596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0d563-8d8d-40aa-8d08-92ac669994e7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:29.974266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:29.974901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:29.975957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:29.976237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:29.977040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:29.981997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:30.013633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1223/2451] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:29 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:30.017922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:30.047647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd386d9-55b4-49ed-a5ff-c8b5b51b76d9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:30.075506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:30.076675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:30.081657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:30.082105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:30.083690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:30.085696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:30.106368 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1229/2452] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:30.111087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:30.127009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd515e5-83b3-40dc-93f2-4bea8cb37151 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:30.133467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:30.134531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:30.135051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:30.135698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] PATH_INFO: `/v3/projects/b0f3259733aa43bd93ac274c9fee7f6a/users/ad92ab06d5894d08a330a849eabfb3e8/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:30.159907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f3259733aa43bd93ac274c9fee7f6a, user_id=ad92ab06d5894d08a330a849eabfb3e8, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:30.162794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:30.183872 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1224/2453] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:30 2022] PUT /identity/v3/projects/b0f3259733aa43bd93ac274c9fee7f6a/users/ad92ab06d5894d08a330a849eabfb3e8/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:30.188340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:30.203146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764de8f-5cfd-483c-afa7-ceb4c4927e83 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:30.290475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d129a-e085-4650-a013-705b295cffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:30.291396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d129a-e085-4650-a013-705b295cffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:30.291865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d129a-e085-4650-a013-705b295cffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:30.292398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d129a-e085-4650-a013-705b295cffa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:30.293227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d129a-e085-4650-a013-705b295cffa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:30.295473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d129a-e085-4650-a013-705b295cffa5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:30.318267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1230/2454] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:30.322398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:30.336684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eec810-2e97-4b8e-9a1e-69a6cb33525d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:30.360418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:30.361127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:30.361502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:30.362448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] PATH_INFO: `/v3/projects/b0f3259733aa43bd93ac274c9fee7f6a/users/ad92ab06d5894d08a330a849eabfb3e8/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:30.366370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f3259733aa43bd93ac274c9fee7f6a, user_id=ad92ab06d5894d08a330a849eabfb3e8, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:30.370225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:30.386778 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:30.396027 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1225/2455] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:30 2022] PUT /identity/v3/projects/b0f3259733aa43bd93ac274c9fee7f6a/users/ad92ab06d5894d08a330a849eabfb3e8/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:30.412422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea322be-5460-49bf-b759-e0f41e8d19d5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:30.416059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea322be-5460-49bf-b759-e0f41e8d19d5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:30.416623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea322be-5460-49bf-b759-e0f41e8d19d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:30.547489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bea322be-5460-49bf-b759-e0f41e8d19d5 None None] MFA Rules not processed for user `ad92ab06d5894d08a330a849eabfb3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:30.569395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bea322be-5460-49bf-b759-e0f41e8d19d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:30.721064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1231/2456] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:30.728001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:30.751716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5b79e-2a3c-45ff-9833-4ee7d5e8ccaf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:30.762658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:30.763237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:30.763716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:30.764133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:30.765021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:30.765387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:30.767464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:30.789880 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1226/2457] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:30.794096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea322be-5460-49bf-b759-e0f41e8d19d5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:30.814533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea322be-5460-49bf-b759-e0f41e8d19d5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:30.821381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:30.822346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:30.822810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:30.823364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:30.824197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:30.828125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:30.871134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1232/2458] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:30 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:30.872480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:30.884790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216c9c1-0699-4d79-9abd-d240131f5712 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:30.999335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:31.000043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.001038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.001038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.003131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:31.003517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:31.009630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:31.012421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:31.014844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:31.035452 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1227/2459] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:31.041625 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:31.114475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb715a5-719b-482c-87be-633ca3e79926 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:31.120919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf5a29-cdcd-4214-b218-48a64aa19986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:31.121917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5a29-cdcd-4214-b218-48a64aa19986 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.122243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5a29-cdcd-4214-b218-48a64aa19986 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.122625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5a29-cdcd-4214-b218-48a64aa19986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.130767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fecf5a29-cdcd-4214-b218-48a64aa19986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:31.209676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf5a29-cdcd-4214-b218-48a64aa19986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:31.211315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf5a29-cdcd-4214-b218-48a64aa19986 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:31.222956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1233/2460] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:31.255544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:31.257854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:31.273393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f624b-9a9d-4636-93a3-7b3e02a515c2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:31.279025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:31.279697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.279965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.280230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.288909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:31.290618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:31.301083 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1228/2461] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:31.316416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac4002-a595-467a-9147-c45aedbb0431 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.316703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac4002-a595-467a-9147-c45aedbb0431 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.317013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac4002-a595-467a-9147-c45aedbb0431 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.318379 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1234/2462] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:31.323211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:31.338873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:31.348386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8ae4-73ce-49bb-b303-a81bf678347d service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:31.353155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:31.353933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.354278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.354614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/c0a15a335a8d4c91bf3df11af031416d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.356484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=c0a15a335a8d4c91bf3df11af031416d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:31.358854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:31.364256 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1229/2463] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:31 2022] GET /identity/v3/projects/c0a15a335a8d4c91bf3df11af031416d => generated 369 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:31.694253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb63e-2231-4c14-b1ab-ab8f5bbfa587 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.694538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb63e-2231-4c14-b1ab-ab8f5bbfa587 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.694806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb63e-2231-4c14-b1ab-ab8f5bbfa587 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.696175 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1235/2464] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:31.701462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:31.715473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:31.725958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069144a5-2241-4a50-b6af-45e94f742961 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:31.731320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56020e0-820d-4ce2-90a4-c3c3a49a081a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:31.732370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56020e0-820d-4ce2-90a4-c3c3a49a081a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.732925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56020e0-820d-4ce2-90a4-c3c3a49a081a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.733227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56020e0-820d-4ce2-90a4-c3c3a49a081a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/c0a15a335a8d4c91bf3df11af031416d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.734497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56020e0-820d-4ce2-90a4-c3c3a49a081a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=c0a15a335a8d4c91bf3df11af031416d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:31.746859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56020e0-820d-4ce2-90a4-c3c3a49a081a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:31.746859 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1230/2465] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:31 2022] GET /identity/v3/projects/c0a15a335a8d4c91bf3df11af031416d => generated 369 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:32.186291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111cd2c-0a24-4cba-9a30-c93f7ec0e835 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.186742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111cd2c-0a24-4cba-9a30-c93f7ec0e835 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.186742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111cd2c-0a24-4cba-9a30-c93f7ec0e835 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.188275 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1236/2466] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:32.208463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f7ca-641d-478b-a4c5-36146b1b6dd4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.209122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f7ca-641d-478b-a4c5-36146b1b6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.209558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f7ca-641d-478b-a4c5-36146b1b6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.243363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3f81f7ca-641d-478b-a4c5-36146b1b6dd4 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:32.246379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3f81f7ca-641d-478b-a4c5-36146b1b6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:32.382355 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1231/2467] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:32.406893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111cd2c-0a24-4cba-9a30-c93f7ec0e835 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:32.409107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8111cd2c-0a24-4cba-9a30-c93f7ec0e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:32.435949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111cd2c-0a24-4cba-9a30-c93f7ec0e835 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:32.442812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:32.443703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.444136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.444568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.462728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:32.465020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:32.513375 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1237/2468] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:32.528940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f38-eafb-4e2c-93ac-0d84b0ea0f45 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.529534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f38-eafb-4e2c-93ac-0d84b0ea0f45 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.529987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f38-eafb-4e2c-93ac-0d84b0ea0f45 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.531835 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1232/2469] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:08:32.538363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:32.565443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:32.578604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f814-a10a-4178-bdc1-59819711fbde service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:32.589377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:32.590318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.590603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.590877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/c0a15a335a8d4c91bf3df11af031416d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.592911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=c0a15a335a8d4c91bf3df11af031416d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:32.595226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:32.601011 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1238/2470] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:32 2022] GET /identity/v3/projects/c0a15a335a8d4c91bf3df11af031416d => generated 369 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:32.625029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa31f38-eafb-4e2c-93ac-0d84b0ea0f45 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:32.649539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa31f38-eafb-4e2c-93ac-0d84b0ea0f45 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:32.657270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:32.659745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.660272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.661642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/c0a15a335a8d4c91bf3df11af031416d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.666852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c0a15a335a8d4c91bf3df11af031416d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:32.669588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:32.715741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:32.718975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:32.798322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a15a335a8d4c91bf3df11af031416d', 'request_id': 'req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:32.805381 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:32.818188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a15a335a8d4c91bf3df11af031416d', 'request_id': 'req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:32.825687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a15a335a8d4c91bf3df11af031416d', 'request_id': 'req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:32.850936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] The token cache is being invalidate because project c0a15a335a8d4c91bf3df11af031416d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:32.851231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:32.854837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ccac77c-7c53-4ed6-a49e-cb5f1f94ad7a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:32.855706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a3b0-bcf1-430d-967a-fbc623cf9255 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:32.856611 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1233/2471] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:32 2022] DELETE /identity/v3/projects/c0a15a335a8d4c91bf3df11af031416d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:32.893427 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:32.905339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.905627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.905917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.907845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1234/2472] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:08:32.914160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:32.916334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:32.934300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:32.935125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:32.935491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:32.935840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:32.937931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:32.953265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:32.954796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:32.966003 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1239/2473] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:33.009142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:33.010440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:33.092398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc88dcf-c90a-44bf-8551-5353d968ad12 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:33.098479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b32a-14f7-4908-8655-04dc8b574156 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:33.099189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b32a-14f7-4908-8655-04dc8b574156 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.099565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b32a-14f7-4908-8655-04dc8b574156 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.099837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b32a-14f7-4908-8655-04dc8b574156 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/b0c60f4d25f340e38920b223b711dc8f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.101161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b32a-14f7-4908-8655-04dc8b574156 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=b0c60f4d25f340e38920b223b711dc8f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:33.103412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b32a-14f7-4908-8655-04dc8b574156 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:33.105186 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1235/2474] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:32 2022] GET /identity/v3/projects/b0c60f4d25f340e38920b223b711dc8f => generated 375 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:33.126201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:33.148235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1077836-040c-4123-8ca4-c86a9e801fd6 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:33.157377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:33.158441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.159069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.159449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.160258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:33.160677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:33.185612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:33.204550 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1240/2475] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:33.208621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:33.209227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ce411-839d-407a-a3e2-2d265abcb6ca None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.209514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ce411-839d-407a-a3e2-2d265abcb6ca None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.209779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ce411-839d-407a-a3e2-2d265abcb6ca None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.211249 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1236/2476] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:33.224033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.224482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.224758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.226259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30fea9-82bb-4bd6-9926-10962b036732 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:33.231908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:33.232709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.233020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.233741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.233954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:33.235942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:33.260176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:33.268236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:33.278458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1241/2477] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:33 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:33.280347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:33.283705 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1237/2478] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:08:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:33.298160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:33.300236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:33.371023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b0559-348b-4657-beab-ebda19b1ec2b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:33.376215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195061d-04fa-423d-9cad-75c438269ba7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:33.377044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195061d-04fa-423d-9cad-75c438269ba7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.377153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195061d-04fa-423d-9cad-75c438269ba7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.377432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195061d-04fa-423d-9cad-75c438269ba7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.378106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195061d-04fa-423d-9cad-75c438269ba7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:33.378412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195061d-04fa-423d-9cad-75c438269ba7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:33.380181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195061d-04fa-423d-9cad-75c438269ba7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:33.421385 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1242/2479] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:33.462441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea34b4-4e67-4cdd-97b0-9ed031e1df5b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:33.505188 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:33.540379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd911f9-08c8-4f75-9a14-c84a9d4b05d2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.540678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd911f9-08c8-4f75-9a14-c84a9d4b05d2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.540968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd911f9-08c8-4f75-9a14-c84a9d4b05d2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.542904 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1243/2480] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:08:33.543699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a234f-e8be-449a-912f-ecc35ea4c44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:33.545115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a234f-e8be-449a-912f-ecc35ea4c44e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.547075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a234f-e8be-449a-912f-ecc35ea4c44e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.547596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a234f-e8be-449a-912f-ecc35ea4c44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.547937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd911f9-08c8-4f75-9a14-c84a9d4b05d2 None None] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:33.679375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a234f-e8be-449a-912f-ecc35ea4c44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:33.680842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a234f-e8be-449a-912f-ecc35ea4c44e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:33.694742 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1238/2481] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:33.711788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd911f9-08c8-4f75-9a14-c84a9d4b05d2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:33.727278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd911f9-08c8-4f75-9a14-c84a9d4b05d2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:33.733260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:33.735564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.736227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.736700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/87c34935e0f64083a0b699d34b6a68d2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.740680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=87c34935e0f64083a0b699d34b6a68d2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:33.743243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:33.746346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1244/2482] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:33 2022] GET /identity/v3/projects/87c34935e0f64083a0b699d34b6a68d2 => generated 371 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:08:33.914705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0454-0bc3-46a5-81dd-f5ceb570431a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.914997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0454-0bc3-46a5-81dd-f5ceb570431a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.915241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0454-0bc3-46a5-81dd-f5ceb570431a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.916629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1239/2483] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:33.921998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:33.925366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:33.944257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:33.952944 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:33.958695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228fa8-a82c-4fc4-9eda-e438ccf519b3 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:33.965969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:33.966709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:33.967306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:33.967712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/87c34935e0f64083a0b699d34b6a68d2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:33.969679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=87c34935e0f64083a0b699d34b6a68d2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:33.972730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:33.975625 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1245/2484] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:33 2022] GET /identity/v3/projects/87c34935e0f64083a0b699d34b6a68d2 => generated 371 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:34.030616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d0454-0bc3-46a5-81dd-f5ceb570431a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:34.067182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d0454-0bc3-46a5-81dd-f5ceb570431a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:34.076006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:34.077473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.078077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.080033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:34.081674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:34.082398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:34.085295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:34.102970 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1240/2485] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:34.107231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:34.135486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30518-ae87-4775-9da5-9aff4d21cb1a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:34.149856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98311-e79a-41e1-881c-435d186b2493 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:34.153052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98311-e79a-41e1-881c-435d186b2493 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.153521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98311-e79a-41e1-881c-435d186b2493 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.154186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98311-e79a-41e1-881c-435d186b2493 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:34.156747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98311-e79a-41e1-881c-435d186b2493 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:34.159142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98311-e79a-41e1-881c-435d186b2493 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:34.192592 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1246/2486] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:34 2022] POST /identity/v3/users => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:34.196865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:34.215069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b83cb5-af4a-4df0-98b8-17b93a836bbd tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:34.223887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:34.227007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.227422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.229045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:34.229845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:34.230278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:34.233558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:34.263252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1241/2487] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:34.370485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e2a22-e723-4e2f-a3b4-f8f580c17bc5 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.370984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e2a22-e723-4e2f-a3b4-f8f580c17bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.371176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e2a22-e723-4e2f-a3b4-f8f580c17bc5 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:34.372949 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1247/2488] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:34.382594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:34.406148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:34.430262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2dede-71a6-4b52-adb8-6a84ad6150a9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:34.444389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:34.445084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.445361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.445810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/87c34935e0f64083a0b699d34b6a68d2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:34.447233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=87c34935e0f64083a0b699d34b6a68d2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:34.449639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:34.451530 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1242/2489] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:34 2022] GET /identity/v3/projects/87c34935e0f64083a0b699d34b6a68d2 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:34.875196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad18c7-f2b7-4a96-858a-0974e06b97b8 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.875739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad18c7-f2b7-4a96-858a-0974e06b97b8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.876211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad18c7-f2b7-4a96-858a-0974e06b97b8 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:34.878909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1248/2490] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:34.883884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:34.898246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:34.912924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af0a37-e1d0-45d8-910a-356d7a9e6da2 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:34.918924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:34.920133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.920133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.920370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/87c34935e0f64083a0b699d34b6a68d2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:34.921707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=87c34935e0f64083a0b699d34b6a68d2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:34.923862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:34.925939 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1243/2491] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:34 2022] GET /identity/v3/projects/87c34935e0f64083a0b699d34b6a68d2 => generated 371 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:34.961027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad18c7-f2b7-4a96-858a-0974e06b97b8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:34.976635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad18c7-f2b7-4a96-858a-0974e06b97b8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:34.982344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:34.983147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:34.983519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:34.983886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/users/a4b18a4fb3584bdc857ebfd30e2ad59e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.002158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a4b18a4fb3584bdc857ebfd30e2ad59e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:35.015184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:35.066082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b18a4fb3584bdc857ebfd30e2ad59e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.077677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b18a4fb3584bdc857ebfd30e2ad59e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.109940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b18a4fb3584bdc857ebfd30e2ad59e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.110731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b18a4fb3584bdc857ebfd30e2ad59e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.124919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b18a4fb3584bdc857ebfd30e2ad59e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.150807 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1249/2492] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:34 2022] DELETE /identity/v3/users/a4b18a4fb3584bdc857ebfd30e2ad59e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:35.157249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:35.157527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:35.171473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bebd8-9f92-40d9-ae62-b1e8edc269ac tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:35.261381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:35.262143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:35.262521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:35.263122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/87c34935e0f64083a0b699d34b6a68d2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.264628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:35.264795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:delete_project(project_id=87c34935e0f64083a0b699d34b6a68d2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:35.266149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:35.267150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:35.322598 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:35.356086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c34935e0f64083a0b699d34b6a68d2', 'request_id': 'req-d91332ff-8fbc-4135-81f3-9727a3a5c251'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.370909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c34935e0f64083a0b699d34b6a68d2', 'request_id': 'req-d91332ff-8fbc-4135-81f3-9727a3a5c251'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.378250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c34935e0f64083a0b699d34b6a68d2', 'request_id': 'req-d91332ff-8fbc-4135-81f3-9727a3a5c251'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.382739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb0be9-1352-403c-b714-f609b4f53cd4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:35.395116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] The token cache is being invalidate because project 87c34935e0f64083a0b699d34b6a68d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:35.395393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.396275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d91332ff-8fbc-4135-81f3-9727a3a5c251 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.398644 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1244/2493] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:35 2022] DELETE /identity/v3/projects/87c34935e0f64083a0b699d34b6a68d2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:35.452702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:35.453012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:35.453467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.454032 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:35.455052 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1245/2494] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:08:35.461226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:35.464273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:35.469641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:35.469784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:35.470126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:35.472358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] PATH_INFO: `/v3/users/49f609273d3d4d18a9ef755ed5359da9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.474101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f609273d3d4d18a9ef755ed5359da9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:35.476338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:35.533623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f609273d3d4d18a9ef755ed5359da9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.543092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f609273d3d4d18a9ef755ed5359da9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.552200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:35.553505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:35.568791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f609273d3d4d18a9ef755ed5359da9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.568791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f609273d3d4d18a9ef755ed5359da9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.570824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b5a8b9-0616-48cc-9fe9-91770ea0bbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f609273d3d4d18a9ef755ed5359da9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:35.584983 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1250/2495] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:35 2022] DELETE /identity/v3/users/49f609273d3d4d18a9ef755ed5359da9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:35.586531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:35.586813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:35.587080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.609299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:35.610589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:35.630995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bea420-c843-4b80-9c06-0e102abb9f97 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:35.681668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1251/2496] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:35.691982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:35.693487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:35.702814 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:35.711013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edcba4-c305-42a5-be38-bd22a55edb29 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:35.711665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edcba4-c305-42a5-be38-bd22a55edb29 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:35.712229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edcba4-c305-42a5-be38-bd22a55edb29 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:35.712863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edcba4-c305-42a5-be38-bd22a55edb29 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/b0c60f4d25f340e38920b223b711dc8f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.714744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edcba4-c305-42a5-be38-bd22a55edb29 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=b0c60f4d25f340e38920b223b711dc8f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:35.717504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edcba4-c305-42a5-be38-bd22a55edb29 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:35.719709 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1246/2497] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:35 2022] GET /identity/v3/projects/b0c60f4d25f340e38920b223b711dc8f => generated 375 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:35.762285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934441-109f-4c23-9522-d96d19ed74d3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:35.770491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:35.771139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:35.771416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:35.771684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.784991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:35.786411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:35.805195 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1252/2498] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:35.992720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b79691-addd-4ee7-a310-5e4f12bd47d1 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:35.993473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b79691-addd-4ee7-a310-5e4f12bd47d1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:35.993685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b79691-addd-4ee7-a310-5e4f12bd47d1 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:35.995639 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1247/2499] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:36.015389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:36.015389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:36.041605 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:36.135701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:36.137193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:36.159609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf6d1-9b99-418a-b7e3-0d61f0bec085 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:36.164316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:36.164990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:36.165271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:36.166147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/b0c60f4d25f340e38920b223b711dc8f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:36.166676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=b0c60f4d25f340e38920b223b711dc8f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:36.168751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:36.171005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1253/2500] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:36 2022] GET /identity/v3/projects/b0c60f4d25f340e38920b223b711dc8f => generated 375 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:36.240643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b79691-addd-4ee7-a310-5e4f12bd47d1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:36.241184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53b79691-addd-4ee7-a310-5e4f12bd47d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:36.286124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b79691-addd-4ee7-a310-5e4f12bd47d1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:36.311683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:36.312555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:36.312910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:36.313497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] PATH_INFO: `/v3/projects/58c64f1c2dba41298be11cd0772e8792` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:36.317861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c64f1c2dba41298be11cd0772e8792)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:36.324725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:36.415543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c64f1c2dba41298be11cd0772e8792', 'request_id': 'req-53e35b79-98c3-4899-b47b-affb54ce06ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.427533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c64f1c2dba41298be11cd0772e8792', 'request_id': 'req-53e35b79-98c3-4899-b47b-affb54ce06ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.436720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c64f1c2dba41298be11cd0772e8792', 'request_id': 'req-53e35b79-98c3-4899-b47b-affb54ce06ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.456986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] The token cache is being invalidate because project 58c64f1c2dba41298be11cd0772e8792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:36.458496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.459642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-53e35b79-98c3-4899-b47b-affb54ce06ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.461866 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1248/2501] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:36 2022] DELETE /identity/v3/projects/58c64f1c2dba41298be11cd0772e8792 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:36.465807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:36.469073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:36.487296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139c333-4a3b-493e-9a49-18d84cc7cff9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:36.556945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:36.557626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:36.557873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:36.558143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] PATH_INFO: `/v3/users/94440802e03e4106877aedf6dd94d388` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:36.559305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94440802e03e4106877aedf6dd94d388)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:36.561317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:36.626181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94440802e03e4106877aedf6dd94d388'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.637833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94440802e03e4106877aedf6dd94d388'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.662843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94440802e03e4106877aedf6dd94d388'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.662843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94440802e03e4106877aedf6dd94d388'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.670849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94440802e03e4106877aedf6dd94d388'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:36.683244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1254/2502] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:36 2022] DELETE /identity/v3/users/94440802e03e4106877aedf6dd94d388 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:36.738202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68fc5-941b-4216-ab5a-d12623ddbdd1 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:36.738576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68fc5-941b-4216-ab5a-d12623ddbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:36.738924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68fc5-941b-4216-ab5a-d12623ddbdd1 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:36.740349 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1249/2503] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:36.745327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:08:36.746771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:36.776186 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:36.831316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:36.832608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:36.910787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af5b6-770d-4858-ab90-a5c9d06b417a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:36.915819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad92ab06d5894d08a330a849eabfb3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0f3259733aa43bd93ac274c9fee7f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:36.916661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:36.916929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:36.917331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] PATH_INFO: `/v3/projects/b0c60f4d25f340e38920b223b711dc8f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:36.918948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorizing `identity:get_project(project_id=b0c60f4d25f340e38920b223b711dc8f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:36.921537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:36.923129 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1255/2504] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:08:36 2022] GET /identity/v3/projects/b0c60f4d25f340e38920b223b711dc8f => generated 375 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:37.125505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c68fc5-941b-4216-ab5a-d12623ddbdd1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:37.128853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05c68fc5-941b-4216-ab5a-d12623ddbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.293536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c68fc5-941b-4216-ab5a-d12623ddbdd1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:37.299903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:37.301488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.302008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.302471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] PATH_INFO: `/v3/projects/f1938b6301cd4787b78f35925d0290e0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.304704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1938b6301cd4787b78f35925d0290e0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:37.307072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:37.361260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:37.363297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.383751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d660b-82b7-4465-9a7c-b02aaa7a399b tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:37.394369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1938b6301cd4787b78f35925d0290e0', 'request_id': 'req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.408838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1938b6301cd4787b78f35925d0290e0', 'request_id': 'req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.435964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1938b6301cd4787b78f35925d0290e0', 'request_id': 'req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.448170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] The token cache is being invalidate because project f1938b6301cd4787b78f35925d0290e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:37.448424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.449317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4ebf909d-7854-47f8-8ae2-7e346f2c61c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.451453 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1250/2505] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:37 2022] DELETE /identity/v3/projects/f1938b6301cd4787b78f35925d0290e0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:37.456306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979416f-dbf3-41e0-8b17-68355536ca0c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.456800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979416f-dbf3-41e0-8b17-68355536ca0c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.458597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979416f-dbf3-41e0-8b17-68355536ca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.479811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6979416f-dbf3-41e0-8b17-68355536ca0c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:37.481279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6979416f-dbf3-41e0-8b17-68355536ca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.494169 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:37.509191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:37.511415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.511861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.512551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] PATH_INFO: `/v3/users/7347c7b70cd84a7ba7bb8181fa80d5ea` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.514288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7347c7b70cd84a7ba7bb8181fa80d5ea)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:37.516218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:37.568851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1251/2506] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:37.570546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.571025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.571260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.603800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:37.605044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.609859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7347c7b70cd84a7ba7bb8181fa80d5ea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.614253 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1252/2507] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:37.615097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:37.617295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.620212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7347c7b70cd84a7ba7bb8181fa80d5ea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.635397 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:37.646283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7347c7b70cd84a7ba7bb8181fa80d5ea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.647446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7347c7b70cd84a7ba7bb8181fa80d5ea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.656547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7347c7b70cd84a7ba7bb8181fa80d5ea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:37.665102 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1256/2508] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:37 2022] DELETE /identity/v3/users/7347c7b70cd84a7ba7bb8181fa80d5ea => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:37.665897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:37.668261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.718608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6023b85-d051-4dbd-8ee0-8432c7c50693 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:37.743268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1843-f80b-4198-946f-0c13b2d5c12a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:37.749392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cefa-31e7-4c61-8d7b-9953b473830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:37.750013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cefa-31e7-4c61-8d7b-9953b473830f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.750287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cefa-31e7-4c61-8d7b-9953b473830f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.750606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cefa-31e7-4c61-8d7b-9953b473830f admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.751309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cefa-31e7-4c61-8d7b-9953b473830f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:37.751609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cefa-31e7-4c61-8d7b-9953b473830f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:37.753370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cefa-31e7-4c61-8d7b-9953b473830f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:37.766945 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1257/2509] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:37.768229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a033b-c5d3-4fd2-a3f6-d536766831d5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.768510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a033b-c5d3-4fd2-a3f6-d536766831d5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.768841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a033b-c5d3-4fd2-a3f6-d536766831d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.791267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-440a033b-c5d3-4fd2-a3f6-d536766831d5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:37.792507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-440a033b-c5d3-4fd2-a3f6-d536766831d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.794468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:37.795362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.795643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.795920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.797820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.804496 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1258/2510] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:37.805981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a033b-c5d3-4fd2-a3f6-d536766831d5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:37.821713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a033b-c5d3-4fd2-a3f6-d536766831d5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:37.827966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:37.828617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.828933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.829227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:37.830290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:37.832243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:37.851810 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:37.867953 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1259/2511] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:37 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:37.867953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:37.867953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:37.886115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:37.888823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:37.900307 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1253/2512] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:37 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:37.901846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:37.917078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ff598-0b40-467b-beb2-9eb9d1d358d1 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:37.944662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2c0bc-8005-44df-9067-3964af72d873 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:37.950718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:37.952449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:37.952730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:37.953079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.006569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.006867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.007075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.007349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.008038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.010883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.033179 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:38.037727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.040781 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1254/2513] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:37 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:38.041706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.044423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.066315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7533-905d-42b0-9848-d849ef992ce6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.069955 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1260/2514] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:38.072945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.073658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.073941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.074213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.074866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.077506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.096960 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1255/2515] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:38.100186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.121959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8340cc9-cf52-4984-8f3d-be6f8498a548 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.143293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7549ca-5c42-46cb-80be-5b8b172b7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.143931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7549ca-5c42-46cb-80be-5b8b172b7db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.144227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7549ca-5c42-46cb-80be-5b8b172b7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.144496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7549ca-5c42-46cb-80be-5b8b172b7db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.145939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7549ca-5c42-46cb-80be-5b8b172b7db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.147727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7549ca-5c42-46cb-80be-5b8b172b7db0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.162089 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1261/2516] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:38.166383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.177013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629611-b1e7-4586-b3a3-8b28c72a26ca admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.182817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.183510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.183827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.184103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] PATH_INFO: `/v3/projects/d6c33fdd699445f49624b53f427abe17/users/54fde4c52ab1472fa83fdc2d136aa557/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.202795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c33fdd699445f49624b53f427abe17, user_id=54fde4c52ab1472fa83fdc2d136aa557, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.206004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.229512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1256/2517] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:38 2022] PUT /identity/v3/projects/d6c33fdd699445f49624b53f427abe17/users/54fde4c52ab1472fa83fdc2d136aa557/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:38.240126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87034-86c7-4015-a1ba-97f25043cd99 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.240943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87034-86c7-4015-a1ba-97f25043cd99 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.241198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87034-86c7-4015-a1ba-97f25043cd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.276849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-99e87034-86c7-4015-a1ba-97f25043cd99 None None] MFA Rules not processed for user `54fde4c52ab1472fa83fdc2d136aa557`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:38.278071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-99e87034-86c7-4015-a1ba-97f25043cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:38.375928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.380025 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1262/2518] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:38.474885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdda4-f758-487f-a2a5-193248e79f79 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.485511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.486151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.486429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.486703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.487341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.489277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.524528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1257/2519] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:38 2022] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:38.528224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e87034-86c7-4015-a1ba-97f25043cd99 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.540647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e87034-86c7-4015-a1ba-97f25043cd99 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.567396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.569303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:38.611612 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:38.657264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.657911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.658191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.669361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.674921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.681593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.690213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e437459-8b0e-4696-89db-aee4234ca9f7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.701758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.702725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.703140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.703340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] PATH_INFO: `/v3/projects/b0c60f4d25f340e38920b223b711dc8f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.704395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c60f4d25f340e38920b223b711dc8f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.706397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.723381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1263/2520] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:38 2022] POST /identity/v3/users => generated 305 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:38.727228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.743776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457095d-d4d0-48e7-be2e-58bf980f011c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.750958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.752009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.752946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.753263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.753944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.755733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.771618 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1264/2521] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:38.776694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.789414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c60f4d25f340e38920b223b711dc8f', 'request_id': 'req-26d138b0-702e-448b-b26b-3fe782381de5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:38.790899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabb9ae-d452-4c77-bcde-b5bc523daacf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.807093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c60f4d25f340e38920b223b711dc8f', 'request_id': 'req-26d138b0-702e-448b-b26b-3fe782381de5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:38.817681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c60f4d25f340e38920b223b711dc8f', 'request_id': 'req-26d138b0-702e-448b-b26b-3fe782381de5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:38.837255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] The token cache is being invalidate because project b0c60f4d25f340e38920b223b711dc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:38.837461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:38.838226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:38.841918 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1258/2522] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:38 2022] DELETE /identity/v3/projects/b0c60f4d25f340e38920b223b711dc8f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:38.846083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.847875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:38.876036 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:38.900705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.901777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.902074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.902380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] PATH_INFO: `/v3/projects/35ad432585fe44afa4256b672e510c64/users/a03689bd09574f029ce1a626ad784d17/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.931987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ad432585fe44afa4256b672e510c64, user_id=a03689bd09574f029ce1a626ad784d17, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.935130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.937765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d138b0-702e-448b-b26b-3fe782381de5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:38.943833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:38.944728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:38.945029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:38.945373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] PATH_INFO: `/v3/users/ad92ab06d5894d08a330a849eabfb3e8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:38.946662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad92ab06d5894d08a330a849eabfb3e8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:38.948984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:38.957505 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1265/2523] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:38 2022] PUT /identity/v3/projects/35ad432585fe44afa4256b672e510c64/users/a03689bd09574f029ce1a626ad784d17/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:38.961455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:38.966913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.023276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad92ab06d5894d08a330a849eabfb3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.027359 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:39.035093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad92ab06d5894d08a330a849eabfb3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.035920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad92ab06d5894d08a330a849eabfb3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.051151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad92ab06d5894d08a330a849eabfb3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.052153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad92ab06d5894d08a330a849eabfb3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.078556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8794a6c-5606-4f40-aeef-08ed167fb8fb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:39.087808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7270e-2e50-46e5-a19d-7e3bed249a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:39.088386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7270e-2e50-46e5-a19d-7e3bed249a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.088805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7270e-2e50-46e5-a19d-7e3bed249a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.089111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7270e-2e50-46e5-a19d-7e3bed249a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.089991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7270e-2e50-46e5-a19d-7e3bed249a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:39.092755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7270e-2e50-46e5-a19d-7e3bed249a44 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:39.108453 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1259/2524] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:38 2022] DELETE /identity/v3/users/ad92ab06d5894d08a330a849eabfb3e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:39.124971 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1266/2525] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:39.129927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:39.129927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.262315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089d6c-06db-4976-890a-96cc27c3023a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:39.270895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:39.272237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.272614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.272923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] PATH_INFO: `/v3/projects/35ad432585fe44afa4256b672e510c64/users/a03689bd09574f029ce1a626ad784d17/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.275803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ad432585fe44afa4256b672e510c64, user_id=a03689bd09574f029ce1a626ad784d17, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:39.278874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:39.292838 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1260/2526] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:39 2022] PUT /identity/v3/projects/35ad432585fe44afa4256b672e510c64/users/a03689bd09574f029ce1a626ad784d17/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:39.304069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dcf96-c042-40a7-aea5-d223a8d3461a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.304693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dcf96-c042-40a7-aea5-d223a8d3461a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.305375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dcf96-c042-40a7-aea5-d223a8d3461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.343252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fd8dcf96-c042-40a7-aea5-d223a8d3461a None None] MFA Rules not processed for user `a03689bd09574f029ce1a626ad784d17`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:39.344680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fd8dcf96-c042-40a7-aea5-d223a8d3461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.457601 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1267/2527] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:39.584679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:39.586602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.670314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e459f18-fb16-4410-8e4e-4f202ccc6a31 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:39.675776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:39.676423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.676749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.677516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] PATH_INFO: `/v3/projects/b0f3259733aa43bd93ac274c9fee7f6a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.678725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f3259733aa43bd93ac274c9fee7f6a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:39.680692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:39.739011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f3259733aa43bd93ac274c9fee7f6a', 'request_id': 'req-1a7e340c-9aae-4f49-8426-caa7cad09c6a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.747266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f3259733aa43bd93ac274c9fee7f6a', 'request_id': 'req-1a7e340c-9aae-4f49-8426-caa7cad09c6a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.752921 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:39.760239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f3259733aa43bd93ac274c9fee7f6a', 'request_id': 'req-1a7e340c-9aae-4f49-8426-caa7cad09c6a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.773398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] The token cache is being invalidate because project b0f3259733aa43bd93ac274c9fee7f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:39.773693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.774336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a7e340c-9aae-4f49-8426-caa7cad09c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:39.778196 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1261/2528] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:39 2022] DELETE /identity/v3/projects/b0f3259733aa43bd93ac274c9fee7f6a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:39.784792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4d356-628e-4f79-b35e-1678eb0986c6 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.784996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.785423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.785502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4d356-628e-4f79-b35e-1678eb0986c6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.785577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.785651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4d356-628e-4f79-b35e-1678eb0986c6 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.786844 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1262/2529] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:39.792553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f647523-2384-4bc1-afc2-cbb94d131764 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.792981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f647523-2384-4bc1-afc2-cbb94d131764 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.793324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f647523-2384-4bc1-afc2-cbb94d131764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.806396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:39.807684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.817476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2f647523-2384-4bc1-afc2-cbb94d131764 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:39.818818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2f647523-2384-4bc1-afc2-cbb94d131764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.875583 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:39.891861 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1268/2530] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:39.897706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:39.900346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.911182 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1263/2531] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:39.912710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:39.913251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:39.913794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:39.949258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:39.950539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.960193 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1264/2532] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:39.961059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:39.962288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:39.992452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b0552-9544-4155-9a7b-db7327b6d3dd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.002533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.003162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.003433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.003778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.007081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:40.043162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb94e-27ae-40eb-9a5f-6c23e90ba027 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.049012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.050079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.050411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.050688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.067045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.069039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.090658 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1265/2533] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:40.093286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.104888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352724e7-b18a-4cac-85e4-46f33c9b8822 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.109992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7d32-a45a-4cbd-aeb1-655625946f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.111099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7d32-a45a-4cbd-aeb1-655625946f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.112010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7d32-a45a-4cbd-aeb1-655625946f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.112282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7d32-a45a-4cbd-aeb1-655625946f55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.112955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7d32-a45a-4cbd-aeb1-655625946f55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:40.113260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7d32-a45a-4cbd-aeb1-655625946f55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.115015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7d32-a45a-4cbd-aeb1-655625946f55 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.125069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.129026 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1266/2534] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:40.130281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b9d62-1992-4567-b9d3-05d5bf49d6d7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.130560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b9d62-1992-4567-b9d3-05d5bf49d6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.130829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b9d62-1992-4567-b9d3-05d5bf49d6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.139398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.153337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b55b9d62-1992-4567-b9d3-05d5bf49d6d7 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:40.155069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b55b9d62-1992-4567-b9d3-05d5bf49d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:40.157165 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1269/2535] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:40.158083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.170317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b5e45-3ce4-4186-9a3a-df868f941588 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.177078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.177078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.177078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.177326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.178632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.180733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.194229 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1267/2536] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:08:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:40.205790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b9d62-1992-4567-b9d3-05d5bf49d6d7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.217190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b9d62-1992-4567-b9d3-05d5bf49d6d7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.229760 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1270/2537] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:40 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:40.230312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.230947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.231236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.231505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.235606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.252121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.253639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.277040 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1268/2538] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:40.403518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faede677-e474-471e-86a3-e57d38a214c6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.409968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.412397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.412842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.413125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.413775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.415729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.459035 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:40.473768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.488710 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1271/2539] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:40 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:40.499552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873654-d365-4648-aeb4-455693e5036d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.506231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.510562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.511106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.511730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.512581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.522052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.553467 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1269/2540] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:40.558200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.590275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2f27-51b0-4cd5-872c-792197ee03e6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.601432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d0128-376d-4f30-83fe-91d5f836b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.602125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d0128-376d-4f30-83fe-91d5f836b0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.602352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d0128-376d-4f30-83fe-91d5f836b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.602624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d0128-376d-4f30-83fe-91d5f836b0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.603281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d0128-376d-4f30-83fe-91d5f836b0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.604943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d0128-376d-4f30-83fe-91d5f836b0ef admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.620944 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1272/2541] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:40.625293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.639376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9c1d6-6bb0-4456-900f-ef9bd1c8f821 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.655471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.656164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.656446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.656721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] PATH_INFO: `/v3/projects/238f21f4c486416caa3eb44c58d2b452/users/9174038735de4d78b4ad527105d06624/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.674727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=238f21f4c486416caa3eb44c58d2b452, user_id=9174038735de4d78b4ad527105d06624, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.677449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.695092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1270/2542] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:40 2022] PUT /identity/v3/projects/238f21f4c486416caa3eb44c58d2b452/users/9174038735de4d78b4ad527105d06624/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:40.700626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.701449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.702048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.724561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:40.725855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:40.811873 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1273/2543] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:40.876899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:40.879267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:40.898573 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:40.955982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f7a4-cda0-4c23-be41-9d5fdfcfb53c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:40.960008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:40.960658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:40.961378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:40.961378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:40.980253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:40.982090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:40.993309 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1271/2544] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:41.263212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:41.264971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:41.360530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f387e-e828-4448-9dc6-89889962bf94 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:41.367123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2daee2-d86d-4a96-b3e7-3d07f4a5d73d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:41.368447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2daee2-d86d-4a96-b3e7-3d07f4a5d73d service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:41.369123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2daee2-d86d-4a96-b3e7-3d07f4a5d73d service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:41.369563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2daee2-d86d-4a96-b3e7-3d07f4a5d73d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:41.371839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bf2daee2-d86d-4a96-b3e7-3d07f4a5d73d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:41.460217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2daee2-d86d-4a96-b3e7-3d07f4a5d73d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:41.462042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2daee2-d86d-4a96-b3e7-3d07f4a5d73d service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:41.488397 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1274/2545] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:41 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:41.691992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:41.694212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:41.708535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1e74-e211-48d2-a47f-09586e027d75 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:41.714262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:41.714975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:41.715126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:41.715400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] PATH_INFO: `/v3/users/54fde4c52ab1472fa83fdc2d136aa557` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:41.716902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fde4c52ab1472fa83fdc2d136aa557)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:41.719037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:41.777361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fde4c52ab1472fa83fdc2d136aa557'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:41.789521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fde4c52ab1472fa83fdc2d136aa557'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:41.790855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fde4c52ab1472fa83fdc2d136aa557'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:41.800066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fde4c52ab1472fa83fdc2d136aa557'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:41.800569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fde4c52ab1472fa83fdc2d136aa557'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:41.822858 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1272/2546] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:41 2022] DELETE /identity/v3/users/54fde4c52ab1472fa83fdc2d136aa557 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:41.828605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:41.829866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:41.830323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:41.853487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:41.854986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:41.877185 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:41.930585 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1275/2547] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:41.940800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:41.943353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:42.058684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac1fd-522f-40ed-8cad-a8498258a044 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:42.062866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:42.063822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:42.063822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:42.064048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:42.076985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:42.078459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:42.090732 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1273/2548] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:43.013723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:43.015262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:43.034718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba839d4-02d0-45c0-87f5-b9e64e90d4bd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:43.047714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:43.048701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:43.049668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:43.049941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] PATH_INFO: `/v3/projects/d6c33fdd699445f49624b53f427abe17` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:43.054446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c33fdd699445f49624b53f427abe17)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:43.058753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:43.173296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c33fdd699445f49624b53f427abe17', 'request_id': 'req-13614bc5-e416-49b5-bcd3-3a7c399b1429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.201276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c33fdd699445f49624b53f427abe17', 'request_id': 'req-13614bc5-e416-49b5-bcd3-3a7c399b1429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.229356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c33fdd699445f49624b53f427abe17', 'request_id': 'req-13614bc5-e416-49b5-bcd3-3a7c399b1429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.251831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] The token cache is being invalidate because project d6c33fdd699445f49624b53f427abe17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:43.252900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.255921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.259897 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1276/2549] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:43 2022] DELETE /identity/v3/projects/d6c33fdd699445f49624b53f427abe17 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:43.265118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:43.282413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712018b-1cbb-4ce4-be70-75ec83caf0e2 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:43.347179 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:43.399700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:43.401316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:43.402027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:43.403040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] PATH_INFO: `/v3/users/a03689bd09574f029ce1a626ad784d17` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:43.405703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03689bd09574f029ce1a626ad784d17)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:43.408216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:43.498493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03689bd09574f029ce1a626ad784d17'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.510471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03689bd09574f029ce1a626ad784d17'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.511234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03689bd09574f029ce1a626ad784d17'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.522331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03689bd09574f029ce1a626ad784d17'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.523964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c011987-6665-4a5d-95db-de903b4f45d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03689bd09574f029ce1a626ad784d17'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:43.553641 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1274/2550] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:43 2022] DELETE /identity/v3/users/a03689bd09574f029ce1a626ad784d17 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:44.585444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:44.586976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:44.614255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13614bc5-e416-49b5-bcd3-3a7c399b1429 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:44.762633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:44.764078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:44.764368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:44.764705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] PATH_INFO: `/v3/projects/35ad432585fe44afa4256b672e510c64` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:44.767653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ad432585fe44afa4256b672e510c64)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:44.778539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:44.881326 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:44.883450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ad432585fe44afa4256b672e510c64', 'request_id': 'req-b734abde-5b68-45cd-81bc-65a561571df4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:44.906476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ad432585fe44afa4256b672e510c64', 'request_id': 'req-b734abde-5b68-45cd-81bc-65a561571df4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:44.928548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ad432585fe44afa4256b672e510c64', 'request_id': 'req-b734abde-5b68-45cd-81bc-65a561571df4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:44.967627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] The token cache is being invalidate because project 35ad432585fe44afa4256b672e510c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:44.967997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:44.968577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b734abde-5b68-45cd-81bc-65a561571df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:44.975481 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1277/2551] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:44 2022] DELETE /identity/v3/projects/35ad432585fe44afa4256b672e510c64 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:44.977448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dba60-69e3-4742-bda2-7cc5bbae93dc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:44.978410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dba60-69e3-4742-bda2-7cc5bbae93dc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:44.978870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dba60-69e3-4742-bda2-7cc5bbae93dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.005013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-612dba60-69e3-4742-bda2-7cc5bbae93dc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:45.007188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-612dba60-69e3-4742-bda2-7cc5bbae93dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:45.110312 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1275/2552] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:45.113413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ccd9-da72-4b01-9808-7f2b78fd4ff0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.114318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ccd9-da72-4b01-9808-7f2b78fd4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.114940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ccd9-da72-4b01-9808-7f2b78fd4ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.139778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-53a0ccd9-da72-4b01-9808-7f2b78fd4ff0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:45.141069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-53a0ccd9-da72-4b01-9808-7f2b78fd4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:45.153469 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1278/2553] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:45.155138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dba60-69e3-4742-bda2-7cc5bbae93dc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.173807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dba60-69e3-4742-bda2-7cc5bbae93dc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:45.181330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:45.181969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.182248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.182522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.184208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:45.184805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:45.188004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:45.208175 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1276/2554] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:45.209271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0ccd9-da72-4b01-9808-7f2b78fd4ff0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.222853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0ccd9-da72-4b01-9808-7f2b78fd4ff0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:45.229232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:45.229876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.230435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.231789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.231789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:45.234964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:45.275927 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1279/2555] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:45 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:45.281010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.292466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b5832-3803-4c74-8574-c743ed31927c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:45.393391 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:45.451213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:45.452785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.453705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.455190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.455987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:45.463963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:45.505275 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1277/2556] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:45 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:45.509450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.532600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724b62c-0239-472e-9589-825781a6a7cb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:45.538852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980116c-0266-454c-b494-096e864abb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:45.539689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980116c-0266-454c-b494-096e864abb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.540390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980116c-0266-454c-b494-096e864abb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.540610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980116c-0266-454c-b494-096e864abb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.541574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980116c-0266-454c-b494-096e864abb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:45.543857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980116c-0266-454c-b494-096e864abb88 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:45.566098 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1280/2557] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:45.567115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.567777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea77f6e-814d-426d-b058-ae4467da6440 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.568179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea77f6e-814d-426d-b058-ae4467da6440 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.568547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea77f6e-814d-426d-b058-ae4467da6440 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.570802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1281/2558] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:08:45.584638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4314771-04fb-4fe5-9f19-6fb65f2351b8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:45.592436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.593932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.594431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.597500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:45.598167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.599948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.600247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.600952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:45.602568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:45.638321 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1278/2559] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:08:45.664341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.669994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:45.678654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:45.688886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c99d1-1cd6-4307-905d-1d5710284d96 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:45.694064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709a63a-a022-4b86-9166-99208033158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:45.694792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709a63a-a022-4b86-9166-99208033158a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.695075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709a63a-a022-4b86-9166-99208033158a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.695348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709a63a-a022-4b86-9166-99208033158a admin admin] PATH_INFO: `/v3/projects/54a0d2d889d54aebad0a9177c4db66da/users/43d366716e804e73aed48940449409e9/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.718771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709a63a-a022-4b86-9166-99208033158a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a0d2d889d54aebad0a9177c4db66da, user_id=43d366716e804e73aed48940449409e9, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:45.721604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709a63a-a022-4b86-9166-99208033158a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:45.744008 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1279/2560] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:45 2022] PUT /identity/v3/projects/54a0d2d889d54aebad0a9177c4db66da/users/43d366716e804e73aed48940449409e9/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:45.756569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:45.758693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:45.759817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:45.805548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] MFA Rules not processed for user `43d366716e804e73aed48940449409e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:45.807300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:45.851896 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1282/2561] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:45.852815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.857487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:45.894956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f0c75-0bec-4b8c-bac9-7e2baecb8582 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:45.905088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1280/2562] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:45.905088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:45.905088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:45.993557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8933dd0-08fa-4bc1-9084-af1acecf2d9f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.000285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.001173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.001568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.002022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.005365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.006229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.006679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.007095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] PATH_INFO: `/v3/users/857c9f7c3ced41ff88104ae41ea3427e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.008917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857c9f7c3ced41ff88104ae41ea3427e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.011140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.025191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.032127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.072657 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:46.073611 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1281/2563] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:46.074721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:46.089849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51312b-0b42-44a6-894d-07ed303c58cc service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.099085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857c9f7c3ced41ff88104ae41ea3427e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.099198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.099999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.100343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.100691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.101723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.107271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.112707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857c9f7c3ced41ff88104ae41ea3427e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.116292 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:46.154233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857c9f7c3ced41ff88104ae41ea3427e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.155025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857c9f7c3ced41ff88104ae41ea3427e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.164790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857c9f7c3ced41ff88104ae41ea3427e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.179439 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1283/2564] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:45 2022] DELETE /identity/v3/users/857c9f7c3ced41ff88104ae41ea3427e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:46.179643 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1282/2565] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:46 2022] POST /identity/v3/projects => generated 395 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:46.184574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:46.189065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:46.308863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03a2b-6525-4366-8364-a4be86a6ea91 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.315110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.316033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.316461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.317203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.318250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.329239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.414320 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1284/2566] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:46 2022] POST /identity/v3/users => generated 304 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:46.418828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:46.515021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88250-57e4-42cc-a4d7-aef2d5446ac7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.520009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.522273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.522627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.522986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.524138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.526630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.548515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:46.548734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1283/2567] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:46.569024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac43f-04d3-4c7d-9f46-1c24feb9a087 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.577853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.579732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.580455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.581579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] PATH_INFO: `/v3/projects/73b1b3d1389540a9bd76ff92e9ab5fa3/users/a6725792b3e24a74829652c667142e07/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.610605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b1b3d1389540a9bd76ff92e9ab5fa3, user_id=a6725792b3e24a74829652c667142e07, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.631116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.666721 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1285/2568] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:46 2022] PUT /identity/v3/projects/73b1b3d1389540a9bd76ff92e9ab5fa3/users/a6725792b3e24a74829652c667142e07/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:46.671131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:46.683843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae566d6-81fd-41f8-9584-1cf0abdc308f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.789436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.790114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.790732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.791012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.791822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.796677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.811868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:46.812814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1284/2569] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:46.817026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:46.817266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:46.836556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aeb2c-bfb8-4e3f-a07a-ddcccf48af9b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.842486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e4616-7187-4f6b-9b29-6b0d141a022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.842734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a31e3-5dd8-4808-8927-152d0826c544 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:46.843513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4616-7187-4f6b-9b29-6b0d141a022d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.845311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4616-7187-4f6b-9b29-6b0d141a022d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.847472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4616-7187-4f6b-9b29-6b0d141a022d admin admin] PATH_INFO: `/v3/projects/73b1b3d1389540a9bd76ff92e9ab5fa3/users/a6725792b3e24a74829652c667142e07/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.850355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:46.851002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.851330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.851503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e4616-7187-4f6b-9b29-6b0d141a022d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b1b3d1389540a9bd76ff92e9ab5fa3, user_id=a6725792b3e24a74829652c667142e07, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.851639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] PATH_INFO: `/v3/projects/5f1cb43a57c442fda7d778cac048765a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.852976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1cb43a57c442fda7d778cac048765a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:46.858639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e4616-7187-4f6b-9b29-6b0d141a022d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.869255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:46.878268 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1285/2570] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:46 2022] PUT /identity/v3/projects/73b1b3d1389540a9bd76ff92e9ab5fa3/users/a6725792b3e24a74829652c667142e07/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:46.890632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57739-0263-4473-8df0-39f4dd057364 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:46.891613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57739-0263-4473-8df0-39f4dd057364 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:46.892494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57739-0263-4473-8df0-39f4dd057364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:46.962716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1cb43a57c442fda7d778cac048765a', 'request_id': 'req-ab1e9a93-8c73-43c3-b569-a3deb76174ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.970713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1cb43a57c442fda7d778cac048765a', 'request_id': 'req-ab1e9a93-8c73-43c3-b569-a3deb76174ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.976439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-aab57739-0263-4473-8df0-39f4dd057364 None None] MFA Rules not processed for user `a6725792b3e24a74829652c667142e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:46.977207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1cb43a57c442fda7d778cac048765a', 'request_id': 'req-ab1e9a93-8c73-43c3-b569-a3deb76174ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:46.978010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aab57739-0263-4473-8df0-39f4dd057364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:46.990084 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=82,keystone:DELETE=12,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:46.997302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] The token cache is being invalidate because project 5f1cb43a57c442fda7d778cac048765a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:47.007162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:47.009270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab1e9a93-8c73-43c3-b569-a3deb76174ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:47.012965 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1286/2571] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:46 2022] DELETE /identity/v3/projects/5f1cb43a57c442fda7d778cac048765a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:47.019546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.020094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.020606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.068253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:47.069915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:47.125981 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:47.181013 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1286/2572] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:47.218720 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1287/2573] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:47.227091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece78bd-3b5a-4633-b85a-b1bbe0b78451 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.227461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece78bd-3b5a-4633-b85a-b1bbe0b78451 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.227738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece78bd-3b5a-4633-b85a-b1bbe0b78451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.252835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.254638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:47.321312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2ece78bd-3b5a-4633-b85a-b1bbe0b78451 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:47.324363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2ece78bd-3b5a-4633-b85a-b1bbe0b78451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:47.350517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1287/2574] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:47.355030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece78bd-3b5a-4633-b85a-b1bbe0b78451 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.368016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece78bd-3b5a-4633-b85a-b1bbe0b78451 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.376983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.379591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.379959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.380940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.384368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:47.384368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.389058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:47.441276 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1288/2575] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:47.451207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.471649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c37b-edd6-4471-9e0e-72aee43db6ee admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.491729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.492348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.492627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.492932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.493570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.496268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:47.498341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ed724-9998-438b-a6f4-7ca06d84e0ea None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.505526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.506607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.507070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.507510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.523505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.526211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:47.536457 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1289/2576] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:47 2022] POST /identity/v3/projects => generated 405 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:47.538069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.539681 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1288/2577] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:47.618622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.620279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:47.625115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31ac1e-62da-4c0f-8272-4e82b4bdc21d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.630218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.630843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.631125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.631451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.632126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.634395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:47.645699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059205d-0651-4f15-ad8d-cc259568ed28 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.655726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.656540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.656966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.657326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] PATH_INFO: `/v3/users/43d366716e804e73aed48940449409e9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.658874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d366716e804e73aed48940449409e9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.663573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:47.679378 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1290/2578] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:47 2022] POST /identity/v3/users => generated 303 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:08:47.684524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.711198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debadf3-427d-40ec-84cf-d6331bb382de admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.723649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.727474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.727474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.727785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.728383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.732836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:47.780530 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1291/2579] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:47.782332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d366716e804e73aed48940449409e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:47.785432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.802262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfa23b-4c60-48e3-b9d7-02cb804195fa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.803779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d366716e804e73aed48940449409e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:47.812480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.814358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.815397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.816088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.817529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.820849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:47.825559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d366716e804e73aed48940449409e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:47.829335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d366716e804e73aed48940449409e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:47.841931 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1292/2580] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:47.843566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f7f2d464-e8ac-4b60-9d1b-f9b4ab2ebce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d366716e804e73aed48940449409e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:47.845805 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:47.846858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:47.851137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:47.870740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26913dbf-db74-4435-b546-e807178bc216 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:47.891654 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1289/2581] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:47 2022] DELETE /identity/v3/users/43d366716e804e73aed48940449409e9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:47.908196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622860a-a80c-4d5c-af62-378685467022 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.908721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622860a-a80c-4d5c-af62-378685467022 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.909043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622860a-a80c-4d5c-af62-378685467022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.938171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1622860a-a80c-4d5c-af62-378685467022 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:47.939419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1622860a-a80c-4d5c-af62-378685467022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:47.968223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7745d-6419-4354-860f-31c044383723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:47.969226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7745d-6419-4354-860f-31c044383723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:47.970223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7745d-6419-4354-860f-31c044383723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:47.971089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7745d-6419-4354-860f-31c044383723 admin admin] PATH_INFO: `/v3/projects/7cea8924d4c34c6b95038df1e44346d1/users/a27d91386a2d445097c01390045e7a18/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:47.996325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7745d-6419-4354-860f-31c044383723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cea8924d4c34c6b95038df1e44346d1, user_id=a27d91386a2d445097c01390045e7a18, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:47.999543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7745d-6419-4354-860f-31c044383723 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:48.017186 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:48.022110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1293/2582] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:47 2022] PUT /identity/v3/projects/7cea8924d4c34c6b95038df1e44346d1/users/a27d91386a2d445097c01390045e7a18/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:48.027331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f8c9-f460-4ba3-a9f1-7651ba1258b8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:48.029721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f8c9-f460-4ba3-a9f1-7651ba1258b8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:48.030215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f8c9-f460-4ba3-a9f1-7651ba1258b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:48.048964 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1290/2583] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:48.056358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622860a-a80c-4d5c-af62-378685467022 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:48.059074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1622860a-a80c-4d5c-af62-378685467022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:48.079938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e4d6f8c9-f460-4ba3-a9f1-7651ba1258b8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:48.081512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e4d6f8c9-f460-4ba3-a9f1-7651ba1258b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:48.174994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622860a-a80c-4d5c-af62-378685467022 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:48.196960 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1294/2584] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:48.204873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6f8c9-f460-4ba3-a9f1-7651ba1258b8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:48.263488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:48.264282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:48.264542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:48.264839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:48.280815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:48.282731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:48.283481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6f8c9-f460-4ba3-a9f1-7651ba1258b8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:48.289187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:48.289813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:48.290096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:48.290349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:48.301968 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1291/2585] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:48.318297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:48.319933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:48.343937 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1295/2586] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:08:49.322077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:49.325662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:49.364640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df8d94-9931-4cf9-a9f1-222f2fddb23a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:49.378939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:49.379903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:49.380275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:49.380646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] PATH_INFO: `/v3/projects/54a0d2d889d54aebad0a9177c4db66da` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:49.386059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a0d2d889d54aebad0a9177c4db66da)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:49.388227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:49.547292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a0d2d889d54aebad0a9177c4db66da', 'request_id': 'req-117a76aa-7d63-4348-ab01-f1358c395196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.551857 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:49.566084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a0d2d889d54aebad0a9177c4db66da', 'request_id': 'req-117a76aa-7d63-4348-ab01-f1358c395196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.586502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a0d2d889d54aebad0a9177c4db66da', 'request_id': 'req-117a76aa-7d63-4348-ab01-f1358c395196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.605824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] The token cache is being invalidate because project 54a0d2d889d54aebad0a9177c4db66da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:49.606599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.613421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-117a76aa-7d63-4348-ab01-f1358c395196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.618191 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1292/2587] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:49 2022] DELETE /identity/v3/projects/54a0d2d889d54aebad0a9177c4db66da => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:49.619346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:49.634587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396e9b6-9fc2-4c7a-8818-1c413eb05248 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:49.803894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:49.804553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:49.805348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:49.805348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] PATH_INFO: `/v3/users/a6725792b3e24a74829652c667142e07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:49.807478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6725792b3e24a74829652c667142e07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:49.808882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:49.875771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9c49-a17e-456c-a241-0465f5ea40bf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:49.876054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9c49-a17e-456c-a241-0465f5ea40bf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:49.876324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9c49-a17e-456c-a241-0465f5ea40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:49.902488 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:49.905957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6725792b3e24a74829652c667142e07'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.922385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6725792b3e24a74829652c667142e07'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.922921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6725792b3e24a74829652c667142e07'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.937499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6725792b3e24a74829652c667142e07'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.938775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6725792b3e24a74829652c667142e07'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:49.940700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-34dc9c49-a17e-456c-a241-0465f5ea40bf None None] MFA Rules not processed for user `9174038735de4d78b4ad527105d06624`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:49.942392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-34dc9c49-a17e-456c-a241-0465f5ea40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:49.977116 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1296/2588] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:49 2022] DELETE /identity/v3/users/a6725792b3e24a74829652c667142e07 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:50.078303 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1293/2589] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:50.086126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.087668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:50.195599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa747619-8fb3-4dcf-9c8c-75e927c75097 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:50.200931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:50.202135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.202520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.202982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.203736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:50.205804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:50.271089 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1297/2590] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:50 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:50.275362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc9c49-a17e-456c-a241-0465f5ea40bf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.296128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc9c49-a17e-456c-a241-0465f5ea40bf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:50.396707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:50.398209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.398522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.398792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.400346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:50.401779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:50.426219 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1294/2591] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:50 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:50.430256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.448270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc814d-adab-4e79-b52e-011d09537873 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:50.456068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:50.456907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.457282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.457987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.458614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:50.460332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:50.490053 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1298/2592] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:50.494877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.499877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.501691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:50.513505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233941c-5ce9-43d2-a7c6-08e28c2d99ad admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:50.522927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23614-61d8-486c-9a58-f4356b787f72 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:50.525298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:50.525976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.526251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.526517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] PATH_INFO: `/v3/projects/773ea26cd1f0413bb0a785fb7bc6f04b/users/784f69623b6e4401a90fc5ab58e9545e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.529078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:50.529859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.530259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.530628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] PATH_INFO: `/v3/projects/73b1b3d1389540a9bd76ff92e9ab5fa3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.531885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b1b3d1389540a9bd76ff92e9ab5fa3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:50.534638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:50.565091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=773ea26cd1f0413bb0a785fb7bc6f04b, user_id=784f69623b6e4401a90fc5ab58e9545e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:50.571036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:50.604750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1295/2593] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:50 2022] PUT /identity/v3/projects/773ea26cd1f0413bb0a785fb7bc6f04b/users/784f69623b6e4401a90fc5ab58e9545e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:50.606099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.630471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b1b3d1389540a9bd76ff92e9ab5fa3', 'request_id': 'req-35281047-4401-4ff9-843f-21b1464de046'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:50.653967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b1b3d1389540a9bd76ff92e9ab5fa3', 'request_id': 'req-35281047-4401-4ff9-843f-21b1464de046'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:50.663100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b1b3d1389540a9bd76ff92e9ab5fa3', 'request_id': 'req-35281047-4401-4ff9-843f-21b1464de046'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:50.696069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] The token cache is being invalidate because project 73b1b3d1389540a9bd76ff92e9ab5fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:50.696561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:50.698004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35281047-4401-4ff9-843f-21b1464de046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:50.700539 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1299/2594] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:50 2022] DELETE /identity/v3/projects/73b1b3d1389540a9bd76ff92e9ab5fa3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:50.704044 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:50.707427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec8bff-9674-40fc-a6f7-975663f70fa8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.707940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec8bff-9674-40fc-a6f7-975663f70fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.709250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec8bff-9674-40fc-a6f7-975663f70fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.748552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c237277-a9e6-4b08-8589-2860a0bc7d0a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:50.758681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-93ec8bff-9674-40fc-a6f7-975663f70fa8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:50.763706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93ec8bff-9674-40fc-a6f7-975663f70fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:50.791538 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:50.868695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:50.869450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.870152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.870304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.871055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:50.876916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:50.913201 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1296/2595] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:50.917853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.922966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:50.937485 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1300/2596] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:50.946761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86cc5-3b5f-49a9-ae0a-6108b2951d61 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.947057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86cc5-3b5f-49a9-ae0a-6108b2951d61 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.947310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86cc5-3b5f-49a9-ae0a-6108b2951d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.971313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115a068-9398-490b-8d83-31ca5a344b9a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:50.975975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bee86cc5-3b5f-49a9-ae0a-6108b2951d61 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:50.977328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bee86cc5-3b5f-49a9-ae0a-6108b2951d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:50.982426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:50.983340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:50.984887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:50.986206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] PATH_INFO: `/v3/projects/773ea26cd1f0413bb0a785fb7bc6f04b/users/784f69623b6e4401a90fc5ab58e9545e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:50.987474 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1301/2597] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:50.992052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee86cc5-3b5f-49a9-ae0a-6108b2951d61 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:50.992598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773ea26cd1f0413bb0a785fb7bc6f04b, user_id=784f69623b6e4401a90fc5ab58e9545e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:51.002504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee86cc5-3b5f-49a9-ae0a-6108b2951d61 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:51.003523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:51.007864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:51.008472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:51.008940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:51.009374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:51.010032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:51.010332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:51.012033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:51.030114 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1297/2598] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:50 2022] PUT /identity/v3/projects/773ea26cd1f0413bb0a785fb7bc6f04b/users/784f69623b6e4401a90fc5ab58e9545e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:51.034674 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1302/2599] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:08:51.035657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:51.201987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4b87b-013d-43f3-b902-1ebab8003525 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:51.211042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:51.211662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:51.211941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:51.212254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:51.212955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:51.219499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:51.285035 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1298/2600] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:51 2022] POST /identity/v3/projects => generated 367 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:51.289898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:51.304706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7499b-da1b-496d-aabb-d1562d1d7e91 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:51.422137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:51.423454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:51.423869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:51.424379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:51.425555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:51.428009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:51.463451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1303/2601] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:51 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:51.469477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:51.487353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8f8e-2048-430e-b93d-5d486f5c4fc8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:51.500901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:51.501705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:51.504298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:51.504697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:51.505935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:51.513973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:51.544455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:51.550843 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1299/2602] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:51.558056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16189b-1691-4c24-9799-5b5d6ce83640 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:51.569656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ea92-826e-4852-aa08-fdd4de00a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:51.571453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ea92-826e-4852-aa08-fdd4de00a380 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:51.573134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ea92-826e-4852-aa08-fdd4de00a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:51.574121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ea92-826e-4852-aa08-fdd4de00a380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:51.574986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ea92-826e-4852-aa08-fdd4de00a380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:51.581768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ea92-826e-4852-aa08-fdd4de00a380 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:51.642354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1304/2603] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:08:51.648247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:51.661486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2bea5-825f-4ba5-b4e8-4f5e4850af66 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:51.687251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:51.687946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:51.688372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:51.688651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] PATH_INFO: `/v3/projects/6073ae2e8036492faa2a4f7a26489134/users/b0bd3eeeb578465a8f5e5eaa3b3fdc85/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:51.738075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6073ae2e8036492faa2a4f7a26489134, user_id=b0bd3eeeb578465a8f5e5eaa3b3fdc85, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:51.745759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:51.777258 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1300/2604] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:51 2022] PUT /identity/v3/projects/6073ae2e8036492faa2a4f7a26489134/users/b0bd3eeeb578465a8f5e5eaa3b3fdc85/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:51.782959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:51.783278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:51.783638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:51.820078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:51.825905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:51.971445 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1305/2605] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:52.097851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:52.099648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:52.129529 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:52.177733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1118-ebdb-4607-b086-f15cd94af4c9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:52.183225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23840f1-a96b-4ad0-9c11-a615573c264c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:52.183984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23840f1-a96b-4ad0-9c11-a615573c264c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:52.184739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23840f1-a96b-4ad0-9c11-a615573c264c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:52.185197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23840f1-a96b-4ad0-9c11-a615573c264c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:52.197086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23840f1-a96b-4ad0-9c11-a615573c264c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:52.201044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23840f1-a96b-4ad0-9c11-a615573c264c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:52.213152 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1301/2606] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:53.724933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:53.726388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:53.759159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7827b-25cf-45db-ab55-10a60e1736af None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:53.770903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:53.771768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:53.772154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:53.772534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] PATH_INFO: `/v3/users/9ebc6e77ecbc4a61a6f13803cd1a1589` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:53.773906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebc6e77ecbc4a61a6f13803cd1a1589)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:53.776208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:53.797117 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:53.891372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebc6e77ecbc4a61a6f13803cd1a1589'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:53.908000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebc6e77ecbc4a61a6f13803cd1a1589'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:53.908670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebc6e77ecbc4a61a6f13803cd1a1589'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:53.918463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebc6e77ecbc4a61a6f13803cd1a1589'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:53.919479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebc6e77ecbc4a61a6f13803cd1a1589'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:53.948471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1306/2607] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:53 2022] DELETE /identity/v3/users/9ebc6e77ecbc4a61a6f13803cd1a1589 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:53.954343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1aee8-0ed5-4da1-a0e8-2bda403f6ea6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:53.954850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1aee8-0ed5-4da1-a0e8-2bda403f6ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:53.954930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1aee8-0ed5-4da1-a0e8-2bda403f6ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:53.976202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-17f1aee8-0ed5-4da1-a0e8-2bda403f6ea6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:53.977688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-17f1aee8-0ed5-4da1-a0e8-2bda403f6ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.124027 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1302/2608] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:54.142622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:54.144204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.290156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d3cd2-6383-46f5-828b-c7cb876926fd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:54.300856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:54.301629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.301963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.302301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.322590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:54.324147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:54.343695 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1307/2609] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:54.749731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063308-d9b3-47c2-9df2-028b546eda1d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.750168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063308-d9b3-47c2-9df2-028b546eda1d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.750630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063308-d9b3-47c2-9df2-028b546eda1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.793489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d9063308-d9b3-47c2-9df2-028b546eda1d None None] MFA Rules not processed for user `52db969e85344bb6a40150cedc205df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:54.794931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d9063308-d9b3-47c2-9df2-028b546eda1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.937941 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1303/2610] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.103388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.106466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.144439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000532-2f4e-4daa-9efd-fd0759b025bc service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.160648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.161340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.161615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.162203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] PATH_INFO: `/v3/projects/74a87c21538344c7ac51835993e5839d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.165010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a87c21538344c7ac51835993e5839d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.167100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.277123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a87c21538344c7ac51835993e5839d', 'request_id': 'req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.297816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a87c21538344c7ac51835993e5839d', 'request_id': 'req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.304525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a87c21538344c7ac51835993e5839d', 'request_id': 'req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.340451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] The token cache is being invalidate because project 74a87c21538344c7ac51835993e5839d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:55.340931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.343373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.343664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1308/2611] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:55 2022] DELETE /identity/v3/projects/74a87c21538344c7ac51835993e5839d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:55.349576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9063308-d9b3-47c2-9df2-028b546eda1d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.362408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9063308-d9b3-47c2-9df2-028b546eda1d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.434292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.435822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.436286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.436730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] PATH_INFO: `/v3/users/7abd7dd96a1e4264ba8b374857d1ef89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.438176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abd7dd96a1e4264ba8b374857d1ef89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.441177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.447407 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:55.525416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abd7dd96a1e4264ba8b374857d1ef89'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.537327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abd7dd96a1e4264ba8b374857d1ef89'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.561180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abd7dd96a1e4264ba8b374857d1ef89'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.562589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abd7dd96a1e4264ba8b374857d1ef89'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.579641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c5e3ef5-047d-42cb-bc39-7025ffd49287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abd7dd96a1e4264ba8b374857d1ef89'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:55.597701 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1304/2612] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:55 2022] DELETE /identity/v3/users/7abd7dd96a1e4264ba8b374857d1ef89 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:56.512379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.515694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:56.542131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a27b-84ef-4cb6-a4a8-071031cb13e0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.606906 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.817099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.818238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.818521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.818791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] PATH_INFO: `/v3/projects/a420e5cee9a64a2db8b85ce4a4158bf8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.820472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a420e5cee9a64a2db8b85ce4a4158bf8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.823735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.954712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a420e5cee9a64a2db8b85ce4a4158bf8', 'request_id': 'req-5e778e8f-ab60-46af-a61f-7d4fd875bd76'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:56.969843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a420e5cee9a64a2db8b85ce4a4158bf8', 'request_id': 'req-5e778e8f-ab60-46af-a61f-7d4fd875bd76'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:56.983285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a420e5cee9a64a2db8b85ce4a4158bf8', 'request_id': 'req-5e778e8f-ab60-46af-a61f-7d4fd875bd76'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:57.007708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] The token cache is being invalidate because project a420e5cee9a64a2db8b85ce4a4158bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:08:57.008003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:57.008690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e778e8f-ab60-46af-a61f-7d4fd875bd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:08:57.016536 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1309/2613] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:08:56 2022] DELETE /identity/v3/projects/a420e5cee9a64a2db8b85ce4a4158bf8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:57.018160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212f7c3-88da-4051-a3e5-3b95b53e2132 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.018646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212f7c3-88da-4051-a3e5-3b95b53e2132 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.018744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212f7c3-88da-4051-a3e5-3b95b53e2132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.073307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6212f7c3-88da-4051-a3e5-3b95b53e2132 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.076535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6212f7c3-88da-4051-a3e5-3b95b53e2132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.187717 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1305/2614] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.196745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322490-d644-4ef8-90e0-2b1a1cf597d3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.197115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322490-d644-4ef8-90e0-2b1a1cf597d3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.197434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322490-d644-4ef8-90e0-2b1a1cf597d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.250128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-41322490-d644-4ef8-90e0-2b1a1cf597d3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.261609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-41322490-d644-4ef8-90e0-2b1a1cf597d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.312798 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1310/2615] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.318361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212f7c3-88da-4051-a3e5-3b95b53e2132 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.351904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212f7c3-88da-4051-a3e5-3b95b53e2132 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.381268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.382928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.383543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.384751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.386520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:57.390648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.392719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.423652 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1306/2616] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:57.428016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41322490-d644-4ef8-90e0-2b1a1cf597d3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.442611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41322490-d644-4ef8-90e0-2b1a1cf597d3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.452570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.455200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.455688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.456111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.461751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.463723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.549226 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1311/2617] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:57.551816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.577277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e89ff-e12f-423c-bb41-5c735acb25da admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.744967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.745587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.745866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.746141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.748355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.750863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.776474 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:57.789594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.804933 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1307/2618] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:57.821124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82823853-b42e-4dbb-a6cf-8b0e591dbd94 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.828199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.829498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.830122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.830652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.832276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.835926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.884064 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1312/2619] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:57.886556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.905970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed22f16-9d3f-41a5-9186-45ac2c8bdf80 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.921579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff002ce1-3775-4ab5-8d52-fd3ec7e9292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.924536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff002ce1-3775-4ab5-8d52-fd3ec7e9292f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.924739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff002ce1-3775-4ab5-8d52-fd3ec7e9292f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.926700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff002ce1-3775-4ab5-8d52-fd3ec7e9292f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.927565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff002ce1-3775-4ab5-8d52-fd3ec7e9292f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.956296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff002ce1-3775-4ab5-8d52-fd3ec7e9292f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.998647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1308/2620] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:58.007838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.029501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501a77c-0644-49c9-8a15-944f4063b6d3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.044680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.046929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.051914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.052357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] PATH_INFO: `/v3/projects/3e8b6b7fd8a34dca8d5d4d61c408526f/users/fd88041239124e50b42b98e16b19af1a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.094784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8b6b7fd8a34dca8d5d4d61c408526f, user_id=fd88041239124e50b42b98e16b19af1a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.097742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.120734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1313/2621] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:58 2022] PUT /identity/v3/projects/3e8b6b7fd8a34dca8d5d4d61c408526f/users/fd88041239124e50b42b98e16b19af1a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:58.122313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda160d5-a0c8-418b-ad39-982200944e58 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.122815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda160d5-a0c8-418b-ad39-982200944e58 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.122815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda160d5-a0c8-418b-ad39-982200944e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.171586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dda160d5-a0c8-418b-ad39-982200944e58 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:58.172856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dda160d5-a0c8-418b-ad39-982200944e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:58.340005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1309/2622] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:58.391074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.393199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:58.563535 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:58.607510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a8d5-eb57-41ff-a342-7af964e310c9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.620950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.625308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.627595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.629788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.660984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.666463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.708039 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1314/2623] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:04.577995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650a496-11aa-4ab8-a1ab-ece9259b9dce None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:04.580391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650a496-11aa-4ab8-a1ab-ece9259b9dce None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:04.580859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650a496-11aa-4ab8-a1ab-ece9259b9dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:04.687296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9650a496-11aa-4ab8-a1ab-ece9259b9dce None None] MFA Rules not processed for user `a27d91386a2d445097c01390045e7a18`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:04.689639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9650a496-11aa-4ab8-a1ab-ece9259b9dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:04.860531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1310/2624] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:05.069838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:05.071941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:05.231664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf76600-07f2-4d23-b0fe-d8ecdb6b031b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:05.250550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae99a5d-e294-4cad-8256-22bd4b44a65d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:05.251188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae99a5d-e294-4cad-8256-22bd4b44a65d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:05.251468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae99a5d-e294-4cad-8256-22bd4b44a65d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:05.251739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae99a5d-e294-4cad-8256-22bd4b44a65d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:05.269300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae99a5d-e294-4cad-8256-22bd4b44a65d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:05.271786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae99a5d-e294-4cad-8256-22bd4b44a65d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:05.290199 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1315/2625] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:05.571730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:05.572405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:05.573081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:05.641271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39af4-2e77-4e2b-bb6f-fab5a7d97355 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:05.641583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39af4-2e77-4e2b-bb6f-fab5a7d97355 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:05.641829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39af4-2e77-4e2b-bb6f-fab5a7d97355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:05.655514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] MFA Rules not processed for user `547522b0b07f472a91ec83f15a36bb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:05.659004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:05.696516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-36b39af4-2e77-4e2b-bb6f-fab5a7d97355 None None] MFA Rules not processed for user `b0bd3eeeb578465a8f5e5eaa3b3fdc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:05.697769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36b39af4-2e77-4e2b-bb6f-fab5a7d97355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:05.782808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1311/2626] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:05.846533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1316/2627] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:05.850990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:05.852661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:05.891660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080df0-364b-4b49-a7ce-b2c97c15c784 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:05.907158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:05.910078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:05.910614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:05.911348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:05.914093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:05.922228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.020630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39af4-2e77-4e2b-bb6f-fab5a7d97355 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.020866 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1312/2628] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:05 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:06.051959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39af4-2e77-4e2b-bb6f-fab5a7d97355 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.216710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.217395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.217687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.217954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.218606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.220523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.239255 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:06.294646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.300231 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:06.306500 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1317/2629] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:06 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:06.313041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9919a6-6482-4ca3-a9b9-30e80fee8eb7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.344349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.345012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.345287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.345556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.346205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.348066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.399284 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1313/2630] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:06.403543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.453784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eed137-5bce-4933-93f3-08fd2fb068bb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.481640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.487396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.487701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.488159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] PATH_INFO: `/v3/projects/53981a5094de458785f37039740101e2/users/5abc5c325ac64b18bb8d88cfafb66db3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.554331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53981a5094de458785f37039740101e2, user_id=5abc5c325ac64b18bb8d88cfafb66db3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.562009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.603491 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1318/2631] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:06 2022] PUT /identity/v3/projects/53981a5094de458785f37039740101e2/users/5abc5c325ac64b18bb8d88cfafb66db3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:06.609718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.624267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad334e34-b808-4484-bca1-24cceac35833 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.778119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.778952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.779052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.779284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.780015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.781688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.809511 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1314/2632] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:06.815203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.832801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fb19-febe-4134-9623-a35edf282e43 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.850073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7c62-21d2-401f-a9c4-89c58931b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.850842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7c62-21d2-401f-a9c4-89c58931b5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.851121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7c62-21d2-401f-a9c4-89c58931b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.851392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7c62-21d2-401f-a9c4-89c58931b5f3 admin admin] PATH_INFO: `/v3/projects/53981a5094de458785f37039740101e2/users/5abc5c325ac64b18bb8d88cfafb66db3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.857098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7c62-21d2-401f-a9c4-89c58931b5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53981a5094de458785f37039740101e2, user_id=5abc5c325ac64b18bb8d88cfafb66db3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.859760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7c62-21d2-401f-a9c4-89c58931b5f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.903663 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1319/2633] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:06 2022] PUT /identity/v3/projects/53981a5094de458785f37039740101e2/users/5abc5c325ac64b18bb8d88cfafb66db3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:08.883857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:08.885956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:08.911362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d889-6873-492c-98e0-118d388a92e1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:09.109429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:09.110443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:09.111206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:09.119450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] PATH_INFO: `/v3/users/1c396660456743b19abe19dccdb9ba2e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:09.121885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c396660456743b19abe19dccdb9ba2e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:09.137512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:09.250271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c396660456743b19abe19dccdb9ba2e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:09.275004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c396660456743b19abe19dccdb9ba2e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:09.304823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c396660456743b19abe19dccdb9ba2e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:09.304823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c396660456743b19abe19dccdb9ba2e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:09.326914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c396660456743b19abe19dccdb9ba2e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:09.364923 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1315/2634] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:08 2022] DELETE /identity/v3/users/1c396660456743b19abe19dccdb9ba2e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:09.368863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:09.369327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:09.369705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:09.416737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:09.437461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:09.645267 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1320/2635] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:09.709252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:09.710900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:09.743972 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:09.870534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af032f5-781a-45c2-ac87-e11c575ad573 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:09.878733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:09.879350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:09.879630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:09.879900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:09.895563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:09.900014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:09.913655 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1316/2636] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:12.367612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:12.369142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:12.391873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c6a4-fb09-4caf-a59d-7f4ae1e29350 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:12.409175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:12.409919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:12.410599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:12.411058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] PATH_INFO: `/v3/projects/10a30211c0624285b0d861b43a2036c4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:12.412476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a30211c0624285b0d861b43a2036c4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:12.416396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:12.508728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a30211c0624285b0d861b43a2036c4', 'request_id': 'req-07138f57-09e9-411f-8718-5947b652c54b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.520086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a30211c0624285b0d861b43a2036c4', 'request_id': 'req-07138f57-09e9-411f-8718-5947b652c54b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.530878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a30211c0624285b0d861b43a2036c4', 'request_id': 'req-07138f57-09e9-411f-8718-5947b652c54b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.545917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] The token cache is being invalidate because project 10a30211c0624285b0d861b43a2036c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:12.559439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.560634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.563643 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1321/2637] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:12 2022] DELETE /identity/v3/projects/10a30211c0624285b0d861b43a2036c4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:12.567497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:12.586574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d333c9e-6c3d-49f6-80d3-ac63334f7e4b service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:12.720233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:12.721355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:12.721927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:12.722555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] PATH_INFO: `/v3/users/b36f8a6bf3fd4cde8092f575873acf08` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:12.725286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36f8a6bf3fd4cde8092f575873acf08)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:12.730844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:12.886968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36f8a6bf3fd4cde8092f575873acf08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.904453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36f8a6bf3fd4cde8092f575873acf08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.961009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36f8a6bf3fd4cde8092f575873acf08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.963066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36f8a6bf3fd4cde8092f575873acf08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:13.006679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-108ef9a4-b497-49eb-b3a5-72b639e77ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36f8a6bf3fd4cde8092f575873acf08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:13.038379 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1317/2638] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:12 2022] DELETE /identity/v3/users/b36f8a6bf3fd4cde8092f575873acf08 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:14.748692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:14.751154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:14.787742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07138f57-09e9-411f-8718-5947b652c54b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:14.903168 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:14.971716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:14.972394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:14.972890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:14.973313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] PATH_INFO: `/v3/projects/2f0ba949f8dc4b7494c13a0fa7b387fb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:14.975810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0ba949f8dc4b7494c13a0fa7b387fb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:14.979926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:15.130099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0ba949f8dc4b7494c13a0fa7b387fb', 'request_id': 'req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:15.149426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0ba949f8dc4b7494c13a0fa7b387fb', 'request_id': 'req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:15.160715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0ba949f8dc4b7494c13a0fa7b387fb', 'request_id': 'req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:15.183042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] The token cache is being invalidate because project 2f0ba949f8dc4b7494c13a0fa7b387fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:15.183464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:15.185530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ddef3ee1-85c4-4967-9bba-34348fcf4ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:15.191058 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1322/2639] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:14 2022] DELETE /identity/v3/projects/2f0ba949f8dc4b7494c13a0fa7b387fb => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:15.192673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8a02-9a8e-4481-baba-7c4b459480ec None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.193149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8a02-9a8e-4481-baba-7c4b459480ec None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.193271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8a02-9a8e-4481-baba-7c4b459480ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:15.222436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c06e8a02-9a8e-4481-baba-7c4b459480ec None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:15.224927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c06e8a02-9a8e-4481-baba-7c4b459480ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:15.266719 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:15.367941 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1318/2640] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:15.378450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dd082-6a9b-4920-bc0a-0bfbd39d1fc3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.379142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dd082-6a9b-4920-bc0a-0bfbd39d1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.379636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dd082-6a9b-4920-bc0a-0bfbd39d1fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:15.432396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-113dd082-6a9b-4920-bc0a-0bfbd39d1fc3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:15.434909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-113dd082-6a9b-4920-bc0a-0bfbd39d1fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:15.446913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1323/2641] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:15.451292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8a02-9a8e-4481-baba-7c4b459480ec None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:15.464583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8a02-9a8e-4481-baba-7c4b459480ec None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:15.472661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f590a5-4678-4285-9683-c5ad0ae16ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:15.474539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f590a5-4678-4285-9683-c5ad0ae16ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.475647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f590a5-4678-4285-9683-c5ad0ae16ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.476127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f590a5-4678-4285-9683-c5ad0ae16ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:15.477864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f590a5-4678-4285-9683-c5ad0ae16ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:15.478504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f590a5-4678-4285-9683-c5ad0ae16ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:15.480992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f590a5-4678-4285-9683-c5ad0ae16ec8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:15.498536 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1319/2642] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:15.503095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dd082-6a9b-4920-bc0a-0bfbd39d1fc3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:15.518244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dd082-6a9b-4920-bc0a-0bfbd39d1fc3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:15.524582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:15.525815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.526310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.526915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:15.537359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:15.548600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:15.598063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66058-456d-4917-b67c-f216b5534998 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.598456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66058-456d-4917-b67c-f216b5534998 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.598831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66058-456d-4917-b67c-f216b5534998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:15.663834 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1324/2643] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:15 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:15.664748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:15.675351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-40e66058-456d-4917-b67c-f216b5534998 None None] MFA Rules not processed for user `fd88041239124e50b42b98e16b19af1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:15.677835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-40e66058-456d-4917-b67c-f216b5534998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:15.824851 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1320/2644] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:15.845728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72ae77-84fa-41ec-a83f-952c8267c356 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:15.862681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:15.863407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.863774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.864134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:15.865702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:15.868341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:15.909935 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1325/2645] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:15 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:15.911132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e66058-456d-4917-b67c-f216b5534998 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:15.929341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e66058-456d-4917-b67c-f216b5534998 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:15.945184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:15.945817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.946092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.946422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:15.947008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:15.950756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:15.977538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:15.978163 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1321/2646] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:15.980745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:15.981065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:16.010659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7ffe5-df7b-43e0-b5c3-46350ca38b49 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.024159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.025315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.025813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.026484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.027556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.030862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.041801 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:16.052149 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1322/2647] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:16.054535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:16.070336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3487b5-0a2d-4777-8e69-9f363a5a3e3e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.082459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101b05-baeb-47e7-b933-4bfddbf299e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.083214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101b05-baeb-47e7-b933-4bfddbf299e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.083490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101b05-baeb-47e7-b933-4bfddbf299e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.083830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101b05-baeb-47e7-b933-4bfddbf299e5 admin admin] PATH_INFO: `/v3/projects/1b094e07a54b4d908fb9fcb60b1c87bf/users/897d73e68cc44589ac64edfb23770a66/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.190105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101b05-baeb-47e7-b933-4bfddbf299e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b094e07a54b4d908fb9fcb60b1c87bf, user_id=897d73e68cc44589ac64edfb23770a66, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.196449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf9fd-b337-4a95-b8c8-f7af16dab47a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.199994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101b05-baeb-47e7-b933-4bfddbf299e5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.219395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.224665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.232843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.232843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.233508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1323/2648] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:16 2022] PUT /identity/v3/projects/1b094e07a54b4d908fb9fcb60b1c87bf/users/897d73e68cc44589ac64edfb23770a66/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:16.238554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935ac7-3369-4e46-a43e-fb7161056ec1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.239080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935ac7-3369-4e46-a43e-fb7161056ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.239388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935ac7-3369-4e46-a43e-fb7161056ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.253510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.255316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.271004 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1326/2649] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:16.288664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1a935ac7-3369-4e46-a43e-fb7161056ec1 None None] MFA Rules not processed for user `897d73e68cc44589ac64edfb23770a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:16.290369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1a935ac7-3369-4e46-a43e-fb7161056ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:16.382579 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:16.419280 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1324/2650] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:16.419523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:16.434509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05ed92-2546-489e-acbc-1bea4a2ec1dc service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.539723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4569380-d5a5-4796-804a-fbf1f0a1892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.540448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4569380-d5a5-4796-804a-fbf1f0a1892e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.541004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4569380-d5a5-4796-804a-fbf1f0a1892e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.541843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4569380-d5a5-4796-804a-fbf1f0a1892e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.542063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4569380-d5a5-4796-804a-fbf1f0a1892e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.544361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4569380-d5a5-4796-804a-fbf1f0a1892e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.601898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1327/2651] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:16 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:16.603330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a935ac7-3369-4e46-a43e-fb7161056ec1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:16.604455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b6e6-b7ae-484e-8835-248a5ea90a30 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.604815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b6e6-b7ae-484e-8835-248a5ea90a30 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.605794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b6e6-b7ae-484e-8835-248a5ea90a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.627097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a935ac7-3369-4e46-a43e-fb7161056ec1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.680388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5b38b6e6-b7ae-484e-8835-248a5ea90a30 None None] MFA Rules not processed for user `784f69623b6e4401a90fc5ab58e9545e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:16.682465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b38b6e6-b7ae-484e-8835-248a5ea90a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:16.722981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.723785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.724359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.724714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.726749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.728345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.760303 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1325/2652] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:16 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:16.764358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:16.781960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e65287-e241-40f3-80b8-1665827277dd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.797040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.799189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.800954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.801690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.802398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.809203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.840939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1326/2653] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:16.843197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:16.861462 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1328/2654] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:16.869964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80104-7b7a-4d9a-a53e-229db96b5adc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.881980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.883584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.883868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.885276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] PATH_INFO: `/v3/projects/48c18b2fa4604803a8872ccabef18444/users/7ba7f82ad18747f6b8cc1bc10cba0a15/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.919417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c18b2fa4604803a8872ccabef18444, user_id=7ba7f82ad18747f6b8cc1bc10cba0a15, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.922082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.952828 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1327/2655] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:16 2022] PUT /identity/v3/projects/48c18b2fa4604803a8872ccabef18444/users/7ba7f82ad18747f6b8cc1bc10cba0a15/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:16.954384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38b6e6-b7ae-484e-8835-248a5ea90a30 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:16.987988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38b6e6-b7ae-484e-8835-248a5ea90a30 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:17.031369 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:17.134778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5bdfd-ade5-4d97-a3c4-9497c3edb13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:17.135526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bdfd-ade5-4d97-a3c4-9497c3edb13a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.135875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bdfd-ade5-4d97-a3c4-9497c3edb13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.136238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bdfd-ade5-4d97-a3c4-9497c3edb13a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:17.137951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5bdfd-ade5-4d97-a3c4-9497c3edb13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:17.138979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5bdfd-ade5-4d97-a3c4-9497c3edb13a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:17.157797 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1329/2656] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:17.159238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:17.173118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b67b7-943f-4726-a449-b88f2d798be9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:17.180577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb8fe0-1be5-44e4-aed4-7588f8cc1a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:17.183890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8fe0-1be5-44e4-aed4-7588f8cc1a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.185525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8fe0-1be5-44e4-aed4-7588f8cc1a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.185923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8fe0-1be5-44e4-aed4-7588f8cc1a56 admin admin] PATH_INFO: `/v3/projects/48c18b2fa4604803a8872ccabef18444/users/7ba7f82ad18747f6b8cc1bc10cba0a15/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:17.193282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb8fe0-1be5-44e4-aed4-7588f8cc1a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c18b2fa4604803a8872ccabef18444, user_id=7ba7f82ad18747f6b8cc1bc10cba0a15, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:17.207656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb8fe0-1be5-44e4-aed4-7588f8cc1a56 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:17.248758 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1328/2657] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:17 2022] PUT /identity/v3/projects/48c18b2fa4604803a8872ccabef18444/users/7ba7f82ad18747f6b8cc1bc10cba0a15/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:17.249521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f726-e257-423a-90ae-cc547209d741 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.250066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f726-e257-423a-90ae-cc547209d741 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.250341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f726-e257-423a-90ae-cc547209d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:17.325648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2190f726-e257-423a-90ae-cc547209d741 None None] MFA Rules not processed for user `7ba7f82ad18747f6b8cc1bc10cba0a15`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:17.326835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2190f726-e257-423a-90ae-cc547209d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:17.478056 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1330/2658] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:17.489573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ca689-17ce-4476-a165-fe28cca8bb89 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.489843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ca689-17ce-4476-a165-fe28cca8bb89 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.490172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ca689-17ce-4476-a165-fe28cca8bb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:17.513306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eb3ca689-17ce-4476-a165-fe28cca8bb89 None None] MFA Rules not processed for user `897d73e68cc44589ac64edfb23770a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:17.514548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb3ca689-17ce-4476-a165-fe28cca8bb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:17.616735 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1329/2659] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:18.818172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f726-e257-423a-90ae-cc547209d741 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.823459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2190f726-e257-423a-90ae-cc547209d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:18.986338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f726-e257-423a-90ae-cc547209d741 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.008658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d2ea-8aae-445a-9d72-aea21f83fe46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.009324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d2ea-8aae-445a-9d72-aea21f83fe46 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.009951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d2ea-8aae-445a-9d72-aea21f83fe46 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.010377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d2ea-8aae-445a-9d72-aea21f83fe46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.012971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4555d2ea-8aae-445a-9d72-aea21f83fe46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:19.094226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ca689-17ce-4476-a165-fe28cca8bb89 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:19.117224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ca689-17ce-4476-a165-fe28cca8bb89 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.121559 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:19.135032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470f090-59c1-424b-a98f-18171380852e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.135675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470f090-59c1-424b-a98f-18171380852e service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.135953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470f090-59c1-424b-a98f-18171380852e service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.137339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470f090-59c1-424b-a98f-18171380852e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.166585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470f090-59c1-424b-a98f-18171380852e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.170192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470f090-59c1-424b-a98f-18171380852e service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.183700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d2ea-8aae-445a-9d72-aea21f83fe46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.194433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d2ea-8aae-445a-9d72-aea21f83fe46 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.227444 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1330/2660] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:19.247362 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1331/2661] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:19.927415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57340110-6fb3-4adb-acaf-cbcffc8ea0fe None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.927833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57340110-6fb3-4adb-acaf-cbcffc8ea0fe None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.928228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57340110-6fb3-4adb-acaf-cbcffc8ea0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.992854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-57340110-6fb3-4adb-acaf-cbcffc8ea0fe None None] MFA Rules not processed for user `897d73e68cc44589ac64edfb23770a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:19.994298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-57340110-6fb3-4adb-acaf-cbcffc8ea0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:20.013390 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1331/2662] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:24.238369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d86c0-a900-4660-8a72-b5bd11f77480 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:24.238930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d86c0-a900-4660-8a72-b5bd11f77480 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:24.238930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d86c0-a900-4660-8a72-b5bd11f77480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:24.274729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d14d86c0-a900-4660-8a72-b5bd11f77480 None None] MFA Rules not processed for user `9174038735de4d78b4ad527105d06624`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:24.277409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d14d86c0-a900-4660-8a72-b5bd11f77480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:24.286387 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1332/2663] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:24.493551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101641cb-2eba-4ad3-af82-56ef8e0df6a2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:24.494126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101641cb-2eba-4ad3-af82-56ef8e0df6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:24.494126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101641cb-2eba-4ad3-af82-56ef8e0df6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:24.539442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-101641cb-2eba-4ad3-af82-56ef8e0df6a2 None None] MFA Rules not processed for user `72250431a7f44bff83c1881ff733f2de`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:24.542609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-101641cb-2eba-4ad3-af82-56ef8e0df6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:24.565020 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:24.652998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1332/2664] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:28.193349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be41754-5813-45cb-b2bd-e5dea10e092e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:28.194671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be41754-5813-45cb-b2bd-e5dea10e092e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:28.194946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be41754-5813-45cb-b2bd-e5dea10e092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:28.236301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0be41754-5813-45cb-b2bd-e5dea10e092e None None] MFA Rules not processed for user `5abc5c325ac64b18bb8d88cfafb66db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:28.237796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0be41754-5813-45cb-b2bd-e5dea10e092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:28.397322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:28.398400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:28.398917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:28.404590 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1333/2665] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:28.430968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] MFA Rules not processed for user `b0bd3eeeb578465a8f5e5eaa3b3fdc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:28.433908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:28.545837 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1333/2666] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:29.155115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be41754-5813-45cb-b2bd-e5dea10e092e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:29.175657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be41754-5813-45cb-b2bd-e5dea10e092e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:29.194836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:29.195690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:29.196199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:29.196712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:29.199040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:29.232043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:29.234229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:29.267556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1334/2667] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:29.760481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:29.764025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:29.977964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07f2f5-24a1-4006-b237-6bbb2d004552 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:29.988911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:29.989794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:29.990071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:29.990410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:29.995474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:30.020259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:30.029845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:30.056125 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1334/2668] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:39.242130 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=51 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:40.047144 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=75 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:41.722590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.725467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:41.803537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a074-3d3d-441c-9a28-3faa99976667 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:41.808378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:41.809058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.809336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.809609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] PATH_INFO: `/v3/users/a27d91386a2d445097c01390045e7a18` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.810744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27d91386a2d445097c01390045e7a18)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.812653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.864324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27d91386a2d445097c01390045e7a18'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.875822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27d91386a2d445097c01390045e7a18'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.877180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27d91386a2d445097c01390045e7a18'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.893043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27d91386a2d445097c01390045e7a18'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.894231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-be16e2ae-6a41-4c36-9734-4b6820c32fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27d91386a2d445097c01390045e7a18'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.925428 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1335/2669] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:41 2022] DELETE /identity/v3/users/a27d91386a2d445097c01390045e7a18 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:42.270081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.283983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfa28-0ed2-4a97-8b95-6315ebc21765 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.365857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.366503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.366779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.367051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] PATH_INFO: `/v3/projects/7cea8924d4c34c6b95038df1e44346d1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.368278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cea8924d4c34c6b95038df1e44346d1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.370470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.418347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cea8924d4c34c6b95038df1e44346d1', 'request_id': 'req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.425063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cea8924d4c34c6b95038df1e44346d1', 'request_id': 'req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.431392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cea8924d4c34c6b95038df1e44346d1', 'request_id': 'req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.444374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] The token cache is being invalidate because project 7cea8924d4c34c6b95038df1e44346d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:42.444714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.445315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5c3b6f8f-2f61-4365-9cee-bd299ff89dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.446895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1335/2670] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:42 2022] DELETE /identity/v3/projects/7cea8924d4c34c6b95038df1e44346d1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:42.453546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b401d-187f-4b32-ad9d-df0a8f4b6982 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.453830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b401d-187f-4b32-ad9d-df0a8f4b6982 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.454105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b401d-187f-4b32-ad9d-df0a8f4b6982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.474622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f85b401d-187f-4b32-ad9d-df0a8f4b6982 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:42.475912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f85b401d-187f-4b32-ad9d-df0a8f4b6982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.538738 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1336/2671] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:42.546833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940a5a-9117-4414-862e-1e222a99aca7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.547111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940a5a-9117-4414-862e-1e222a99aca7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.547407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940a5a-9117-4414-862e-1e222a99aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.568468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f8940a5a-9117-4414-862e-1e222a99aca7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:42.569730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f8940a5a-9117-4414-862e-1e222a99aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.578663 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1336/2672] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:42.582938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b401d-187f-4b32-ad9d-df0a8f4b6982 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.593235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b401d-187f-4b32-ad9d-df0a8f4b6982 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.597892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.598495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.598768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.599034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.599695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:42.600083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.601732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.613836 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1337/2673] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:42.618131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940a5a-9117-4414-862e-1e222a99aca7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.627766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940a5a-9117-4414-862e-1e222a99aca7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.632682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.633337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.633611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.633881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.634668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.636790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.668346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1337/2674] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:42.672607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.683470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402c3e-dc97-442d-ba0d-630956d61059 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.687383 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:42.743744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.744503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.744785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.745041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.745690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.747594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.771049 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1338/2675] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:42.775220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.786174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43195e9-9f18-4a65-af0b-b745152dc6a6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.791515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.792129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.792400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.792667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.793340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.795105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.809054 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1338/2676] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:42.810482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.820734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f8a4-5b87-40cc-a630-fea097658c75 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.826727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c32e-edd4-4e14-81b4-831f6814cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.827355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c32e-edd4-4e14-81b4-831f6814cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.827627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c32e-edd4-4e14-81b4-831f6814cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.827894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c32e-edd4-4e14-81b4-831f6814cfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.828575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c32e-edd4-4e14-81b4-831f6814cfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.830188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c32e-edd4-4e14-81b4-831f6814cfcf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.846679 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1339/2677] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:42.851092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.862212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8959390-5b06-4883-8f80-2d969c46d184 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.867440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.868070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.868348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.868620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] PATH_INFO: `/v3/projects/3e58a6cdaef14d36a9afbaf330135478/users/e8d05275c344461cb9bdef94c765de35/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.883968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e58a6cdaef14d36a9afbaf330135478, user_id=e8d05275c344461cb9bdef94c765de35, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.887268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.903265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1339/2678] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:42 2022] PUT /identity/v3/projects/3e58a6cdaef14d36a9afbaf330135478/users/e8d05275c344461cb9bdef94c765de35/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:42.908348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1dd6a-0fa0-4ae7-b6a4-0b815d74319d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.908947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1dd6a-0fa0-4ae7-b6a4-0b815d74319d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.908947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1dd6a-0fa0-4ae7-b6a4-0b815d74319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.930092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d9b1dd6a-0fa0-4ae7-b6a4-0b815d74319d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:42.931299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d9b1dd6a-0fa0-4ae7-b6a4-0b815d74319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.022115 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1340/2679] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:43.058808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.060545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.108693 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:43.145008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b77f8-bb5a-47fa-b1a6-22fbf831f31e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.153296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.154016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.154386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.154750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.168645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.170531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.181801 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1340/2680] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:46.195193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d470-0f6c-4d21-8f17-babcd29209c4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:46.196016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d470-0f6c-4d21-8f17-babcd29209c4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:46.196404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d470-0f6c-4d21-8f17-babcd29209c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:46.251731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3734d470-0f6c-4d21-8f17-babcd29209c4 None None] MFA Rules not processed for user `897d73e68cc44589ac64edfb23770a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:46.253204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3734d470-0f6c-4d21-8f17-babcd29209c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:46.389483 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1341/2681] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:49.772518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:49.777578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:49.800804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a2a6d-7e96-4162-9a02-35b1c15dfe0e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:49.818635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:49.820799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:49.822663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:49.823031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] PATH_INFO: `/v3/users/fd88041239124e50b42b98e16b19af1a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:49.824930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd88041239124e50b42b98e16b19af1a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:49.829172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:49.938591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd88041239124e50b42b98e16b19af1a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.954448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd88041239124e50b42b98e16b19af1a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.975782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd88041239124e50b42b98e16b19af1a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.977391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd88041239124e50b42b98e16b19af1a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.985730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd88041239124e50b42b98e16b19af1a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:50.003574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1341/2682] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:49 2022] DELETE /identity/v3/users/fd88041239124e50b42b98e16b19af1a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:51.653044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d470-0f6c-4d21-8f17-babcd29209c4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.680400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d470-0f6c-4d21-8f17-babcd29209c4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.734864 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:51.827267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.828452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.828940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.829363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] PATH_INFO: `/v3/projects/3e8b6b7fd8a34dca8d5d4d61c408526f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.830725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8b6b7fd8a34dca8d5d4d61c408526f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.833519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.940196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8b6b7fd8a34dca8d5d4d61c408526f', 'request_id': 'req-4d0a2995-69a9-4b36-8566-28a1a346af67'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.950896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8b6b7fd8a34dca8d5d4d61c408526f', 'request_id': 'req-4d0a2995-69a9-4b36-8566-28a1a346af67'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.960614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8b6b7fd8a34dca8d5d4d61c408526f', 'request_id': 'req-4d0a2995-69a9-4b36-8566-28a1a346af67'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.989051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.991996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.003305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] The token cache is being invalidate because project 3e8b6b7fd8a34dca8d5d4d61c408526f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:52.003880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:52.005876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d0a2995-69a9-4b36-8566-28a1a346af67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:52.011971 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1342/2683] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:51 2022] DELETE /identity/v3/projects/3e8b6b7fd8a34dca8d5d4d61c408526f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:52.013832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1657-2f50-4540-8352-47556a8b6257 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.014633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1657-2f50-4540-8352-47556a8b6257 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.015005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1657-2f50-4540-8352-47556a8b6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.062253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-98fb1657-2f50-4540-8352-47556a8b6257 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:52.066482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-98fb1657-2f50-4540-8352-47556a8b6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.289510 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1343/2684] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:52.306224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811055e-6d2e-4581-9d3b-53a668768c8e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.306224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811055e-6d2e-4581-9d3b-53a668768c8e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.306224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811055e-6d2e-4581-9d3b-53a668768c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.368874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bb6af-57a7-423c-968d-efc01f734d54 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.378246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2811055e-6d2e-4581-9d3b-53a668768c8e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:52.385645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2811055e-6d2e-4581-9d3b-53a668768c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.418438 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1344/2685] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:52.427937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811055e-6d2e-4581-9d3b-53a668768c8e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:52.473595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811055e-6d2e-4581-9d3b-53a668768c8e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.476366 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:52.497591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768850bc-74b0-4d71-81b4-83773cb884e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.498631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768850bc-74b0-4d71-81b4-83773cb884e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.499108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768850bc-74b0-4d71-81b4-83773cb884e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.500373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768850bc-74b0-4d71-81b4-83773cb884e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.507273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768850bc-74b0-4d71-81b4-83773cb884e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:52.507935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768850bc-74b0-4d71-81b4-83773cb884e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.511610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768850bc-74b0-4d71-81b4-83773cb884e3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:52.547616 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1345/2686] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:52.548989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.549865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e59b-676d-47b7-930c-2b6b334a5ee6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.550359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e59b-676d-47b7-930c-2b6b334a5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.550501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.551573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.551774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.552224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e59b-676d-47b7-930c-2b6b334a5ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.553766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.608824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e726e59b-676d-47b7-930c-2b6b334a5ee6 None None] MFA Rules not processed for user `e8d05275c344461cb9bdef94c765de35`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:52.610101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e726e59b-676d-47b7-930c-2b6b334a5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.677895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.680068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:52.713803 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1342/2687] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:52.717032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:52.718599 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:52.735015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eee07c-ba8e-4c71-bdde-c188ad465b39 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.747554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.753121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.754291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.756928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.757723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.759834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:52.808746 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1346/2688] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:52.842639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1343/2689] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:52 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:52.848413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726e59b-676d-47b7-930c-2b6b334a5ee6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:52.893121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726e59b-676d-47b7-930c-2b6b334a5ee6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.991310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.992282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.992629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.992994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.993704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.996155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.041661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1347/2690] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:52 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:53.046161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:53.069206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b156a-2e69-4c30-90dc-bd8ee808f38b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:53.073368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:53.074390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.074813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.075088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.076049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:53.077679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.089839 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1344/2691] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:53.093771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:53.105159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b6929-d4fe-42e1-8e35-762c3f22c1d6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:53.114816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:53.115841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.116197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.116542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.117293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:53.118969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.136806 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1348/2692] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:53.140692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:53.153055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf421-d47c-432a-a100-9db5e838d6be admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:53.158163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b6b72-6574-4075-a6c1-df68f2d1b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:53.158949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6b72-6574-4075-a6c1-df68f2d1b494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.159296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6b72-6574-4075-a6c1-df68f2d1b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.159683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6b72-6574-4075-a6c1-df68f2d1b494 admin admin] PATH_INFO: `/v3/projects/8ed4c6546835436c8182a67c787fbb61/users/2386f0dd3caf4191bb93ca2a2c950a51/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.182695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b6b72-6574-4075-a6c1-df68f2d1b494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed4c6546835436c8182a67c787fbb61, user_id=2386f0dd3caf4191bb93ca2a2c950a51, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:53.185761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b6b72-6574-4075-a6c1-df68f2d1b494 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.186455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:53.188416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:53.210954 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1345/2693] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:53 2022] PUT /identity/v3/projects/8ed4c6546835436c8182a67c787fbb61/users/2386f0dd3caf4191bb93ca2a2c950a51/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:53.213154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.213417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.213696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.254318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] MFA Rules not processed for user `2386f0dd3caf4191bb93ca2a2c950a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:53.255331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:53.297504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198709e0-b8a6-4f43-bf38-cd07e6bd5f57 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:53.332587 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1346/2694] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:53.354754 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:53.376817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:53.377446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.377723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.377993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.433918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:53.435530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.449238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1349/2695] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:54.048381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.056068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:54.074678 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:54.093395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3dd5f-dc3a-418f-8879-ce1ac693e06f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.101757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747b6ea-6459-4e52-8a26-4c25f7ac88fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.102644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747b6ea-6459-4e52-8a26-4c25f7ac88fd service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.103072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747b6ea-6459-4e52-8a26-4c25f7ac88fd service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.103522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747b6ea-6459-4e52-8a26-4c25f7ac88fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.113993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747b6ea-6459-4e52-8a26-4c25f7ac88fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.116166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747b6ea-6459-4e52-8a26-4c25f7ac88fd service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.142198 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1347/2696] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:55.517613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:55.657645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2ea1-42db-4206-a5bb-89bc88dba590 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:55.681515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:55.682446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:55.682656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:55.682839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] PATH_INFO: `/v3/users/2386f0dd3caf4191bb93ca2a2c950a51` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:55.686425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:55.687196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2386f0dd3caf4191bb93ca2a2c950a51)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:55.687942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:55.688475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:55.689107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:55.720657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:55.731026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:55.779469 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1348/2697] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:55.798568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:55.800350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:55.814968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2386f0dd3caf4191bb93ca2a2c950a51'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:55.839823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2386f0dd3caf4191bb93ca2a2c950a51'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:55.840464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2386f0dd3caf4191bb93ca2a2c950a51'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:55.861791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2386f0dd3caf4191bb93ca2a2c950a51'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:55.863054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-823fb352-c5f7-4a1b-be79-4a90b2da45de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2386f0dd3caf4191bb93ca2a2c950a51'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:55.909714 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1350/2698] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:55 2022] DELETE /identity/v3/users/2386f0dd3caf4191bb93ca2a2c950a51 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:55.912358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:55.912638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:55.912936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:55.936971 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:55.949158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23dcbd-441c-4938-be3b-b50c000a7f12 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:55.959645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:55.961812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:56.076720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04654d94-c3e9-49f8-bb79-6a99b913b1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:56.079494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654d94-c3e9-49f8-bb79-6a99b913b1cc service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:56.081673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654d94-c3e9-49f8-bb79-6a99b913b1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:56.082398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654d94-c3e9-49f8-bb79-6a99b913b1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:56.088118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-04654d94-c3e9-49f8-bb79-6a99b913b1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:56.171934 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1351/2699] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:56.182008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:56.183914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:56.199647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b24fd-7502-4a54-9b24-a74bfc3acb47 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:56.204713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:56.205382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:56.205654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:56.205978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:56.220105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:56.225534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:56.237691 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1352/2700] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:56.336067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04654d94-c3e9-49f8-bb79-6a99b913b1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:56.339243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04654d94-c3e9-49f8-bb79-6a99b913b1cc service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:56.385866 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1349/2701] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:58.043066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.044287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.062172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55ae1f-e260-4d23-b7f5-2999001181e1 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.067287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.068114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.068400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.068678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] PATH_INFO: `/v3/projects/8ed4c6546835436c8182a67c787fbb61` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.070013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed4c6546835436c8182a67c787fbb61)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.072466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.145747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e84f7-c88d-420f-ab65-d8e93c67dcdd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.147549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e84f7-c88d-420f-ab65-d8e93c67dcdd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.148131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e84f7-c88d-420f-ab65-d8e93c67dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.222397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5d4e84f7-c88d-420f-ab65-d8e93c67dcdd None None] MFA Rules not processed for user `e8d05275c344461cb9bdef94c765de35`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:58.225927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5d4e84f7-c88d-420f-ab65-d8e93c67dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.238724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed4c6546835436c8182a67c787fbb61', 'request_id': 'req-4c9caf67-3581-49c2-a3f6-c8524ff9205b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.257306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed4c6546835436c8182a67c787fbb61', 'request_id': 'req-4c9caf67-3581-49c2-a3f6-c8524ff9205b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.271803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed4c6546835436c8182a67c787fbb61', 'request_id': 'req-4c9caf67-3581-49c2-a3f6-c8524ff9205b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.312962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] The token cache is being invalidate because project 8ed4c6546835436c8182a67c787fbb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:58.314817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.315855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c9caf67-3581-49c2-a3f6-c8524ff9205b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.326661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1353/2702] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:58 2022] DELETE /identity/v3/projects/8ed4c6546835436c8182a67c787fbb61 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:58.333135 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:58.333380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945d857-e356-4812-93e6-676929c647eb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.333795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945d857-e356-4812-93e6-676929c647eb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.339015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945d857-e356-4812-93e6-676929c647eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.362397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1945d857-e356-4812-93e6-676929c647eb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:58.363706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1945d857-e356-4812-93e6-676929c647eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.367977 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1350/2703] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:58.450847 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1354/2704] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:58.453048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734be5-beb4-43d3-a096-72c78e30f309 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.453338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734be5-beb4-43d3-a096-72c78e30f309 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.453636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734be5-beb4-43d3-a096-72c78e30f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.476424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fb734be5-beb4-43d3-a096-72c78e30f309 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:58.478129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb734be5-beb4-43d3-a096-72c78e30f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.489487 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1351/2705] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:58.494028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945d857-e356-4812-93e6-676929c647eb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.506362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945d857-e356-4812-93e6-676929c647eb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.512152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.513070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.513489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.513903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.514698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:58.515156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.516753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.538375 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1355/2706] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:58.539172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb734be5-beb4-43d3-a096-72c78e30f309 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.550632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb734be5-beb4-43d3-a096-72c78e30f309 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.557589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.558541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.559592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.560108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.560803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.562989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.604399 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1352/2707] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:58.608635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.614396 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:58.624667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349a29-7edc-4b10-98bd-11b04cc647ef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.723392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.723922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.724231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.724507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.725255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.727859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.765469 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1356/2708] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:58 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:58.769873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.789186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d817a-cd95-4efd-ba8a-c15f89864b1a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.803121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.803937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.805127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.805503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.807466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.810156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.859112 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1353/2709] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:58.863988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.884993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b572-c58f-4359-b814-bd964f8fc0a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.902170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079156b-f647-4d30-b581-299bf206b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.902981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079156b-f647-4d30-b581-299bf206b116 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.903370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079156b-f647-4d30-b581-299bf206b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.903751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079156b-f647-4d30-b581-299bf206b116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.904747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079156b-f647-4d30-b581-299bf206b116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.906663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079156b-f647-4d30-b581-299bf206b116 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.933333 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1357/2710] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:58.936180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.968888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d60b81-53cd-45fa-a3e4-96f8db28b411 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.977839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.979364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.979897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.980356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] PATH_INFO: `/v3/projects/9c67ffccd1f747798e073cb3aed71dda/users/ef3cbcb0d2844ef78896e6044136e786/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:59.011814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c67ffccd1f747798e073cb3aed71dda, user_id=ef3cbcb0d2844ef78896e6044136e786, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:59.017028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:59.038855 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1354/2711] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:58 2022] PUT /identity/v3/projects/9c67ffccd1f747798e073cb3aed71dda/users/ef3cbcb0d2844ef78896e6044136e786/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:59.044899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:59.045473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:59.045473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:59.072846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:59.075271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:59.184815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1358/2712] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:59.195120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:59.198308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:59.320264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f8a2f-2ddc-4757-bbef-7d97f8e630a0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:59.326525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60e819-f418-4310-8591-00af8dc9e9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:59.327642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e819-f418-4310-8591-00af8dc9e9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:59.328403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e819-f418-4310-8591-00af8dc9e9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:59.329128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e819-f418-4310-8591-00af8dc9e9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:59.342976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60e819-f418-4310-8591-00af8dc9e9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:59.345548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60e819-f418-4310-8591-00af8dc9e9f3 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:59.368203 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1355/2713] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:04.467457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:04.469078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:04.813995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa22fb6-bbb8-46a0-9c96-6592272a154b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:04.835790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c500-4cb5-4a3a-8c4c-828089b3e08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:04.840156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c500-4cb5-4a3a-8c4c-828089b3e08e service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:04.840460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c500-4cb5-4a3a-8c4c-828089b3e08e service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:04.843733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c500-4cb5-4a3a-8c4c-828089b3e08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:04.848405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6be9c500-4cb5-4a3a-8c4c-828089b3e08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:04.871652 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:05.000544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c500-4cb5-4a3a-8c4c-828089b3e08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:05.002378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c500-4cb5-4a3a-8c4c-828089b3e08e service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:05.016429 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1359/2714] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:06.704085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.704729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.705175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.736646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] MFA Rules not processed for user `547522b0b07f472a91ec83f15a36bb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:06.738296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:06.837246 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1356/2715] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:07.864954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.865485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.865485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.927642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] MFA Rules not processed for user `ef3cbcb0d2844ef78896e6044136e786`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:07.929933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:08.044649 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1360/2716] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:08.234541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:08.236124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:08.274500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55321-146f-4b58-bf88-57c11b5f494e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:08.297687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10113f3-596b-4fd5-ac1d-b68b786bc417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:08.297687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10113f3-596b-4fd5-ac1d-b68b786bc417 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:08.297687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10113f3-596b-4fd5-ac1d-b68b786bc417 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:08.297687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10113f3-596b-4fd5-ac1d-b68b786bc417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:08.319524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10113f3-596b-4fd5-ac1d-b68b786bc417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:08.321199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10113f3-596b-4fd5-ac1d-b68b786bc417 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:08.340388 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1357/2717] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:09.355380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:09.357177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:09.452625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7582c0-c784-41d1-b8b7-a5358c68091e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:09.459205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1c326-2c38-4eea-8687-34e8c30f89a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:09.459847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1c326-2c38-4eea-8687-34e8c30f89a1 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:09.460129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1c326-2c38-4eea-8687-34e8c30f89a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:09.460403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1c326-2c38-4eea-8687-34e8c30f89a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:09.463270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-98c1c326-2c38-4eea-8687-34e8c30f89a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:09.484348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1c326-2c38-4eea-8687-34e8c30f89a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:09.486157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1c326-2c38-4eea-8687-34e8c30f89a1 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:09.501942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1361/2718] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:11.585565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fa3e-5067-463e-83b7-25b9bbce266e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.586390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fa3e-5067-463e-83b7-25b9bbce266e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.587442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fa3e-5067-463e-83b7-25b9bbce266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.625044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8199fa3e-5067-463e-83b7-25b9bbce266e None None] MFA Rules not processed for user `ef3cbcb0d2844ef78896e6044136e786`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:11.627303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8199fa3e-5067-463e-83b7-25b9bbce266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.641530 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1358/2719] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:11.710614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92c8b7-3d0c-4c6b-98f0-623b8412d489 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.711304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92c8b7-3d0c-4c6b-98f0-623b8412d489 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.711304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92c8b7-3d0c-4c6b-98f0-623b8412d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.766007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4b92c8b7-3d0c-4c6b-98f0-623b8412d489 None None] MFA Rules not processed for user `b0bd3eeeb578465a8f5e5eaa3b3fdc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:11.767602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4b92c8b7-3d0c-4c6b-98f0-623b8412d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.889569 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:11.943791 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1362/2720] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:21.607464 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:21.928661 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:37.588422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea3b4-9ba5-435a-917e-8263492dc310 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:37.589043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea3b4-9ba5-435a-917e-8263492dc310 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:37.589043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea3b4-9ba5-435a-917e-8263492dc310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:37.608577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dbaea3b4-9ba5-435a-917e-8263492dc310 None None] MFA Rules not processed for user `72250431a7f44bff83c1881ff733f2de`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:37.609940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dbaea3b4-9ba5-435a-917e-8263492dc310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:37.672239 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1359/2721] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:46.402228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92c8b7-3d0c-4c6b-98f0-623b8412d489 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:46.416672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92c8b7-3d0c-4c6b-98f0-623b8412d489 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:46.423279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122698b5-750c-4a3e-a3e3-56dae07f0b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:46.423998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122698b5-750c-4a3e-a3e3-56dae07f0b7f service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:46.424349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122698b5-750c-4a3e-a3e3-56dae07f0b7f service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:46.424671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122698b5-750c-4a3e-a3e3-56dae07f0b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:46.426557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-122698b5-750c-4a3e-a3e3-56dae07f0b7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:46.495915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122698b5-750c-4a3e-a3e3-56dae07f0b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:46.497565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122698b5-750c-4a3e-a3e3-56dae07f0b7f service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:46.507145 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1363/2722] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:47.664836 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=25 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:51.535932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f15b7-54f6-4cd3-b3df-4c64126ee267 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:51.536928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f15b7-54f6-4cd3-b3df-4c64126ee267 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:51.537414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f15b7-54f6-4cd3-b3df-4c64126ee267 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:51.539407 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1360/2723] 10.222.0.46 () {54 vars in 921 bytes} [Sun Aug 21 01:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:10:51.546600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0064d8-a140-497c-9389-3caa839e9d56 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:51.547087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0064d8-a140-497c-9389-3caa839e9d56 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:51.547179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0064d8-a140-497c-9389-3caa839e9d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:51.570608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2d0064d8-a140-497c-9389-3caa839e9d56 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:51.572361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2d0064d8-a140-497c-9389-3caa839e9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:51.582963 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1364/2724] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:51.594847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f15b7-54f6-4cd3-b3df-4c64126ee267 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:51.614338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f15b7-54f6-4cd3-b3df-4c64126ee267 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:51.619208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbadf7-a990-462d-9528-df11adc7f0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:51.619841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbadf7-a990-462d-9528-df11adc7f0dd service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:51.620180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbadf7-a990-462d-9528-df11adc7f0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:51.620639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbadf7-a990-462d-9528-df11adc7f0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:51.635147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbadf7-a990-462d-9528-df11adc7f0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:51.637843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbadf7-a990-462d-9528-df11adc7f0dd service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:51.654648 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1361/2725] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:52.762969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:52.763953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:52.764485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:52.804102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] MFA Rules not processed for user `9174038735de4d78b4ad527105d06624`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:52.805439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:52.864177 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1365/2726] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:57.006079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18aa7c-6454-4378-9ee3-8d3a50b2a3f3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:57.006630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18aa7c-6454-4378-9ee3-8d3a50b2a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:57.006630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18aa7c-6454-4378-9ee3-8d3a50b2a3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:57.029474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-aa18aa7c-6454-4378-9ee3-8d3a50b2a3f3 None None] MFA Rules not processed for user `b0bd3eeeb578465a8f5e5eaa3b3fdc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:57.030738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aa18aa7c-6454-4378-9ee3-8d3a50b2a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:57.039188 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1362/2727] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:02.857683 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=58 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:07.024696 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:23.746613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:23.750492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:23.790368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c144f9-7064-409c-87f5-6cc655dadf1f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:23.798096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:23.799134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:23.800143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:23.801086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] PATH_INFO: `/v3/users/52db969e85344bb6a40150cedc205df8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:23.802647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52db969e85344bb6a40150cedc205df8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:23.806566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:23.880418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52db969e85344bb6a40150cedc205df8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:23.901653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52db969e85344bb6a40150cedc205df8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:23.903247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52db969e85344bb6a40150cedc205df8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:23.915294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52db969e85344bb6a40150cedc205df8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:23.916503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52db969e85344bb6a40150cedc205df8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:23.940311 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1366/2728] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:23 2022] DELETE /identity/v3/users/52db969e85344bb6a40150cedc205df8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:24.405963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18aa7c-6454-4378-9ee3-8d3a50b2a3f3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:24.422176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18aa7c-6454-4378-9ee3-8d3a50b2a3f3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:24.540905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:24.541945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:24.542605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:24.543093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] PATH_INFO: `/v3/projects/c81f6af23f174318870b6ef8633f5cf3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:24.544634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81f6af23f174318870b6ef8633f5cf3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:24.547037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:24.607252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81f6af23f174318870b6ef8633f5cf3', 'request_id': 'req-ab8f4e77-3d0b-4954-825c-f19209e9aff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.617226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81f6af23f174318870b6ef8633f5cf3', 'request_id': 'req-ab8f4e77-3d0b-4954-825c-f19209e9aff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.624463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81f6af23f174318870b6ef8633f5cf3', 'request_id': 'req-ab8f4e77-3d0b-4954-825c-f19209e9aff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.638190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] The token cache is being invalidate because project c81f6af23f174318870b6ef8633f5cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:24.638520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.639111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.640984 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1363/2729] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:24 2022] DELETE /identity/v3/projects/c81f6af23f174318870b6ef8633f5cf3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:24.645108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:24.647454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:24.662632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbe39f-bb88-40f3-8e87-df124250dc85 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:24.739125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:24.740381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:24.740381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:24.740655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] PATH_INFO: `/v3/users/6f0a23308def48b3864933b57cd0108b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:24.741886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0a23308def48b3864933b57cd0108b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:24.744044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:24.795235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0a23308def48b3864933b57cd0108b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.803484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0a23308def48b3864933b57cd0108b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.804428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0a23308def48b3864933b57cd0108b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.812414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0a23308def48b3864933b57cd0108b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.813347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b79b5cc1-1bb1-4f83-9c3a-249e0cde03df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0a23308def48b3864933b57cd0108b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:24.822629 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:24.835956 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1367/2730] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:24 2022] DELETE /identity/v3/users/6f0a23308def48b3864933b57cd0108b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:25.019906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:25.021508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:25.039474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4e77-3d0b-4954-825c-f19209e9aff6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:25.121755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:25.122596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.122941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.123320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] PATH_INFO: `/v3/projects/7303254fe7a344ea8dc2697340085f57` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.124718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7303254fe7a344ea8dc2697340085f57)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:25.127314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:25.179773 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:25.202898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7303254fe7a344ea8dc2697340085f57', 'request_id': 'req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:25.210936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7303254fe7a344ea8dc2697340085f57', 'request_id': 'req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:25.219307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7303254fe7a344ea8dc2697340085f57', 'request_id': 'req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:25.240308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] The token cache is being invalidate because project 7303254fe7a344ea8dc2697340085f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:25.240707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:25.242155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e171a77b-2163-4eb2-aeb1-47fa4b5a24e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:25.243825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1364/2731] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:25 2022] DELETE /identity/v3/projects/7303254fe7a344ea8dc2697340085f57 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:25.248954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8feed4-4d67-4250-993b-78e6f48e8c60 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.249429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8feed4-4d67-4250-993b-78e6f48e8c60 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.249793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8feed4-4d67-4250-993b-78e6f48e8c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.278317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2f8feed4-4d67-4250-993b-78e6f48e8c60 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:25.279555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2f8feed4-4d67-4250-993b-78e6f48e8c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:25.375572 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1368/2732] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:25.377860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11de12b-6f8d-4c63-91b0-e12f56967642 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.378183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11de12b-6f8d-4c63-91b0-e12f56967642 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.378735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11de12b-6f8d-4c63-91b0-e12f56967642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.407549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f11de12b-6f8d-4c63-91b0-e12f56967642 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:25.410163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f11de12b-6f8d-4c63-91b0-e12f56967642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:25.436473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8feed4-4d67-4250-993b-78e6f48e8c60 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:25.437058 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1365/2733] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:25.448109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8feed4-4d67-4250-993b-78e6f48e8c60 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:25.453456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:25.454224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.454589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.455054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.455829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:25.456217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:25.458050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:25.476999 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1369/2734] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:25.478485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11de12b-6f8d-4c63-91b0-e12f56967642 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:25.489846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11de12b-6f8d-4c63-91b0-e12f56967642 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:25.495758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:25.496446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.496843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.497203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.498425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:25.500003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:25.544337 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1366/2735] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:25 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:25.545817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:25.580225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060aafb-a47d-4930-a9e2-384907abc8c0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:25.665472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:25.666183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.666464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.666736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.667365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:25.669486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:25.699316 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1370/2736] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:25 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:25.701618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:25.719063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5dcd4-9346-42ee-9ed2-27b37462ebff admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:25.727418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:25.728320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.728944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.730013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.731181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:25.733748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:25.751064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1367/2737] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:25.755315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:25.780869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd4c36-3a8b-4123-8eb6-503a6a6e48bc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:25.786457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4d124-64e9-41a0-ba35-acd9147976e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:25.787339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4d124-64e9-41a0-ba35-acd9147976e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.787708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4d124-64e9-41a0-ba35-acd9147976e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.788152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4d124-64e9-41a0-ba35-acd9147976e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.789045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4d124-64e9-41a0-ba35-acd9147976e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:25.790870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4d124-64e9-41a0-ba35-acd9147976e1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:25.809070 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1371/2738] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:25.812221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:25.823512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f43273-d99e-465a-bf3d-52b1d8a9eccc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:25.828494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:25.829149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.829694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.829694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] PATH_INFO: `/v3/projects/b6ac0c091cee49acacd938d3cf62b0a8/users/32c1ff3e569349b28f72c8e2e20aebde/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.848356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ac0c091cee49acacd938d3cf62b0a8, user_id=32c1ff3e569349b28f72c8e2e20aebde, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:25.851974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:25.869395 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1368/2739] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:25 2022] PUT /identity/v3/projects/b6ac0c091cee49acacd938d3cf62b0a8/users/32c1ff3e569349b28f72c8e2e20aebde/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:25.881236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440986ec-515f-48e8-b253-e1adfbf4fc7a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:25.881830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440986ec-515f-48e8-b253-e1adfbf4fc7a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:25.881830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440986ec-515f-48e8-b253-e1adfbf4fc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:25.916931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-440986ec-515f-48e8-b253-e1adfbf4fc7a None None] MFA Rules not processed for user `32c1ff3e569349b28f72c8e2e20aebde`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:25.918441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-440986ec-515f-48e8-b253-e1adfbf4fc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:25.981920 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:25.999753 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1372/2740] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:26.004367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.072569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af9d31-bc0d-4287-8972-e2ceb13a1664 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.079101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.079671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.079945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.080212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.080882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.082921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.118634 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1369/2741] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:26 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:26.119939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440986ec-515f-48e8-b253-e1adfbf4fc7a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.143985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440986ec-515f-48e8-b253-e1adfbf4fc7a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.234503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.236037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.236037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.236037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.238488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.242129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.270912 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1373/2742] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:26 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:26.273459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.286874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0344-7ba7-448e-9369-ec0e40ef0fa3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.291670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.292285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.292560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.292871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.293513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.295458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.312014 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1370/2743] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:11:26.313525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.324982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf35b36-f47a-48a7-bbee-5eabcda9b1cd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.330340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.331070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.331416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.331748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] PATH_INFO: `/v3/projects/9a84082f50044e0a8c05d204ebd5ea19/users/42ee5de7902f47639df3138940f8ddd5/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.347908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a84082f50044e0a8c05d204ebd5ea19, user_id=42ee5de7902f47639df3138940f8ddd5, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.351539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.364891 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1374/2744] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:26 2022] PUT /identity/v3/projects/9a84082f50044e0a8c05d204ebd5ea19/users/42ee5de7902f47639df3138940f8ddd5/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:26.369921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.380258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3077e-d9c8-4ad9-a84f-b4917f90092a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.413105 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:26.447777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa241b0-4b96-4316-baa6-748fb02b0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.448386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa241b0-4b96-4316-baa6-748fb02b0cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.448726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa241b0-4b96-4316-baa6-748fb02b0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.449028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa241b0-4b96-4316-baa6-748fb02b0cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.449689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa241b0-4b96-4316-baa6-748fb02b0cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.452535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa241b0-4b96-4316-baa6-748fb02b0cb6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.464995 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1371/2745] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:26.469219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.481991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966c503-d718-4b71-b8bd-e024961b3f32 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.488398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.488855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.489126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.489391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] PATH_INFO: `/v3/projects/9a84082f50044e0a8c05d204ebd5ea19/users/42ee5de7902f47639df3138940f8ddd5/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.491827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a84082f50044e0a8c05d204ebd5ea19, user_id=42ee5de7902f47639df3138940f8ddd5, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.495256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.509969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1375/2746] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:26 2022] PUT /identity/v3/projects/9a84082f50044e0a8c05d204ebd5ea19/users/42ee5de7902f47639df3138940f8ddd5/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:26.525742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed764b-d01b-4563-a99d-741b41245bc9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.526951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed764b-d01b-4563-a99d-741b41245bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.527368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed764b-d01b-4563-a99d-741b41245bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.565157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-84ed764b-d01b-4563-a99d-741b41245bc9 None None] MFA Rules not processed for user `42ee5de7902f47639df3138940f8ddd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:26.566670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84ed764b-d01b-4563-a99d-741b41245bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:26.672539 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1372/2747] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:26.684601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.688038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:26.801623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f4d6-dcb3-4eca-a573-8c77c406a77f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.810477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4fc85-2a98-48c1-9fa6-378cda3f65cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.812222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fc85-2a98-48c1-9fa6-378cda3f65cf service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.812222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fc85-2a98-48c1-9fa6-378cda3f65cf service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.812222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fc85-2a98-48c1-9fa6-378cda3f65cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.827166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4fc85-2a98-48c1-9fa6-378cda3f65cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.829069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4fc85-2a98-48c1-9fa6-378cda3f65cf service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.860588 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1376/2748] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:27.779394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed764b-d01b-4563-a99d-741b41245bc9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:27.902475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed764b-d01b-4563-a99d-741b41245bc9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:27.909294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:27.909950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:27.910231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:27.910646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] PATH_INFO: `/v3/users/32c1ff3e569349b28f72c8e2e20aebde` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:27.912024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c1ff3e569349b28f72c8e2e20aebde)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:27.914067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:28.004735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c1ff3e569349b28f72c8e2e20aebde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.017025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c1ff3e569349b28f72c8e2e20aebde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.019256 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:28.045032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c1ff3e569349b28f72c8e2e20aebde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.045861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c1ff3e569349b28f72c8e2e20aebde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.061729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c1ff3e569349b28f72c8e2e20aebde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.075758 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1373/2749] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:27 2022] DELETE /identity/v3/users/32c1ff3e569349b28f72c8e2e20aebde => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:28.080213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:28.081081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:28.081513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:28.125820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:28.127080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:28.149394 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:28.206345 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1377/2750] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:28.217622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:28.219153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:28.304620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce1f5b-5be8-4bc4-96cb-10a223294636 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:28.310164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:28.311198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:28.311526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:28.311982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:28.324397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:28.326094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:28.338701 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1374/2751] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:28.454722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:28.459871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:28.477562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d1f4-e6ea-4ce5-937e-ff9565c98a59 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:28.483105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:28.483822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:28.484276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:28.484713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] PATH_INFO: `/v3/users/ef3cbcb0d2844ef78896e6044136e786` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:28.486275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3cbcb0d2844ef78896e6044136e786)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:28.488373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:28.561770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3cbcb0d2844ef78896e6044136e786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.580681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3cbcb0d2844ef78896e6044136e786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.581460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3cbcb0d2844ef78896e6044136e786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.591897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3cbcb0d2844ef78896e6044136e786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.592752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3cbcb0d2844ef78896e6044136e786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:28.617518 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1378/2752] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:28 2022] DELETE /identity/v3/users/ef3cbcb0d2844ef78896e6044136e786 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:28.659727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:28.661916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:28.693491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886929-49a6-4e55-8949-d87ac6ccf4d3 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:28.723275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:28.725078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:28.847975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:28.849519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:28.850685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:28.851337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] PATH_INFO: `/v3/users/897d73e68cc44589ac64edfb23770a66` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:28.863640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2038b87-dd90-4465-b6b7-57365eef2c73 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:28.870120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897d73e68cc44589ac64edfb23770a66)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:28.871754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:28.872566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:28.872957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:28.873419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] PATH_INFO: `/v3/projects/b6ac0c091cee49acacd938d3cf62b0a8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:28.875576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ac0c091cee49acacd938d3cf62b0a8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:28.877261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:28.879580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:28.981552 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:29.004175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ac0c091cee49acacd938d3cf62b0a8', 'request_id': 'req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.005206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897d73e68cc44589ac64edfb23770a66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.017976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897d73e68cc44589ac64edfb23770a66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.021766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ac0c091cee49acacd938d3cf62b0a8', 'request_id': 'req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.030211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ac0c091cee49acacd938d3cf62b0a8', 'request_id': 'req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.038914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897d73e68cc44589ac64edfb23770a66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.040402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897d73e68cc44589ac64edfb23770a66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.047663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] The token cache is being invalidate because project b6ac0c091cee49acacd938d3cf62b0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:29.047889 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:29.047985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.048754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.064544 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1379/2753] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:28 2022] DELETE /identity/v3/projects/b6ac0c091cee49acacd938d3cf62b0a8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:29.064716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897d73e68cc44589ac64edfb23770a66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.064851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:29.064851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:29.067165 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1375/2754] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:28 2022] DELETE /identity/v3/users/897d73e68cc44589ac64edfb23770a66 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:29.068142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:29.070237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:29.141235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682fa3a-1a89-4d2b-addf-eb6e16f54daa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:29.194648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba31b19-0646-41d2-8774-6b6db6eeca92 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:29.203663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:29.207805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.208287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.208668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] PATH_INFO: `/v3/users/42ee5de7902f47639df3138940f8ddd5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.210854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ee5de7902f47639df3138940f8ddd5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:29.213567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:29.250543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:29.254589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.254999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.255448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] PATH_INFO: `/v3/projects/9c67ffccd1f747798e073cb3aed71dda` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.257930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c67ffccd1f747798e073cb3aed71dda)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:29.260575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:29.347051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c67ffccd1f747798e073cb3aed71dda', 'request_id': 'req-1f6d3aea-5eaf-4b40-a932-99b58600a414'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.360311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c67ffccd1f747798e073cb3aed71dda', 'request_id': 'req-1f6d3aea-5eaf-4b40-a932-99b58600a414'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.369748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c67ffccd1f747798e073cb3aed71dda', 'request_id': 'req-1f6d3aea-5eaf-4b40-a932-99b58600a414'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.393208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] The token cache is being invalidate because project 9c67ffccd1f747798e073cb3aed71dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:29.393589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.396132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f6d3aea-5eaf-4b40-a932-99b58600a414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.401385 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1380/2755] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:29 2022] DELETE /identity/v3/projects/9c67ffccd1f747798e073cb3aed71dda => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:29.403665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.404002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.404306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.417029 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:29.432324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:29.434162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:29.467844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ee5de7902f47639df3138940f8ddd5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.478103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ee5de7902f47639df3138940f8ddd5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.490946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ee5de7902f47639df3138940f8ddd5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.492187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ee5de7902f47639df3138940f8ddd5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.500446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-964eccac-3c1e-4128-a417-9c70c9d73b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ee5de7902f47639df3138940f8ddd5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:29.507456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1376/2756] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:29 2022] DELETE /identity/v3/users/42ee5de7902f47639df3138940f8ddd5 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:29.508404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66aaa-444f-4f67-b9dd-4193e679c412 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.508678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66aaa-444f-4f67-b9dd-4193e679c412 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.508975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66aaa-444f-4f67-b9dd-4193e679c412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.512213 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1381/2757] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:29.520584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:29.522933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:29.531392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cba66aaa-444f-4f67-b9dd-4193e679c412 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:29.532606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cba66aaa-444f-4f67-b9dd-4193e679c412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:29.618858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be65a8b-c7fa-4b41-a6d8-4be3b8dd91d8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:29.628009 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1377/2758] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:29.704599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4029e-319a-4989-bdff-3950ddd7683b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.704971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4029e-319a-4989-bdff-3950ddd7683b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.705311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4029e-319a-4989-bdff-3950ddd7683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.731663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:29.732622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.733117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.733524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.733862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e0f4029e-319a-4989-bdff-3950ddd7683b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:29.735488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e0f4029e-319a-4989-bdff-3950ddd7683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:29.751474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:29.751790 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1378/2759] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:11:29.755531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:29.774439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4029e-319a-4989-bdff-3950ddd7683b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:29.782154 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1382/2760] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:29.789663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4029e-319a-4989-bdff-3950ddd7683b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:29.795396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:29.797184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.797455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.797722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.798393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:29.798694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:29.800396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:29.803046 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:29.824868 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1379/2761] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:29.827652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:29.838927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7111c5-999a-4020-bb4b-e61eb23fda5a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:29.843865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:29.844480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.844751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.845041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.845673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:29.847665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:29.881404 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1383/2762] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:29 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:29.882618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:29.893899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bf952-9b33-49ce-9401-a419bdfafffd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:29.964089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:29.964979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:29.965283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:29.965582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:29.966359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:29.968637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:29.999089 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1380/2763] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:29 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:30.003058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:30.014628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2783f6-60c5-4d40-9759-2aaec5d99e58 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:30.021002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:30.021944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.022222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.022493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.023251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:30.024920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:30.040267 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1384/2764] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:11:30.041619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:30.055060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8bc75-e478-42f0-b64a-ed559b4198a3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:30.061543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee9358-e528-46a0-8c5e-a9c0c4ab2138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:30.062367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9358-e528-46a0-8c5e-a9c0c4ab2138 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.062705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9358-e528-46a0-8c5e-a9c0c4ab2138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.063118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9358-e528-46a0-8c5e-a9c0c4ab2138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.063830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee9358-e528-46a0-8c5e-a9c0c4ab2138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:30.065912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee9358-e528-46a0-8c5e-a9c0c4ab2138 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:30.080709 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1381/2765] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:30.085946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:30.100260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45604b5d-b030-4069-918e-4c7f2ae359df admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:30.105033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:30.105707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.105981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.106253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] PATH_INFO: `/v3/projects/13b4ddb93fac43868ba8972d2f753e47/users/d1fa5fee71024c328a90d1724a048c7e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.142191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b4ddb93fac43868ba8972d2f753e47, user_id=d1fa5fee71024c328a90d1724a048c7e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:30.145479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:30.168524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.168867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.169108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.178658 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1385/2766] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:30 2022] PUT /identity/v3/projects/13b4ddb93fac43868ba8972d2f753e47/users/d1fa5fee71024c328a90d1724a048c7e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:30.193966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:30.196134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:30.294816 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1382/2767] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:30.351532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:30.375356 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:30.473826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068afaef-b414-4cff-ba78-993262af5d94 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:30.488273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:30.489180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.489739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.491583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.500974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:30.502399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:30.538020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653a3d-bb5b-4af8-8c4d-abe577f96a67 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:30.539374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:30.541077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:30.546273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:30.546503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.556596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.557301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] PATH_INFO: `/v3/projects/1b094e07a54b4d908fb9fcb60b1c87bf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.560330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b094e07a54b4d908fb9fcb60b1c87bf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:30.562776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:30.566982 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1386/2768] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:30.567933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:30.570208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:30.605216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ddf9-5e92-44f8-b637-a597ac109c6c service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:30.618391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:30.619382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.619829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.620787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] PATH_INFO: `/v3/projects/9a84082f50044e0a8c05d204ebd5ea19` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.622233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a84082f50044e0a8c05d204ebd5ea19)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:30.624734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:30.633475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b094e07a54b4d908fb9fcb60b1c87bf', 'request_id': 'req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.645098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b094e07a54b4d908fb9fcb60b1c87bf', 'request_id': 'req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.684393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b094e07a54b4d908fb9fcb60b1c87bf', 'request_id': 'req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.691741 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:30.710772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] The token cache is being invalidate because project 1b094e07a54b4d908fb9fcb60b1c87bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:30.711621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.712685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.715206 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1383/2769] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:30 2022] DELETE /identity/v3/projects/1b094e07a54b4d908fb9fcb60b1c87bf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:30.718947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a84082f50044e0a8c05d204ebd5ea19', 'request_id': 'req-bef920b9-77d3-4b7a-b548-5ae3b473e055'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.719335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:30.720947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:30.731638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a84082f50044e0a8c05d204ebd5ea19', 'request_id': 'req-bef920b9-77d3-4b7a-b548-5ae3b473e055'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.742653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a84082f50044e0a8c05d204ebd5ea19', 'request_id': 'req-bef920b9-77d3-4b7a-b548-5ae3b473e055'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.761953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] The token cache is being invalidate because project 9a84082f50044e0a8c05d204ebd5ea19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:30.762819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.763973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bef920b9-77d3-4b7a-b548-5ae3b473e055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:30.766274 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1387/2770] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:30 2022] DELETE /identity/v3/projects/9a84082f50044e0a8c05d204ebd5ea19 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:30.773366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288a7f-f2df-4af8-a904-bc50bfa66897 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.773781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288a7f-f2df-4af8-a904-bc50bfa66897 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.773981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288a7f-f2df-4af8-a904-bc50bfa66897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.813698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9a288a7f-f2df-4af8-a904-bc50bfa66897 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:30.820612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9a288a7f-f2df-4af8-a904-bc50bfa66897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:30.834835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0eb6-ba6b-42cc-bfd0-b56ccddde091 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:30.911993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:30.913192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.913612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.914244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] PATH_INFO: `/v3/users/7ba7f82ad18747f6b8cc1bc10cba0a15` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.915706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba7f82ad18747f6b8cc1bc10cba0a15)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:30.918158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:30.956926 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1388/2771] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:30.959978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579675a-73dd-45cc-95a1-c957264117fc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:30.960569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579675a-73dd-45cc-95a1-c957264117fc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:30.961047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579675a-73dd-45cc-95a1-c957264117fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:30.986651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8579675a-73dd-45cc-95a1-c957264117fc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:30.988073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8579675a-73dd-45cc-95a1-c957264117fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:30.996146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba7f82ad18747f6b8cc1bc10cba0a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.000823 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1389/2772] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:31.003644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579675a-73dd-45cc-95a1-c957264117fc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.012913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba7f82ad18747f6b8cc1bc10cba0a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.024914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579675a-73dd-45cc-95a1-c957264117fc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.036923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.037945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.038111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.038251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.039121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:31.039514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.041212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.043135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba7f82ad18747f6b8cc1bc10cba0a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.044898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba7f82ad18747f6b8cc1bc10cba0a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.058985 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1390/2773] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:31.063378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.064415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba7f82ad18747f6b8cc1bc10cba0a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.067639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:31.079224 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1384/2774] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:30 2022] DELETE /identity/v3/users/7ba7f82ad18747f6b8cc1bc10cba0a15 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:31.085056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94dfd3-685b-4dcd-b765-1decfc8c38d9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.095161 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:31.171493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.172373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.172852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.173350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.174110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.176473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.213500 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1391/2775] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:31 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:31.218382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.236651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb483-5f4f-4a74-b661-fac0bb484c2d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.261075 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:31.321490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.322115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.322446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.322767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.323493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.325852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.362607 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1385/2776] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:31 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:31.363998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.379665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d047-1ba0-4254-9e3a-64c15ad8cd99 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.387203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.387893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.388342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.388913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.389406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.391960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.413428 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1392/2777] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:31.415726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.437516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6105e-688b-4bf9-a17d-11479aa710dc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.448736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273c4da-0ca8-4acc-8155-2537306e764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.450538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273c4da-0ca8-4acc-8155-2537306e764b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.450979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273c4da-0ca8-4acc-8155-2537306e764b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.451294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273c4da-0ca8-4acc-8155-2537306e764b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.452793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273c4da-0ca8-4acc-8155-2537306e764b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.457091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273c4da-0ca8-4acc-8155-2537306e764b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.478980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1386/2778] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:31.480843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.496991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568c80-5a66-47de-9cd0-60fd82af6b3c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.502268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.503075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.503446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.503835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] PATH_INFO: `/v3/projects/488f3d3b14644df99fc79ba99afdd31f/users/6a5af59ff6be4cb5bca262ccfd176ef3/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.531778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488f3d3b14644df99fc79ba99afdd31f, user_id=6a5af59ff6be4cb5bca262ccfd176ef3, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.537892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.579022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1393/2779] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:31 2022] PUT /identity/v3/projects/488f3d3b14644df99fc79ba99afdd31f/users/6a5af59ff6be4cb5bca262ccfd176ef3/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:31.586604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610bd95-dcac-4be2-bcf8-d29fd892c6f0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.586998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610bd95-dcac-4be2-bcf8-d29fd892c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.587280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610bd95-dcac-4be2-bcf8-d29fd892c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.611439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.613922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:31.652339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2610bd95-dcac-4be2-bcf8-d29fd892c6f0 None None] MFA Rules not processed for user `6a5af59ff6be4cb5bca262ccfd176ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:31.678535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2610bd95-dcac-4be2-bcf8-d29fd892c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:31.808497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca817-9fd8-4e9f-a44b-5b26022bd614 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.810007 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1387/2780] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:31.815564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610bd95-dcac-4be2-bcf8-d29fd892c6f0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.824455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.825134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.825410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.825673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] PATH_INFO: `/v3/projects/48c18b2fa4604803a8872ccabef18444` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.829893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c18b2fa4604803a8872ccabef18444)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.830297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610bd95-dcac-4be2-bcf8-d29fd892c6f0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:31.832061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.837995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:31.839036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.839963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.841572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.843179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:31.850680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:31.897754 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1388/2781] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:31 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:31.899472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:31.929758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c18b2fa4604803a8872ccabef18444', 'request_id': 'req-807c8b39-da38-400e-abb1-b3914b77421b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.940026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c18b2fa4604803a8872ccabef18444', 'request_id': 'req-807c8b39-da38-400e-abb1-b3914b77421b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.949457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c18b2fa4604803a8872ccabef18444', 'request_id': 'req-807c8b39-da38-400e-abb1-b3914b77421b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.953086 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:31.970717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] The token cache is being invalidate because project 48c18b2fa4604803a8872ccabef18444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:31.971330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.972301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-807c8b39-da38-400e-abb1-b3914b77421b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:31.974407 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1394/2782] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:31 2022] DELETE /identity/v3/projects/48c18b2fa4604803a8872ccabef18444 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:31.982460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f329410-4f57-4dcf-8415-61ea8ec63d6e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:31.982796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f329410-4f57-4dcf-8415-61ea8ec63d6e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:31.983079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f329410-4f57-4dcf-8415-61ea8ec63d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:31.988302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c9b46-0cb6-49b8-ae2e-3045e3b3ff54 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.004722 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:32.012514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3f329410-4f57-4dcf-8415-61ea8ec63d6e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:32.015423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3f329410-4f57-4dcf-8415-61ea8ec63d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:32.072114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.073107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.073544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.073900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.074622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.077428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.095697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1395/2783] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:11:32.104039 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1389/2784] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:31 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:32.104804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b5ffb-3baa-4c0d-838f-6a5115e8aa67 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.105249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b5ffb-3baa-4c0d-838f-6a5115e8aa67 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.105671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b5ffb-3baa-4c0d-838f-6a5115e8aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.108119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.110619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:32.128897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724e679-2652-4b9e-ae36-34a67f893878 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.129110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-076b5ffb-3baa-4c0d-838f-6a5115e8aa67 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:32.129375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-076b5ffb-3baa-4c0d-838f-6a5115e8aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:32.141800 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1396/2785] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:11:32.145571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.146026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b5ffb-3baa-4c0d-838f-6a5115e8aa67 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.146473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.147028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.147028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.147730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.149491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.156289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b5ffb-3baa-4c0d-838f-6a5115e8aa67 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.161150 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1390/2786] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:32.165078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.165705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.166004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.166196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.166314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.166914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:32.167215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.168833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.177557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6902-b67a-4a79-8dce-b5fb7e3b6feb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.181926 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1397/2787] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:11:32.186429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.186852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.188245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.188846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.188846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] PATH_INFO: `/v3/projects/26ffa738fe524333920f28d5906fbe9f/users/73a0064ba0ca4898861483a6d3c76007/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.200085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350892c4-e046-40ba-944e-228bff0ca6a4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.205349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.206070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.206446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.206653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ffa738fe524333920f28d5906fbe9f, user_id=73a0064ba0ca4898861483a6d3c76007, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.206912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.207654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.209726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.210207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.228980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1391/2788] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:32 2022] PUT /identity/v3/projects/26ffa738fe524333920f28d5906fbe9f/users/73a0064ba0ca4898861483a6d3c76007/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:32.233125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.245150 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1398/2789] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:32 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:32.249173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.314420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01754468-d0a0-4876-a03a-6d079e31120e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.320174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.320841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.321340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.321622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.322310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.323986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.328487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408af02-cdee-498f-8e35-2460ed65d16a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.334879 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1392/2790] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:32.336399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.337275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.337735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.338367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.338965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.340102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.341741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.351651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6ef6-0081-4e53-99cc-ba2e4253b208 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.357662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a22b8-9989-4776-ab45-3ad61864c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.358185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a22b8-9989-4776-ab45-3ad61864c53b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.358519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a22b8-9989-4776-ab45-3ad61864c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.358852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a22b8-9989-4776-ab45-3ad61864c53b admin admin] PATH_INFO: `/v3/projects/26ffa738fe524333920f28d5906fbe9f/users/73a0064ba0ca4898861483a6d3c76007/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.361029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a22b8-9989-4776-ab45-3ad61864c53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ffa738fe524333920f28d5906fbe9f, user_id=73a0064ba0ca4898861483a6d3c76007, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.363952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a22b8-9989-4776-ab45-3ad61864c53b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.376800 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1399/2791] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:32 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:32.378442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.387004 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1393/2792] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:32 2022] PUT /identity/v3/projects/26ffa738fe524333920f28d5906fbe9f/users/73a0064ba0ca4898861483a6d3c76007/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:32.394612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00bab3-41e4-4067-b86d-8eb79e54f282 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.400581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.400917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.401192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.445579 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:32.447086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] MFA Rules not processed for user `73a0064ba0ca4898861483a6d3c76007`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:32.449613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:32.474742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.475900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.476160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.476496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.477267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.479036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.492333 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1400/2793] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:11:32.496975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.508951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad913f-ade6-4332-923d-b9d43057f6e0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.512232 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:32.518606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.519507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.519998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.520425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.522128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.524208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.536401 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1401/2794] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:32.541896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.549670 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1394/2795] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:32.559819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58b554-5ce0-4252-b0d2-44aca7e69034 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.562795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.564904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:32.568920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88f174-9b34-4fd0-a88d-8ac55b4e832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.570111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f174-9b34-4fd0-a88d-8ac55b4e832c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.570551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f174-9b34-4fd0-a88d-8ac55b4e832c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.571027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f174-9b34-4fd0-a88d-8ac55b4e832c admin admin] PATH_INFO: `/v3/projects/3d87d5fedc284c0cad5a477016021b4b/users/9b7128cfcf1b41caa8c0ec7e6e00ae48/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.591991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88f174-9b34-4fd0-a88d-8ac55b4e832c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d87d5fedc284c0cad5a477016021b4b, user_id=9b7128cfcf1b41caa8c0ec7e6e00ae48, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.594873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88f174-9b34-4fd0-a88d-8ac55b4e832c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.611775 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1402/2796] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:32 2022] PUT /identity/v3/projects/3d87d5fedc284c0cad5a477016021b4b/users/9b7128cfcf1b41caa8c0ec7e6e00ae48/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:32.624258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011562d2-2831-40c1-983d-719c7a238512 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.624654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011562d2-2831-40c1-983d-719c7a238512 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.625104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011562d2-2831-40c1-983d-719c7a238512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.657205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-011562d2-2831-40c1-983d-719c7a238512 None None] MFA Rules not processed for user `9b7128cfcf1b41caa8c0ec7e6e00ae48`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:32.658797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-011562d2-2831-40c1-983d-719c7a238512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:32.664856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7f0aa-27ab-4ce1-9a5a-1716bf689b51 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.756354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1403/2797] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:32.758660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.759516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.759711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.760016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.772301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011562d2-2831-40c1-983d-719c7a238512 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:32.774361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-011562d2-2831-40c1-983d-719c7a238512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:32.793819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011562d2-2831-40c1-983d-719c7a238512 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:32.804900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41d1da-7e4c-42e3-ba46-6986d5b4a50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:32.805706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41d1da-7e4c-42e3-ba46-6986d5b4a50a service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:32.806457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41d1da-7e4c-42e3-ba46-6986d5b4a50a service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:32.806457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41d1da-7e4c-42e3-ba46-6986d5b4a50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:32.817580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41d1da-7e4c-42e3-ba46-6986d5b4a50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.820124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41d1da-7e4c-42e3-ba46-6986d5b4a50a service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.833287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:32.836408 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1404/2798] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:32.836641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:32.862274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1395/2799] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:11:33.126588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cb04-b666-4c96-9109-7594fa5c513b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:33.127230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cb04-b666-4c96-9109-7594fa5c513b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:33.127703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cb04-b666-4c96-9109-7594fa5c513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:33.158451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a234cb04-b666-4c96-9109-7594fa5c513b None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:33.160039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a234cb04-b666-4c96-9109-7594fa5c513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:33.319927 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1405/2800] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:11:33.380363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:33.383003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:33.422437 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:33.495324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cb04-b666-4c96-9109-7594fa5c513b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:33.545646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219935d-cfef-4bf5-82b3-f408a9bc5158 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:33.555299 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:33.561071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51e5f2-9875-4881-98f5-aa5c47c93fad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:33.561709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51e5f2-9875-4881-98f5-aa5c47c93fad service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:33.561979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51e5f2-9875-4881-98f5-aa5c47c93fad service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:33.562249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51e5f2-9875-4881-98f5-aa5c47c93fad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:33.576008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51e5f2-9875-4881-98f5-aa5c47c93fad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:33.577763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51e5f2-9875-4881-98f5-aa5c47c93fad service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:33.593524 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1396/2801] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:11:33.646723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cb04-b666-4c96-9109-7594fa5c513b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:33.652450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:33.653370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:33.653893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:33.654273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] PATH_INFO: `/v3/users/6a5af59ff6be4cb5bca262ccfd176ef3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:33.655814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5af59ff6be4cb5bca262ccfd176ef3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:33.658279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:33.770647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5af59ff6be4cb5bca262ccfd176ef3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.790347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5af59ff6be4cb5bca262ccfd176ef3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.791231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5af59ff6be4cb5bca262ccfd176ef3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.797432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2c5e4-1df3-49a2-a4e4-8de2b8e5df9f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:33.797939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2c5e4-1df3-49a2-a4e4-8de2b8e5df9f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:33.798212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2c5e4-1df3-49a2-a4e4-8de2b8e5df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:33.800345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5af59ff6be4cb5bca262ccfd176ef3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.801317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5af59ff6be4cb5bca262ccfd176ef3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.824402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-21d2c5e4-1df3-49a2-a4e4-8de2b8e5df9f None None] MFA Rules not processed for user `9b7128cfcf1b41caa8c0ec7e6e00ae48`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:33.825907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-21d2c5e4-1df3-49a2-a4e4-8de2b8e5df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:33.842391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1397/2803] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:33.843501 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1406/2803] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:33 2022] DELETE /identity/v3/users/6a5af59ff6be4cb5bca262ccfd176ef3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:33.845226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:33.845515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:33.847334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:33.873151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:33.874406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:33.958337 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1398/2804] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:33.969139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:33.970691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:34.036639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049cb1-7845-45f8-86e1-99e5c894ddf3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:34.042515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:34.043173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:34.043457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:34.043724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:34.057162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:34.058717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:34.074350 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1407/2805] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:34.409929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:34.412466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:34.462830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368384f-e796-4df0-b8d5-d52f7fc9cc45 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:34.479337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:34.480736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:34.482704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:34.483254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] PATH_INFO: `/v3/projects/488f3d3b14644df99fc79ba99afdd31f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:34.484794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488f3d3b14644df99fc79ba99afdd31f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:34.487346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:34.591104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488f3d3b14644df99fc79ba99afdd31f', 'request_id': 'req-5422b3e1-5492-4148-b713-92c793bd31a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.600564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488f3d3b14644df99fc79ba99afdd31f', 'request_id': 'req-5422b3e1-5492-4148-b713-92c793bd31a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.612708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488f3d3b14644df99fc79ba99afdd31f', 'request_id': 'req-5422b3e1-5492-4148-b713-92c793bd31a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.629871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] The token cache is being invalidate because project 488f3d3b14644df99fc79ba99afdd31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:34.631446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.632441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5422b3e1-5492-4148-b713-92c793bd31a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.635317 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1399/2806] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:34 2022] DELETE /identity/v3/projects/488f3d3b14644df99fc79ba99afdd31f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:34.639124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:34.651859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c440-5c85-4af5-ac43-c93bb2470b46 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:34.752601 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:34.776587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:34.777868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:34.778935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:34.779473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] PATH_INFO: `/v3/users/73a0064ba0ca4898861483a6d3c76007` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:34.781576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a0064ba0ca4898861483a6d3c76007)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:34.785248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:34.844732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:34.845337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:34.846118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:34.884731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:34.886060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a0064ba0ca4898861483a6d3c76007'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.890106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:34.899692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a0064ba0ca4898861483a6d3c76007'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.900466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a0064ba0ca4898861483a6d3c76007'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.918309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a0064ba0ca4898861483a6d3c76007'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.919349 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:34.920456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a0064ba0ca4898861483a6d3c76007'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:34.975465 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1408/2807] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:34 2022] DELETE /identity/v3/users/73a0064ba0ca4898861483a6d3c76007 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:34.991881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1400/2808] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:35.008085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:35.009936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:35.196054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaf7f5-6665-498b-8f85-2f8f8c4d758a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:35.201695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0eb34-2a85-4680-a9ca-12bcbce1b3d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:35.202547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0eb34-2a85-4680-a9ca-12bcbce1b3d3 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:35.203047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0eb34-2a85-4680-a9ca-12bcbce1b3d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:35.203505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0eb34-2a85-4680-a9ca-12bcbce1b3d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:35.288372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0eb34-2a85-4680-a9ca-12bcbce1b3d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:35.290376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0eb34-2a85-4680-a9ca-12bcbce1b3d3 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:35.315731 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1409/2809] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:35.720411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:35.722185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:35.740025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6c4dc-c26c-4339-b062-6be7e3a9db45 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:35.827042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:35.828156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:35.828654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:35.829161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] PATH_INFO: `/v3/users/9b7128cfcf1b41caa8c0ec7e6e00ae48` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:35.831237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7128cfcf1b41caa8c0ec7e6e00ae48)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:35.833686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:35.912226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7128cfcf1b41caa8c0ec7e6e00ae48'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.927804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7128cfcf1b41caa8c0ec7e6e00ae48'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.951922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7128cfcf1b41caa8c0ec7e6e00ae48'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.952761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7128cfcf1b41caa8c0ec7e6e00ae48'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.966936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7128cfcf1b41caa8c0ec7e6e00ae48'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.979881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1401/2810] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:35 2022] DELETE /identity/v3/users/9b7128cfcf1b41caa8c0ec7e6e00ae48 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:35.982326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:35.983355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:35.983641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:35.996928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:35.999133 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:36.003989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.007221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:36.014237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.086726 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:36.114360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444cb06-9737-4408-9e5f-7a4765f954b7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.121123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.121777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.122051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.122318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] PATH_INFO: `/v3/projects/26ffa738fe524333920f28d5906fbe9f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.123477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ffa738fe524333920f28d5906fbe9f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.130035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.167436 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1410/2811] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:11:36.209112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.212392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.269576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ffa738fe524333920f28d5906fbe9f', 'request_id': 'req-d2db793f-91c0-49d3-814a-89c42c0522a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:36.286766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ffa738fe524333920f28d5906fbe9f', 'request_id': 'req-d2db793f-91c0-49d3-814a-89c42c0522a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:36.301877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ffa738fe524333920f28d5906fbe9f', 'request_id': 'req-d2db793f-91c0-49d3-814a-89c42c0522a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:36.330464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] The token cache is being invalidate because project 26ffa738fe524333920f28d5906fbe9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:36.330976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:36.334577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2db793f-91c0-49d3-814a-89c42c0522a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:36.342610 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1402/2812] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:35 2022] DELETE /identity/v3/projects/26ffa738fe524333920f28d5906fbe9f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:36.345531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad245-0e38-4571-97e8-a7b0a49f5a72 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.348576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad245-0e38-4571-97e8-a7b0a49f5a72 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.348839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad245-0e38-4571-97e8-a7b0a49f5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.349712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fce58d-3103-42f6-b98d-33c6de87cefc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.373739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e70ad245-0e38-4571-97e8-a7b0a49f5a72 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:36.374946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e70ad245-0e38-4571-97e8-a7b0a49f5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.438374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.439444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.439926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.440392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.440845 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1403/2813] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:36.446587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.448974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690e2a-e10a-47b8-af3b-8afe9e9b469f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.449256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690e2a-e10a-47b8-af3b-8afe9e9b469f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.449525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690e2a-e10a-47b8-af3b-8afe9e9b469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.462081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.464465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.474899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-44690e2a-e10a-47b8-af3b-8afe9e9b469f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:36.477517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-44690e2a-e10a-47b8-af3b-8afe9e9b469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.478102 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1411/2814] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:36.486402 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1404/2815] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:36.490684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.503330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86115a38-99a8-49ea-9bd6-b37bcb618a65 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.508843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.509712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.510306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.510799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.511636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:36.512275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.514282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.545329 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1412/2816] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:11:36.546231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44690e2a-e10a-47b8-af3b-8afe9e9b469f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.560363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44690e2a-e10a-47b8-af3b-8afe9e9b469f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.567056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.568285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.569193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.569900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.570750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.573368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.617792 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1405/2817] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:36 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:36.619165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.637252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72691fca-3b60-4d37-bcf2-0c7c20db81ce admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.748186 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:36.769577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.771132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.771618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.772090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.773143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.775819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.810087 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1413/2818] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:36 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:36.813520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.848274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334b14f-67d7-47ad-b0ae-f4dae365ae5a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.856801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.858068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.858814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.859322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.860491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.866958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.891125 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1406/2819] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:11:36.895442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.910490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e22d66-437f-42b5-b615-e8122c8739a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.938827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8c928-b28f-45da-85dc-9b5bfa58e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.940935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c928-b28f-45da-85dc-9b5bfa58e146 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.941327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c928-b28f-45da-85dc-9b5bfa58e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.941704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c928-b28f-45da-85dc-9b5bfa58e146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.942470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8c928-b28f-45da-85dc-9b5bfa58e146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.946098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8c928-b28f-45da-85dc-9b5bfa58e146 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.969465 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1414/2820] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:36.973375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.989950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf47327-b551-445b-bbc3-8b7b936dcb3b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.007369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.008811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.010194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.010194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] PATH_INFO: `/v3/projects/873b0bab669c4c6189a6b40825e8125c/users/cf8bc431d27e443fbd404bc60014ef9c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.037433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873b0bab669c4c6189a6b40825e8125c, user_id=cf8bc431d27e443fbd404bc60014ef9c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.042782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.092502 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1407/2821] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:36 2022] PUT /identity/v3/projects/873b0bab669c4c6189a6b40825e8125c/users/cf8bc431d27e443fbd404bc60014ef9c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:37.106232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de686-e07a-41e6-aca7-c204abd88360 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.106743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de686-e07a-41e6-aca7-c204abd88360 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.106853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de686-e07a-41e6-aca7-c204abd88360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.158858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6c2de686-e07a-41e6-aca7-c204abd88360 None None] MFA Rules not processed for user `cf8bc431d27e443fbd404bc60014ef9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:37.160108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6c2de686-e07a-41e6-aca7-c204abd88360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:37.257866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.260320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:37.284200 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:37.321561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1415/2822] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:37.327708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2de686-e07a-41e6-aca7-c204abd88360 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.414592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efff95-ecc8-48e5-8fbb-a47c99b95e83 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.418473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2de686-e07a-41e6-aca7-c204abd88360 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.420383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.421138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.421416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.421690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] PATH_INFO: `/v3/projects/3d87d5fedc284c0cad5a477016021b4b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.422942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d87d5fedc284c0cad5a477016021b4b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.424392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.424958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.425093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.425456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.425730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.426963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.429443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.491996 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1416/2823] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:37.493173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.501381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d87d5fedc284c0cad5a477016021b4b', 'request_id': 'req-e69d28b6-5dee-4492-a065-2de85d0c70be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:37.509878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d87d5fedc284c0cad5a477016021b4b', 'request_id': 'req-e69d28b6-5dee-4492-a065-2de85d0c70be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:37.516884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d87d5fedc284c0cad5a477016021b4b', 'request_id': 'req-e69d28b6-5dee-4492-a065-2de85d0c70be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:37.536696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] The token cache is being invalidate because project 3d87d5fedc284c0cad5a477016021b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:37.537144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:37.538570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e69d28b6-5dee-4492-a065-2de85d0c70be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:37.542029 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1408/2824] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:37 2022] DELETE /identity/v3/projects/3d87d5fedc284c0cad5a477016021b4b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:37.546953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4477b-022e-4cbe-a92d-99aeda970359 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.547322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4477b-022e-4cbe-a92d-99aeda970359 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.547600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4477b-022e-4cbe-a92d-99aeda970359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.575332 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:37.578366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5ed4477b-022e-4cbe-a92d-99aeda970359 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:37.580596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ed4477b-022e-4cbe-a92d-99aeda970359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:37.609625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4eac-ccaa-4cc0-a176-3f2438cfdba1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.616576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.617388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.617771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.618735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.619305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.622573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.663228 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1417/2825] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:37.664641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.666899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:37.682848 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1409/2826] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:37.684643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b331e6-2019-4ca8-836d-6f3577a3f764 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.685221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b331e6-2019-4ca8-836d-6f3577a3f764 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.685702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b331e6-2019-4ca8-836d-6f3577a3f764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.686084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf342028-f0be-4e0a-9209-12b0d90724cc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.691180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.692116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.692406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.692707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.693500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.696901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.717540 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1418/2827] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:37.718514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.734020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b2b331e6-2019-4ca8-836d-6f3577a3f764 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:37.735361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b2b331e6-2019-4ca8-836d-6f3577a3f764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:37.743978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e27b4-b6cf-4cbe-8735-e0ec6407d5b2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.749346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1410/2828] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:37.750488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b331e6-2019-4ca8-836d-6f3577a3f764 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.752409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.753127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.753395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.753668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] PATH_INFO: `/v3/projects/95a9c2d1a3e94bcb868d3d45cadb25c9/users/3c1bdbae19b34ffbbdf7e9e1e86f9f28/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.760622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b331e6-2019-4ca8-836d-6f3577a3f764 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.767021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.767634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.767912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.768186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.770366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:37.770670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.772342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.778832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a9c2d1a3e94bcb868d3d45cadb25c9, user_id=3c1bdbae19b34ffbbdf7e9e1e86f9f28, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.781488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.803423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1411/2829] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:37.803423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.811105 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1419/2830] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:37 2022] PUT /identity/v3/projects/95a9c2d1a3e94bcb868d3d45cadb25c9/users/3c1bdbae19b34ffbbdf7e9e1e86f9f28/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:37.815629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.827635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0acd2-d641-4d49-86ac-dd3aaca26661 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.845663 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:37.918787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.920071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.920347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.921452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.921737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.923629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.943547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a0fa7-0a98-4352-91cb-40875885c651 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.950340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.951999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.952497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.953091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.954311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.956460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.979272 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1420/2831] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:37.980408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.990028 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1412/2832] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:37.995866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.006031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d094-457c-4544-bf47-9a4050efdb9f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.085317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69239a6-446a-4b7a-9359-1efb6001bbbf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.088700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052b1a8-3f38-4df7-8447-1e6b40440e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.089707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052b1a8-3f38-4df7-8447-1e6b40440e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.091110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052b1a8-3f38-4df7-8447-1e6b40440e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.091627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052b1a8-3f38-4df7-8447-1e6b40440e08 admin admin] PATH_INFO: `/v3/projects/95a9c2d1a3e94bcb868d3d45cadb25c9/users/3c1bdbae19b34ffbbdf7e9e1e86f9f28/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.093409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.098314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.098659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.098975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.099427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052b1a8-3f38-4df7-8447-1e6b40440e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a9c2d1a3e94bcb868d3d45cadb25c9, user_id=3c1bdbae19b34ffbbdf7e9e1e86f9f28, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.100853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.102841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.103171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052b1a8-3f38-4df7-8447-1e6b40440e08 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.140038 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1421/2833] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:37 2022] PUT /identity/v3/projects/95a9c2d1a3e94bcb868d3d45cadb25c9/users/3c1bdbae19b34ffbbdf7e9e1e86f9f28/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:38.151977 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1413/2834] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:38.158882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d506d1-901a-4372-95e2-471b2983072b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.162361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d506d1-901a-4372-95e2-471b2983072b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.162361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d506d1-901a-4372-95e2-471b2983072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.163330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.187134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b948c-f03d-45cf-abc8-5f290c4313ca admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.236961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-87d506d1-901a-4372-95e2-471b2983072b None None] MFA Rules not processed for user `3c1bdbae19b34ffbbdf7e9e1e86f9f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:38.238305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-87d506d1-901a-4372-95e2-471b2983072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:38.280001 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:38.313003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.313631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.313909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.314190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.315480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.317451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.338040 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1414/2835] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:38.341782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.357254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ef82-2467-41d6-b80a-31e53a5bde8a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.365526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.366431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.366726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.367082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.367772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.369426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.386931 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1415/2836] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:38.388947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1422/2837] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:38.395819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.399447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d506d1-901a-4372-95e2-471b2983072b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.410740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d506d1-901a-4372-95e2-471b2983072b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.410980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dfd7b-322e-406d-a4b7-6d685c17a22a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.416742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.417521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.417907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.418263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.418501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496713-c0b5-40cf-b925-823b437be874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.419141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:38.419267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496713-c0b5-40cf-b925-823b437be874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.419478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496713-c0b5-40cf-b925-823b437be874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.419754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496713-c0b5-40cf-b925-823b437be874 admin admin] PATH_INFO: `/v3/projects/c5715eb5c1474f35bb87595ba83a23f6/users/57bbc3575a184139b26e3b0bdd221a91/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.420049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.421781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.438989 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1423/2838] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:38.444695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.451507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496713-c0b5-40cf-b925-823b437be874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5715eb5c1474f35bb87595ba83a23f6, user_id=57bbc3575a184139b26e3b0bdd221a91, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.461957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b5277-c311-487c-aceb-931402a56017 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.470203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.470369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496713-c0b5-40cf-b925-823b437be874 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.471770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.472222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.472594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.474137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.476797 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:38.477447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.503730 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1416/2839] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:38 2022] PUT /identity/v3/projects/c5715eb5c1474f35bb87595ba83a23f6/users/57bbc3575a184139b26e3b0bdd221a91/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:38.509336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.510951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.512726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.531061 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1424/2840] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:38 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:38.535431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.566432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:38.569081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:38.693083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6de79-9e1e-4b9e-8725-991956cbe50e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.708879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.709777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.712074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.712450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.714690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:38.715923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.718992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.740669 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1417/2841] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:38.749906 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1425/2842] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:11:38.760640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.763834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:38.765350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:38.765685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:38.874456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11657f-8297-4d1a-8e19-cbdd53c1f5d6 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.880663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcb09c-8f82-4129-9710-63f8293cd0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.881904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb09c-8f82-4129-9710-63f8293cd0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.882071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb09c-8f82-4129-9710-63f8293cd0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.882320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb09c-8f82-4129-9710-63f8293cd0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.895334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcb09c-8f82-4129-9710-63f8293cd0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.897642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcb09c-8f82-4129-9710-63f8293cd0a5 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.914030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1426/2843] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:38.916265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbfcdc-15c4-4349-9bf7-45df84d1248f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:38.925019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:38.925534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:38.925818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:38.926088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:38.938860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:38.940984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:38.974661 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1418/2844] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:39.003849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5518-3c2e-4cc3-be00-47e2b0f5ed7a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.004132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5518-3c2e-4cc3-be00-47e2b0f5ed7a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.004401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5518-3c2e-4cc3-be00-47e2b0f5ed7a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.006146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1427/2845] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:39.010992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:39.026266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:39.052903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeda12d-4375-4d92-a44e-a687bed03937 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:39.059912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:39.061170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.061944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.062454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.064001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:get_project(project_id=8ebac2ac1f644ae6997c721b5f6cb154)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:39.067171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:39.070781 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1419/2846] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:39 2022] GET /identity/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154 => generated 369 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:39.340968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f0f35-4187-436c-98d1-de867bf54a40 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.341660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f0f35-4187-436c-98d1-de867bf54a40 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.341660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f0f35-4187-436c-98d1-de867bf54a40 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.343310 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1428/2847] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:39.349741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:39.370180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:39.399260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2415902-41bd-47f2-8ab4-230a23a660ca tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:39.411355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:39.413318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.413918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.414641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.416782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:get_project(project_id=8ebac2ac1f644ae6997c721b5f6cb154)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:39.421374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:39.438639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1420/2848] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:39 2022] GET /identity/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154 => generated 369 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:39.500311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f0f35-4187-436c-98d1-de867bf54a40 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:39.526438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f0f35-4187-436c-98d1-de867bf54a40 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:39.537648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:39.538738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.540080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.540290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.541234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:39.541551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:39.545103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:39.569542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:39.569774 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1429/2849] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:39.588192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d82a95-07cc-43d4-89e3-e848f0e77d3a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:39.595265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790a36f-ba1f-44f2-8459-73431eecd5d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:39.596558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790a36f-ba1f-44f2-8459-73431eecd5d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.596908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790a36f-ba1f-44f2-8459-73431eecd5d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.597803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790a36f-ba1f-44f2-8459-73431eecd5d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.598477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790a36f-ba1f-44f2-8459-73431eecd5d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:39.601027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790a36f-ba1f-44f2-8459-73431eecd5d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:39.643829 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1421/2850] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:39 2022] POST /identity/v3/users => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:39.648709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:39.656604 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:39.662690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097e7b-6fa2-4be0-b4f0-e57ac71fa77b tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:39.671353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:39.672448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.672990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.673524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.674767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:39.675328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:39.677223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:39.695691 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1430/2851] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:39.738516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e38b0-e72a-463f-a664-62dd9b03bc57 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.738832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e38b0-e72a-463f-a664-62dd9b03bc57 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.739065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e38b0-e72a-463f-a664-62dd9b03bc57 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.741173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1422/2852] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:39.749662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:39.777684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:39.789778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a71e5-1690-4102-8e1e-62941e15bc0e tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:39.795587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:39.796325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:39.796678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:39.797056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:39.798325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:get_project(project_id=8ebac2ac1f644ae6997c721b5f6cb154)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:39.800660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:39.803012 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1431/2853] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:39 2022] GET /identity/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154 => generated 369 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:40.096647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b861e-a168-48cb-a44a-f11bec8776eb None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:40.097278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b861e-a168-48cb-a44a-f11bec8776eb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:40.097367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b861e-a168-48cb-a44a-f11bec8776eb None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:40.099429 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1423/2854] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:40.105395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:40.107220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:40.130251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:40.150858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c69197-0601-44b8-aa5a-fecb105e55d3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:40.156749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:40.157495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:40.157792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:40.158118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:40.159398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:get_project(project_id=8ebac2ac1f644ae6997c721b5f6cb154)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:40.161819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:40.165335 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1432/2855] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:40 2022] GET /identity/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154 => generated 369 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:40.217295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b861e-a168-48cb-a44a-f11bec8776eb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:40.233372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b861e-a168-48cb-a44a-f11bec8776eb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:40.240396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:40.241431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:40.242412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:40.242980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/users/a90b682851024b02a55f679a153fe0cf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:40.273157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a90b682851024b02a55f679a153fe0cf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:40.276730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:40.337031 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:40.366738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90b682851024b02a55f679a153fe0cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.383454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90b682851024b02a55f679a153fe0cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.406631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90b682851024b02a55f679a153fe0cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.407590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90b682851024b02a55f679a153fe0cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.417925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90b682851024b02a55f679a153fe0cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.430325 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1424/2856] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:40 2022] DELETE /identity/v3/users/a90b682851024b02a55f679a153fe0cf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:40.431550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:40.434390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:40.462296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe24cd-afc1-4c80-8d1e-48ea6836b066 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:40.607476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1bdbae19b34ffbbdf7e9e1e86f9f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:40.608843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:40.609550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:40.610283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] PATH_INFO: `/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:40.617870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ebac2ac1f644ae6997c721b5f6cb154)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:40.621809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:40.732537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ebac2ac1f644ae6997c721b5f6cb154', 'request_id': 'req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.744057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ebac2ac1f644ae6997c721b5f6cb154', 'request_id': 'req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.811175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ebac2ac1f644ae6997c721b5f6cb154', 'request_id': 'req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.829659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] The token cache is being invalidate because project 8ebac2ac1f644ae6997c721b5f6cb154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:40.830520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.831347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0413fbf3-3129-42d5-a6ca-9e229f4b9d72 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:40.833513 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1433/2857] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:40 2022] DELETE /identity/v3/projects/8ebac2ac1f644ae6997c721b5f6cb154 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:40.845422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:40.848746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:40.916278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:40.916524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:40.916793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:40.983306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] MFA Rules not processed for user `d1fa5fee71024c328a90d1724a048c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:40.987411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:41.070787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abe15c-3f8f-4a49-ac28-9edbc578fae3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:41.147599 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:41.181675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:41.182415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:41.182779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:41.183266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] PATH_INFO: `/v3/users/cf8bc431d27e443fbd404bc60014ef9c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:41.185925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8bc431d27e443fbd404bc60014ef9c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:41.188463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:41.201028 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1434/2858] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:41.217402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:41.219720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:41.298626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8bc431d27e443fbd404bc60014ef9c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:41.312095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8bc431d27e443fbd404bc60014ef9c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:41.317057 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:41.345072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8bc431d27e443fbd404bc60014ef9c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:41.346081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8bc431d27e443fbd404bc60014ef9c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:41.358167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c298b7e8-5995-4517-9114-1e09bacd7285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8bc431d27e443fbd404bc60014ef9c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:41.359430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bee18-41c9-4e63-9610-d17c0306419a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:41.385400 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1425/2859] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:40 2022] DELETE /identity/v3/users/cf8bc431d27e443fbd404bc60014ef9c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:41.390278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:41.390631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:41.390967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:41.393189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:41.394802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:41.397247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:41.399269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:41.404261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:41.440442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:41.445769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:41.448138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:41.452921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:41.490670 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1435/2860] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:41.670501 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1426/2861] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:41.698866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:41.706781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:41.868073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebc8ea-de88-4d25-8125-e58958d20e0a service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:41.962841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:41.963663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:41.963946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:41.964245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:41.978191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:41.985902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:42.006563 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1436/2862] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:42.642501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:42.654008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:42.698654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2739839-73d3-4727-b9c4-731fdbe61f22 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:42.706462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:42.724851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:42.728911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:42.729195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] PATH_INFO: `/v3/projects/873b0bab669c4c6189a6b40825e8125c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:42.733341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873b0bab669c4c6189a6b40825e8125c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:42.738107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:42.883957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873b0bab669c4c6189a6b40825e8125c', 'request_id': 'req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:42.894600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873b0bab669c4c6189a6b40825e8125c', 'request_id': 'req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:42.903867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873b0bab669c4c6189a6b40825e8125c', 'request_id': 'req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:42.925785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] The token cache is being invalidate because project 873b0bab669c4c6189a6b40825e8125c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:42.926132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:42.927109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:42.930936 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1427/2863] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:42 2022] DELETE /identity/v3/projects/873b0bab669c4c6189a6b40825e8125c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:42.934568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:42.945808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c530dae-63f4-4e9d-bd35-f08d827a0a2f service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:43.016256 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:43.049321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:43.050249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:43.050776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:43.051418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] PATH_INFO: `/v3/users/3c1bdbae19b34ffbbdf7e9e1e86f9f28` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:43.053771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1bdbae19b34ffbbdf7e9e1e86f9f28)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:43.056305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:43.166745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1bdbae19b34ffbbdf7e9e1e86f9f28'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:43.186871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1bdbae19b34ffbbdf7e9e1e86f9f28'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:43.186871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1bdbae19b34ffbbdf7e9e1e86f9f28'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:43.200480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1bdbae19b34ffbbdf7e9e1e86f9f28'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:43.201496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1bdbae19b34ffbbdf7e9e1e86f9f28'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:43.232719 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1437/2864] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:42 2022] DELETE /identity/v3/users/3c1bdbae19b34ffbbdf7e9e1e86f9f28 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:44.822238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:44.824122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:44.916478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3792a0-ab3e-4130-9fe2-e20dfc7dbc66 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:44.929584 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:44.987418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b23d41-f4f9-46a7-89f9-c19fd0254b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:44.988458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b23d41-f4f9-46a7-89f9-c19fd0254b1c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:44.989008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b23d41-f4f9-46a7-89f9-c19fd0254b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:44.989558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b23d41-f4f9-46a7-89f9-c19fd0254b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:44.991996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6b23d41-f4f9-46a7-89f9-c19fd0254b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:45.178529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b23d41-f4f9-46a7-89f9-c19fd0254b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.180024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b23d41-f4f9-46a7-89f9-c19fd0254b1c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.210604 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1428/2865] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:11:45.272623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.277880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:45.465780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a0e0c-883e-4732-900e-72461630fc4c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.475904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.477001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.477472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.477926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] PATH_INFO: `/v3/projects/95a9c2d1a3e94bcb868d3d45cadb25c9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.482578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a9c2d1a3e94bcb868d3d45cadb25c9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.487940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.667602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.668613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.669138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.740875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'request_id': 'req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.743955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] MFA Rules not processed for user `72250431a7f44bff83c1881ff733f2de`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:45.745954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:45.760374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'request_id': 'req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.763887 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:45.780049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a9c2d1a3e94bcb868d3d45cadb25c9', 'request_id': 'req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.820113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] The token cache is being invalidate because project 95a9c2d1a3e94bcb868d3d45cadb25c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:45.820113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.822495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698dc7f0-3f84-45f6-b5fd-8cf8b02c96a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.826413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1438/2866] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:45 2022] DELETE /identity/v3/projects/95a9c2d1a3e94bcb868d3d45cadb25c9 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:45.832813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c66e1-91ab-4094-acb9-ee818eea4325 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.832813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c66e1-91ab-4094-acb9-ee818eea4325 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.833161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c66e1-91ab-4094-acb9-ee818eea4325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.873325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e93c66e1-91ab-4094-acb9-ee818eea4325 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:45.876450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e93c66e1-91ab-4094-acb9-ee818eea4325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:45.888877 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1429/2867] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:45.956485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.958960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:46.063696 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1439/2868] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:11:46.064790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5b3b-16af-436b-9aa4-aeb047335863 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.065076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5b3b-16af-436b-9aa4-aeb047335863 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.065346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5b3b-16af-436b-9aa4-aeb047335863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.073388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94a1a2-fba7-41c5-bb18-1e1319f18957 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:46.082145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:46.085208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.085564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.085844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.089264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:46.104851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-93ea5b3b-16af-436b-9aa4-aeb047335863 None None] MFA Rules not processed for user `d1fa5fee71024c328a90d1724a048c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:46.112616 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:46.116185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93ea5b3b-16af-436b-9aa4-aeb047335863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:46.338944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1440/2869] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:46.341457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26402-007d-44a3-9d22-3209c06734c2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.342562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26402-007d-44a3-9d22-3209c06734c2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.345511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26402-007d-44a3-9d22-3209c06734c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.370846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:46.382908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:46.415590 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1430/2870] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:11:46.443827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6df26402-007d-44a3-9d22-3209c06734c2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:46.445802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6df26402-007d-44a3-9d22-3209c06734c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:46.484936 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1441/2871] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:46.486830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:46.500287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98295333-b1a2-448a-ae4c-5f57b4e1f559 service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:46.524441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:46.525426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.526498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.526994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.527861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:46.528397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:46.531110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:46.544865 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1431/2872] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:11:46.549580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26402-007d-44a3-9d22-3209c06734c2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:46.562225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26402-007d-44a3-9d22-3209c06734c2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:46.567913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:46.568878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.569696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.570174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.571032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:46.573273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:46.613430 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1442/2873] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:46 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:46.617866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:46.634292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e30d99-c170-4fa0-8fb3-10dfa585f18b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:46.775288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:46.776004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.776278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.783672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.784981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:46.789637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:46.842564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1432/2874] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:46 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:46.846805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:46.874103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7523-930d-4fcc-a206-7d34db767fdf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:46.889971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:46.890708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.891182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.891519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.893264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:46.896154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:46.929037 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1443/2875] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:46.933957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:46.948684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc8aa-9f14-4789-8e9b-eff7cfe6d1eb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:46.960015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354dcf3-0137-4de3-bea0-bef8efa9db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:46.960518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354dcf3-0137-4de3-bea0-bef8efa9db8b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.960518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354dcf3-0137-4de3-bea0-bef8efa9db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.960783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354dcf3-0137-4de3-bea0-bef8efa9db8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.964044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354dcf3-0137-4de3-bea0-bef8efa9db8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:46.969354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354dcf3-0137-4de3-bea0-bef8efa9db8b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:46.993838 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1433/2876] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:46.998094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:47.012089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c2059-4254-468e-800f-0bbdab34cd5d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:47.022148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:47.022848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:47.029248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:47.029720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] PATH_INFO: `/v3/projects/d9693bd58bdb4c9a81b6b1cc13c48328/users/b6d8a0051a574633af4d5fc202b9b47f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:47.059813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9693bd58bdb4c9a81b6b1cc13c48328, user_id=b6d8a0051a574633af4d5fc202b9b47f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:47.064986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:47.090451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1444/2877] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:46 2022] PUT /identity/v3/projects/d9693bd58bdb4c9a81b6b1cc13c48328/users/b6d8a0051a574633af4d5fc202b9b47f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:47.106890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:47.107119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:47.107394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:47.173784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] MFA Rules not processed for user `b6d8a0051a574633af4d5fc202b9b47f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:47.176821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:47.339367 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:47.365131 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1434/2878] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:47.365952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:47.452059 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:47.535083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:47.536628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:47.554338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd66de-6aef-4028-8b91-6aa879b21e93 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:47.569928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:47.570702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:47.570981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:47.571252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:47.572471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:47.577621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:47.667429 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1445/2879] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:47 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:47.668540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:47.675951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a69a-04be-4ca0-93ef-b366daed1108 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:47.794882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15a1c-acd9-44e6-b4da-32618ac43b31 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:47.803642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:47.804559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:47.805065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:47.805436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:47.806838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:47.809511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:47.876215 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1446/2880] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:47 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:47.878861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:47.885917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:47.886557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:47.886996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:47.887386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:47.896126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:47.912014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562347a-0038-42ec-a99f-4b3c0b1b66ef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:47.930783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:47.933972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:47.934567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:47.935154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:47.938776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:47.945174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:47.946181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:47.949098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:47.968445 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1435/2881] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:11:47.979991 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1447/2882] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:47.984802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:47.998966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72bd0e-2c58-4d18-ae85-9e0d70660343 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:48.010581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:48.011257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.011537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.011812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] PATH_INFO: `/v3/projects/e8541782b5db4139bb213a9f6e6423ea/users/c8bffc53b0564d17a10dd0edbecfffcc/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.052525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8541782b5db4139bb213a9f6e6423ea, user_id=c8bffc53b0564d17a10dd0edbecfffcc, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:48.057142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:48.085898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1436/2883] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:47 2022] PUT /identity/v3/projects/e8541782b5db4139bb213a9f6e6423ea/users/c8bffc53b0564d17a10dd0edbecfffcc/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:48.088125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.103123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efaf4-2c1e-4edb-835c-673052926ba6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:48.234901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886445ff-8866-4026-8d71-3f2ab5d6c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:48.235772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886445ff-8866-4026-8d71-3f2ab5d6c226 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.236151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886445ff-8866-4026-8d71-3f2ab5d6c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.236625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886445ff-8866-4026-8d71-3f2ab5d6c226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.237412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886445ff-8866-4026-8d71-3f2ab5d6c226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:48.241869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886445ff-8866-4026-8d71-3f2ab5d6c226 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:48.261482 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1448/2884] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:48.263002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.283467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db72681-279f-4f54-90f7-cc335eb5d017 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:48.297269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:48.297964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.298497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.298766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] PATH_INFO: `/v3/projects/e8541782b5db4139bb213a9f6e6423ea/users/c8bffc53b0564d17a10dd0edbecfffcc/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.307595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8541782b5db4139bb213a9f6e6423ea, user_id=c8bffc53b0564d17a10dd0edbecfffcc, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:48.310634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:48.399754 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1437/2885] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:48 2022] PUT /identity/v3/projects/e8541782b5db4139bb213a9f6e6423ea/users/c8bffc53b0564d17a10dd0edbecfffcc/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:48.406062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf7961-93fc-4e3b-9180-ea837b1acde7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.407051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf7961-93fc-4e3b-9180-ea837b1acde7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.407525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf7961-93fc-4e3b-9180-ea837b1acde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.480878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-50cf7961-93fc-4e3b-9180-ea837b1acde7 None None] MFA Rules not processed for user `c8bffc53b0564d17a10dd0edbecfffcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:48.485672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-50cf7961-93fc-4e3b-9180-ea837b1acde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:48.548284 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:48.778411 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1449/2886] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:48.779552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.799605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fdd27-ca7e-4120-8b98-649c435c7651 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:48.819904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:48.820360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.820647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.820943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.828926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:48.829099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:48.830687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:48.856932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf7961-93fc-4e3b-9180-ea837b1acde7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.884818 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1438/2887] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:48.893062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.895070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:48.931650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf7961-93fc-4e3b-9180-ea837b1acde7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:48.951766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:48.953122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.955112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.955466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.956269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:48.962553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:49.064663 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:49.099804 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1450/2888] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:48 2022] POST /identity/v3/projects => generated 371 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:49.101849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:49.184037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1b7d-17ec-44f7-9fe7-3e48d62a559c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:49.410713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d135-2d2f-49bc-9f2e-3b7e6ae746ae tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:49.475246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:49.490627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:49.490914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:49.497581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:49.499635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:49.499953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:49.501645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:49.521540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:49.522154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:49.522465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:49.522702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] PATH_INFO: `/v3/users/9174038735de4d78b4ad527105d06624` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:49.524495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9174038735de4d78b4ad527105d06624)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:49.526470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:49.544073 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1451/2889] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:49.555524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:49.562368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:49.657658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9174038735de4d78b4ad527105d06624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.667086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9174038735de4d78b4ad527105d06624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.706591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9174038735de4d78b4ad527105d06624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.708810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9174038735de4d78b4ad527105d06624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.722735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5955dda7-a619-495d-acd4-dca7f02a18b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9174038735de4d78b4ad527105d06624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.751643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dee19-bc08-4a95-ba59-df4f0b6e59b6 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:49.766088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1439/2890] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:48 2022] DELETE /identity/v3/users/9174038735de4d78b4ad527105d06624 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:49.807750 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:49.962506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:49.963193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:49.963472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:49.963741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:49.971608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:50.152428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:50.154914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:50.178828 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1452/2891] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:50.233893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857888-526c-4b36-a8f8-9d2b1d376652 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:50.234404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857888-526c-4b36-a8f8-9d2b1d376652 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:50.234625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857888-526c-4b36-a8f8-9d2b1d376652 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:50.236580 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1440/2892] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:50.269177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:50.271130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:50.306876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:50.346022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6113b-9e81-48e3-8396-095a36a37c4c service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:50.359204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:50.361914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:50.363217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:50.364678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/projects/9e8babe9d4b3443daaf561d54ef01156` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:50.368716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8babe9d4b3443daaf561d54ef01156)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:50.374679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:50.396953 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1453/2893] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:50 2022] GET /identity/v3/projects/9e8babe9d4b3443daaf561d54ef01156 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:50.742152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf434-b6fe-43e4-88b3-4036683ef504 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:50.742820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf434-b6fe-43e4-88b3-4036683ef504 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:50.743601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf434-b6fe-43e4-88b3-4036683ef504 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:50.745511 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1441/2894] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:50.752436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:50.755101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:50.784386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:50.808540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dacb8f-9d37-4d13-9d40-7a131a9c902c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:50.833975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185b49-eb53-4d53-9115-b073d92b1ce4 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:50.835722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185b49-eb53-4d53-9115-b073d92b1ce4 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:50.843994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185b49-eb53-4d53-9115-b073d92b1ce4 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:50.844355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185b49-eb53-4d53-9115-b073d92b1ce4 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/projects/9e8babe9d4b3443daaf561d54ef01156` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:50.849279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185b49-eb53-4d53-9115-b073d92b1ce4 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8babe9d4b3443daaf561d54ef01156)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:50.851618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185b49-eb53-4d53-9115-b073d92b1ce4 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:50.857402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1454/2895] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:50 2022] GET /identity/v3/projects/9e8babe9d4b3443daaf561d54ef01156 => generated 371 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:50.960347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bf434-b6fe-43e4-88b3-4036683ef504 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:50.981752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bf434-b6fe-43e4-88b3-4036683ef504 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:50.994450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:50.995081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:50.995357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:50.995626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:50.996282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:50.996585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.002368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.028516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5c592-d536-4a24-b57c-7f0bd1ad98df None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.029085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5c592-d536-4a24-b57c-7f0bd1ad98df None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.029535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5c592-d536-4a24-b57c-7f0bd1ad98df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.049894 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1442/2896] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:51.049894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.049894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.103630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-14d5c592-d536-4a24-b57c-7f0bd1ad98df None None] MFA Rules not processed for user `57bbc3575a184139b26e3b0bdd221a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:51.105689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-14d5c592-d536-4a24-b57c-7f0bd1ad98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.126373 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:51.163345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d76bc-47c2-4249-9100-f01d8e730acb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.171019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.171915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.172452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.172977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] PATH_INFO: `/v3/projects/238f21f4c486416caa3eb44c58d2b452` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.177028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238f21f4c486416caa3eb44c58d2b452)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.179913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.239668 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1455/2897] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:51.239668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5c592-d536-4a24-b57c-7f0bd1ad98df None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.254275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5c592-d536-4a24-b57c-7f0bd1ad98df None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.258134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238f21f4c486416caa3eb44c58d2b452', 'request_id': 'req-82b94466-5c05-4895-913d-d716318c52a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.270813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238f21f4c486416caa3eb44c58d2b452', 'request_id': 'req-82b94466-5c05-4895-913d-d716318c52a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.283489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238f21f4c486416caa3eb44c58d2b452', 'request_id': 'req-82b94466-5c05-4895-913d-d716318c52a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.296939 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:51.302412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] The token cache is being invalidate because project 238f21f4c486416caa3eb44c58d2b452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:51.302987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.305550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.308921 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1443/2898] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:51 2022] DELETE /identity/v3/projects/238f21f4c486416caa3eb44c58d2b452 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:51.310082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.312350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.339408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.343159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.344438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.344438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.344438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.348235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.398387 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1456/2899] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:51 2022] POST /identity/v3/users => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:51.401147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.405208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.499339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b94466-5c05-4895-913d-d716318c52a8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.516481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c96d3-75b0-4474-8425-3f71fe5fc672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.517433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c96d3-75b0-4474-8425-3f71fe5fc672 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.517883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c96d3-75b0-4474-8425-3f71fe5fc672 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.518305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c96d3-75b0-4474-8425-3f71fe5fc672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.523246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4d1c96d3-75b0-4474-8425-3f71fe5fc672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.525457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bbbcb-9eda-4cdf-b278-f16dfd4715aa tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.532362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.533140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.533485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.533767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] PATH_INFO: `/v3/users/784f69623b6e4401a90fc5ab58e9545e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.535104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784f69623b6e4401a90fc5ab58e9545e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.537640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.602394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784f69623b6e4401a90fc5ab58e9545e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.614707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784f69623b6e4401a90fc5ab58e9545e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.615627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784f69623b6e4401a90fc5ab58e9545e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.629542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784f69623b6e4401a90fc5ab58e9545e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.630472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784f69623b6e4401a90fc5ab58e9545e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.651890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c96d3-75b0-4474-8425-3f71fe5fc672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.654464 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1457/2900] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:51 2022] DELETE /identity/v3/users/784f69623b6e4401a90fc5ab58e9545e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:51.655256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c96d3-75b0-4474-8425-3f71fe5fc672 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.655518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.657283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.670075 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1444/2901] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:51.722233 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:51.781591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df0ac9-dd26-4e45-88de-fcae76ebc790 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.794003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.794433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.794778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.795135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.796053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:51.796420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.810713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.832355 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1458/2902] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:51.852957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc948-fe30-44f8-88bc-13a4aab9097f None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.852957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc948-fe30-44f8-88bc-13a4aab9097f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.853431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc948-fe30-44f8-88bc-13a4aab9097f None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.855535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1445/2903] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:51.863656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:51.866195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:52.039055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:52.082723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b6929-4001-4422-a5ae-f859c981f3eb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:52.107866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20b6e6-0ada-41f9-9296-5fd63ed5c3a5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:52.110038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20b6e6-0ada-41f9-9296-5fd63ed5c3a5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:52.110323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20b6e6-0ada-41f9-9296-5fd63ed5c3a5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:52.118490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20b6e6-0ada-41f9-9296-5fd63ed5c3a5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/projects/9e8babe9d4b3443daaf561d54ef01156` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:52.119943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20b6e6-0ada-41f9-9296-5fd63ed5c3a5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8babe9d4b3443daaf561d54ef01156)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:52.130007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20b6e6-0ada-41f9-9296-5fd63ed5c3a5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:52.138806 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1459/2904] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:51 2022] GET /identity/v3/projects/9e8babe9d4b3443daaf561d54ef01156 => generated 371 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:52.479368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dc948-fe30-44f8-88bc-13a4aab9097f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:52.481197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a87dc948-fe30-44f8-88bc-13a4aab9097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:52.529666 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:52.564043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70d78d-11dd-4372-bd89-e265cf4d1bbf None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:52.564365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70d78d-11dd-4372-bd89-e265cf4d1bbf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:52.564787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70d78d-11dd-4372-bd89-e265cf4d1bbf None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:52.566511 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1460/2905] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:11:52.574413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70d78d-11dd-4372-bd89-e265cf4d1bbf None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:11:52.602300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70d78d-11dd-4372-bd89-e265cf4d1bbf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:52.619036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dc948-fe30-44f8-88bc-13a4aab9097f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:52.626252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70d78d-11dd-4372-bd89-e265cf4d1bbf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:52.627979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:52.630164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:52.630667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:52.631580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:52.636652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:52.637313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:52.638167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:52.639704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:52.640157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/projects/9e8babe9d4b3443daaf561d54ef01156` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:52.645000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8babe9d4b3443daaf561d54ef01156)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:52.648037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:52.655632 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1461/2906] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:11:52 2022] GET /identity/v3/projects/9e8babe9d4b3443daaf561d54ef01156 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:52.661496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:52.663993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:52.687570 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1446/2907] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:52.706343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:52.709565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:52.720300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:52.739251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635365-55b8-4645-8fcf-f4ca3612fef4 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:52.762993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:52.765397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:52.765880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:52.769638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/users/e31b0dff7744496098059a769edc3278` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:52.821717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e31b0dff7744496098059a769edc3278)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:52.830502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:52.901075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2830-4cf5-4799-a21d-57f8f686d778 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:52.915537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:52.916542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:52.916967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:52.917588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] PATH_INFO: `/v3/projects/773ea26cd1f0413bb0a785fb7bc6f04b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:52.921320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773ea26cd1f0413bb0a785fb7bc6f04b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:52.924506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:52.982682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31b0dff7744496098059a769edc3278'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.003298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31b0dff7744496098059a769edc3278'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.039761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773ea26cd1f0413bb0a785fb7bc6f04b', 'request_id': 'req-a86cc235-7aa6-4e95-9783-f2519d84afd6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.047551 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:53.057059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31b0dff7744496098059a769edc3278'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.057276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773ea26cd1f0413bb0a785fb7bc6f04b', 'request_id': 'req-a86cc235-7aa6-4e95-9783-f2519d84afd6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.058854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31b0dff7744496098059a769edc3278'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.067695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773ea26cd1f0413bb0a785fb7bc6f04b', 'request_id': 'req-a86cc235-7aa6-4e95-9783-f2519d84afd6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.078511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b32f9fd5-b130-4155-8661-e8dd6f5b5ceb tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31b0dff7744496098059a769edc3278'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.084059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] The token cache is being invalidate because project 773ea26cd1f0413bb0a785fb7bc6f04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:53.084472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.085307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.094565 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1447/2909] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:52 2022] DELETE /identity/v3/users/e31b0dff7744496098059a769edc3278 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:53.097735 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1462/2909] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:52 2022] DELETE /identity/v3/projects/773ea26cd1f0413bb0a785fb7bc6f04b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:53.097851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe3c8-6b1d-43e4-9d75-e7e9d390ddac None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:53.097851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe3c8-6b1d-43e4-9d75-e7e9d390ddac None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:53.097851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe3c8-6b1d-43e4-9d75-e7e9d390ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:53.100169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:53.102297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:53.156867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0fdfe3c8-6b1d-43e4-9d75-e7e9d390ddac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:53.158305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0fdfe3c8-6b1d-43e4-9d75-e7e9d390ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:53.249512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cc235-7aa6-4e95-9783-f2519d84afd6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:53.346628 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1448/2910] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:53.349722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41006-5123-458c-9959-235b5fddb3f3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:53.350046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41006-5123-458c-9959-235b5fddb3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:53.350370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41006-5123-458c-9959-235b5fddb3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:53.377894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bffc53b0564d17a10dd0edbecfffcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8541782b5db4139bb213a9f6e6423ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:53.378630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:53.378920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:53.379194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] PATH_INFO: `/v3/projects/9e8babe9d4b3443daaf561d54ef01156` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:53.384880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e8babe9d4b3443daaf561d54ef01156)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:53.387764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1cf41006-5123-458c-9959-235b5fddb3f3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:53.388853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:53.389391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1cf41006-5123-458c-9959-235b5fddb3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:53.405953 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1449/2911] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:53.411766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41006-5123-458c-9959-235b5fddb3f3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:53.436519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41006-5123-458c-9959-235b5fddb3f3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:53.458970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:53.459702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:53.461219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:53.461919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:53.462772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:53.463942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:53.468306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:53.506354 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:53.509942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8babe9d4b3443daaf561d54ef01156', 'request_id': 'req-3247c44a-2a71-4149-be58-730d6301be5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.517849 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1450/2912] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:53.518959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:53.526844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8babe9d4b3443daaf561d54ef01156', 'request_id': 'req-3247c44a-2a71-4149-be58-730d6301be5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.542914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e44ef-1b4f-4cfe-87be-e95421f640b6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:53.546954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8babe9d4b3443daaf561d54ef01156', 'request_id': 'req-3247c44a-2a71-4149-be58-730d6301be5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.573250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] The token cache is being invalidate because project 9e8babe9d4b3443daaf561d54ef01156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:53.573634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.576203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.579719 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1463/2913] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:53 2022] DELETE /identity/v3/projects/9e8babe9d4b3443daaf561d54ef01156 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:53.585610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:53.589806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:53.625020 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:53.683590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:53.685729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:53.686120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:53.694820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:53.695839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:53.698004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:53.709195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247c44a-2a71-4149-be58-730d6301be5c tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:53.731465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:53.732283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:53.732663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:53.733054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] PATH_INFO: `/v3/users/b6d8a0051a574633af4d5fc202b9b47f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:53.737304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d8a0051a574633af4d5fc202b9b47f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:53.740457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:53.767808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1451/2914] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:53 2022] POST /identity/v3/projects => generated 373 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:53.771145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:53.774993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:53.847850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d8a0051a574633af4d5fc202b9b47f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.865571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d8a0051a574633af4d5fc202b9b47f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.866440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d8a0051a574633af4d5fc202b9b47f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.884396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d8a0051a574633af4d5fc202b9b47f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.887834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-64a49f24-9434-4a77-b5fd-40a1136c5ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d8a0051a574633af4d5fc202b9b47f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:53.934534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1464/2915] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:53 2022] DELETE /identity/v3/users/b6d8a0051a574633af4d5fc202b9b47f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:53.937244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb682c2-880d-482c-a432-5ea022868dd5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:53.939238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:53.939720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:53.940092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:53.991111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:53.993028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:54.084825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:54.085818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:54.086429 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1465/2916] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:54.086818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:54.087592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:54.088448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:54.090827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:54.133577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:54.139649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:54.147767 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1452/2917] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:53 2022] POST /identity/v3/users => generated 287 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:54.156472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:54.168074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:54.234256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95407538-f9aa-4a62-880b-2045ebf595db admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:54.249890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:54.251176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:54.251468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:54.251979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:54.256073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:54.259542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:54.296083 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:54.304056 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1453/2918] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:54.309343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:54.322014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c730f-cc1d-4d92-9794-731373d94827 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:54.328323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:54.329431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:54.329639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:54.329903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:54.349975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2580-35c1-4687-af26-53175c9c1e03 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:54.354300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:54.355748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:54.367430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d067a-defe-4614-a624-17278194669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:54.368033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d067a-defe-4614-a624-17278194669c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:54.368313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d067a-defe-4614-a624-17278194669c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:54.368589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d067a-defe-4614-a624-17278194669c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:54.369271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d067a-defe-4614-a624-17278194669c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:54.371439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d067a-defe-4614-a624-17278194669c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:54.381171 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1466/2919] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:54.383461 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:54.399570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:54.401500 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1454/2920] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:54.419658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928e6a-1001-44e8-a0d5-ccd8f5462f8f service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:54.425513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:54.426193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:54.426524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:54.426795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] PATH_INFO: `/v3/projects/5ef09c8f40204707a31a81da24b90085/users/1cfe4a3f6ee24a2086e35af2dc30ffe0/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:54.463664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef09c8f40204707a31a81da24b90085, user_id=1cfe4a3f6ee24a2086e35af2dc30ffe0, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:54.466440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:54.488913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1467/2921] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:54 2022] PUT /identity/v3/projects/5ef09c8f40204707a31a81da24b90085/users/1cfe4a3f6ee24a2086e35af2dc30ffe0/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:11:54.495444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a259-7b72-4c91-8bb2-08bdd4445742 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:54.495823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a259-7b72-4c91-8bb2-08bdd4445742 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:54.496001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a259-7b72-4c91-8bb2-08bdd4445742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:54.545201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8d26a259-7b72-4c91-8bb2-08bdd4445742 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:54.547002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8d26a259-7b72-4c91-8bb2-08bdd4445742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:54.677366 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1455/2922] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:54.707661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:54.709670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:54.817028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf0c75-4a77-4cd8-9bd4-ea8a6d414593 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:54.821047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:54.821670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:54.821930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:54.822198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:54.832630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:54.834253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:54.855629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1468/2923] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:56.105537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c0c2-849b-4ace-b7f6-02ace63cf43d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:56.106029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c0c2-849b-4ace-b7f6-02ace63cf43d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:56.106148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c0c2-849b-4ace-b7f6-02ace63cf43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:56.156320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e968c0c2-849b-4ace-b7f6-02ace63cf43d None None] MFA Rules not processed for user `57bbc3575a184139b26e3b0bdd221a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:56.160844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e968c0c2-849b-4ace-b7f6-02ace63cf43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:56.175566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:56.178233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:56.205817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045cfae-cdcb-4be0-971d-93370889c7af service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:56.220935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:56.221977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:56.222538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:56.222993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] PATH_INFO: `/v3/projects/d9693bd58bdb4c9a81b6b1cc13c48328` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:56.225450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9693bd58bdb4c9a81b6b1cc13c48328)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:56.230939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:56.335596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9693bd58bdb4c9a81b6b1cc13c48328', 'request_id': 'req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.337813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1456/2924] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:56.345914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9693bd58bdb4c9a81b6b1cc13c48328', 'request_id': 'req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.353152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9693bd58bdb4c9a81b6b1cc13c48328', 'request_id': 'req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.369860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] The token cache is being invalidate because project d9693bd58bdb4c9a81b6b1cc13c48328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:56.370194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.370950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.373153 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1469/2925] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:56 2022] DELETE /identity/v3/projects/d9693bd58bdb4c9a81b6b1cc13c48328 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:56.379848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c0c2-849b-4ace-b7f6-02ace63cf43d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:56.410354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c0c2-849b-4ace-b7f6-02ace63cf43d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:56.523672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:56.524334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:56.524610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:56.524904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] PATH_INFO: `/v3/users/c8bffc53b0564d17a10dd0edbecfffcc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:56.527956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8bffc53b0564d17a10dd0edbecfffcc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:56.530154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:56.632077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8bffc53b0564d17a10dd0edbecfffcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.634197 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:56.648736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8bffc53b0564d17a10dd0edbecfffcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.667596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8bffc53b0564d17a10dd0edbecfffcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.669076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8bffc53b0564d17a10dd0edbecfffcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.678918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-effa2514-23f9-4da8-b834-0729bc4ab02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8bffc53b0564d17a10dd0edbecfffcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:56.695766 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1457/2926] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:56 2022] DELETE /identity/v3/users/c8bffc53b0564d17a10dd0edbecfffcc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:57.603834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:57.605885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:57.621780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc425c-8f72-4e8d-9c0e-00bdbd5cbafb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:57.697232 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:57.719220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:57.720241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:57.721036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:57.721517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] PATH_INFO: `/v3/projects/e8541782b5db4139bb213a9f6e6423ea` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:57.723154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8541782b5db4139bb213a9f6e6423ea)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:57.725546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:57.807367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8541782b5db4139bb213a9f6e6423ea', 'request_id': 'req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:57.821783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8541782b5db4139bb213a9f6e6423ea', 'request_id': 'req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:57.832081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8541782b5db4139bb213a9f6e6423ea', 'request_id': 'req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:57.860985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] The token cache is being invalidate because project e8541782b5db4139bb213a9f6e6423ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:57.860985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:57.872271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:57.874661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1470/2927] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:57 2022] DELETE /identity/v3/projects/e8541782b5db4139bb213a9f6e6423ea => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:57.880897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0843e8f-6d10-4f33-9c30-07509e667eab None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:57.881435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0843e8f-6d10-4f33-9c30-07509e667eab None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:57.881928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0843e8f-6d10-4f33-9c30-07509e667eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:57.917626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:57.919324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:57.925750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a0843e8f-6d10-4f33-9c30-07509e667eab None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:57.927481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a0843e8f-6d10-4f33-9c30-07509e667eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:58.015833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e26ee-a81d-4fd3-8580-6a4f8ca74be4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:58.037698 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1458/2928] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:58.039168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:58.039808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.040086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.040358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.048165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7e9f-8820-4943-ab59-47d094a2fe33 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.048401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7e9f-8820-4943-ab59-47d094a2fe33 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.048520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:58.048732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7e9f-8820-4943-ab59-47d094a2fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.071462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:58.073953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:58.077621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dc6f7e9f-8820-4943-ab59-47d094a2fe33 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:58.079951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dc6f7e9f-8820-4943-ab59-47d094a2fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:58.092811 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1459/2929] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:58.096808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7e9f-8820-4943-ab59-47d094a2fe33 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:58.105888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1471/2930] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:58.113679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7e9f-8820-4943-ab59-47d094a2fe33 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:58.119327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:58.120217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.120484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.120952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.121752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:58.123071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:58.126323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:58.161320 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1460/2931] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:58.163726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:58.179683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f1434-cbdb-4799-9b89-779e986f8471 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:58.187999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:58.189240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.190189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.190644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.191816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:58.195384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:58.243021 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1472/2932] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:58 2022] POST /identity/v3/projects => generated 407 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:58.247641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:58.265673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1608-47f2-4dd2-97cd-64cd536d3418 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:58.434501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:58.435145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.435404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.437172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.437840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:58.444447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:58.485334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1461/2933] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:58 2022] POST /identity/v3/users => generated 304 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:58.487830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:58.500055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a3dd6-962b-4ef8-8b3b-cc18d1d16de3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:58.512070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:58.513755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.513755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.514436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.516307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:58.519730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:58.565851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1473/2934] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:11:58.568054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:58.584268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb0ad-7291-4edd-a981-d00d3306819f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:58.611364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a50e3-4fee-49c2-be69-62b81146bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:58.614541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a50e3-4fee-49c2-be69-62b81146bf2c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.616867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a50e3-4fee-49c2-be69-62b81146bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.617158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a50e3-4fee-49c2-be69-62b81146bf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.618922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a50e3-4fee-49c2-be69-62b81146bf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:58.623289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a50e3-4fee-49c2-be69-62b81146bf2c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:58.656706 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1462/2935] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:58.659979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:58.679067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6da16-5857-4783-b203-ca4cacc08f74 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:58.694765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:58.695458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.695887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.697187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] PATH_INFO: `/v3/projects/b69b7cfd0a1d4242ab50e8ecebc4cddb/users/636c692b99c3406a984069e55df57fdf/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.735664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69b7cfd0a1d4242ab50e8ecebc4cddb, user_id=636c692b99c3406a984069e55df57fdf, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:58.745602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:58.770021 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1474/2936] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:58 2022] PUT /identity/v3/projects/b69b7cfd0a1d4242ab50e8ecebc4cddb/users/636c692b99c3406a984069e55df57fdf/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:58.787846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7252a-2e46-424c-9f79-2e9e9a7794de None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:58.790203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7252a-2e46-424c-9f79-2e9e9a7794de None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:58.792260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7252a-2e46-424c-9f79-2e9e9a7794de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:58.891347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7bd7252a-2e46-424c-9f79-2e9e9a7794de None None] MFA Rules not processed for user `636c692b99c3406a984069e55df57fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:58.902680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7bd7252a-2e46-424c-9f79-2e9e9a7794de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:58.986967 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:59.268595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:59.271499 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1463/2937] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:59.278660 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:59.409942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9086-182d-4a5f-ada5-02bc575afaec admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:59.416288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:59.416938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:59.417218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:59.417624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:59.418941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:59.421811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:59.498985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7252a-2e46-424c-9f79-2e9e9a7794de None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:59.507627 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1475/2938] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:59 2022] POST /identity/v3/projects => generated 409 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:59.522612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7252a-2e46-424c-9f79-2e9e9a7794de None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:59.703154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:59.703823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:59.704197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:59.704456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:59.705343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:59.707565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:59.755776 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1464/2939] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:59 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:59.757647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:59.773892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25d723-16d2-47df-9f39-93e550eedd11 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:59.793670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:59.794521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:59.794958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:59.795401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:59.800266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:59.802407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:59.853046 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1476/2940] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:59.854992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:59.868740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e8752-5584-45c5-9bb9-bd4f0459e289 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:59.896365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:59.898979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:59.899210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:59.900174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] PATH_INFO: `/v3/projects/00a6fc4e608f440d996ca16a01c2ccaf/users/bdfa6507c1f7483c99591acb9c65786b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:59.921254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a6fc4e608f440d996ca16a01c2ccaf, user_id=bdfa6507c1f7483c99591acb9c65786b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:59.925960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:59.973045 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1465/2941] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:59 2022] PUT /identity/v3/projects/00a6fc4e608f440d996ca16a01c2ccaf/users/bdfa6507c1f7483c99591acb9c65786b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:59.977355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:59.996292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e49c4-1001-4162-a26e-929bf1b45151 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:00.204156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4549e-83f3-4a46-afb1-8a39dee33a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:00.208967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4549e-83f3-4a46-afb1-8a39dee33a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:00.209373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4549e-83f3-4a46-afb1-8a39dee33a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:00.210216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4549e-83f3-4a46-afb1-8a39dee33a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:00.211492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4549e-83f3-4a46-afb1-8a39dee33a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:00.218559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4549e-83f3-4a46-afb1-8a39dee33a72 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:00.250673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:00.266626 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1477/2942] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:12:00.277503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5262c-1018-4e01-98d7-d85cc5ee918f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:00.292841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:00.293738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:00.294380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:00.295818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] PATH_INFO: `/v3/projects/00a6fc4e608f440d996ca16a01c2ccaf/users/bdfa6507c1f7483c99591acb9c65786b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:00.305878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a6fc4e608f440d996ca16a01c2ccaf, user_id=bdfa6507c1f7483c99591acb9c65786b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:00.309162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:00.346733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1466/2943] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:00 2022] PUT /identity/v3/projects/00a6fc4e608f440d996ca16a01c2ccaf/users/bdfa6507c1f7483c99591acb9c65786b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:00.361847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b0b6-6da6-4e5e-9cf9-c408a23a8f9b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:00.362281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b0b6-6da6-4e5e-9cf9-c408a23a8f9b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:00.362646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b0b6-6da6-4e5e-9cf9-c408a23a8f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:00.425613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-94a7b0b6-6da6-4e5e-9cf9-c408a23a8f9b None None] MFA Rules not processed for user `bdfa6507c1f7483c99591acb9c65786b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:00.426973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-94a7b0b6-6da6-4e5e-9cf9-c408a23a8f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:00.641529 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:00.661471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1478/2944] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:00.667740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:00.896649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b559-e9f0-407a-8b12-7b5902c883ba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:00.918714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:00.919547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:00.919928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:00.920636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] PATH_INFO: `/v3/users/636c692b99c3406a984069e55df57fdf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:00.922004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636c692b99c3406a984069e55df57fdf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:00.924453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:00.939193 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:01.057574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636c692b99c3406a984069e55df57fdf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:01.073117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636c692b99c3406a984069e55df57fdf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:01.096462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636c692b99c3406a984069e55df57fdf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:01.098480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636c692b99c3406a984069e55df57fdf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:01.135026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636c692b99c3406a984069e55df57fdf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:01.165368 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1467/2945] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:12:00 2022] DELETE /identity/v3/users/636c692b99c3406a984069e55df57fdf => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:01.170626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:01.171534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:01.171981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:01.194077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:01.195859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:01.362064 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1479/2946] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:01.407305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:01.409918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:01.604844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414448-18a6-4596-8c6e-3b29b0a43635 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:01.616267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:01.617798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:01.618430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:01.619548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:01.634963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:01.636759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:01.649220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1468/2947] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:03.951853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:03.953313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:03.976975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb85a6-eabc-4712-a4a1-516443d63f41 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:03.996739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:03.997348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:03.997630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:03.997902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] PATH_INFO: `/v3/projects/b69b7cfd0a1d4242ab50e8ecebc4cddb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:03.999062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b69b7cfd0a1d4242ab50e8ecebc4cddb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:04.001000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:04.158900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b69b7cfd0a1d4242ab50e8ecebc4cddb', 'request_id': 'req-473f68cd-8501-404f-b953-e7c7c522493a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.172391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b69b7cfd0a1d4242ab50e8ecebc4cddb', 'request_id': 'req-473f68cd-8501-404f-b953-e7c7c522493a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.185610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b69b7cfd0a1d4242ab50e8ecebc4cddb', 'request_id': 'req-473f68cd-8501-404f-b953-e7c7c522493a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.206051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] The token cache is being invalidate because project b69b7cfd0a1d4242ab50e8ecebc4cddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:12:04.206451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.210077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.219326 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1480/2948] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:03 2022] DELETE /identity/v3/projects/b69b7cfd0a1d4242ab50e8ecebc4cddb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:04.223567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:04.236761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af9d5-af04-4e98-8df0-71a4373ba0e0 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:04.368201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:04.368896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:04.369175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:04.369591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] PATH_INFO: `/v3/users/bdfa6507c1f7483c99591acb9c65786b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:04.375365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfa6507c1f7483c99591acb9c65786b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:04.382808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:04.453991 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:04.479547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfa6507c1f7483c99591acb9c65786b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.502254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfa6507c1f7483c99591acb9c65786b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.535834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfa6507c1f7483c99591acb9c65786b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.538684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfa6507c1f7483c99591acb9c65786b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.554392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81305b66-ca17-4790-abe3-290eef416ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfa6507c1f7483c99591acb9c65786b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:04.569749 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1469/2949] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:12:04 2022] DELETE /identity/v3/users/bdfa6507c1f7483c99591acb9c65786b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:05.624874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:05.628049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:05.647930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f68cd-8501-404f-b953-e7c7c522493a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:05.774444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:05.775571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:05.776512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:05.778276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] PATH_INFO: `/v3/projects/00a6fc4e608f440d996ca16a01c2ccaf` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:05.779567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a6fc4e608f440d996ca16a01c2ccaf)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:05.783043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:05.874075 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:05.923503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a6fc4e608f440d996ca16a01c2ccaf', 'request_id': 'req-a0990d18-ce0f-4d07-99bc-494b57d9b981'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:05.940030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a6fc4e608f440d996ca16a01c2ccaf', 'request_id': 'req-a0990d18-ce0f-4d07-99bc-494b57d9b981'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:05.952433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a6fc4e608f440d996ca16a01c2ccaf', 'request_id': 'req-a0990d18-ce0f-4d07-99bc-494b57d9b981'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:05.979269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] The token cache is being invalidate because project 00a6fc4e608f440d996ca16a01c2ccaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:12:05.979569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:05.981451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a0990d18-ce0f-4d07-99bc-494b57d9b981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:05.984692 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1481/2950] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:05 2022] DELETE /identity/v3/projects/00a6fc4e608f440d996ca16a01c2ccaf => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:05.992645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2289-a8fe-4709-9ad8-4134def9dae4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:05.993273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2289-a8fe-4709-9ad8-4134def9dae4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:05.993592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2289-a8fe-4709-9ad8-4134def9dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.041925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-738e2289-a8fe-4709-9ad8-4134def9dae4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:06.045838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-738e2289-a8fe-4709-9ad8-4134def9dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:06.220976 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1470/2951] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:06.232501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247530-391b-4387-9d35-fa5e519c6cb0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.232912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247530-391b-4387-9d35-fa5e519c6cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.233297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247530-391b-4387-9d35-fa5e519c6cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.260202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-68247530-391b-4387-9d35-fa5e519c6cb0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:06.261577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68247530-391b-4387-9d35-fa5e519c6cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:06.286089 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1482/2952] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:06.287910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e2289-a8fe-4709-9ad8-4134def9dae4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:06.346620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e2289-a8fe-4709-9ad8-4134def9dae4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:06.357659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:06.358296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.358574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.360513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.363045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:12:06.363773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:06.368597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:06.396176 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1471/2953] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:12:06.401344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68247530-391b-4387-9d35-fa5e519c6cb0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:06.420198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68247530-391b-4387-9d35-fa5e519c6cb0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:06.456448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:06.457246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.457668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.457960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.461766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:06.466268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:06.541925 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1483/2954] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:12:06 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:06.543167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:06.558494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bac2-8d00-40aa-a4f7-7bee4288c937 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:06.708723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:06.709437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.709741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.710018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.710664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:06.712724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:06.745038 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1472/2955] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:12:06 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:06.749032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:06.764634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948831d9-5108-4823-baf4-318918e0d019 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:06.774086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:06.774338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.774609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.774877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.775667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:06.777579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:06.798697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1484/2956] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:12:06.799635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:06.814632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dde48-100d-4da2-9f8d-7c4e1ea036f8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:06.821674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d206-22d7-403a-9d39-63aa967bf1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:06.821871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d206-22d7-403a-9d39-63aa967bf1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.822085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d206-22d7-403a-9d39-63aa967bf1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.822258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d206-22d7-403a-9d39-63aa967bf1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.823086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d206-22d7-403a-9d39-63aa967bf1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:06.828416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d206-22d7-403a-9d39-63aa967bf1aa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:06.847430 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1473/2957] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:12:06.851748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:06.865723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579bba2-648e-4ccd-9e32-83e117f3a138 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:06.884185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:06.884911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.885209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.885456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] PATH_INFO: `/v3/projects/18092524add04e5784fdf5083815c095/users/375872cad2074fbbae93c7c258339b37/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.947290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18092524add04e5784fdf5083815c095, user_id=375872cad2074fbbae93c7c258339b37, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:06.950045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:06.997484 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1485/2958] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:06 2022] PUT /identity/v3/projects/18092524add04e5784fdf5083815c095/users/375872cad2074fbbae93c7c258339b37/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:07.068461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836756b1-6618-416b-9471-1b7de506442c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:07.068988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836756b1-6618-416b-9471-1b7de506442c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:07.069136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836756b1-6618-416b-9471-1b7de506442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:07.103464 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:07.106527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-836756b1-6618-416b-9471-1b7de506442c None None] MFA Rules not processed for user `375872cad2074fbbae93c7c258339b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:07.107684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-836756b1-6618-416b-9471-1b7de506442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:07.237795 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1474/2959] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:12:07.243990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:07.246263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:07.347098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d24e-ecf9-4c10-9fe3-3b3a8bbd8577 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:07.353995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf170-ccdd-43f3-9f49-4170cf3ee572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:07.354793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf170-ccdd-43f3-9f49-4170cf3ee572 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:07.355141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf170-ccdd-43f3-9f49-4170cf3ee572 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:07.355479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf170-ccdd-43f3-9f49-4170cf3ee572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:07.369677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaf170-ccdd-43f3-9f49-4170cf3ee572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:07.371375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaf170-ccdd-43f3-9f49-4170cf3ee572 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:07.381882 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1486/2960] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:12:07.921019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836756b1-6618-416b-9471-1b7de506442c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:08.141916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836756b1-6618-416b-9471-1b7de506442c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:08.155752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:08.157079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:08.157371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:08.158516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] PATH_INFO: `/v3/users/375872cad2074fbbae93c7c258339b37` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:08.162392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375872cad2074fbbae93c7c258339b37)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:08.168239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:08.349528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375872cad2074fbbae93c7c258339b37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:08.367791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375872cad2074fbbae93c7c258339b37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:08.404319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375872cad2074fbbae93c7c258339b37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:08.405109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375872cad2074fbbae93c7c258339b37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:08.426295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375872cad2074fbbae93c7c258339b37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:08.450411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:08.451696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:08.452168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:08.460136 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1475/2961] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:12:07 2022] DELETE /identity/v3/users/375872cad2074fbbae93c7c258339b37 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:08.492445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:08.496190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:08.553990 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:08.601042 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1487/2962] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:08.609980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:08.612136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:08.672819 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:08.746659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378772a-57db-4d6c-a83a-6e1090ca67a9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:08.755406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c74fa-ac15-4695-8c9d-76cb48b92b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:08.756467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c74fa-ac15-4695-8c9d-76cb48b92b0e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:08.756467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c74fa-ac15-4695-8c9d-76cb48b92b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:08.756684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c74fa-ac15-4695-8c9d-76cb48b92b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:08.777585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c74fa-ac15-4695-8c9d-76cb48b92b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:08.779044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c74fa-ac15-4695-8c9d-76cb48b92b0e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:08.800523 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1476/2963] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:09.850419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:09.852739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:09.883061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032059da-56de-4efe-891b-fd75b7867f1a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:09.895266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:09.895941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:09.896219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:09.898364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] PATH_INFO: `/v3/projects/18092524add04e5784fdf5083815c095` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:09.900057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18092524add04e5784fdf5083815c095)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:09.905684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:10.018312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18092524add04e5784fdf5083815c095', 'request_id': 'req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:10.040455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18092524add04e5784fdf5083815c095', 'request_id': 'req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:10.048866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18092524add04e5784fdf5083815c095', 'request_id': 'req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:10.050216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.051073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.051504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.079554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] The token cache is being invalidate because project 18092524add04e5784fdf5083815c095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:12:10.079848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:10.080514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2d7bd50-521a-4ac0-95f1-de7dd76c373e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:10.082344 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1488/2964] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:09 2022] DELETE /identity/v3/projects/18092524add04e5784fdf5083815c095 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:10.088118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8ef41-b8ee-43a9-a747-588abfebff28 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.088404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8ef41-b8ee-43a9-a747-588abfebff28 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.088684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8ef41-b8ee-43a9-a747-588abfebff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.122174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] MFA Rules not processed for user `1cfe4a3f6ee24a2086e35af2dc30ffe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:10.125217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:10.140827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-39b8ef41-b8ee-43a9-a747-588abfebff28 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:10.142066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-39b8ef41-b8ee-43a9-a747-588abfebff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:10.244011 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1477/2965] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:10.257869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:10.260103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:10.284188 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1489/2966] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:10.292252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed570c-0161-4865-907d-cd83e839de0d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.292727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed570c-0161-4865-907d-cd83e839de0d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.293120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed570c-0161-4865-907d-cd83e839de0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.325345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-75ed570c-0161-4865-907d-cd83e839de0d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:10.326753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-75ed570c-0161-4865-907d-cd83e839de0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:10.336813 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1490/2967] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:10.343188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed570c-0161-4865-907d-cd83e839de0d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:10.386965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed570c-0161-4865-907d-cd83e839de0d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:10.400075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:10.400732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.401026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.401279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.401955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:12:10.402672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:10.413831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:10.438992 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1491/2968] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:12:10.439978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:10.454583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b1a0b-459d-43c4-8f07-2c083351efd5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:10.473329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:10.476267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.476683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56216b6-1dbf-423c-8a2f-6df02956bb69 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:10.479322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.479609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.490818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:10.491729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.492340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.492812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.494473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:10.499461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:10.517773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:10.525415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:10.552375 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1492/2969] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:12:10 2022] POST /identity/v3/projects => generated 397 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:10.556960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:10.576647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1478/2970] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:10.608586 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:10.805738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe4ed-9d6b-4b7b-a524-559115057dfa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:10.819892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:10.820907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.823004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.823409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.824237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:10.840197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:10.917806 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1493/2971] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:12:10 2022] POST /identity/v3/users => generated 299 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:10.919519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:10.939251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb1f3-7ccd-42f1-9e36-6cd237a02beb service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:10.968524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:10.969182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:10.969820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:10.969820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:10.970361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:10.972230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:11.030453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:11.030872 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1479/2972] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:11.059100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8d6f8-d757-4a2c-b818-0d86a0af3320 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:11.072323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dc7af-63c7-4205-9cff-efc69f684923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:11.072993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dc7af-63c7-4205-9cff-efc69f684923 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:11.073278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dc7af-63c7-4205-9cff-efc69f684923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:11.073555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dc7af-63c7-4205-9cff-efc69f684923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:11.074392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dc7af-63c7-4205-9cff-efc69f684923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:11.076012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dc7af-63c7-4205-9cff-efc69f684923 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:11.095584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:11.104425 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1494/2973] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:12:11.109286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac03d5-cf10-4fee-a17f-0acdcb634e4d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:11.118181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:11.118871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:11.119152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:11.119427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] PATH_INFO: `/v3/projects/8c0caa335f1945d19fa908bb8eb4d5ef/users/1f54a9dab8d0485a9f052a115d4810d7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:11.164508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0caa335f1945d19fa908bb8eb4d5ef, user_id=1f54a9dab8d0485a9f052a115d4810d7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:11.168136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:11.211618 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1480/2974] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:11 2022] PUT /identity/v3/projects/8c0caa335f1945d19fa908bb8eb4d5ef/users/1f54a9dab8d0485a9f052a115d4810d7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:11.213054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:11.213575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:11.214061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:11.253670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:11.255386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:11.424857 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1495/2975] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:11.523235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:11.525379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:11.534978 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:11.679484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0169a6-7bcf-461a-8bac-75d311b341d7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:11.686605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:11.687034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:11.687439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:11.687789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:11.712998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:11.714690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:11.752178 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1481/2976] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:12.214822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:12.220666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:12.396925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1e782-048b-4a01-89ea-653edbe3b595 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:12.411152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:12.411802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:12.412083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:12.412358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:12.415383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:12.446338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:12.449646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:12.472491 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1496/2977] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:13.275787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:13.278901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:13.322387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eb034-1fe4-48b5-9650-60d432ddc32a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:13.338812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:13.339625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:13.340179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:13.341039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] PATH_INFO: `/v3/users/e8d05275c344461cb9bdef94c765de35` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:13.342953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d05275c344461cb9bdef94c765de35)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:13.348464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:13.450364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d05275c344461cb9bdef94c765de35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:13.466183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d05275c344461cb9bdef94c765de35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:13.503797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d05275c344461cb9bdef94c765de35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:13.513938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d05275c344461cb9bdef94c765de35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:13.530755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8416dc92-34b3-4692-b26a-fd714056cd4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d05275c344461cb9bdef94c765de35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:13.545931 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1482/2978] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:12:13 2022] DELETE /identity/v3/users/e8d05275c344461cb9bdef94c765de35 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:13.959673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:13.973857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881bb1-b5b3-468e-b93a-0e90e1eb4e3c service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:14.009673 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:14.088573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:14.089795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.090317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.090799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] PATH_INFO: `/v3/projects/3e58a6cdaef14d36a9afbaf330135478` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.092055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e58a6cdaef14d36a9afbaf330135478)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:14.094294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:14.178424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e58a6cdaef14d36a9afbaf330135478', 'request_id': 'req-78f1453e-8801-4882-99ee-70deb264f4d0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:14.189788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e58a6cdaef14d36a9afbaf330135478', 'request_id': 'req-78f1453e-8801-4882-99ee-70deb264f4d0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:14.205144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e58a6cdaef14d36a9afbaf330135478', 'request_id': 'req-78f1453e-8801-4882-99ee-70deb264f4d0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:14.226043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] The token cache is being invalidate because project 3e58a6cdaef14d36a9afbaf330135478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:12:14.226870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:14.227067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78f1453e-8801-4882-99ee-70deb264f4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:14.232130 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1497/2979] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:13 2022] DELETE /identity/v3/projects/3e58a6cdaef14d36a9afbaf330135478 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:14.240639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa6202-947c-46af-9eab-3e18e16c332d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.240957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa6202-947c-46af-9eab-3e18e16c332d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.241250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa6202-947c-46af-9eab-3e18e16c332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.296422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5ffa6202-947c-46af-9eab-3e18e16c332d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:14.297841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ffa6202-947c-46af-9eab-3e18e16c332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:14.441385 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1483/2980] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:14.449983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67219-fade-41f2-8399-63655ebbdb38 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.450264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67219-fade-41f2-8399-63655ebbdb38 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.450533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67219-fade-41f2-8399-63655ebbdb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.497263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5bd67219-fade-41f2-8399-63655ebbdb38 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:14.498822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5bd67219-fade-41f2-8399-63655ebbdb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:14.513619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1498/2981] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:14.514273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa6202-947c-46af-9eab-3e18e16c332d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:14.529419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa6202-947c-46af-9eab-3e18e16c332d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:14.538255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:14.539465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.540091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.543016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.544106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:12:14.544859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:14.547130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:14.563825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1484/2982] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:12:14.570440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67219-fade-41f2-8399-63655ebbdb38 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:14.594121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67219-fade-41f2-8399-63655ebbdb38 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:14.601660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:14.602306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.602587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.602859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.603501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:14.605590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:14.648937 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1499/2983] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:12:14 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:12:14.654176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:14.672088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e97f92-7ba4-4975-8340-fcab28d436da admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:14.677543 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:14.752580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:14.753378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.753757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.754250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.755055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:14.757528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:14.786062 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1485/2984] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:12:14 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:14.790209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:14.804170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190e5f-ec86-4c59-8dea-ea01a7cb0ae6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:14.829631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:14.831170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.831455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.834660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.836310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:14.838324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:14.854536 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1500/2985] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:12:14.858305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:14.870250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5bbbe-58f8-49e2-8a4d-c23474a14a83 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:14.875258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced99ff9-74b1-4c3b-a2d6-b04c517e0dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:14.875899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced99ff9-74b1-4c3b-a2d6-b04c517e0dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.876167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced99ff9-74b1-4c3b-a2d6-b04c517e0dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.876619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced99ff9-74b1-4c3b-a2d6-b04c517e0dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.877325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced99ff9-74b1-4c3b-a2d6-b04c517e0dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:14.879947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced99ff9-74b1-4c3b-a2d6-b04c517e0dc3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:14.894295 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1486/2986] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:14.899376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:14.912140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b03560-9549-49ed-9061-2cee4a09f125 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:14.920150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:14.921367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.921910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.922421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] PATH_INFO: `/v3/projects/503c042abb9448a393e983403fa0c1fe/users/25d98f9b858449a0af6ed328aa334600/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:14.946162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=503c042abb9448a393e983403fa0c1fe, user_id=25d98f9b858449a0af6ed328aa334600, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:14.949328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:14.975515 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1501/2987] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:14 2022] PUT /identity/v3/projects/503c042abb9448a393e983403fa0c1fe/users/25d98f9b858449a0af6ed328aa334600/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:14.978079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6804-8641-4fb8-868e-203a0173a0aa None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:14.978985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6804-8641-4fb8-868e-203a0173a0aa None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:14.979517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6804-8641-4fb8-868e-203a0173a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:15.012501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-530f6804-8641-4fb8-868e-203a0173a0aa None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:15.014369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-530f6804-8641-4fb8-868e-203a0173a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:15.148477 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1487/2988] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:15.165746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:15.167915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:15.261610 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:15.272581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d760600-0648-4273-8181-82b9efc6e99a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:15.277155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8a717-1ac5-4da7-93e3-37d0d1009450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:15.277785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8a717-1ac5-4da7-93e3-37d0d1009450 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:15.278061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8a717-1ac5-4da7-93e3-37d0d1009450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:15.278336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8a717-1ac5-4da7-93e3-37d0d1009450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:15.290863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8a717-1ac5-4da7-93e3-37d0d1009450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:15.292503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8a717-1ac5-4da7-93e3-37d0d1009450 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:15.305417 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1502/2989] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:15.843196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6804-8641-4fb8-868e-203a0173a0aa None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:15.860938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6804-8641-4fb8-868e-203a0173a0aa None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:15.867824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:15.869313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:15.870557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:15.871181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:15.874035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:15.890909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:15.893263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:15.941259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1488/2990] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:24.449933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:24.450463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:24.450463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:24.512636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] MFA Rules not processed for user `1f54a9dab8d0485a9f052a115d4810d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:24.515883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:24.648799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:24.656246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:24.698854 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1503/2991] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:24.714637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:24.720237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:24.783211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f19aa-4ca9-491b-9946-dad9d6c132dd service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:24.792564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac21b9-3978-41c6-afc0-f2867871fc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:24.793517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac21b9-3978-41c6-afc0-f2867871fc63 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:24.793981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac21b9-3978-41c6-afc0-f2867871fc63 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:24.794435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac21b9-3978-41c6-afc0-f2867871fc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:24.796476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bdac21b9-3978-41c6-afc0-f2867871fc63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:24.831155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac21b9-3978-41c6-afc0-f2867871fc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:24.833639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac21b9-3978-41c6-afc0-f2867871fc63 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:24.857489 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:24.865560 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1489/2992] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:12:24.968380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c503a7-29fc-4931-aa71-83473ea94359 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:24.986337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:24.986605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:24.986712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:24.987299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:25.025601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:25.029589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:25.076255 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1504/2993] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:29.335703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd713dd-0f98-4758-adab-9bd15846863d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:29.338932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd713dd-0f98-4758-adab-9bd15846863d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:29.340392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd713dd-0f98-4758-adab-9bd15846863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:29.397109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4bd713dd-0f98-4758-adab-9bd15846863d None None] MFA Rules not processed for user `25d98f9b858449a0af6ed328aa334600`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:29.398532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4bd713dd-0f98-4758-adab-9bd15846863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:29.575121 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1490/2994] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:29.581182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:29.606685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96220eae-aea2-498d-b3ed-79ebbbeb396c service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:29.614022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:29.615642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:29.616078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:29.616527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:29.617640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:29.619832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:29.667356 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1505/2995] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:12:29 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:29.671068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd713dd-0f98-4758-adab-9bd15846863d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:29.688720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd713dd-0f98-4758-adab-9bd15846863d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:29.817864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:29.818848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:29.819379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:29.819784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:29.820682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:29.823067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:29.854698 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1491/2996] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:12:29 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:29.859208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:29.889314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c997da-1187-4280-b075-8187ab96f806 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:29.913266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:29.914045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:29.914326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:29.914590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:29.915251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:29.916929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:29.959895 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1506/2997] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:29.961013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:29.974203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f442-4913-411a-84dd-e9a4807ee992 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:29.980578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:29.981483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:29.981866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:29.982247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] PATH_INFO: `/v3/projects/24fe69ac3ed846c896fa32c71e116208/users/757e7fda7bba4d379b96cfabdac2c4c3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:30.025964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fe69ac3ed846c896fa32c71e116208, user_id=757e7fda7bba4d379b96cfabdac2c4c3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:30.037197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:30.074566 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1492/2998] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:29 2022] PUT /identity/v3/projects/24fe69ac3ed846c896fa32c71e116208/users/757e7fda7bba4d379b96cfabdac2c4c3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:12:30.078768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:30.101378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14f9f-64d9-4cdf-a4cd-e3467485714e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:30.198863 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:30.274226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:30.276027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:30.286035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:30.286964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:30.287696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:30.289950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:30.290782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:30.293005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:30.299369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168452ba-a6f6-45bb-8deb-0631bbe287d9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:30.312325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:30.313286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:30.314857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:30.315366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] PATH_INFO: `/v3/users/1cfe4a3f6ee24a2086e35af2dc30ffe0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:30.320591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfe4a3f6ee24a2086e35af2dc30ffe0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:30.323317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:30.327512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1507/2999] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:12:30.328483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:30.354008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcd6e0-c858-429f-b408-744683268f31 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:30.366514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:30.370566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:30.371036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:30.371534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] PATH_INFO: `/v3/projects/24fe69ac3ed846c896fa32c71e116208/users/757e7fda7bba4d379b96cfabdac2c4c3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:30.376404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fe69ac3ed846c896fa32c71e116208, user_id=757e7fda7bba4d379b96cfabdac2c4c3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:30.383277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:30.426369 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1508/3000] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:30 2022] PUT /identity/v3/projects/24fe69ac3ed846c896fa32c71e116208/users/757e7fda7bba4d379b96cfabdac2c4c3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:30.457397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfe4a3f6ee24a2086e35af2dc30ffe0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:30.459323 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:30.471397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfe4a3f6ee24a2086e35af2dc30ffe0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:30.503520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfe4a3f6ee24a2086e35af2dc30ffe0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:30.504361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfe4a3f6ee24a2086e35af2dc30ffe0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:30.518650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2321b916-3eff-4ab0-8548-c3aca66553f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfe4a3f6ee24a2086e35af2dc30ffe0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:30.538157 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1493/3001] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:12:30 2022] DELETE /identity/v3/users/1cfe4a3f6ee24a2086e35af2dc30ffe0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:31.052126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:31.054030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:31.211168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9572-4215-40a0-bf62-909add5d0d61 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:31.335325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:31.336231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:31.336597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:31.336908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] PATH_INFO: `/v3/projects/5ef09c8f40204707a31a81da24b90085` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:31.338499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef09c8f40204707a31a81da24b90085)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:31.343661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:31.411223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef09c8f40204707a31a81da24b90085', 'request_id': 'req-c9cd17ea-ffe4-4768-849d-289939785481'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:31.428342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef09c8f40204707a31a81da24b90085', 'request_id': 'req-c9cd17ea-ffe4-4768-849d-289939785481'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:31.441974 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:31.444886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef09c8f40204707a31a81da24b90085', 'request_id': 'req-c9cd17ea-ffe4-4768-849d-289939785481'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:31.462458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] The token cache is being invalidate because project 5ef09c8f40204707a31a81da24b90085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:12:31.463049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:31.464224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9cd17ea-ffe4-4768-849d-289939785481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:31.466263 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1509/3002] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:31 2022] DELETE /identity/v3/projects/5ef09c8f40204707a31a81da24b90085 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:31.472226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535761-658d-4397-a420-fc5acd053536 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:31.473107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535761-658d-4397-a420-fc5acd053536 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:31.473780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535761-658d-4397-a420-fc5acd053536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:31.522829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bc535761-658d-4397-a420-fc5acd053536 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:31.526566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bc535761-658d-4397-a420-fc5acd053536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:31.622643 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1494/3003] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:31.630521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1de9db-8fcb-4d4a-87ae-d894e2442185 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:31.631394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1de9db-8fcb-4d4a-87ae-d894e2442185 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:31.631848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1de9db-8fcb-4d4a-87ae-d894e2442185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:31.697328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5d1de9db-8fcb-4d4a-87ae-d894e2442185 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:31.701805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5d1de9db-8fcb-4d4a-87ae-d894e2442185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:31.730837 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1510/3004] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:31.735515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc535761-658d-4397-a420-fc5acd053536 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:31.748381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc535761-658d-4397-a420-fc5acd053536 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:31.755717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:31.756787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:31.757399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:31.757833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:31.758832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:12:31.759628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:31.761704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:31.780099 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1495/3005] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:12:31.784464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1de9db-8fcb-4d4a-87ae-d894e2442185 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:31.795741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1de9db-8fcb-4d4a-87ae-d894e2442185 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:31.801916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:31.802601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:31.803434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:31.803722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:31.804618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:31.807396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:31.858836 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1511/3006] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:12:31 2022] POST /identity/v3/projects => generated 395 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:31.859430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:31.874534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c0131-4b67-4968-b0bb-b501c01f48f7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:32.045086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:32.051830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:32.051830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:32.053542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:32.054823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:32.061074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:32.099172 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1496/3007] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:12:31 2022] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:32.104150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:32.127447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a437-0ce6-4a3c-912b-dd2965d36c36 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:32.140577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:32.141245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:32.141615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:32.141770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:32.144517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:32.147225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:32.177683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:32.178759 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1512/3008] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:32.191382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867439b6-b510-4724-8d7a-131d8abb4e77 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:32.207208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba8cc3-7522-4ddb-a632-af305288a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:32.207894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8cc3-7522-4ddb-a632-af305288a9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:32.208173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8cc3-7522-4ddb-a632-af305288a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:32.208443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8cc3-7522-4ddb-a632-af305288a9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:32.209133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba8cc3-7522-4ddb-a632-af305288a9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:32.210845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba8cc3-7522-4ddb-a632-af305288a9d0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:32.224818 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1497/3009] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:12:32.227853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:32.257694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d5e40-3be4-4b9c-b000-3625b1fd4fc6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:32.265386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:32.267215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:32.267215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:32.267215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] PATH_INFO: `/v3/projects/83d569790af2403fb3d2e0025f021449/users/b5751bf986f7456cb5cee4644f5a3559/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:32.291125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d569790af2403fb3d2e0025f021449, user_id=b5751bf986f7456cb5cee4644f5a3559, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:32.299106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:32.338645 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1513/3010] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:32 2022] PUT /identity/v3/projects/83d569790af2403fb3d2e0025f021449/users/b5751bf986f7456cb5cee4644f5a3559/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:32.341114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:32.341397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:32.341711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:32.381778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] MFA Rules not processed for user `b5751bf986f7456cb5cee4644f5a3559`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:32.383628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:32.415162 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:32.542207 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1498/3011] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:32.555423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:32.557676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:32.764380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e54b8-d1ab-49c5-bbff-9efa4f862654 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:32.782396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:32.783131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:32.783475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:32.784946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:32.803184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:32.805106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:32.830042 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1514/3012] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:33.082916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:33.084194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:33.211604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:33.280926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6958599-0372-4788-8177-5a581b0a6629 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:33.292196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:33.294671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:33.296107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:33.296646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] PATH_INFO: `/v3/users/1f54a9dab8d0485a9f052a115d4810d7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:33.302612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f54a9dab8d0485a9f052a115d4810d7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:33.308278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:33.420461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac099f05-d1f7-4f40-a1b1-704b52729455 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:33.436221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:33.436787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:33.437241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:33.437788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] PATH_INFO: `/v3/users/b5751bf986f7456cb5cee4644f5a3559` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:33.439315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5751bf986f7456cb5cee4644f5a3559)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:33.445023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f54a9dab8d0485a9f052a115d4810d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.446697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:33.462517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f54a9dab8d0485a9f052a115d4810d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.490652 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:33.501973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f54a9dab8d0485a9f052a115d4810d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.504114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f54a9dab8d0485a9f052a115d4810d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.529977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bbe0d42f-6cc1-4495-8d34-08cbd7e9f654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f54a9dab8d0485a9f052a115d4810d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.550127 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1499/3013] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:12:33 2022] DELETE /identity/v3/users/1f54a9dab8d0485a9f052a115d4810d7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:33.595690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5751bf986f7456cb5cee4644f5a3559'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.611490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5751bf986f7456cb5cee4644f5a3559'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.612444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5751bf986f7456cb5cee4644f5a3559'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.632680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5751bf986f7456cb5cee4644f5a3559'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.634810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5751bf986f7456cb5cee4644f5a3559'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:33.733481 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1515/3014] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:12:33 2022] DELETE /identity/v3/users/b5751bf986f7456cb5cee4644f5a3559 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:12:33.738160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:33.738550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:33.738918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:33.785657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:33.787541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:33.902339 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:33.977624 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1500/3015] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:34.000380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.001926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:34.050440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.052351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:34.068600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dd7a8-a86d-4579-b179-8ab9bd79b0c3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:34.077421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:34.078248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.078627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.079045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] PATH_INFO: `/v3/projects/8c0caa335f1945d19fa908bb8eb4d5ef` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.081253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0caa335f1945d19fa908bb8eb4d5ef)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:34.083540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:34.170565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b459b-c6bc-48ac-9f7a-ee423ef94f4f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:34.171022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0caa335f1945d19fa908bb8eb4d5ef', 'request_id': 'req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:34.190868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0caa335f1945d19fa908bb8eb4d5ef', 'request_id': 'req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:34.199706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0caa335f1945d19fa908bb8eb4d5ef', 'request_id': 'req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:34.232497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] The token cache is being invalidate because project 8c0caa335f1945d19fa908bb8eb4d5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:12:34.234474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:34.238845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-29e01e7e-bccc-4be0-8c09-46959bb6ceb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:34.244806 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1501/3016] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:34 2022] DELETE /identity/v3/projects/8c0caa335f1945d19fa908bb8eb4d5ef => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:34.246403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1b3f5-aab9-4fe6-8ae7-646f41b8ad98 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.246794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1b3f5-aab9-4fe6-8ae7-646f41b8ad98 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.247647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1b3f5-aab9-4fe6-8ae7-646f41b8ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.263756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5220eb2-dfd5-403d-a270-0cb382d08cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:34.265044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5220eb2-dfd5-403d-a270-0cb382d08cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.265499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5220eb2-dfd5-403d-a270-0cb382d08cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.265932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5220eb2-dfd5-403d-a270-0cb382d08cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.272123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f5220eb2-dfd5-403d-a270-0cb382d08cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:34.274249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0bf1b3f5-aab9-4fe6-8ae7-646f41b8ad98 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:34.275730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0bf1b3f5-aab9-4fe6-8ae7-646f41b8ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:34.356879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5220eb2-dfd5-403d-a270-0cb382d08cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:34.360207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5220eb2-dfd5-403d-a270-0cb382d08cb3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:34.366564 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:34.384933 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1516/3017] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:34.408622 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1502/3018] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:34.418324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ba9d1-4990-4a8b-b010-51a66cc142c8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.418590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ba9d1-4990-4a8b-b010-51a66cc142c8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.418811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ba9d1-4990-4a8b-b010-51a66cc142c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.456413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f91ba9d1-4990-4a8b-b010-51a66cc142c8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:34.459057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f91ba9d1-4990-4a8b-b010-51a66cc142c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:34.470238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1517/3019] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:34.475194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1b3f5-aab9-4fe6-8ae7-646f41b8ad98 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.485744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1b3f5-aab9-4fe6-8ae7-646f41b8ad98 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:34.493106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:34.494011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.494516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.495031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.495914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:12:34.496433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:34.503943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:34.522627 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1503/3020] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:12:34.523286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ba9d1-4990-4a8b-b010-51a66cc142c8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.540454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ba9d1-4990-4a8b-b010-51a66cc142c8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:34.554898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:34.557581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.557896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.558173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.559273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:34.563112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:34.627256 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1518/3021] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:12:34 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:34.631356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.647579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515be92-4e63-4e59-a57a-c8fc692e14b8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:34.751643 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:34.776241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:34.777036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.777423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.777764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.778458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:34.781028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:34.834401 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1504/3022] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:12:34 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:12:34.838430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.859205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5c16-886d-43e0-bad1-f2e5fff56dcd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:34.869733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:34.870377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.872522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.872786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.875983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:34.878384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:34.892964 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1519/3023] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:34.898487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.910430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a681-fef1-44a6-aaf7-4dce7da9b068 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:34.933966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:34.934670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:34.935017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:34.935350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:34.937439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:34.939798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:34.974837 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1505/3024] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:34.980493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:34.995945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b55552-7ec5-4cd8-a5e8-bc92418d476e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:35.009677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebb064-a702-4180-a5de-67a21294309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:35.011145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebb064-a702-4180-a5de-67a21294309d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.012507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebb064-a702-4180-a5de-67a21294309d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.013823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebb064-a702-4180-a5de-67a21294309d admin admin] PATH_INFO: `/v3/projects/26ee54d7a3e84461b4e5aff422e87f5a/users/83fa03ac4589405e911fda3211620529/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.056408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebb064-a702-4180-a5de-67a21294309d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ee54d7a3e84461b4e5aff422e87f5a, user_id=83fa03ac4589405e911fda3211620529, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:35.091267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebb064-a702-4180-a5de-67a21294309d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:35.110321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:35.110574 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1520/3025] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:34 2022] PUT /identity/v3/projects/26ee54d7a3e84461b4e5aff422e87f5a/users/83fa03ac4589405e911fda3211620529/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:35.112886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:35.115523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.115822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.116102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.150253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:35.150888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a2171-d04c-4c4c-990e-e4d878e75839 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:35.151520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:35.284872 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1521/3026] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:35.297535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:35.299036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:35.309164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:35.309818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.310091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.310357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] PATH_INFO: `/v3/projects/83d569790af2403fb3d2e0025f021449` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.319495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d569790af2403fb3d2e0025f021449)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:35.322556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:35.392506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d569790af2403fb3d2e0025f021449', 'request_id': 'req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:35.399909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d569790af2403fb3d2e0025f021449', 'request_id': 'req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:35.407019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d569790af2403fb3d2e0025f021449', 'request_id': 'req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:35.410931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad069d-a4ee-4da3-8b58-df1045883f10 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:35.439249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] The token cache is being invalidate because project 83d569790af2403fb3d2e0025f021449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:12:35.440811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:35.443236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f15be1-ca83-483b-ac8f-6d4876f49ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:12:35.446915 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1506/3027] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:35 2022] DELETE /identity/v3/projects/83d569790af2403fb3d2e0025f021449 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:35.452749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b28b3-c916-4613-b86b-8578f30ce786 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.453241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b28b3-c916-4613-b86b-8578f30ce786 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.453560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b28b3-c916-4613-b86b-8578f30ce786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.506908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d91b28b3-c916-4613-b86b-8578f30ce786 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:35.508143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d91b28b3-c916-4613-b86b-8578f30ce786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:35.520348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:35.522115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.523134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.523517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.526367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:35.533031 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:35.608565 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:35.630110 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1507/3028] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:35.632282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea24f-ad26-4d53-bc4b-7cdf3707b973 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.632895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea24f-ad26-4d53-bc4b-7cdf3707b973 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.632895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea24f-ad26-4d53-bc4b-7cdf3707b973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.661854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-71dea24f-ad26-4d53-bc4b-7cdf3707b973 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:35.663393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-71dea24f-ad26-4d53-bc4b-7cdf3707b973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:35.678117 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1508/3029] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:35.679288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dea24f-ad26-4d53-bc4b-7cdf3707b973 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:35.694694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dea24f-ad26-4d53-bc4b-7cdf3707b973 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:35.700748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:35.701975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.702250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.702570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.703249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:12:35.703594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:35.705278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:35.715546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:35.717500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:35.725060 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1509/3030] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:12:35.729662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:35.739214 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1522/3031] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:12:35.750065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33cd21-20e5-4074-8fec-bc9a85d599de admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:35.756497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:35.757320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:35.757641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:35.757910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:35.758612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:35.761909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:35.808100 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1510/3032] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:12:35 2022] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:35.812708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:35.850383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8db2d-261c-4950-a0ac-66b3bbd9d2c9 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:36.017069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:36.018223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:36.018835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:36.019622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:36.020834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:36.024210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:36.076503 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1523/3033] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:12:35 2022] POST /identity/v3/users => generated 282 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:12:36.080345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:36.101174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00baf-cf09-4e96-909f-d92c68b46497 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:36.132010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:36.132795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:36.132987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:36.133223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:36.133949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:36.143345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:36.179596 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1511/3034] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:36.185535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:36.200599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63e36-0a5a-423f-aa0e-f4a9dcacdb6d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:36.231083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f69b9-3ba5-4184-ad3f-fcdb40f5228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:36.231969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f69b9-3ba5-4184-ad3f-fcdb40f5228e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:36.232456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f69b9-3ba5-4184-ad3f-fcdb40f5228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:36.232993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f69b9-3ba5-4184-ad3f-fcdb40f5228e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:36.233860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f69b9-3ba5-4184-ad3f-fcdb40f5228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:36.239914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f69b9-3ba5-4184-ad3f-fcdb40f5228e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:36.272815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1524/3035] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:12:36.274261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:36.299917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b46d2-18cd-490e-9272-dfe1cdc82e20 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:36.305082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:36.305926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:36.306295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:36.306788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] PATH_INFO: `/v3/projects/985e65b1266f46c196e8a07a9a016210/users/2a2ecc1a81574d7aa2679307a7985908/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:36.325915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985e65b1266f46c196e8a07a9a016210, user_id=2a2ecc1a81574d7aa2679307a7985908, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:36.329551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:36.361223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb1eb-ab9c-40ac-a1b8-30c934b5951a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:36.361725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb1eb-ab9c-40ac-a1b8-30c934b5951a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:36.362055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb1eb-ab9c-40ac-a1b8-30c934b5951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:36.365364 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1512/3036] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:12:36 2022] PUT /identity/v3/projects/985e65b1266f46c196e8a07a9a016210/users/2a2ecc1a81574d7aa2679307a7985908/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:36.397958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-236cb1eb-ab9c-40ac-a1b8-30c934b5951a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:36.399215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-236cb1eb-ab9c-40ac-a1b8-30c934b5951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:36.573208 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1525/3037] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:36.593773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:36.595908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:36.692242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756201e-a191-4389-93aa-d3e175b5c114 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:36.696566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:36.697544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:36.698068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:36.698435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:36.712321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:36.715270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:36.731500 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1513/3038] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:39.980074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b2643-4db3-40b1-bdb5-391daf8b44ba None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:39.980595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b2643-4db3-40b1-bdb5-391daf8b44ba None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:39.980819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b2643-4db3-40b1-bdb5-391daf8b44ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:40.051194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-893b2643-4db3-40b1-bdb5-391daf8b44ba None None] MFA Rules not processed for user `757e7fda7bba4d379b96cfabdac2c4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:40.052428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-893b2643-4db3-40b1-bdb5-391daf8b44ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:40.068108 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:40.187903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1526/3039] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:40.196686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:40.199929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:40.365354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb50e3-b228-4682-b62c-809b0380269e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:40.375726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157159d-9210-48cb-8ef7-c4b895c7b55f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:40.376578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157159d-9210-48cb-8ef7-c4b895c7b55f service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:40.377044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157159d-9210-48cb-8ef7-c4b895c7b55f service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:40.377566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157159d-9210-48cb-8ef7-c4b895c7b55f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:40.379816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c157159d-9210-48cb-8ef7-c4b895c7b55f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:40.422790 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:40.488733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157159d-9210-48cb-8ef7-c4b895c7b55f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:40.490632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157159d-9210-48cb-8ef7-c4b895c7b55f service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:40.506784 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1514/3040] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:12:46.983561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:46.984880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:46.985613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:47.094501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] MFA Rules not processed for user `2a2ecc1a81574d7aa2679307a7985908`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:47.097393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:47.370091 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1527/3041] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:47.383756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:47.384540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:47.384540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:47.427452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] MFA Rules not processed for user `2a2ecc1a81574d7aa2679307a7985908`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:47.431001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:47.461007 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1515/3042] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:47.467878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:47.469494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:47.626879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec61a7-510c-4cd5-b23c-74e83c4ac99d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:47.649645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144d7a-0b76-4a2c-9e1f-9bec3ffaafe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:47.650287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144d7a-0b76-4a2c-9e1f-9bec3ffaafe7 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:47.650561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144d7a-0b76-4a2c-9e1f-9bec3ffaafe7 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:47.650825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144d7a-0b76-4a2c-9e1f-9bec3ffaafe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:47.678573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56144d7a-0b76-4a2c-9e1f-9bec3ffaafe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:47.680214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56144d7a-0b76-4a2c-9e1f-9bec3ffaafe7 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:47.716651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1528/3043] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:49.152567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:49.154664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:49.177095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a32cc-e887-4e2d-8222-22ffb71e1edd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:49.192554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:49.193272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:49.193570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:49.193825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:49.199990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:49.233381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:49.235292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:49.256386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1516/3044] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:51.883657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c96a96-5260-48ce-bd46-3adabe7be8d7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:51.884185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c96a96-5260-48ce-bd46-3adabe7be8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:51.884463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c96a96-5260-48ce-bd46-3adabe7be8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:51.944532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-82c96a96-5260-48ce-bd46-3adabe7be8d7 None None] MFA Rules not processed for user `83fa03ac4589405e911fda3211620529`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:51.946171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-82c96a96-5260-48ce-bd46-3adabe7be8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:51.964319 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:52.141382 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1529/3045] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:52.149415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:52.160260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd4a75-71a0-48ab-be4d-4a45ea340d61 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:52.181579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:52.182749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:52.183209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:52.183686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:52.211570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:52.215789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:52.248081 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1517/3046] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:57.239670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:57.240247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:57.240399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:57.321195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] MFA Rules not processed for user `83fa03ac4589405e911fda3211620529`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:57.325436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:57.362932 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1530/3047] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:12:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:02.227211 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=33 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:07.261833 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=26 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:13.279779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:13.284199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:13.312897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119da47-9de6-492d-b64a-1f3f9c89b037 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:13.326566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:13.327346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:13.327718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:13.330115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:13.332839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:13.480995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:13.482827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:13.506983 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1518/3048] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:14.920963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:14.925009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:14.946792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:14.948208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:14.984689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0251dc-4871-412b-a3dd-0d02495823f0 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:15.003905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:15.004549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:15.005035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:15.005460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] PATH_INFO: `/v3/users/d1fa5fee71024c328a90d1724a048c7e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:15.008881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fa5fee71024c328a90d1724a048c7e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:15.010964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:15.167925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fa5fee71024c328a90d1724a048c7e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.170104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976ebac-309d-4465-8af0-ce0163824cb0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:15.176341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:15.177421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:15.177852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:15.178273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:15.187302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fa5fee71024c328a90d1724a048c7e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.189258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:15.216386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:15.218214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:15.221249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fa5fee71024c328a90d1724a048c7e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.222773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fa5fee71024c328a90d1724a048c7e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.241957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8af7886b-de91-4414-abca-acdf0736f099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fa5fee71024c328a90d1724a048c7e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.243797 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1531/3049] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:15.249584 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1519/3050] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:13:14 2022] DELETE /identity/v3/users/d1fa5fee71024c328a90d1724a048c7e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:13:15.568692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:15.587303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548e11a-d11f-4cd7-9ade-3774cb6f9905 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:15.666830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:15.670513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:15.671298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:15.671909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] PATH_INFO: `/v3/projects/13b4ddb93fac43868ba8972d2f753e47` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:15.674286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b4ddb93fac43868ba8972d2f753e47)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:15.677143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:15.745111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b4ddb93fac43868ba8972d2f753e47', 'request_id': 'req-690e7aad-000e-4bfb-86f8-94187381d0fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.756242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b4ddb93fac43868ba8972d2f753e47', 'request_id': 'req-690e7aad-000e-4bfb-86f8-94187381d0fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.765166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b4ddb93fac43868ba8972d2f753e47', 'request_id': 'req-690e7aad-000e-4bfb-86f8-94187381d0fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.781073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] The token cache is being invalidate because project 13b4ddb93fac43868ba8972d2f753e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:13:15.781473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.782777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-690e7aad-000e-4bfb-86f8-94187381d0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:15.784941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1532/3051] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:15 2022] DELETE /identity/v3/projects/13b4ddb93fac43868ba8972d2f753e47 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:15.789775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ca4ce-1c56-4e08-8d51-4c8b66f0e526 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:15.790006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ca4ce-1c56-4e08-8d51-4c8b66f0e526 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:15.790465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ca4ce-1c56-4e08-8d51-4c8b66f0e526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:15.828623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4a2ca4ce-1c56-4e08-8d51-4c8b66f0e526 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:15.830579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a2ca4ce-1c56-4e08-8d51-4c8b66f0e526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:15.937625 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1520/3052] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:15.939465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87bd06-c68a-4f31-8175-c322822d5528 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:15.939984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87bd06-c68a-4f31-8175-c322822d5528 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:15.940641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87bd06-c68a-4f31-8175-c322822d5528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.021944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5f87bd06-c68a-4f31-8175-c322822d5528 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:16.024190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5f87bd06-c68a-4f31-8175-c322822d5528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:16.054051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ca4ce-1c56-4e08-8d51-4c8b66f0e526 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:16.055035 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1533/3053] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:16.078088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ca4ce-1c56-4e08-8d51-4c8b66f0e526 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:16.110574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:16.111405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.111649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.112735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.116451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:13:16.116985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:16.119856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:16.145202 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:16.182447 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1521/3054] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:16.187108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87bd06-c68a-4f31-8175-c322822d5528 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:16.204130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87bd06-c68a-4f31-8175-c322822d5528 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:16.214189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:16.215108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.216817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.217271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.218077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:16.228921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:16.270809 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:16.309343 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1534/3055] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:13:16 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:13:16.313373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:16.327893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42867c-5c20-4240-9b44-be1ca12478b9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:16.420138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:16.420798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.421081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.421351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.421991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:16.424139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:16.475720 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1522/3056] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:13:16 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:13:16.481142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:16.498774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35ed82-6db3-406b-9058-eaad58b2294c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:16.511838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:16.512443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.512725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.513099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.514004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:16.516858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:16.543536 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1535/3057] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:13:16.547895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:16.560892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca979-2858-4f56-867e-11936905f9cf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:16.573657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880a164-5059-4be6-874a-0ad6f81ed9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:16.574332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880a164-5059-4be6-874a-0ad6f81ed9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.574663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880a164-5059-4be6-874a-0ad6f81ed9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.574943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880a164-5059-4be6-874a-0ad6f81ed9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.576277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880a164-5059-4be6-874a-0ad6f81ed9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:16.588915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880a164-5059-4be6-874a-0ad6f81ed9d7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:16.597019 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1523/3058] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:13:16.601106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:16.612567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c325-2096-45fd-b4d5-725854e24c14 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:16.617749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:16.618928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.619309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.619685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] PATH_INFO: `/v3/projects/6548e216312e4326a0efba388107207b/users/a04086173676446ab71da619f5826f97/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.644502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6548e216312e4326a0efba388107207b, user_id=a04086173676446ab71da619f5826f97, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:16.647411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:16.667001 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1536/3059] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:13:16 2022] PUT /identity/v3/projects/6548e216312e4326a0efba388107207b/users/a04086173676446ab71da619f5826f97/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:16.671797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.672081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.672357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.727971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:16.729182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:16.872893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1524/3060] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:16.884553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:16.887486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:16.976030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610da07-4095-4ff5-873a-fc4b217f597e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:16.982204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40913fbf-bc36-41fb-8de8-58aada69a10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:16.982833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40913fbf-bc36-41fb-8de8-58aada69a10d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:16.983265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40913fbf-bc36-41fb-8de8-58aada69a10d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:16.983537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40913fbf-bc36-41fb-8de8-58aada69a10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:16.998907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40913fbf-bc36-41fb-8de8-58aada69a10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:17.000916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40913fbf-bc36-41fb-8de8-58aada69a10d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:17.014347 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1537/3061] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:13:18.407737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:18.409809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:18.619611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1606afb-3f66-4914-a437-18af10836b5f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:18.627585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:18.629201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:18.629648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:18.630649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:18.633757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:18.652648 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:18.737907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:18.739800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:18.756386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1525/3062] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:20.534216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e09eb-86f0-47bf-b96a-54f0cefabde0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:20.534776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e09eb-86f0-47bf-b96a-54f0cefabde0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:20.534776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e09eb-86f0-47bf-b96a-54f0cefabde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:20.569975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-085e09eb-86f0-47bf-b96a-54f0cefabde0 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:20.571707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-085e09eb-86f0-47bf-b96a-54f0cefabde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:20.763185 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1538/3063] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:21.019044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:21.020580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:21.233551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290859f1-ce8b-4b3a-9f60-f0e8b9c4d73c service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:21.249821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8535a-64c5-4c6d-a3ea-495a3d789278 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:21.251844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8535a-64c5-4c6d-a3ea-495a3d789278 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:21.252264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8535a-64c5-4c6d-a3ea-495a3d789278 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:21.253898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8535a-64c5-4c6d-a3ea-495a3d789278 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:21.279938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8535a-64c5-4c6d-a3ea-495a3d789278 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:21.284962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8535a-64c5-4c6d-a3ea-495a3d789278 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:21.309718 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1526/3064] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:13:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:21.627836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d928052-cfe7-4c03-9b8a-6e32fe5ab4df None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:21.628368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d928052-cfe7-4c03-9b8a-6e32fe5ab4df None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:21.628368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d928052-cfe7-4c03-9b8a-6e32fe5ab4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:21.650389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8d928052-cfe7-4c03-9b8a-6e32fe5ab4df None None] MFA Rules not processed for user `547522b0b07f472a91ec83f15a36bb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:21.651687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8d928052-cfe7-4c03-9b8a-6e32fe5ab4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:21.664238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1539/3065] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:31.312597 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=53 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:31.643607 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:33.622173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456318-b845-4a26-944c-8d2b900758bf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:33.622744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456318-b845-4a26-944c-8d2b900758bf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:33.623307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456318-b845-4a26-944c-8d2b900758bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:33.663546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b3456318-b845-4a26-944c-8d2b900758bf None None] MFA Rules not processed for user `25d98f9b858449a0af6ed328aa334600`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:33.668800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b3456318-b845-4a26-944c-8d2b900758bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:33.855472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1527/3066] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:33.867920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec6964-d1eb-478e-b6ec-004b380486ba None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:33.868504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec6964-d1eb-478e-b6ec-004b380486ba None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:33.868861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec6964-d1eb-478e-b6ec-004b380486ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:33.937270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-19ec6964-d1eb-478e-b6ec-004b380486ba None None] MFA Rules not processed for user `25d98f9b858449a0af6ed328aa334600`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:33.940725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19ec6964-d1eb-478e-b6ec-004b380486ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:33.952481 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1540/3067] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:35.372200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:35.372649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:35.372743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:35.405440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] MFA Rules not processed for user `a04086173676446ab71da619f5826f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:35.407569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:35.499503 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1528/3068] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:35.502298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e03c9-7131-4df7-9c10-a3cfb36754a2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:35.503180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e03c9-7131-4df7-9c10-a3cfb36754a2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:35.503866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e03c9-7131-4df7-9c10-a3cfb36754a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:35.526079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-019e03c9-7131-4df7-9c10-a3cfb36754a2 None None] MFA Rules not processed for user `a04086173676446ab71da619f5826f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:35.528198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-019e03c9-7131-4df7-9c10-a3cfb36754a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:35.540672 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1541/3069] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:42.010942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:42.013060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:42.037384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deb809-fd95-49f7-9682-80a3ea6ea868 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:42.051432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:42.052109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:42.052382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:42.052660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] PATH_INFO: `/v3/users/72250431a7f44bff83c1881ff733f2de` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:42.055963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=72250431a7f44bff83c1881ff733f2de)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:42.059476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:42.162299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72250431a7f44bff83c1881ff733f2de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:42.173488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72250431a7f44bff83c1881ff733f2de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:42.194813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72250431a7f44bff83c1881ff733f2de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:42.195757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72250431a7f44bff83c1881ff733f2de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:42.206236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72250431a7f44bff83c1881ff733f2de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:42.216021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1529/3070] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:13:42 2022] DELETE /identity/v3/users/72250431a7f44bff83c1881ff733f2de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:42.220146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:42.220660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:42.221794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:42.259521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:42.260978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:42.311214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:42.317495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:42.330808 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:42.395029 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1542/3071] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:42.405322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:42.407552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:42.502657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ab18-ce13-416e-8cf6-d4a21a5cecbb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:42.510369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:42.511168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:42.511590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:42.512004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:42.514240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:42.550884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd3433-f776-47b4-b67e-87760004e721 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:42.555490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:42.556252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:42.556531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:42.556831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:42.580204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:42.581793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:42.598724 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1543/3072] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:42.641670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:42.643287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:42.666642 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1530/3073] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:42.870079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:42.871624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:42.897346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1db10-6a39-4892-8122-66f0909e4d00 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:42.914167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:42.914167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:42.914167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:42.914167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] PATH_INFO: `/v3/projects/f8905ebcf94b46da8aad6632c78b4881` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:42.915326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8905ebcf94b46da8aad6632c78b4881)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:42.917326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:43.006985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8905ebcf94b46da8aad6632c78b4881', 'request_id': 'req-612c2173-5c3f-495a-8de9-7057acc26a24'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.029274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8905ebcf94b46da8aad6632c78b4881', 'request_id': 'req-612c2173-5c3f-495a-8de9-7057acc26a24'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.035799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:43.036300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8905ebcf94b46da8aad6632c78b4881', 'request_id': 'req-612c2173-5c3f-495a-8de9-7057acc26a24'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.047871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84723fe9-2d71-42c0-94ef-269300357a7a service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:43.056235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] The token cache is being invalidate because project f8905ebcf94b46da8aad6632c78b4881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:13:43.056524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.057428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.063775 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1544/3074] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:42 2022] DELETE /identity/v3/projects/f8905ebcf94b46da8aad6632c78b4881 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:43.065131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:43.066525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:43.087425 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:43.149933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c2173-5c3f-495a-8de9-7057acc26a24 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:43.155026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:43.156899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:43.157489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:43.157944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] PATH_INFO: `/v3/users/b35f092e6bfa489c910de20007267a75` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:43.159374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35f092e6bfa489c910de20007267a75)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:43.161542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:43.178679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:43.179616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:43.179968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:43.180399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:43.183592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:43.199090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:43.200885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:43.220114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35f092e6bfa489c910de20007267a75'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.229220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1531/3075] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:43.230811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35f092e6bfa489c910de20007267a75'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.231819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35f092e6bfa489c910de20007267a75'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.240128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35f092e6bfa489c910de20007267a75'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.241073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c059ad23-c23b-4420-b7b7-8c924bdb57fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35f092e6bfa489c910de20007267a75'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.265811 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1545/3076] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:13:43 2022] DELETE /identity/v3/users/b35f092e6bfa489c910de20007267a75 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:43.700911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:43.729916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683593d9-0bf0-42da-b3bf-d68cfc9d4332 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:43.837364 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:43.862767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:43.864224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:43.864690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:43.865181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] PATH_INFO: `/v3/projects/c27f9d1ac44947208d478968f0ced360` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:43.867958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27f9d1ac44947208d478968f0ced360)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:43.870092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:43.971728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27f9d1ac44947208d478968f0ced360', 'request_id': 'req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:43.996042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27f9d1ac44947208d478968f0ced360', 'request_id': 'req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:44.002735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27f9d1ac44947208d478968f0ced360', 'request_id': 'req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:44.020058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] The token cache is being invalidate because project c27f9d1ac44947208d478968f0ced360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:13:44.020816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:44.021721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f21890c-ea77-41ee-8ac5-8cb015c1ba98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:44.024894 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1532/3077] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:43 2022] DELETE /identity/v3/projects/c27f9d1ac44947208d478968f0ced360 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:44.029827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85816-4ca9-46ec-b4ac-aee11358977c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.030138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85816-4ca9-46ec-b4ac-aee11358977c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.030413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85816-4ca9-46ec-b4ac-aee11358977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.061125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-71c85816-4ca9-46ec-b4ac-aee11358977c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:44.062710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-71c85816-4ca9-46ec-b4ac-aee11358977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:44.163608 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1546/3078] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:44.166129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24742-33e2-4fd1-9193-a637bff9413e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.167168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24742-33e2-4fd1-9193-a637bff9413e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.167755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24742-33e2-4fd1-9193-a637bff9413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.204854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8fb24742-33e2-4fd1-9193-a637bff9413e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:44.206100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8fb24742-33e2-4fd1-9193-a637bff9413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:44.226283 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1533/3079] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:44.227188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85816-4ca9-46ec-b4ac-aee11358977c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:44.238098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85816-4ca9-46ec-b4ac-aee11358977c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:44.243610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:44.244439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.244919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.245373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.246376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:13:44.246991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:44.248910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:44.268266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb24742-33e2-4fd1-9193-a637bff9413e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:44.279069 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1547/3080] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:44.280301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb24742-33e2-4fd1-9193-a637bff9413e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:44.286228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:44.287145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.287593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.288035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.288947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:44.291168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:44.330251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1534/3081] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:13:44 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:13:44.335033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:44.350123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fe0c4-3d7c-4888-b23f-f75cf894faac admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:44.383725 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:44.480915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:44.482285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.482827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.484158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.484935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:44.487142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:44.517488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:44.528744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083def-919d-4887-9db2-79d1ea8c6f4a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:44.529719 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1548/3082] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:13:44 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:13:44.534227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:44.534927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.535291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.535646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.536336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:44.538077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:44.558020 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1535/3083] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:13:44.558200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:44.580940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1a124-04d4-4354-9445-e4606a0fac69 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:44.590083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425d43-410e-4d30-b3df-c1538e5fd59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:44.590763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425d43-410e-4d30-b3df-c1538e5fd59d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.590992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425d43-410e-4d30-b3df-c1538e5fd59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.591320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425d43-410e-4d30-b3df-c1538e5fd59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.591903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425d43-410e-4d30-b3df-c1538e5fd59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:44.594237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425d43-410e-4d30-b3df-c1538e5fd59d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:44.627830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:44.630386 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1549/3084] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:13:44.643622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68535a-f704-4b09-9177-ead34c44cf0f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:44.663163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:44.664082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.664517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.664981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c/users/f8cd2a7facca4461a9802262a222a164/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.697566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7365174bf8e492a870365b0a2b3c63c, user_id=f8cd2a7facca4461a9802262a222a164, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:44.700586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:44.729972 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1536/3085] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:13:44 2022] PUT /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c/users/f8cd2a7facca4461a9802262a222a164/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:13:44.733296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491467-9441-4e49-b67f-f21e15b39df8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.733897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491467-9441-4e49-b67f-f21e15b39df8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.735887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491467-9441-4e49-b67f-f21e15b39df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.771788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-50491467-9441-4e49-b67f-f21e15b39df8 None None] MFA Rules not processed for user `f8cd2a7facca4461a9802262a222a164`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:44.773333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-50491467-9441-4e49-b67f-f21e15b39df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:44.869048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1550/3086] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:44.873232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:44.962015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2a608-f026-4247-b601-46b5be96deaa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:44.974764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:44.975874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:44.976241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:44.976600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:44.977439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:44.979675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:45.005894 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:45.021776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50491467-9441-4e49-b67f-f21e15b39df8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:45.028545 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1537/3087] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:13:44 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:13:45.061619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50491467-9441-4e49-b67f-f21e15b39df8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:45.282180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0620db-f1fc-4a20-940b-9cf5a17a9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:45.283758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0620db-f1fc-4a20-940b-9cf5a17a9170 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.284436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0620db-f1fc-4a20-940b-9cf5a17a9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.284436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0620db-f1fc-4a20-940b-9cf5a17a9170 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.286384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0620db-f1fc-4a20-940b-9cf5a17a9170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:45.292653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0620db-f1fc-4a20-940b-9cf5a17a9170 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:45.336725 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1551/3088] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:13:45 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:13:45.337968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:45.354629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.354995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.355339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.367735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024fdac-632a-49dd-b481-3446ad0be4f6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:45.375654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:45.376619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.377322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.377917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.378934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:45.379863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:45.381276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:45.381761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:45.399260 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:45.399762 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1538/3089] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:13:45.405442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:45.430688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6a43a-305c-45a0-bc2f-39fe8c147bf7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:45.439416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:45.440207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.440597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.440986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] PATH_INFO: `/v3/projects/efcc62c5219449e988cb84e0941c06ed/users/f04672e5fc5a4473b95b24abcfc99c93/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.462245 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1552/3090] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:45.464932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc62c5219449e988cb84e0941c06ed, user_id=f04672e5fc5a4473b95b24abcfc99c93, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:45.469098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:45.477637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:45.479958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:45.489445 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1539/3091] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:13:45 2022] PUT /identity/v3/projects/efcc62c5219449e988cb84e0941c06ed/users/f04672e5fc5a4473b95b24abcfc99c93/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:45.493066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:45.565765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1addb96-4239-44e8-af6c-9281a92e5db6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:45.571257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:45.572080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.572459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.572962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.573770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:45.576599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:45.592389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cdd1b-6a67-44f8-b02d-321b346ef676 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:45.593708 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1540/3092] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:13:45.595952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:45.615072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c436f9-75bc-4956-a551-8708fb52ae74 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:45.621302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b287da-2167-4290-9bd3-68f3f1ec30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:45.621566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b287da-2167-4290-9bd3-68f3f1ec30d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.621836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b287da-2167-4290-9bd3-68f3f1ec30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.622110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b287da-2167-4290-9bd3-68f3f1ec30d0 admin admin] PATH_INFO: `/v3/projects/efcc62c5219449e988cb84e0941c06ed/users/f04672e5fc5a4473b95b24abcfc99c93/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.624255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b287da-2167-4290-9bd3-68f3f1ec30d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc62c5219449e988cb84e0941c06ed, user_id=f04672e5fc5a4473b95b24abcfc99c93, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:45.627700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b287da-2167-4290-9bd3-68f3f1ec30d0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:45.641086 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1541/3093] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:13:45 2022] PUT /identity/v3/projects/efcc62c5219449e988cb84e0941c06ed/users/f04672e5fc5a4473b95b24abcfc99c93/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:45.652590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.652891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.653174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.687620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] MFA Rules not processed for user `f04672e5fc5a4473b95b24abcfc99c93`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:45.689283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:45.710117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08694d-0d60-4651-aa70-264c979d2755 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:45.711872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08694d-0d60-4651-aa70-264c979d2755 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:45.712949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08694d-0d60-4651-aa70-264c979d2755 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:45.713456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08694d-0d60-4651-aa70-264c979d2755 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:45.793745 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1542/3094] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:45.801311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08694d-0d60-4651-aa70-264c979d2755 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:45.803338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08694d-0d60-4651-aa70-264c979d2755 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:45.813632 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1553/3095] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:13:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:47.156395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:47.158018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:47.208811 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:47.284482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5dfc-acfb-4b62-b377-489c17779bfa None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:47.294168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624914-d382-4117-9482-90b852179d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:47.294874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624914-d382-4117-9482-90b852179d85 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:47.295279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624914-d382-4117-9482-90b852179d85 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:47.295696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624914-d382-4117-9482-90b852179d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:47.306418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624914-d382-4117-9482-90b852179d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:47.308801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624914-d382-4117-9482-90b852179d85 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:47.322808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1543/3096] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:47.353677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b33588-3b88-4f4e-a4a2-426c030e896a None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:47.354553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b33588-3b88-4f4e-a4a2-426c030e896a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:47.354991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b33588-3b88-4f4e-a4a2-426c030e896a None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:47.356519 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1554/3097] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:47.386600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624914-d382-4117-9482-90b852179d85 service nova] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:47.433912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624914-d382-4117-9482-90b852179d85 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:47.460048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624914-d382-4117-9482-90b852179d85 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:47.473053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ca1cc-7a27-4018-be69-7d6949f65236 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:47.477846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ca1cc-7a27-4018-be69-7d6949f65236 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:47.478254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ca1cc-7a27-4018-be69-7d6949f65236 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:47.478411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ca1cc-7a27-4018-be69-7d6949f65236 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:47.479674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ca1cc-7a27-4018-be69-7d6949f65236 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:47.481751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ca1cc-7a27-4018-be69-7d6949f65236 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:47.489490 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1544/3098] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:47 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:47.915238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5da6f-6ced-4dbb-a3d5-a50613bb9dcb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:47.915238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5da6f-6ced-4dbb-a3d5-a50613bb9dcb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:47.915594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5da6f-6ced-4dbb-a3d5-a50613bb9dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:47.943868 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:47.956925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-68b5da6f-6ced-4dbb-a3d5-a50613bb9dcb None None] MFA Rules not processed for user `2a2ecc1a81574d7aa2679307a7985908`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:47.961595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68b5da6f-6ced-4dbb-a3d5-a50613bb9dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:48.030484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec95247-1723-47ae-8689-d7811da9a1ed None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:48.031338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec95247-1723-47ae-8689-d7811da9a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:48.031971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec95247-1723-47ae-8689-d7811da9a1ed None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:48.033919 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1545/3099] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:48.040619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec95247-1723-47ae-8689-d7811da9a1ed None None] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:48.043251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0ec95247-1723-47ae-8689-d7811da9a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:48.091544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec95247-1723-47ae-8689-d7811da9a1ed None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:48.112632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec95247-1723-47ae-8689-d7811da9a1ed None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:48.122847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa0e9e-fd12-4439-b447-7e8cdf75a608 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:48.123627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0e9e-fd12-4439-b447-7e8cdf75a608 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:48.124629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0e9e-fd12-4439-b447-7e8cdf75a608 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:48.130557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0e9e-fd12-4439-b447-7e8cdf75a608 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:48.130557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa0e9e-fd12-4439-b447-7e8cdf75a608 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:48.130557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa0e9e-fd12-4439-b447-7e8cdf75a608 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:48.132316 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1546/3100] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:48 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:48.149153 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1555/3101] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:48.270658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772dfaa-a419-4235-8462-c9ce0ddb4da2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:48.271218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772dfaa-a419-4235-8462-c9ce0ddb4da2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:48.271218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772dfaa-a419-4235-8462-c9ce0ddb4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:48.330821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6772dfaa-a419-4235-8462-c9ce0ddb4da2 None None] MFA Rules not processed for user `f8cd2a7facca4461a9802262a222a164`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:48.334587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6772dfaa-a419-4235-8462-c9ce0ddb4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:48.537893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1547/3102] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:48.660724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5da6f-6ced-4dbb-a3d5-a50613bb9dcb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:48.679241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5da6f-6ced-4dbb-a3d5-a50613bb9dcb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:48.685625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:48.686525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:48.687710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:48.688209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:48.698157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:48.701597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:48.734841 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1556/3103] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:50.475873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c18a7-acac-4bce-a8ac-64c005d1013a None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:50.476858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c18a7-acac-4bce-a8ac-64c005d1013a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:50.477310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c18a7-acac-4bce-a8ac-64c005d1013a None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:50.479005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1548/3104] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:50.485604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:50.525229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:50.552255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029936bf-c008-47f1-b25c-591bc34e436f service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:50.563845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:50.564495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:50.564791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:50.565057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:50.570673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:50.572726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:50.579801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1557/3105] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:50 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:51.350503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bc76-a260-469a-94b7-4c789b9edced None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:51.350954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bc76-a260-469a-94b7-4c789b9edced None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:51.351116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bc76-a260-469a-94b7-4c789b9edced None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:51.352632 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1549/3106] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:51.359413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:51.374463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:51.385988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edd4d-f99a-42ab-84eb-73b31e8045f9 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:51.390756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:51.391386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:51.391662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:51.391927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:51.393061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:51.395212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:51.397011 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1558/3107] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:51 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:51.438966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76355-64ee-4fbc-97b0-b42114fbbde9 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:51.439738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76355-64ee-4fbc-97b0-b42114fbbde9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:51.440202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76355-64ee-4fbc-97b0-b42114fbbde9 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:51.442948 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1550/3108] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:51.447961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:51.462373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:51.474186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd6dc-f397-4265-9f74-de84f85da350 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:51.481220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a21b60-9f5e-4627-9b7e-1d160e1fd821 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:51.482115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a21b60-9f5e-4627-9b7e-1d160e1fd821 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:51.482394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a21b60-9f5e-4627-9b7e-1d160e1fd821 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:51.482660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a21b60-9f5e-4627-9b7e-1d160e1fd821 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:51.484050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a21b60-9f5e-4627-9b7e-1d160e1fd821 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:51.486612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a21b60-9f5e-4627-9b7e-1d160e1fd821 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:51.488687 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1559/3109] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:51 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:13:51.571623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:51.572098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:51.572228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:51.599346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] MFA Rules not processed for user `f8cd2a7facca4461a9802262a222a164`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:51.601628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:51.610608 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1551/3110] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:52.885526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac31f-91e6-498a-9ce0-6e8bde63a1ea None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:52.886638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac31f-91e6-498a-9ce0-6e8bde63a1ea None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:52.887154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac31f-91e6-498a-9ce0-6e8bde63a1ea None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:52.889165 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1560/3111] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:52.895178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:52.912660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:52.927461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093f476-0371-457d-b28a-4eb05d07d93f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:52.932829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:52.933468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:52.935936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:52.936303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:52.938044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:52.940517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:52.942547 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1552/3112] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:52 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:53.931457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1dab-7f87-4625-998f-9123ad1aafce None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:53.932349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1dab-7f87-4625-998f-9123ad1aafce None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:53.932872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1dab-7f87-4625-998f-9123ad1aafce None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:53.935160 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1561/3113] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:53.943616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:53.967773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:53.981913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4c626-1e65-48dc-bb1d-02cacc0c7018 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:53.987856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:53.988829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:53.989271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:53.989702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:53.991233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:53.993722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:54.003343 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1553/3114] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:53 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:54.117309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ea50-94d2-4968-b35d-d18afdec0b5b None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:54.117759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ea50-94d2-4968-b35d-d18afdec0b5b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:54.118130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ea50-94d2-4968-b35d-d18afdec0b5b None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:54.119548 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1562/3115] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:54.132262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:54.186212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:54.202543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bc4c0-f781-4b62-8358-55401358be43 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:54.217612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67b51f-b938-4176-b06e-96d0d10f6cab tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:54.218317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b51f-b938-4176-b06e-96d0d10f6cab tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:54.218601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b51f-b938-4176-b06e-96d0d10f6cab tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:54.218870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b51f-b938-4176-b06e-96d0d10f6cab tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:54.220237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67b51f-b938-4176-b06e-96d0d10f6cab tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:54.222607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67b51f-b938-4176-b06e-96d0d10f6cab tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:54.230145 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1554/3116] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:54 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:54.426374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:54.427697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:54.428652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:54.473313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] MFA Rules not processed for user `f8cd2a7facca4461a9802262a222a164`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:54.476872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:54.488752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1563/3117] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:55.939977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07d88-5519-40e2-abfc-1c2177a1d4a4 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:55.942104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07d88-5519-40e2-abfc-1c2177a1d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:55.942983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07d88-5519-40e2-abfc-1c2177a1d4a4 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:55.945882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1555/3118] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:13:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:13:55.953239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:13:55.968264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:55.982244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a9925-7627-46fd-a980-46a1eb56ed97 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:55.988626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fddeee-820f-4a83-ad64-2400ad00146e tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f04672e5fc5a4473b95b24abcfc99c93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efcc62c5219449e988cb84e0941c06ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:55.989611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddeee-820f-4a83-ad64-2400ad00146e tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:55.990091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddeee-820f-4a83-ad64-2400ad00146e tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:55.990554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fddeee-820f-4a83-ad64-2400ad00146e tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:55.991983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fddeee-820f-4a83-ad64-2400ad00146e tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:55.994495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fddeee-820f-4a83-ad64-2400ad00146e tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:56.010270 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1564/3119] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:13:55 2022] GET /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 381 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:13:56.709370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07d88-5519-40e2-abfc-1c2177a1d4a4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:56.903927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07d88-5519-40e2-abfc-1c2177a1d4a4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:56.912117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:56.913015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:56.914527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:56.914942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] PATH_INFO: `/v3/users/f8cd2a7facca4461a9802262a222a164` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:56.918237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cd2a7facca4461a9802262a222a164)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:56.930716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:56.982290 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:57.062278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cd2a7facca4461a9802262a222a164'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:57.080100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cd2a7facca4461a9802262a222a164'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:57.103494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cd2a7facca4461a9802262a222a164'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:57.104586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cd2a7facca4461a9802262a222a164'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:57.112865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cd2a7facca4461a9802262a222a164'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:57.120077 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1556/3120] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:13:56 2022] DELETE /identity/v3/users/f8cd2a7facca4461a9802262a222a164 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:57.133394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:57.143694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:57.145014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:57.185792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:57.189117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:57.319575 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1565/3121] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:57.336658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:57.338160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:57.466622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140352f-bf84-4380-8059-a5f4a3215e40 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:57.476251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:57.477350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:57.478195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:57.478696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:57.490326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:57.492248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:57.521401 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1557/3122] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:13:58.726121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:58.727601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:58.746950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f22203-32be-4ac6-a549-84f1e79e3f9d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:58.763130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:58.764011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:58.764353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:58.764693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] PATH_INFO: `/v3/projects/f7365174bf8e492a870365b0a2b3c63c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:58.766008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7365174bf8e492a870365b0a2b3c63c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:58.768148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:58.874032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7365174bf8e492a870365b0a2b3c63c', 'request_id': 'req-85a9f4d3-14f9-4468-a153-7bf73709164e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:58.882385 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:58.896113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7365174bf8e492a870365b0a2b3c63c', 'request_id': 'req-85a9f4d3-14f9-4468-a153-7bf73709164e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:58.918289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7365174bf8e492a870365b0a2b3c63c', 'request_id': 'req-85a9f4d3-14f9-4468-a153-7bf73709164e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:58.932202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] The token cache is being invalidate because project f7365174bf8e492a870365b0a2b3c63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:13:58.932495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:58.936219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:58.940630 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1566/3123] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:58 2022] DELETE /identity/v3/projects/f7365174bf8e492a870365b0a2b3c63c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:13:58.945072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:13:58.959074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22368e5-5599-4119-b73d-192ee9bd5924 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:13:59.037949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:13:59.038761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:59.039128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:59.040183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] PATH_INFO: `/v3/users/f04672e5fc5a4473b95b24abcfc99c93` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:59.041486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04672e5fc5a4473b95b24abcfc99c93)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:13:59.043781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:13:59.103710 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:59.119830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04672e5fc5a4473b95b24abcfc99c93'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:59.138292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04672e5fc5a4473b95b24abcfc99c93'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:59.166518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04672e5fc5a4473b95b24abcfc99c93'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:59.167556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04672e5fc5a4473b95b24abcfc99c93'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:59.178010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6ae4376-e598-4776-adc7-9a73b85435b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04672e5fc5a4473b95b24abcfc99c93'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:13:59.192334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1558/3124] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:13:58 2022] DELETE /identity/v3/users/f04672e5fc5a4473b95b24abcfc99c93 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:00.754550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:00.755578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:00.790301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9f4d3-14f9-4468-a153-7bf73709164e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:00.889928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:00.891925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:00.892307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:00.892692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] PATH_INFO: `/v3/projects/efcc62c5219449e988cb84e0941c06ed` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:00.897132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcc62c5219449e988cb84e0941c06ed)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:00.899627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:00.991395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcc62c5219449e988cb84e0941c06ed', 'request_id': 'req-d3564237-3389-46fb-9abe-dc34ad56bb09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:01.003206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcc62c5219449e988cb84e0941c06ed', 'request_id': 'req-d3564237-3389-46fb-9abe-dc34ad56bb09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:01.019174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcc62c5219449e988cb84e0941c06ed', 'request_id': 'req-d3564237-3389-46fb-9abe-dc34ad56bb09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:01.052337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] The token cache is being invalidate because project efcc62c5219449e988cb84e0941c06ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:01.052792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:01.054524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d3564237-3389-46fb-9abe-dc34ad56bb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:01.064805 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1567/3125] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:00 2022] DELETE /identity/v3/projects/efcc62c5219449e988cb84e0941c06ed => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:01.066270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7610-d5bd-4d03-b7a4-439fe320a417 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.066751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7610-d5bd-4d03-b7a4-439fe320a417 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.066869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7610-d5bd-4d03-b7a4-439fe320a417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.104535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-011c7610-d5bd-4d03-b7a4-439fe320a417 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:01.105817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-011c7610-d5bd-4d03-b7a4-439fe320a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:01.240994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1559/3126] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:01.249005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28997-229d-459b-839e-487994d4a140 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.249655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28997-229d-459b-839e-487994d4a140 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.250146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28997-229d-459b-839e-487994d4a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.290009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0eb28997-229d-459b-839e-487994d4a140 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:01.291623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0eb28997-229d-459b-839e-487994d4a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:01.316022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1568/3127] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:01.319200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7610-d5bd-4d03-b7a4-439fe320a417 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:01.334562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7610-d5bd-4d03-b7a4-439fe320a417 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:01.349566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:01.350492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.351002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.351603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.354746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:01.355516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:01.361303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:01.381726 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1560/3128] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:01.385772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28997-229d-459b-839e-487994d4a140 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:01.398739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28997-229d-459b-839e-487994d4a140 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:01.404556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:01.406513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.406897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.407280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.408016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:01.411643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:01.460984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1569/3129] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:01 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:01.465062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:01.481279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3241ed-34b8-4bf9-b7fa-ea830c64973e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:01.618988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:01.621227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.621870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.622528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.623572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:01.629973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:01.685534 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1561/3130] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:01 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:01.690532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:01.706792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac4eac-2d74-4066-b72b-1cb3a81a7f64 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:01.720356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:01.722074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.725242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.725721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.727375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:01.733755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:01.761422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:01.770812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1570/3131] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:01.777854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d20a5-49f1-41dc-8835-071a0d7f4ec1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:01.790916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b72afd-8edc-4ba0-9cf3-750650fc1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:01.791517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72afd-8edc-4ba0-9cf3-750650fc1294 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.791983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72afd-8edc-4ba0-9cf3-750650fc1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.792804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72afd-8edc-4ba0-9cf3-750650fc1294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.793864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b72afd-8edc-4ba0-9cf3-750650fc1294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:01.796044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b72afd-8edc-4ba0-9cf3-750650fc1294 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:01.810915 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1562/3132] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:01.815527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:01.829059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8d2b2-a7fb-4859-b947-3c43ae6077d9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:01.844708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:01.845801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.846278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.846768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] PATH_INFO: `/v3/projects/ea44c8aef10a42baa07af099eb12c6fb/users/8723e9730a1b499a8027c6641a4f2446/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.868809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea44c8aef10a42baa07af099eb12c6fb, user_id=8723e9730a1b499a8027c6641a4f2446, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:01.872297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:01.894436 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1571/3133] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:01 2022] PUT /identity/v3/projects/ea44c8aef10a42baa07af099eb12c6fb/users/8723e9730a1b499a8027c6641a4f2446/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:01.902530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14c741-e07c-4a2e-abad-5062b14eebc0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:01.902830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14c741-e07c-4a2e-abad-5062b14eebc0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:01.903091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14c741-e07c-4a2e-abad-5062b14eebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:01.984050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6c14c741-e07c-4a2e-abad-5062b14eebc0 None None] MFA Rules not processed for user `8723e9730a1b499a8027c6641a4f2446`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:01.985544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6c14c741-e07c-4a2e-abad-5062b14eebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:02.002303 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:02.156891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1563/3134] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:02.161528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:02.197567 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:02.394330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17555dce-2e97-419b-b38b-8605310d5b77 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:02.410129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:02.415015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:02.417171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:02.418063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:02.421527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:02.425203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:02.501209 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1572/3135] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:02 2022] POST /identity/v3/projects => generated 379 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:02.504408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14c741-e07c-4a2e-abad-5062b14eebc0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:02.526088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14c741-e07c-4a2e-abad-5062b14eebc0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:02.686963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:02.687667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:02.688304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:02.688948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:02.690208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:02.692250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:02.774709 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1564/3136] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:02 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:02.777561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:02.798575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182254-3bc1-4469-868a-d1a90a47108a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:02.814259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:02.815204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:02.815639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:02.816376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:02.817211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:02.819668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:02.852644 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1573/3137] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:02.856460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:02.869762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9b914-127c-4db0-9e36-073fa11089cb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:02.885328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:02.886276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:02.886711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:02.887774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] PATH_INFO: `/v3/projects/34126b423af240839c7cba4c82dabc8a/users/21b7199eb6514f2dbe814f74489e76ec/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:02.929274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34126b423af240839c7cba4c82dabc8a, user_id=21b7199eb6514f2dbe814f74489e76ec, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:02.932179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:02.957127 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1565/3138] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:02 2022] PUT /identity/v3/projects/34126b423af240839c7cba4c82dabc8a/users/21b7199eb6514f2dbe814f74489e76ec/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:02.958439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:02.977523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dd1aa-11ce-420a-903f-147168b19bca admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:03.117059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2acc-4a20-46e6-9a05-ff3f6661e442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:03.117699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2acc-4a20-46e6-9a05-ff3f6661e442 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.117969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2acc-4a20-46e6-9a05-ff3f6661e442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.118238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2acc-4a20-46e6-9a05-ff3f6661e442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.118887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2acc-4a20-46e6-9a05-ff3f6661e442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:03.120665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2acc-4a20-46e6-9a05-ff3f6661e442 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:03.146518 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1574/3139] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:03.150739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:03.163213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849f440-bdc4-43c2-8b4d-fe2ec01291cc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:03.187153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:03.187856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.188439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.188709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] PATH_INFO: `/v3/projects/34126b423af240839c7cba4c82dabc8a/users/21b7199eb6514f2dbe814f74489e76ec/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.196139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=34126b423af240839c7cba4c82dabc8a, user_id=21b7199eb6514f2dbe814f74489e76ec, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:03.199627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:03.224043 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1566/3140] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:03 2022] PUT /identity/v3/projects/34126b423af240839c7cba4c82dabc8a/users/21b7199eb6514f2dbe814f74489e76ec/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:03.235843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840a08-dd5c-4d5c-9989-8c6cfc67f07f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.236115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840a08-dd5c-4d5c-9989-8c6cfc67f07f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.236386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840a08-dd5c-4d5c-9989-8c6cfc67f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.297558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d9840a08-dd5c-4d5c-9989-8c6cfc67f07f None None] MFA Rules not processed for user `21b7199eb6514f2dbe814f74489e76ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:03.298828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d9840a08-dd5c-4d5c-9989-8c6cfc67f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:03.430547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1575/3141] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:04.012104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:04.014903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:04.109314 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:04.153903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282cb7-f21c-4ec3-89be-ae96c9d680ed admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:04.160593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1218-3561-45e0-9e62-88833c115891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:04.161500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1218-3561-45e0-9e62-88833c115891 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:04.161962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1218-3561-45e0-9e62-88833c115891 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:04.162414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1218-3561-45e0-9e62-88833c115891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:04.172828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1218-3561-45e0-9e62-88833c115891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:04.176825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1218-3561-45e0-9e62-88833c115891 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:04.192074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1567/3142] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:05.642205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840a08-dd5c-4d5c-9989-8c6cfc67f07f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:05.646594 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:05.790240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840a08-dd5c-4d5c-9989-8c6cfc67f07f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:05.797781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:05.798595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:05.798877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:05.799151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] PATH_INFO: `/v3/users/8723e9730a1b499a8027c6641a4f2446` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:05.800579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8723e9730a1b499a8027c6641a4f2446)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:05.802597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:05.878781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8723e9730a1b499a8027c6641a4f2446'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:05.937005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8723e9730a1b499a8027c6641a4f2446'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:05.937828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8723e9730a1b499a8027c6641a4f2446'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:05.954235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8723e9730a1b499a8027c6641a4f2446'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:05.954929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8723e9730a1b499a8027c6641a4f2446'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:05.991790 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1576/3143] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:05 2022] DELETE /identity/v3/users/8723e9730a1b499a8027c6641a4f2446 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:05.996061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:05.996531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:05.996645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:06.035286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:06.037206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:06.207475 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1568/3144] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:06.229974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:06.232689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:06.380272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c1a21-b696-4788-a995-db5f2eeb95f9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:06.388317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:06.390690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:06.391006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:06.391286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:06.408543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:06.410029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:06.424923 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1577/3145] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:07.438880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.441238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:07.461181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824e0e-b7b8-4718-bff3-604c3192c3f0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.472913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.473896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.474641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.475128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] PATH_INFO: `/v3/users/57bbc3575a184139b26e3b0bdd221a91` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.477390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bbc3575a184139b26e3b0bdd221a91)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.480351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.581317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bbc3575a184139b26e3b0bdd221a91'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.601208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bbc3575a184139b26e3b0bdd221a91'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.634275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bbc3575a184139b26e3b0bdd221a91'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.636088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bbc3575a184139b26e3b0bdd221a91'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.651443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bbc3575a184139b26e3b0bdd221a91'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.669478 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1569/3146] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:07 2022] DELETE /identity/v3/users/57bbc3575a184139b26e3b0bdd221a91 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:07.730440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.733310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:07.747331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800ecc-a66b-4488-84a1-084b6df96b9f service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.770561 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:07.830999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.832547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.833121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.833600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] PATH_INFO: `/v3/projects/ea44c8aef10a42baa07af099eb12c6fb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.835694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea44c8aef10a42baa07af099eb12c6fb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.837987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.939819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea44c8aef10a42baa07af099eb12c6fb', 'request_id': 'req-38e70025-01a0-4419-a0be-8fef08d42d20'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.950807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea44c8aef10a42baa07af099eb12c6fb', 'request_id': 'req-38e70025-01a0-4419-a0be-8fef08d42d20'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.961672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea44c8aef10a42baa07af099eb12c6fb', 'request_id': 'req-38e70025-01a0-4419-a0be-8fef08d42d20'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.977593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] The token cache is being invalidate because project ea44c8aef10a42baa07af099eb12c6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:07.979247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.980164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.985887 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1578/3147] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:07 2022] DELETE /identity/v3/projects/ea44c8aef10a42baa07af099eb12c6fb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:07.986755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.988303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:08.026560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf71e6-e5ff-4bed-a0ad-90d2c5882dde admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:08.129262 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:08.142242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:08.142897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:08.143373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:08.143652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] PATH_INFO: `/v3/users/21b7199eb6514f2dbe814f74489e76ec` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:08.146344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b7199eb6514f2dbe814f74489e76ec)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:08.168443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:08.262049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b7199eb6514f2dbe814f74489e76ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:08.279725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b7199eb6514f2dbe814f74489e76ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:08.347678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b7199eb6514f2dbe814f74489e76ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:08.350450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b7199eb6514f2dbe814f74489e76ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:08.381174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a62d089a-fe93-460c-a17f-f9a1f6319e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b7199eb6514f2dbe814f74489e76ec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:08.400664 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1570/3148] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:07 2022] DELETE /identity/v3/users/21b7199eb6514f2dbe814f74489e76ec => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:08.858534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:08.861037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:08.881850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70025-01a0-4419-a0be-8fef08d42d20 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:09.001036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:09.001891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.002270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.002747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] PATH_INFO: `/v3/projects/c5715eb5c1474f35bb87595ba83a23f6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.004145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5715eb5c1474f35bb87595ba83a23f6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:09.007097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:09.117700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5715eb5c1474f35bb87595ba83a23f6', 'request_id': 'req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:09.137696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5715eb5c1474f35bb87595ba83a23f6', 'request_id': 'req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:09.140431 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:09.156956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5715eb5c1474f35bb87595ba83a23f6', 'request_id': 'req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:09.196731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] The token cache is being invalidate because project c5715eb5c1474f35bb87595ba83a23f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:09.197204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:09.198867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2d7c88c4-72c7-46cb-a93c-92e4584e47f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:09.206930 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1579/3149] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:08 2022] DELETE /identity/v3/projects/c5715eb5c1474f35bb87595ba83a23f6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:09.208804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c6aa-902d-4b48-b6fd-506ca3a2f01b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.209262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c6aa-902d-4b48-b6fd-506ca3a2f01b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.209456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c6aa-902d-4b48-b6fd-506ca3a2f01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.252495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f3f6c6aa-902d-4b48-b6fd-506ca3a2f01b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:09.253784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f3f6c6aa-902d-4b48-b6fd-506ca3a2f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:09.439137 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1571/3150] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:09.446743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb78fd-d5fd-4ec4-83a5-782813236754 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.447647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb78fd-d5fd-4ec4-83a5-782813236754 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.448130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb78fd-d5fd-4ec4-83a5-782813236754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.486546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-40bb78fd-d5fd-4ec4-83a5-782813236754 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:09.487968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40bb78fd-d5fd-4ec4-83a5-782813236754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:09.503012 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1580/3151] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:09.504348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6c6aa-902d-4b48-b6fd-506ca3a2f01b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:09.516385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6c6aa-902d-4b48-b6fd-506ca3a2f01b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:09.521779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:09.522950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.523521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.524005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.525868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:09.526431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:09.528710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:09.554737 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1572/3152] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:09.560186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb78fd-d5fd-4ec4-83a5-782813236754 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:09.573782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb78fd-d5fd-4ec4-83a5-782813236754 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:09.580242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:09.581292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.581796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.582415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.583398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:09.587898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:09.634886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:09.657043 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1581/3153] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:09 2022] POST /identity/v3/projects => generated 395 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:09.663562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615876a-50e0-469e-8e6d-a03737b7cc70 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:09.743485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:09.744579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.745133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.745678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.747146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:09.749874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:09.762962 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:09.786103 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1573/3154] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:09 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:09.789186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:09.809427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bb96e-17b1-47e3-b0e9-ecbccbeba8a6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:09.833909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:09.834789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.835304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.835797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.836801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:09.838980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:09.862328 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1582/3155] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:09.866479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:09.888961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6242e-40af-4481-9efb-e8a91c06fb75 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:09.904798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b415dca-6cbe-4e8e-bab9-f3ccab42581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:09.904798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b415dca-6cbe-4e8e-bab9-f3ccab42581f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.904798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b415dca-6cbe-4e8e-bab9-f3ccab42581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.904798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b415dca-6cbe-4e8e-bab9-f3ccab42581f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.908481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b415dca-6cbe-4e8e-bab9-f3ccab42581f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:09.912197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b415dca-6cbe-4e8e-bab9-f3ccab42581f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:09.936992 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1574/3156] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:09.940894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:09.955294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ffe2f-7406-44b2-9c07-e7d15177e241 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:09.964983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913e031-6afa-418c-a9a2-b6bff3707c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:09.966133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913e031-6afa-418c-a9a2-b6bff3707c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:09.966631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913e031-6afa-418c-a9a2-b6bff3707c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:09.967627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913e031-6afa-418c-a9a2-b6bff3707c87 admin admin] PATH_INFO: `/v3/projects/04f0bc3a7db948e0bc3232eba00ef81a/users/40d2c5c649824015bb405c77264d877a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:09.997802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913e031-6afa-418c-a9a2-b6bff3707c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f0bc3a7db948e0bc3232eba00ef81a, user_id=40d2c5c649824015bb405c77264d877a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:10.002469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913e031-6afa-418c-a9a2-b6bff3707c87 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:10.036277 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1583/3157] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:09 2022] PUT /identity/v3/projects/04f0bc3a7db948e0bc3232eba00ef81a/users/40d2c5c649824015bb405c77264d877a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:10.048944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.049555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.049875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.142134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] MFA Rules not processed for user `40d2c5c649824015bb405c77264d877a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:10.147760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:10.344564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1575/3158] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:10.357907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.358225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.358485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.397972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] MFA Rules not processed for user `40d2c5c649824015bb405c77264d877a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:10.399243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:10.418497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1584/3159] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:10.430494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:10.432223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:10.480396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:10.481882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:10.558243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90f694-eb10-40f9-a693-22b1661b7d63 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:10.568665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763612-678a-4309-a536-26b23d120596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:10.569582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763612-678a-4309-a536-26b23d120596 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.570364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763612-678a-4309-a536-26b23d120596 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.570691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763612-678a-4309-a536-26b23d120596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.583290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763612-678a-4309-a536-26b23d120596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:10.586093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763612-678a-4309-a536-26b23d120596 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:10.602488 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1576/3160] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:10.615164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef5832-7000-4302-b53d-eadff571a06e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:10.629514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:10.630193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.630485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.630767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] PATH_INFO: `/v3/projects/34126b423af240839c7cba4c82dabc8a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.632364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=34126b423af240839c7cba4c82dabc8a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:10.635334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:10.651708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1ddf-1ef8-48fc-800f-0509a1b644d4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.652248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1ddf-1ef8-48fc-800f-0509a1b644d4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.652478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1ddf-1ef8-48fc-800f-0509a1b644d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.699497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-898e1ddf-1ef8-48fc-800f-0509a1b644d4 None None] MFA Rules not processed for user `40d2c5c649824015bb405c77264d877a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:10.700978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-898e1ddf-1ef8-48fc-800f-0509a1b644d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:10.714426 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1577/3161] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:10.777413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34126b423af240839c7cba4c82dabc8a', 'request_id': 'req-7e92211f-1e42-40dc-8bbb-cb138ac595ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.808636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34126b423af240839c7cba4c82dabc8a', 'request_id': 'req-7e92211f-1e42-40dc-8bbb-cb138ac595ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.831881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34126b423af240839c7cba4c82dabc8a', 'request_id': 'req-7e92211f-1e42-40dc-8bbb-cb138ac595ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.856357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] The token cache is being invalidate because project 34126b423af240839c7cba4c82dabc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:10.856882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.858153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7e92211f-1e42-40dc-8bbb-cb138ac595ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.861097 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1585/3162] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:10 2022] DELETE /identity/v3/projects/34126b423af240839c7cba4c82dabc8a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:10.867495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714bf3d-1bd6-4e81-ad9f-357681fe1d04 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.867816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714bf3d-1bd6-4e81-ad9f-357681fe1d04 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.868032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714bf3d-1bd6-4e81-ad9f-357681fe1d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.915403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6714bf3d-1bd6-4e81-ad9f-357681fe1d04 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:10.916800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6714bf3d-1bd6-4e81-ad9f-357681fe1d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:10.969376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c77a1-1749-4afe-82a9-cbb539dd3679 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.969956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c77a1-1749-4afe-82a9-cbb539dd3679 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.969956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c77a1-1749-4afe-82a9-cbb539dd3679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.979155 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:10.996732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1f1c77a1-1749-4afe-82a9-cbb539dd3679 None None] MFA Rules not processed for user `40d2c5c649824015bb405c77264d877a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.001254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1f1c77a1-1749-4afe-82a9-cbb539dd3679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.082942 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:11.119499 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1578/3163] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:11.120701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684a95-4202-480a-bdc3-db9b3fdfe62f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.121155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684a95-4202-480a-bdc3-db9b3fdfe62f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.121508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684a95-4202-480a-bdc3-db9b3fdfe62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.157941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bf684a95-4202-480a-bdc3-db9b3fdfe62f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.159146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bf684a95-4202-480a-bdc3-db9b3fdfe62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.169778 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1586/3164] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:11.180148 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1579/3165] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:11.181020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c77a1-1749-4afe-82a9-cbb539dd3679 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.194933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c77a1-1749-4afe-82a9-cbb539dd3679 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.199615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.200473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.200790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.201038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.201992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:11.202290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.204587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.229048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1587/3166] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:11.230561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf684a95-4202-480a-bdc3-db9b3fdfe62f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.241812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf684a95-4202-480a-bdc3-db9b3fdfe62f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.249793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707ba39-2801-4be4-bb2b-69680fc29be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.250856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707ba39-2801-4be4-bb2b-69680fc29be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.251553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707ba39-2801-4be4-bb2b-69680fc29be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.252456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707ba39-2801-4be4-bb2b-69680fc29be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.253670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707ba39-2801-4be4-bb2b-69680fc29be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.256218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707ba39-2801-4be4-bb2b-69680fc29be7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.311942 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1580/3167] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:11.318370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.319841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9c98-c6f1-4286-8802-25278d6a86e9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.320125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9c98-c6f1-4286-8802-25278d6a86e9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.320396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9c98-c6f1-4286-8802-25278d6a86e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.331288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843dfed-6c7f-42db-9af1-36ce15fd216a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.356178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0d4b9c98-c6f1-4286-8802-25278d6a86e9 None None] MFA Rules not processed for user `40d2c5c649824015bb405c77264d877a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.358536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0d4b9c98-c6f1-4286-8802-25278d6a86e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.461495 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1581/3168] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:11.466134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.466857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.467439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.467774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.468449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.470473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.499188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30b7b-82ee-431a-8d02-34756f2c56eb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.499588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30b7b-82ee-431a-8d02-34756f2c56eb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.499864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30b7b-82ee-431a-8d02-34756f2c56eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.530600 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1588/3169] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:11.535881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.539970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-45f30b7b-82ee-431a-8d02-34756f2c56eb None None] MFA Rules not processed for user `40d2c5c649824015bb405c77264d877a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.541404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-45f30b7b-82ee-431a-8d02-34756f2c56eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.556755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812b8d-67a2-49f2-a712-c4b17c70669d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.562491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.563426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.563701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.564401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.564599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.566448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.570613 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1582/3170] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:11.585523 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1589/3171] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:11.602195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30b7b-82ee-431a-8d02-34756f2c56eb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.602850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.604879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.619728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30b7b-82ee-431a-8d02-34756f2c56eb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.621545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457941ce-c0ad-4286-bee0-a473b9f04d4f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.626810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.627952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.628456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.628975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] PATH_INFO: `/v3/users/40d2c5c649824015bb405c77264d877a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.630549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d2c5c649824015bb405c77264d877a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.632434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.633072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.633195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.633392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.635411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.636987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.638621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.668063 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1583/3172] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:11.673810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.703277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fa37d-9982-4f80-a320-89a8f8976ddb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.708614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711386c4-73d7-4ab6-9ffb-1e5a3f524780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.710307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711386c4-73d7-4ab6-9ffb-1e5a3f524780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.710822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711386c4-73d7-4ab6-9ffb-1e5a3f524780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.711322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711386c4-73d7-4ab6-9ffb-1e5a3f524780 admin admin] PATH_INFO: `/v3/projects/30b2a95273e6417babc48661728340bf/users/b3d2e0ca31ba428d9391b4fa5c91bf4e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.726802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d2c5c649824015bb405c77264d877a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.739550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711386c4-73d7-4ab6-9ffb-1e5a3f524780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b2a95273e6417babc48661728340bf, user_id=b3d2e0ca31ba428d9391b4fa5c91bf4e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.744331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711386c4-73d7-4ab6-9ffb-1e5a3f524780 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.762954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d2c5c649824015bb405c77264d877a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.765218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d2c5c649824015bb405c77264d877a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.794329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d2c5c649824015bb405c77264d877a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.797883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3c6a531-449c-4169-bce8-744c99e8cddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d2c5c649824015bb405c77264d877a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.801614 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1584/3173] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:11 2022] PUT /identity/v3/projects/30b2a95273e6417babc48661728340bf/users/b3d2e0ca31ba428d9391b4fa5c91bf4e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:11.808117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceeb4d-74ba-4696-954d-4b9aabbfb97d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.808638 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:11.811178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceeb4d-74ba-4696-954d-4b9aabbfb97d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.812051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceeb4d-74ba-4696-954d-4b9aabbfb97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.844609 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1590/3174] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:11 2022] DELETE /identity/v3/users/40d2c5c649824015bb405c77264d877a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:11.846555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.846918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.847132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.886922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.888133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.918041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-17ceeb4d-74ba-4696-954d-4b9aabbfb97d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.924261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-17ceeb4d-74ba-4696-954d-4b9aabbfb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:12.065118 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1591/3175] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:12.076279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.078097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:12.162299 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1585/3176] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:12.210902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b2c62-0994-42b6-a8cd-3f1c296340b8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.214946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.215758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.216213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.216657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.237319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceeb4d-74ba-4696-954d-4b9aabbfb97d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.243411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.246103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.267253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceeb4d-74ba-4696-954d-4b9aabbfb97d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.270164 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1592/3177] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:12.283445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740cb28-4106-4013-8aa6-ef460ae061fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.287964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740cb28-4106-4013-8aa6-ef460ae061fc service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.288263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740cb28-4106-4013-8aa6-ef460ae061fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.288544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740cb28-4106-4013-8aa6-ef460ae061fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.315824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740cb28-4106-4013-8aa6-ef460ae061fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.320498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740cb28-4106-4013-8aa6-ef460ae061fc service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.342458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1586/3178] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:14.035277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:14.037780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:14.054055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21943e43-12ad-4d5b-934b-58a6c4e76e88 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:14.058999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:14.060015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.060342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.061120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] PATH_INFO: `/v3/projects/04f0bc3a7db948e0bc3232eba00ef81a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.070283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f0bc3a7db948e0bc3232eba00ef81a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:14.073604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:14.220007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f0bc3a7db948e0bc3232eba00ef81a', 'request_id': 'req-c25757a8-f001-46a5-b417-3914a952d652'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:14.238205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f0bc3a7db948e0bc3232eba00ef81a', 'request_id': 'req-c25757a8-f001-46a5-b417-3914a952d652'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:14.245849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f0bc3a7db948e0bc3232eba00ef81a', 'request_id': 'req-c25757a8-f001-46a5-b417-3914a952d652'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:14.270185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] The token cache is being invalidate because project 04f0bc3a7db948e0bc3232eba00ef81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:14.270476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:14.273166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c25757a8-f001-46a5-b417-3914a952d652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:14.275886 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1593/3179] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:14 2022] DELETE /identity/v3/projects/04f0bc3a7db948e0bc3232eba00ef81a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:14.281018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ba15b-9ae3-47a6-b5e8-d10748d55ab4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.281567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ba15b-9ae3-47a6-b5e8-d10748d55ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.281567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ba15b-9ae3-47a6-b5e8-d10748d55ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.321899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-115ba15b-9ae3-47a6-b5e8-d10748d55ab4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:14.323376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-115ba15b-9ae3-47a6-b5e8-d10748d55ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:14.337623 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:14.412140 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1587/3180] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:14.419132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec3155-82fd-481a-b0e3-ba2f5f80ccf0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.421151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec3155-82fd-481a-b0e3-ba2f5f80ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.421650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec3155-82fd-481a-b0e3-ba2f5f80ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.446031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5bec3155-82fd-481a-b0e3-ba2f5f80ccf0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:14.447553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5bec3155-82fd-481a-b0e3-ba2f5f80ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:14.457686 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1594/3181] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:14.462410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ba15b-9ae3-47a6-b5e8-d10748d55ab4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:14.478253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ba15b-9ae3-47a6-b5e8-d10748d55ab4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:14.498540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:14.500252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.500911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.502103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.502988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:14.504025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:14.506545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:14.525251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1588/3182] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:14.528120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec3155-82fd-481a-b0e3-ba2f5f80ccf0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:14.546852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec3155-82fd-481a-b0e3-ba2f5f80ccf0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:14.568285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:14.572488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.574052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.574357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.577174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:14.583604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:14.596127 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:14.652461 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1595/3183] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:14 2022] POST /identity/v3/projects => generated 399 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:14.658584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:14.684664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648c01e-ff53-4ba6-9a74-9f668fe07fd6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:14.783230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:14.784172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.784516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.785028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.786248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:14.788991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:14.822323 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1589/3184] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:14 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:14.826265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:14.837511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df1b44-2fec-419c-89c4-46716ca0969e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:14.848963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:14.849678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.850008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.850281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.851730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:14.853447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:14.867667 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1596/3185] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:14.871460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:14.886544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c745-ea67-45f2-8b82-b4b1e922f791 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:14.895058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6cef2-cb46-4254-aa03-8b4634046181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:14.895693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6cef2-cb46-4254-aa03-8b4634046181 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.896117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6cef2-cb46-4254-aa03-8b4634046181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.896398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6cef2-cb46-4254-aa03-8b4634046181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.897176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6cef2-cb46-4254-aa03-8b4634046181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:14.899655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6cef2-cb46-4254-aa03-8b4634046181 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:14.918906 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1590/3186] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:14.919774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:14.936748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dab0e4-4510-4090-b5e6-51038481584c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:14.946804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:14.947946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:14.948471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:14.949010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] PATH_INFO: `/v3/projects/e6740efa787346ddaa3b0f22d2c3ffa0/users/6d1bf9f58c8b4cd285bd369a6689c4e8/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:14.982412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6740efa787346ddaa3b0f22d2c3ffa0, user_id=6d1bf9f58c8b4cd285bd369a6689c4e8, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:14.987750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:15.010814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1597/3187] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:14 2022] PUT /identity/v3/projects/e6740efa787346ddaa3b0f22d2c3ffa0/users/6d1bf9f58c8b4cd285bd369a6689c4e8/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:14:15.017049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f5f0-4d6a-40db-9b11-1ed234e34ee4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:15.017279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f5f0-4d6a-40db-9b11-1ed234e34ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:15.017518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f5f0-4d6a-40db-9b11-1ed234e34ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:15.052778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8882f5f0-4d6a-40db-9b11-1ed234e34ee4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:15.054021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8882f5f0-4d6a-40db-9b11-1ed234e34ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:15.179131 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1591/3188] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:15.239946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:15.241945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:15.371840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44648e8-05d1-4ad3-8d5e-9fe63f0dbe4b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:15.381915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8537719-a88d-48a6-a7f1-8d5ab01050af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:15.384482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537719-a88d-48a6-a7f1-8d5ab01050af service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:15.384863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537719-a88d-48a6-a7f1-8d5ab01050af service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:15.385271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537719-a88d-48a6-a7f1-8d5ab01050af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:15.412954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8537719-a88d-48a6-a7f1-8d5ab01050af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:15.412954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8537719-a88d-48a6-a7f1-8d5ab01050af service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:15.447703 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1598/3189] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:19.574728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:19.575239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:19.575363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:19.614470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] MFA Rules not processed for user `b0bd3eeeb578465a8f5e5eaa3b3fdc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:19.615726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:19.649122 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:19.752373 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1592/3190] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:19.919362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924893-d5e7-4c40-8861-cccee6be18f0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:19.919906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924893-d5e7-4c40-8861-cccee6be18f0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:19.920129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924893-d5e7-4c40-8861-cccee6be18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:19.956158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-81924893-d5e7-4c40-8861-cccee6be18f0 None None] MFA Rules not processed for user `83fa03ac4589405e911fda3211620529`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:19.958092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-81924893-d5e7-4c40-8861-cccee6be18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:20.138561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1599/3191] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:28.335972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:28.337494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:28.602765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9db1-077a-410f-9ab1-b770a52207cf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:28.615729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:28.616754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:28.617155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:28.617528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:28.621897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:28.699976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:28.701988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:28.735173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1593/3192] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:29.954922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3ffed-4c58-4d56-8e64-c42397cbf73b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:29.955500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3ffed-4c58-4d56-8e64-c42397cbf73b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:29.955500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3ffed-4c58-4d56-8e64-c42397cbf73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:30.017033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cad3ffed-4c58-4d56-8e64-c42397cbf73b None None] MFA Rules not processed for user `b3d2e0ca31ba428d9391b4fa5c91bf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:30.018528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cad3ffed-4c58-4d56-8e64-c42397cbf73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:30.209103 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:30.243730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:30.245128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:30.297149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1600/3193] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:30.298636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:30.298931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:30.299205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:30.331022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] MFA Rules not processed for user `b3d2e0ca31ba428d9391b4fa5c91bf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:30.333773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:30.350397 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1601/3194] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:30.459265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6118ec-a838-4a08-830b-0b45c3eb38e0 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:30.494999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:30.495560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:30.495844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:30.496119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:30.499254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:30.532527 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:30.654523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:30.656534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:30.747911 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1594/3195] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:30.904731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:30.907705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.055337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:31.057455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.094559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fd1fa-3ba8-4526-9b5a-198bc74d2afc service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.112647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.113516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.113926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.114301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.147085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.150632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.188822 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1595/3196] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:31.264736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aec062-56e2-4b1f-9324-6f41f904ae34 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.272337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.279849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.281111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.281472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.288073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.340698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.346112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.367887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:31.369819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.398252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437d63d-e1f2-4baa-90f4-b2f099181dd4 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.405302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.406393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.407098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.407601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.410488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.416814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1602/3197] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:31.438316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.449101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.463397 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1596/3198] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:32.050205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:32.052556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:32.090801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a85e3-b3e9-4b23-828b-0aae798832e6 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:32.114159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:32.115101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:32.115779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:32.116405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] PATH_INFO: `/v3/users/a04086173676446ab71da619f5826f97` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:32.117868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04086173676446ab71da619f5826f97)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:32.123526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:32.356704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04086173676446ab71da619f5826f97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:32.383600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04086173676446ab71da619f5826f97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:32.384214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04086173676446ab71da619f5826f97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:32.413846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04086173676446ab71da619f5826f97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:32.415504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-288b13a5-fd88-4e0a-bcd3-a44e0037e8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04086173676446ab71da619f5826f97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:32.502315 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1603/3199] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:32 2022] DELETE /identity/v3/users/a04086173676446ab71da619f5826f97 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:33.397107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:33.415778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290e3f-6b54-45a2-994e-cbe6d1a450cc service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:33.566563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:33.567724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:33.568495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:33.569065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] PATH_INFO: `/v3/projects/6548e216312e4326a0efba388107207b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:33.574160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6548e216312e4326a0efba388107207b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:33.577737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:33.659632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6548e216312e4326a0efba388107207b', 'request_id': 'req-d34248f7-bf4d-4345-9df4-56e1e4822559'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:33.670787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6548e216312e4326a0efba388107207b', 'request_id': 'req-d34248f7-bf4d-4345-9df4-56e1e4822559'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:33.681127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6548e216312e4326a0efba388107207b', 'request_id': 'req-d34248f7-bf4d-4345-9df4-56e1e4822559'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:33.709746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] The token cache is being invalidate because project 6548e216312e4326a0efba388107207b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:33.710147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:33.711851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d34248f7-bf4d-4345-9df4-56e1e4822559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:33.719252 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1597/3200] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:33 2022] DELETE /identity/v3/projects/6548e216312e4326a0efba388107207b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:33.720369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2600e6-9d0c-44ac-8434-96abd806229b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:33.720894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2600e6-9d0c-44ac-8434-96abd806229b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:33.721011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2600e6-9d0c-44ac-8434-96abd806229b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:33.820066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9d2600e6-9d0c-44ac-8434-96abd806229b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:33.823673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9d2600e6-9d0c-44ac-8434-96abd806229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:33.879587 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:34.084906 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1604/3201] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:34.090766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3af4f-13cd-4c96-92d7-438c5a112eb3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.091081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3af4f-13cd-4c96-92d7-438c5a112eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.091445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3af4f-13cd-4c96-92d7-438c5a112eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.184109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9cc3af4f-13cd-4c96-92d7-438c5a112eb3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:34.190304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9cc3af4f-13cd-4c96-92d7-438c5a112eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:34.219895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2600e6-9d0c-44ac-8434-96abd806229b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:34.220125 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1598/3202] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:34.243202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2600e6-9d0c-44ac-8434-96abd806229b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:34.262124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaf9e5-cd2d-4df3-b6b5-433113687a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:34.269029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf9e5-cd2d-4df3-b6b5-433113687a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.269403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf9e5-cd2d-4df3-b6b5-433113687a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.270693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf9e5-cd2d-4df3-b6b5-433113687a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.276578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaf9e5-cd2d-4df3-b6b5-433113687a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:34.279363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaf9e5-cd2d-4df3-b6b5-433113687a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:34.284805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaf9e5-cd2d-4df3-b6b5-433113687a6a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:34.349059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1605/3203] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:34.353928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3af4f-13cd-4c96-92d7-438c5a112eb3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:34.381511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3af4f-13cd-4c96-92d7-438c5a112eb3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:34.402510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:34.403166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.403463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.403734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.407222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:34.412998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:34.429426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d71165-5b41-4737-a14a-e6d1c05ee464 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.429968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d71165-5b41-4737-a14a-e6d1c05ee464 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.430421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d71165-5b41-4737-a14a-e6d1c05ee464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.439475 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:34.547636 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1599/3204] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:34 2022] POST /identity/v3/projects => generated 397 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:34.548609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:34.550370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-37d71165-5b41-4737-a14a-e6d1c05ee464 None None] MFA Rules not processed for user `6d1bf9f58c8b4cd285bd369a6689c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:34.552050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-37d71165-5b41-4737-a14a-e6d1c05ee464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:34.634874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d42bd-e0b8-4983-8afc-224377ecd7cd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:34.641451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:34.642193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.642564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.642946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.643648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:34.646276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:34.688695 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1600/3205] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:34 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:34.690358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:34.707269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a79b2-8d6c-4a3a-b012-154d403deb1f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:34.717120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:34.719162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.719951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.720641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.721726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:34.723897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:34.741643 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1601/3206] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:34.757005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:34.800222 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1606/3207] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:34.802595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac49d7-c8a8-45eb-a91f-e40ca7b45a15 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.803099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac49d7-c8a8-45eb-a91f-e40ca7b45a15 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.805531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac49d7-c8a8-45eb-a91f-e40ca7b45a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.817812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beac04-ede6-4e24-a8c9-67cc76b7dbf3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:34.840281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373e2c4-51cc-48fa-9b97-baddf59bd0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:34.841079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373e2c4-51cc-48fa-9b97-baddf59bd0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.842500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373e2c4-51cc-48fa-9b97-baddf59bd0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.843352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373e2c4-51cc-48fa-9b97-baddf59bd0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:34.844753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373e2c4-51cc-48fa-9b97-baddf59bd0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:34.852272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373e2c4-51cc-48fa-9b97-baddf59bd0cf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:34.862939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-04ac49d7-c8a8-45eb-a91f-e40ca7b45a15 None None] MFA Rules not processed for user `6d1bf9f58c8b4cd285bd369a6689c4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:34.864216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-04ac49d7-c8a8-45eb-a91f-e40ca7b45a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:34.895819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1607/3208] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:34.901237 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1602/3209] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:34.905904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac49d7-c8a8-45eb-a91f-e40ca7b45a15 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:34.935921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac49d7-c8a8-45eb-a91f-e40ca7b45a15 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:34.945795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:34.946575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:34.948782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:34.949131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] PATH_INFO: `/v3/projects/c1471f0184d741a0a97be9a7ff45fb65/users/263bda79fe484f1698ed7994566c5116/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:35.009522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1471f0184d741a0a97be9a7ff45fb65, user_id=263bda79fe484f1698ed7994566c5116, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:35.014958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:35.062050 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1608/3210] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:34 2022] PUT /identity/v3/projects/c1471f0184d741a0a97be9a7ff45fb65/users/263bda79fe484f1698ed7994566c5116/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:35.067697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:35.068467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:35.069020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:35.162526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:35.174154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:35.358998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1603/3211] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:35.373592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:35.377563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:35.443391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:35.449743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:35.568547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843340-45ec-4ed4-a8b0-e8f76c1a94be admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:35.573818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:35.574456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:35.574743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:35.575004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:35.594013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:35.595666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:35.604794 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:35.616428 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1609/3212] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:35.630735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9b75b-6a0b-46d9-8fd5-36889d7a16f1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:35.639455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:35.640685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:35.641232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:35.641715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:35.647286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:35.685300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:35.688592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:35.748392 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1604/3213] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:36.074141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:36.076271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:36.096614 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:36.208895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa83e-dd6d-4354-9a19-bb57ea3303c3 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:36.228952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa12ae-6edf-41d1-851a-1215bfa275c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:36.229599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa12ae-6edf-41d1-851a-1215bfa275c6 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:36.229880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa12ae-6edf-41d1-851a-1215bfa275c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:36.230596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa12ae-6edf-41d1-851a-1215bfa275c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:36.360188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa12ae-6edf-41d1-851a-1215bfa275c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:36.362125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa12ae-6edf-41d1-851a-1215bfa275c6 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:36.373438 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1610/3214] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:36.832987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:36.844324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762ee80-87dd-4e7b-acd4-fd6d1d863dae service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:36.859754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e1646-83f7-49d0-af1a-4cdb7c094d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:36.860636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1646-83f7-49d0-af1a-4cdb7c094d96 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:36.861113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1646-83f7-49d0-af1a-4cdb7c094d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:36.862406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1646-83f7-49d0-af1a-4cdb7c094d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:36.866819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb1e1646-83f7-49d0-af1a-4cdb7c094d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:36.880650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e1646-83f7-49d0-af1a-4cdb7c094d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:36.882406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e1646-83f7-49d0-af1a-4cdb7c094d96 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:36.895349 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1605/3215] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:46.370058 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=55 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:46.889456 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=13 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:47.131849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be198f-f4bc-4fbf-b6a1-750b7fb53a81 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:47.132111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be198f-f4bc-4fbf-b6a1-750b7fb53a81 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:47.132388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be198f-f4bc-4fbf-b6a1-750b7fb53a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:47.264587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-14be198f-f4bc-4fbf-b6a1-750b7fb53a81 None None] MFA Rules not processed for user `263bda79fe484f1698ed7994566c5116`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:47.265939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-14be198f-f4bc-4fbf-b6a1-750b7fb53a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:47.380113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:47.380662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:47.381158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:47.447174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:47.450132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:47.524931 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1611/3216] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:47.527400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:47.527715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:47.527971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:47.562484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] MFA Rules not processed for user `263bda79fe484f1698ed7994566c5116`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:47.578048 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1606/3217] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 21 01:14:47.579782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:47.621018 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1612/3218] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:47.652578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:47.657152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:47.755541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:47.759301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:47.809908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637019e7-00fc-4aaa-b49e-6a78b8590bf0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:47.830625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e680ae-27a5-4f0e-be51-956e3558d66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:47.831262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e680ae-27a5-4f0e-be51-956e3558d66e service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:47.831542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e680ae-27a5-4f0e-be51-956e3558d66e service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:47.831814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e680ae-27a5-4f0e-be51-956e3558d66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:47.864930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e680ae-27a5-4f0e-be51-956e3558d66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:47.867110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e680ae-27a5-4f0e-be51-956e3558d66e service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:47.891736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45633524-89e3-403e-a2d1-f1862506a275 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:47.905168 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1613/3219] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:47.911578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:47.912227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:47.913043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:47.913043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:47.937366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:47.938992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:47.968656 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1607/3220] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:14:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:14:57.889540 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=41 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:57.951669 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=61 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:08.511441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d73e8-e9d9-44ee-92ad-758f4967e924 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.511932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d73e8-e9d9-44ee-92ad-758f4967e924 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.512044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d73e8-e9d9-44ee-92ad-758f4967e924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.534232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f39d73e8-e9d9-44ee-92ad-758f4967e924 None None] MFA Rules not processed for user `b3d2e0ca31ba428d9391b4fa5c91bf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:08.536356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f39d73e8-e9d9-44ee-92ad-758f4967e924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:08.653878 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1614/3221] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:11.476642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.478891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:11.498625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba2b1-db14-443c-ad5f-0f606ee152a5 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.506676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.507735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.508305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.508819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.511058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:11.528869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.533001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.550948 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1608/3222] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:12.043213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1b0e8-2b6f-4626-b96f-6b2e9c1e028c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.043708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1b0e8-2b6f-4626-b96f-6b2e9c1e028c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.043840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1b0e8-2b6f-4626-b96f-6b2e9c1e028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.064162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-27b1b0e8-2b6f-4626-b96f-6b2e9c1e028c None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:12.065554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-27b1b0e8-2b6f-4626-b96f-6b2e9c1e028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:12.081161 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1615/3223] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:12.094815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:12.107419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeb5bf-c651-4a86-9174-d52fd7428e7f service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:12.114108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:12.114799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.115146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.115491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.134288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:12.136247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:12.149310 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1609/3224] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:15:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:12.649215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63385eb7-2bed-4ce2-8f8f-3a5c9fb0e59c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.649583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63385eb7-2bed-4ce2-8f8f-3a5c9fb0e59c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.649851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63385eb7-2bed-4ce2-8f8f-3a5c9fb0e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.669298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-63385eb7-2bed-4ce2-8f8f-3a5c9fb0e59c None None] MFA Rules not processed for user `2a2ecc1a81574d7aa2679307a7985908`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:12.670673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63385eb7-2bed-4ce2-8f8f-3a5c9fb0e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:12.734245 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1616/3225] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:22.145720 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=12 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:22.725514 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=56 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:28.874331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:28.913049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51864b-f9e2-4708-b276-040899b20d2b service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:28.923435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:28.924445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:28.924885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:28.925363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:28.927997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:29.083827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:29.085486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:29.103439 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1610/3226] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:32.266293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63385eb7-2bed-4ce2-8f8f-3a5c9fb0e59c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.317237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63385eb7-2bed-4ce2-8f8f-3a5c9fb0e59c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.335690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.338276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.338577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.338856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.346876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:32.418731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.420530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.445215 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1617/3227] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:32.871986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.919340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b381-4350-48c9-b291-1bc2fdd13319 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.927423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.928693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.929979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.930428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] PATH_INFO: `/v3/users/263bda79fe484f1698ed7994566c5116` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.933114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=263bda79fe484f1698ed7994566c5116)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.935383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:33.064871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263bda79fe484f1698ed7994566c5116'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.093962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263bda79fe484f1698ed7994566c5116'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.114272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263bda79fe484f1698ed7994566c5116'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.115965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263bda79fe484f1698ed7994566c5116'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.133393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d1988feb-b188-4571-98eb-019c9cc3fc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263bda79fe484f1698ed7994566c5116'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.149283 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1611/3228] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:32 2022] DELETE /identity/v3/users/263bda79fe484f1698ed7994566c5116 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:33.816000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:33.833989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11c4d-229f-47e0-8cfd-9c79dd0547d9 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:33.971671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:33.972334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:33.972610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:33.972935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] PATH_INFO: `/v3/projects/c1471f0184d741a0a97be9a7ff45fb65` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:33.974136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1471f0184d741a0a97be9a7ff45fb65)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:33.976320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.094137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1471f0184d741a0a97be9a7ff45fb65', 'request_id': 'req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.117508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1471f0184d741a0a97be9a7ff45fb65', 'request_id': 'req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.122345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1471f0184d741a0a97be9a7ff45fb65', 'request_id': 'req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.163790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] The token cache is being invalidate because project c1471f0184d741a0a97be9a7ff45fb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:34.164460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.166292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ea115e51-20c0-477b-bf7d-fc8bfb12bfb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.168441 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1618/3229] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:33 2022] DELETE /identity/v3/projects/c1471f0184d741a0a97be9a7ff45fb65 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:34.174558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad21b2-e4b3-424a-924f-23d1f3db972b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.176896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad21b2-e4b3-424a-924f-23d1f3db972b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.177376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad21b2-e4b3-424a-924f-23d1f3db972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.252214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9bad21b2-e4b3-424a-924f-23d1f3db972b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:34.253853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9bad21b2-e4b3-424a-924f-23d1f3db972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.276525 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:34.442653 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1612/3230] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:34.444913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c4c3-bc2d-44a5-b70f-cb637d836566 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.445788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c4c3-bc2d-44a5-b70f-cb637d836566 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.451289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c4c3-bc2d-44a5-b70f-cb637d836566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.516929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9c80c4c3-bc2d-44a5-b70f-cb637d836566 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:34.524310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c80c4c3-bc2d-44a5-b70f-cb637d836566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.547139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad21b2-e4b3-424a-924f-23d1f3db972b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.555173 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1619/3231] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:34.558381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad21b2-e4b3-424a-924f-23d1f3db972b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.570931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.571567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.571849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.572125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.572815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:34.573125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.574760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.603839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c4c3-bc2d-44a5-b70f-cb637d836566 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.615262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1613/3232] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:34.618052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c4c3-bc2d-44a5-b70f-cb637d836566 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.632603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.633267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.633547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.633819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.634460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.636399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.655352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.658565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.680386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777c39-e692-4785-b5fb-a9d2e0996550 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.699136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.700047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.700047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.700330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] PATH_INFO: `/v3/users/6d1bf9f58c8b4cd285bd369a6689c4e8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.706577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1bf9f58c8b4cd285bd369a6689c4e8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.708559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.722359 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1620/3233] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:34.723314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.791319 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:34.867079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1bf9f58c8b4cd285bd369a6689c4e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.879947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1bf9f58c8b4cd285bd369a6689c4e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.906364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181351-0f16-427f-b414-dc585a1e8210 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.912191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1bf9f58c8b4cd285bd369a6689c4e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.912956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1bf9f58c8b4cd285bd369a6689c4e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.931236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1bf9f58c8b4cd285bd369a6689c4e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.933355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.935080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.936250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.936673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.938148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.940492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.946904 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1614/3234] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:34 2022] DELETE /identity/v3/users/6d1bf9f58c8b4cd285bd369a6689c4e8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:34.985202 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1621/3235] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:34.986440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.991208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:35.102824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b90e-db8d-4aab-b530-91da67b31391 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.110446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.110777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.110986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.111430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.112295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.115177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.131183 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1615/3236] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:35.133917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.152232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b7078-264f-4210-afde-713dad251ef9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.167082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6cb50-8a25-48ed-9e2f-be19c38da48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.167722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6cb50-8a25-48ed-9e2f-be19c38da48d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.168001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6cb50-8a25-48ed-9e2f-be19c38da48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.168277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6cb50-8a25-48ed-9e2f-be19c38da48d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.169528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6cb50-8a25-48ed-9e2f-be19c38da48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.171431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6cb50-8a25-48ed-9e2f-be19c38da48d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.189553 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1622/3237] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:35.193397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.207162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e791d-3cae-4bfb-bcf1-9fdae9e96954 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.221435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.225297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.226058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.226436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] PATH_INFO: `/v3/projects/7461e4a0b7124b3bbbb6396de9b59656/users/22a8b93432dd4d699a28a8db26bc3c98/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.269328 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:35.276471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7461e4a0b7124b3bbbb6396de9b59656, user_id=22a8b93432dd4d699a28a8db26bc3c98, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.280840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.327579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.328563 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1616/3238] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:35 2022] PUT /identity/v3/projects/7461e4a0b7124b3bbbb6396de9b59656/users/22a8b93432dd4d699a28a8db26bc3c98/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:35.329556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.330170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.394084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:35.395333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:35.503207 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1623/3239] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:35.543033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.545726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:35.664397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c42c-4b8c-4d8b-a276-89b9b38e187e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.670320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20899a-ea82-4d76-aff5-a44ea7a39f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.671932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20899a-ea82-4d76-aff5-a44ea7a39f30 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.672345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20899a-ea82-4d76-aff5-a44ea7a39f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.672625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20899a-ea82-4d76-aff5-a44ea7a39f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.690063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20899a-ea82-4d76-aff5-a44ea7a39f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.691759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20899a-ea82-4d76-aff5-a44ea7a39f30 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.706250 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1617/3240] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:36.173214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.174831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:36.195748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f1a9f-e2b7-4310-a95f-664fad73914b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:36.211079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:36.214625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.215097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.216600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] PATH_INFO: `/v3/projects/e6740efa787346ddaa3b0f22d2c3ffa0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.220719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6740efa787346ddaa3b0f22d2c3ffa0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:36.223155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:36.323314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'request_id': 'req-c201c083-15a5-4f4e-bbce-d494e7502d1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.339988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'request_id': 'req-c201c083-15a5-4f4e-bbce-d494e7502d1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.346945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'request_id': 'req-c201c083-15a5-4f4e-bbce-d494e7502d1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.368673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] The token cache is being invalidate because project e6740efa787346ddaa3b0f22d2c3ffa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:36.369145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.370002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c201c083-15a5-4f4e-bbce-d494e7502d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.372019 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1624/3241] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:36 2022] DELETE /identity/v3/projects/e6740efa787346ddaa3b0f22d2c3ffa0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:36.377916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2774-f7bf-424d-8335-43b7aec6b317 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.378392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2774-f7bf-424d-8335-43b7aec6b317 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.378470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2774-f7bf-424d-8335-43b7aec6b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.409833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-853e2774-f7bf-424d-8335-43b7aec6b317 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:36.412390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-853e2774-f7bf-424d-8335-43b7aec6b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:36.540834 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1618/3242] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:36.543722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229e5bc-48b6-4a31-a32a-34b921b40ff4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.544569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229e5bc-48b6-4a31-a32a-34b921b40ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.545108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229e5bc-48b6-4a31-a32a-34b921b40ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.575534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6229e5bc-48b6-4a31-a32a-34b921b40ff4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:36.577449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6229e5bc-48b6-4a31-a32a-34b921b40ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:36.589006 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1625/3243] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:36.594392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e2774-f7bf-424d-8335-43b7aec6b317 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.609762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e2774-f7bf-424d-8335-43b7aec6b317 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:36.618946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:36.619713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.620063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.620397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.621241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:36.621602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:36.624669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:36.643151 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1619/3244] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:36.644668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229e5bc-48b6-4a31-a32a-34b921b40ff4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.656675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229e5bc-48b6-4a31-a32a-34b921b40ff4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:36.663333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:36.664315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.665132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.665610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.666496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:36.668636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:36.685379 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:36.717164 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1626/3245] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:36 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:36.722076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.737158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5cf13-91de-41f6-942d-ba5274847ddb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:36.885467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:36.886179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.886458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.886731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.887651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:36.893621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:36.928930 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:36.945428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1620/3246] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:36 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:36.952831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.987910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45113ae1-6ee6-43e3-8265-8d5fc0966113 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.008648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.010914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.011438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.012053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.018214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.025743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.065168 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1627/3247] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:37.069381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.082630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de26cf-5138-426a-b8f8-fcb8560ff774 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.094973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f877a-fba4-4665-aaaf-edcaea5aaec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.101217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f877a-fba4-4665-aaaf-edcaea5aaec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.101217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f877a-fba4-4665-aaaf-edcaea5aaec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.103283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f877a-fba4-4665-aaaf-edcaea5aaec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.104166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f877a-fba4-4665-aaaf-edcaea5aaec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.110962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f877a-fba4-4665-aaaf-edcaea5aaec7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.142341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.152342 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1621/3248] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:37.157407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ff739-2142-4979-a6c3-e8a8003edd3d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.171713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.172510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.173002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.173539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] PATH_INFO: `/v3/projects/aa16ca726eda42c2ab2983a6b22e73c1/users/7913dc06b5764a5f88399c5a9407feec/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.218037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa16ca726eda42c2ab2983a6b22e73c1, user_id=7913dc06b5764a5f88399c5a9407feec, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.221286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.253667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.254300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.254800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.262459 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1628/3249] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:37 2022] PUT /identity/v3/projects/aa16ca726eda42c2ab2983a6b22e73c1/users/7913dc06b5764a5f88399c5a9407feec/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:37.293119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:37.294808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:37.395733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1622/3250] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:37.412727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.415578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:37.507789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a4f2-016d-4c23-87c1-ca7bf16c936f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.515630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.516941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.517600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.518073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.533683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.535687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.551522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1629/3251] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:39.047808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.050523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:39.069406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e18fe8-3b18-4c73-bbb9-b2b4a742bbb0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.078106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.079006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.080836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.081366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] PATH_INFO: `/v3/users/83fa03ac4589405e911fda3211620529` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.082825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fa03ac4589405e911fda3211620529)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.085187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.163018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fa03ac4589405e911fda3211620529'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.180186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fa03ac4589405e911fda3211620529'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.214779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fa03ac4589405e911fda3211620529'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.218094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fa03ac4589405e911fda3211620529'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.241648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c458ed01-b78e-4d61-aacd-05868ee2752a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fa03ac4589405e911fda3211620529'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.257774 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1623/3252] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:39 2022] DELETE /identity/v3/users/83fa03ac4589405e911fda3211620529 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:39.635932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.650280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59de8-d22d-4855-af1d-88aa301b6163 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.796469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.799479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.799767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.800129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] PATH_INFO: `/v3/projects/26ee54d7a3e84461b4e5aff422e87f5a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.803925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ee54d7a3e84461b4e5aff422e87f5a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.806949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.940223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ee54d7a3e84461b4e5aff422e87f5a', 'request_id': 'req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.954131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ee54d7a3e84461b4e5aff422e87f5a', 'request_id': 'req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.962398 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:39.968003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ee54d7a3e84461b4e5aff422e87f5a', 'request_id': 'req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.997203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] The token cache is being invalidate because project 26ee54d7a3e84461b4e5aff422e87f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:39.997408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:40.001007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bce9a960-6d48-4b9a-ac17-b22d1a1f9838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:40.003829 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1630/3253] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:39 2022] DELETE /identity/v3/projects/26ee54d7a3e84461b4e5aff422e87f5a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:40.009028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088b06-82ab-4554-a12e-76ca4b1c8443 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.009741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088b06-82ab-4554-a12e-76ca4b1c8443 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.009741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088b06-82ab-4554-a12e-76ca4b1c8443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.074550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a4088b06-82ab-4554-a12e-76ca4b1c8443 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:40.081468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a4088b06-82ab-4554-a12e-76ca4b1c8443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:40.293239 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1624/3254] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:40.302135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671c7f2-8eaf-49fc-a1d5-9360b8be0dcf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.302333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671c7f2-8eaf-49fc-a1d5-9360b8be0dcf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.302621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671c7f2-8eaf-49fc-a1d5-9360b8be0dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.353325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9671c7f2-8eaf-49fc-a1d5-9360b8be0dcf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:40.354847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9671c7f2-8eaf-49fc-a1d5-9360b8be0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:40.377403 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1631/3255] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:40.379065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4088b06-82ab-4554-a12e-76ca4b1c8443 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.384676 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:40.395109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4088b06-82ab-4554-a12e-76ca4b1c8443 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.408321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.409002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.409361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.409698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.410615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:40.413510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.415220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.455277 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1625/3256] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:40.460219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671c7f2-8eaf-49fc-a1d5-9360b8be0dcf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.477361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671c7f2-8eaf-49fc-a1d5-9360b8be0dcf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.506391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.507087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.507378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.507648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.508346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.513520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.606425 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1632/3257] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:40.611032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.623639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660535-9e9f-4286-8464-feede7f1b985 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.725921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.726544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.726822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.727092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.727736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.730296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.756814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1626/3258] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:40.760297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.780731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041944a-a244-49df-b905-196b45a6fa1b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.796818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.803372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.804136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.804552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.806319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.809874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.832679 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1633/3259] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:40.837439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.855913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bf2b7-bb7c-4992-bba4-3cd21c95b9ab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.861373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece6e35-bd36-4e75-814d-a7c9ddd6c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.862382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece6e35-bd36-4e75-814d-a7c9ddd6c21c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.863083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece6e35-bd36-4e75-814d-a7c9ddd6c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.863554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece6e35-bd36-4e75-814d-a7c9ddd6c21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.864377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece6e35-bd36-4e75-814d-a7c9ddd6c21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.866403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece6e35-bd36-4e75-814d-a7c9ddd6c21c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.879958 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1627/3260] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:40.885922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.904345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35841-c1c6-4b9d-9061-d4c4d4befef9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.921417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.922450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.922450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.922726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] PATH_INFO: `/v3/projects/9027d7cd75f84b11a4b8846a9769e356/users/3fbef527355e40f3af441a57cd5807be/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.956672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9027d7cd75f84b11a4b8846a9769e356, user_id=3fbef527355e40f3af441a57cd5807be, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.963083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.992876 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1634/3261] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:40 2022] PUT /identity/v3/projects/9027d7cd75f84b11a4b8846a9769e356/users/3fbef527355e40f3af441a57cd5807be/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:40.998690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b565094-5279-4451-957c-6d196f077352 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.999290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b565094-5279-4451-957c-6d196f077352 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.999575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b565094-5279-4451-957c-6d196f077352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:41.049527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5b565094-5279-4451-957c-6d196f077352 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:41.052394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b565094-5279-4451-957c-6d196f077352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:41.227705 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1628/3262] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:41.241335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:41.243452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:41.344949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046e2e9-2ea3-4962-86ef-7d51d69e9dfe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:41.348981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:41.349623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:41.349901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:41.350171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:41.364336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:41.365906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:41.379325 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1635/3263] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:43.593606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846c46b-fea6-4975-a655-c19b4135b650 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:43.594828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846c46b-fea6-4975-a655-c19b4135b650 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:43.595102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846c46b-fea6-4975-a655-c19b4135b650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:43.652174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5846c46b-fea6-4975-a655-c19b4135b650 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:43.655339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5846c46b-fea6-4975-a655-c19b4135b650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:43.859710 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1629/3264] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:43.870768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:43.872897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:44.058229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f49db2-3f9c-4483-b3aa-33a72fb67c87 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:44.066879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d8fd-fabe-4df3-94ec-767b7eb9b1b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:44.068018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d8fd-fabe-4df3-94ec-767b7eb9b1b6 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:44.068446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d8fd-fabe-4df3-94ec-767b7eb9b1b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:44.068931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d8fd-fabe-4df3-94ec-767b7eb9b1b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:44.090813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d8fd-fabe-4df3-94ec-767b7eb9b1b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:44.094385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d8fd-fabe-4df3-94ec-767b7eb9b1b6 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:44.110288 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1636/3265] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:53.829136 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:54.103900 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=1,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:00.075322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527fd4-dddc-49b6-b451-6528f987ceea None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:00.075823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527fd4-dddc-49b6-b451-6528f987ceea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:00.075896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527fd4-dddc-49b6-b451-6528f987ceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:00.181117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d1527fd4-dddc-49b6-b451-6528f987ceea None None] MFA Rules not processed for user `7913dc06b5764a5f88399c5a9407feec`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:00.183714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1527fd4-dddc-49b6-b451-6528f987ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:00.386668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1630/3266] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:00.396798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150631c-4776-473f-8007-02f19e00b326 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:00.397362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150631c-4776-473f-8007-02f19e00b326 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:00.400726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150631c-4776-473f-8007-02f19e00b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:00.454986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4150631c-4776-473f-8007-02f19e00b326 None None] MFA Rules not processed for user `7913dc06b5764a5f88399c5a9407feec`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:00.459067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4150631c-4776-473f-8007-02f19e00b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:00.478355 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1637/3267] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:02.020511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:02.021415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:02.021995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:02.093897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] MFA Rules not processed for user `22a8b93432dd4d699a28a8db26bc3c98`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:02.102265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:02.291229 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1631/3268] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:02.302265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:02.305162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:02.305452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:02.354510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] MFA Rules not processed for user `22a8b93432dd4d699a28a8db26bc3c98`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:02.358042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:02.368843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1638/3269] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:02.482564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:02.486074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:02.613728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea168c-f33a-4fc4-a962-c4187ea15c82 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:02.619772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61c19-9e54-4189-a09d-2077e0fb98d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:02.620411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61c19-9e54-4189-a09d-2077e0fb98d3 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:02.620694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61c19-9e54-4189-a09d-2077e0fb98d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:02.620997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61c19-9e54-4189-a09d-2077e0fb98d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:02.632235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61c19-9e54-4189-a09d-2077e0fb98d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:02.634596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61c19-9e54-4189-a09d-2077e0fb98d3 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:02.650339 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1632/3270] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:04.525062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:04.527205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:04.574332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609607f-9446-4eeb-96c1-5d6557efc8b8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:04.608170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:04.612252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.612721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.613157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.634093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:04.636527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:04.662647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b174-7daf-401a-bca3-58c6dd58c76d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.663139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b174-7daf-401a-bca3-58c6dd58c76d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.663386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b174-7daf-401a-bca3-58c6dd58c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.678603 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:04.685159 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1639/3271] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:04.751563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6a60b174-7daf-401a-bca3-58c6dd58c76d None None] MFA Rules not processed for user `3fbef527355e40f3af441a57cd5807be`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:04.754867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6a60b174-7daf-401a-bca3-58c6dd58c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:04.964118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1633/3272] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:16:05.911323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:05.935927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70421-a74c-4230-af1e-47db7ebdf681 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:05.969442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:05.970210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:05.991694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:05.991996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:06.028973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:06.031694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:06.071871 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1640/3273] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:14.954126 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=30 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:16.055114 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=18 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:18.865475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9dec4-dc38-4730-af1d-56ba474b8f8c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:18.866400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9dec4-dc38-4730-af1d-56ba474b8f8c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:18.866859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9dec4-dc38-4730-af1d-56ba474b8f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:18.910841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-17b9dec4-dc38-4730-af1d-56ba474b8f8c None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:18.912207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-17b9dec4-dc38-4730-af1d-56ba474b8f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:18.942327 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1634/3274] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:18.961035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:19.009789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c96ad0-e348-4216-889e-9ae526945ff4 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:19.023056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317292-d1c6-4baf-a5fd-f8ada7a986bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:19.024027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317292-d1c6-4baf-a5fd-f8ada7a986bc service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:19.024908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317292-d1c6-4baf-a5fd-f8ada7a986bc service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:19.025400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317292-d1c6-4baf-a5fd-f8ada7a986bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:19.044321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317292-d1c6-4baf-a5fd-f8ada7a986bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:19.046964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317292-d1c6-4baf-a5fd-f8ada7a986bc service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:19.059722 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1641/3275] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:16:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:20.016392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:20.021223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:20.022590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:20.050682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] MFA Rules not processed for user `3fbef527355e40f3af441a57cd5807be`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:20.052776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:20.077336 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1635/3276] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:20.133665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:20.134514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:20.134947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:20.168827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] MFA Rules not processed for user `2a2ecc1a81574d7aa2679307a7985908`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:20.171851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:20.308420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1642/3277] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:30.043250 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:30.284342 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=31 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:32.825886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:32.827953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:32.871004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5891e00-7c7b-4e10-9310-2a9e0c0517dd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:32.872728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:32.873411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:32.875030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:32.875390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:32.879739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:32.926629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:32.928133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:32.958319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1636/3278] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:34.770189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.773212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:34.808903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248acf-1641-47c7-bc9c-7cac60db6f3b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.829109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.830118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.831811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.833303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] PATH_INFO: `/v3/users/b3d2e0ca31ba428d9391b4fa5c91bf4e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.843989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d2e0ca31ba428d9391b4fa5c91bf4e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.858729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.008508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d2e0ca31ba428d9391b4fa5c91bf4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.026453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d2e0ca31ba428d9391b4fa5c91bf4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.027745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d2e0ca31ba428d9391b4fa5c91bf4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.055401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d2e0ca31ba428d9391b4fa5c91bf4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.056837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83e10bab-1717-471d-9531-fd701bf316e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d2e0ca31ba428d9391b4fa5c91bf4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.080041 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1643/3279] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:34 2022] DELETE /identity/v3/users/b3d2e0ca31ba428d9391b4fa5c91bf4e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:35.539010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.554437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b88cc-afc9-4d48-9092-715629738ba0 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.678666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.679587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.680043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.680467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] PATH_INFO: `/v3/projects/30b2a95273e6417babc48661728340bf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.681816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b2a95273e6417babc48661728340bf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.683862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.804294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b2a95273e6417babc48661728340bf', 'request_id': 'req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.830933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b2a95273e6417babc48661728340bf', 'request_id': 'req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.852928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b2a95273e6417babc48661728340bf', 'request_id': 'req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.878962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] The token cache is being invalidate because project 30b2a95273e6417babc48661728340bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:35.879534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.880472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce7083fb-6fdf-4517-ab47-ffa0cae0ca87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:35.883715 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1637/3280] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:35 2022] DELETE /identity/v3/projects/30b2a95273e6417babc48661728340bf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:35.888626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733145-ca73-4aa4-b2c6-1ded314a6892 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.889173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733145-ca73-4aa4-b2c6-1ded314a6892 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.889261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733145-ca73-4aa4-b2c6-1ded314a6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.943721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-12733145-ca73-4aa4-b2c6-1ded314a6892 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:35.945668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12733145-ca73-4aa4-b2c6-1ded314a6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:36.036485 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1644/3281] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:36.044187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583e7c6-8e20-4dfb-9b2f-4d8750b5d5e2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.044463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583e7c6-8e20-4dfb-9b2f-4d8750b5d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.044731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583e7c6-8e20-4dfb-9b2f-4d8750b5d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.089979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1583e7c6-8e20-4dfb-9b2f-4d8750b5d5e2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:36.091590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1583e7c6-8e20-4dfb-9b2f-4d8750b5d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:36.109451 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1638/3282] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:36.113561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12733145-ca73-4aa4-b2c6-1ded314a6892 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:36.127489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12733145-ca73-4aa4-b2c6-1ded314a6892 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:36.140660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:36.142868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.145200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.145648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.146663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:16:36.147111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:36.151460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:36.199130 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1645/3283] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:16:36.203766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583e7c6-8e20-4dfb-9b2f-4d8750b5d5e2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:36.215725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583e7c6-8e20-4dfb-9b2f-4d8750b5d5e2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:36.225890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:36.226577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.226860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.227130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.227770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:36.230013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:36.298831 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1639/3284] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:36 2022] POST /identity/v3/projects => generated 411 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:36.303152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:36.339205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eb483-972d-4cb5-9c0c-10e85798a404 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:36.450785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:36.451769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.452191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.452716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.453481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:36.456118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:36.465455 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:36.485389 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1646/3285] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:36 2022] POST /identity/v3/users => generated 306 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:36.489370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:36.508251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925526b-3a0d-4b79-80f3-3e9bec30956c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:36.532934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:36.534608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.535001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.536265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.538500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:36.542854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:36.585747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1640/3286] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:36.590770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:36.606159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0d8da-6f71-41e9-9c6a-be77bcc27070 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:36.612395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15946d72-4f74-4186-a9db-e1a783ab7419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:36.613287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946d72-4f74-4186-a9db-e1a783ab7419 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.613749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946d72-4f74-4186-a9db-e1a783ab7419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.614343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946d72-4f74-4186-a9db-e1a783ab7419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.615583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15946d72-4f74-4186-a9db-e1a783ab7419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:36.618063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15946d72-4f74-4186-a9db-e1a783ab7419 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:36.638696 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1647/3287] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:36.640261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:36.654996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf85c9-8f90-4587-afe6-0cffa44ab584 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:36.673731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:36.674610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.674885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.675414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] PATH_INFO: `/v3/projects/7026e7b12fc24e5c979db5f97191405d/users/9648ebb42868486d81c91e753a293f8f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.708907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7026e7b12fc24e5c979db5f97191405d, user_id=9648ebb42868486d81c91e753a293f8f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:36.718053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:36.752653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8135-9e9e-489b-bf3f-4c001e16a3e0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:36.753095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8135-9e9e-489b-bf3f-4c001e16a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:36.753474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8135-9e9e-489b-bf3f-4c001e16a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:36.758541 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1641/3288] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:36 2022] PUT /identity/v3/projects/7026e7b12fc24e5c979db5f97191405d/users/9648ebb42868486d81c91e753a293f8f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:16:36.794698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-275c8135-9e9e-489b-bf3f-4c001e16a3e0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:36.798095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-275c8135-9e9e-489b-bf3f-4c001e16a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:36.904621 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1648/3289] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:36.925220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:36.927652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:36.942975 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:37.060943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5f00a-4237-49e5-80fb-1f5a3e5b9e7c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:37.066272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:37.067184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:37.067464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:37.067733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:37.081363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:37.083095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:37.096925 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1642/3290] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:45.187981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c8135-9e9e-489b-bf3f-4c001e16a3e0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:45.201564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c8135-9e9e-489b-bf3f-4c001e16a3e0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:45.210808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507d95-bfe4-4452-82c3-164e9ad5ee4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:45.211478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507d95-bfe4-4452-82c3-164e9ad5ee4a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:45.211975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507d95-bfe4-4452-82c3-164e9ad5ee4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:45.212405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507d95-bfe4-4452-82c3-164e9ad5ee4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:45.219045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-07507d95-bfe4-4452-82c3-164e9ad5ee4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:45.394771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507d95-bfe4-4452-82c3-164e9ad5ee4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:45.398790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507d95-bfe4-4452-82c3-164e9ad5ee4a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:45.428339 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1649/3291] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:46.420042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:46.421599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:46.444065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfebd4-fcdc-4593-b67d-43dd60e524df service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:46.454627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd567-9d1a-4cb6-8279-002973cfba01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:46.458972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd567-9d1a-4cb6-8279-002973cfba01 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:46.459573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd567-9d1a-4cb6-8279-002973cfba01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:46.460054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd567-9d1a-4cb6-8279-002973cfba01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:46.462922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-503cd567-9d1a-4cb6-8279-002973cfba01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:46.484349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd567-9d1a-4cb6-8279-002973cfba01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:46.487525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd567-9d1a-4cb6-8279-002973cfba01 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:46.507301 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1643/3292] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:49.794254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:49.794760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:49.794857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:49.842139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] MFA Rules not processed for user `9648ebb42868486d81c91e753a293f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:49.844329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:49.953354 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:49.992397 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1650/3293] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:50.005655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f306-dded-4182-a303-65791969381e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:50.006142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f306-dded-4182-a303-65791969381e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:50.006226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f306-dded-4182-a303-65791969381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:50.074658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2593f306-dded-4182-a303-65791969381e None None] MFA Rules not processed for user `9648ebb42868486d81c91e753a293f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:50.075782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2593f306-dded-4182-a303-65791969381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:50.106278 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1644/3294] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:50.208426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:50.210568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:50.251605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c59f0-2c36-44db-b3fe-733806674436 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:50.269272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:50.271710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:50.276296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:50.276882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:50.297390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:50.299290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:50.320017 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1651/3295] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:50 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:52.230636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f306-dded-4182-a303-65791969381e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:52.233002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2593f306-dded-4182-a303-65791969381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:52.426526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:52.439744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261a737-0c59-4fcc-bbc2-b21afa4b9ec0 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:52.449806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:52.450437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:52.450720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:52.450996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:52.461288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:52.504837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:52.506228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:52.525019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f306-dded-4182-a303-65791969381e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:52.539767 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1652/3296] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:52.541953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:52.542853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:52.543488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:52.544025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:52.546364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:52.568006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:52.569912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:52.588109 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1645/3297] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:53.379560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:53.381271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:53.413810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:53.414383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35e4a6-0c82-4039-bbd7-74dc47070cce service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:53.419266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:53.420202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:53.420544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:53.420978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] PATH_INFO: `/v3/users/547522b0b07f472a91ec83f15a36bb90` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:53.423136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547522b0b07f472a91ec83f15a36bb90)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:53.426085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:53.428037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef09540-3b62-4386-aba8-56df3f7d304c service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:53.442270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:53.443295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:53.445030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:53.445617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:53.449855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:53.482792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:53.486724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:53.501095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547522b0b07f472a91ec83f15a36bb90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:53.512156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547522b0b07f472a91ec83f15a36bb90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:53.512780 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1646/3298] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:16:53.513780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547522b0b07f472a91ec83f15a36bb90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:53.525403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547522b0b07f472a91ec83f15a36bb90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:53.527958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547522b0b07f472a91ec83f15a36bb90'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:53.554194 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1653/3299] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:53 2022] DELETE /identity/v3/users/547522b0b07f472a91ec83f15a36bb90 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:54.154538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:54.180040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8a90-0cca-4d4d-9924-f35c9a21255c service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:54.348386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:54.349254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:54.351007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:54.355348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] PATH_INFO: `/v3/projects/ce70f9ff025c4666be942f9399ae72dc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:54.358273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce70f9ff025c4666be942f9399ae72dc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:54.362387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:54.373540 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:54.475055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce70f9ff025c4666be942f9399ae72dc', 'request_id': 'req-5fad7e23-8dc0-4a34-8f8b-6e2416477758'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.484245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce70f9ff025c4666be942f9399ae72dc', 'request_id': 'req-5fad7e23-8dc0-4a34-8f8b-6e2416477758'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.494491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce70f9ff025c4666be942f9399ae72dc', 'request_id': 'req-5fad7e23-8dc0-4a34-8f8b-6e2416477758'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.524416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] The token cache is being invalidate because project ce70f9ff025c4666be942f9399ae72dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:54.524855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.525643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.530869 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1647/3300] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:54 2022] DELETE /identity/v3/projects/ce70f9ff025c4666be942f9399ae72dc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:54.533162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:54.534873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:54.571384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bccd2-de47-4620-a817-e9be21cc6732 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:54.714052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:54.715534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:54.716325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:54.716862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] PATH_INFO: `/v3/users/1ed19f30606d407b9ae85394340246a8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:54.718799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed19f30606d407b9ae85394340246a8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:54.721657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:54.782857 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:54.790704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed19f30606d407b9ae85394340246a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.804526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed19f30606d407b9ae85394340246a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.805245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed19f30606d407b9ae85394340246a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.816283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed19f30606d407b9ae85394340246a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.817623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27952c21-fd1d-4b46-b467-093751a88d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed19f30606d407b9ae85394340246a8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:54.838785 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1654/3301] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:54 2022] DELETE /identity/v3/users/1ed19f30606d407b9ae85394340246a8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:55.338416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:55.340281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:55.358879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7e23-8dc0-4a34-8f8b-6e2416477758 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:55.471449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:55.472371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:55.473013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:55.473453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] PATH_INFO: `/v3/projects/14f437a323e14d4587abeaf218a30361` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:55.476347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f437a323e14d4587abeaf218a30361)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:55.480313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:55.572860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f437a323e14d4587abeaf218a30361', 'request_id': 'req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:55.601920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f437a323e14d4587abeaf218a30361', 'request_id': 'req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:55.627878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f437a323e14d4587abeaf218a30361', 'request_id': 'req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:55.656957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] The token cache is being invalidate because project 14f437a323e14d4587abeaf218a30361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:55.657378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:55.659282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7ba88c6-0fcd-46bc-af1f-2e56de1b5c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:55.661849 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1648/3302] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:55 2022] DELETE /identity/v3/projects/14f437a323e14d4587abeaf218a30361 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:55.674254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890cc6b-25f4-4591-b715-250ed6e9b7d9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:55.675379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890cc6b-25f4-4591-b715-250ed6e9b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:55.675711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890cc6b-25f4-4591-b715-250ed6e9b7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:55.756834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9890cc6b-25f4-4591-b715-250ed6e9b7d9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:55.760136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9890cc6b-25f4-4591-b715-250ed6e9b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:55.876730 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1655/3303] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:55.878061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85120f6-7436-4de1-8b06-98279cf9ee68 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:55.878341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85120f6-7436-4de1-8b06-98279cf9ee68 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:55.878803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85120f6-7436-4de1-8b06-98279cf9ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:55.923846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b85120f6-7436-4de1-8b06-98279cf9ee68 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:55.925108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b85120f6-7436-4de1-8b06-98279cf9ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:55.940524 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1649/3304] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:55.942845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890cc6b-25f4-4591-b715-250ed6e9b7d9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:55.959804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890cc6b-25f4-4591-b715-250ed6e9b7d9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:55.966278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:55.967041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:55.968024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:55.968374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:55.969371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:16:55.970007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:55.972122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:56.005417 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1656/3305] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:16:56.005964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85120f6-7436-4de1-8b06-98279cf9ee68 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:56.024081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85120f6-7436-4de1-8b06-98279cf9ee68 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:56.036760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:56.037693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:56.038127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:56.039183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:56.039481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:56.042256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:56.060721 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:56.085497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:56.099306 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1650/3306] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:56 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:56.099639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54b133-d33a-410c-b1b4-1bdfe6d22b79 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:56.173735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:56.174371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:56.174644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:56.174916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:56.175547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:56.178009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:56.215928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:56.237162 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1657/3307] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:56 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:56.242850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f26e2-0831-4339-a2ff-57183cbca377 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:56.248946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:56.250039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:56.250378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:56.250714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:56.251422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:56.253233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:56.274396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:56.295355 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1651/3308] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:56.303471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e662b4f-68aa-481e-af58-9309c5742de0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:56.311472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e03c-2ead-4ba7-a030-420a23d6a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:56.312989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e03c-2ead-4ba7-a030-420a23d6a790 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:56.313497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e03c-2ead-4ba7-a030-420a23d6a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:56.314197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e03c-2ead-4ba7-a030-420a23d6a790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:56.315086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e03c-2ead-4ba7-a030-420a23d6a790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:56.317441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e03c-2ead-4ba7-a030-420a23d6a790 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:56.339598 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1658/3309] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:56.345248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:56.372205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ede5-914f-4d2d-a609-54e08df65075 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:56.390771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:56.391365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:56.391644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:56.391912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] PATH_INFO: `/v3/projects/a3b035ec7bd0473788f89c45e4950066/users/b69e173eef9b42a9ae6a0e1255ea2b4c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:56.429689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b035ec7bd0473788f89c45e4950066, user_id=b69e173eef9b42a9ae6a0e1255ea2b4c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:56.437642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:56.473222 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1652/3310] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:56 2022] PUT /identity/v3/projects/a3b035ec7bd0473788f89c45e4950066/users/b69e173eef9b42a9ae6a0e1255ea2b4c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:56.559297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b36a-5a5d-4867-915c-a8c0e27395a8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:56.559637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b36a-5a5d-4867-915c-a8c0e27395a8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:56.559897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b36a-5a5d-4867-915c-a8c0e27395a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:56.625743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4552b36a-5a5d-4867-915c-a8c0e27395a8 None None] MFA Rules not processed for user `b69e173eef9b42a9ae6a0e1255ea2b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:56.627254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4552b36a-5a5d-4867-915c-a8c0e27395a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:56.668162 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:56.758477 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1659/3311] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:56.767932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:56.885601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a9f9-75c5-4dfc-bc5b-422cd0dbfe67 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:56.901481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:56.902598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:56.904114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:56.904703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:56.907397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:56.911635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:56.962573 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1653/3312] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:56 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:56.967032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b36a-5a5d-4867-915c-a8c0e27395a8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:56.990466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b36a-5a5d-4867-915c-a8c0e27395a8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:57.079862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:57.081078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.081507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.081967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.082994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:57.088460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:57.136148 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1660/3313] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:56 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:57.141157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:57.158183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8b32d-d54e-4b8b-b6df-9daa8db15869 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:57.163598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:57.164996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.165689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.166668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.166896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:57.168809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:57.186751 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1654/3314] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:57.191000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:57.214277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c20b-f344-4e3b-a7fb-6893606015c1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:57.225848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:57.227988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.228914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.228914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] PATH_INFO: `/v3/projects/8adcdc517cd743ab9a4a626f3709512d/users/a96e0ed81b82493db1349297ee382ec9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.266686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adcdc517cd743ab9a4a626f3709512d, user_id=a96e0ed81b82493db1349297ee382ec9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:57.270004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:57.291533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1661/3315] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:57 2022] PUT /identity/v3/projects/8adcdc517cd743ab9a4a626f3709512d/users/a96e0ed81b82493db1349297ee382ec9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:57.297094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:57.342385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8e200-3872-41a5-8a4c-a70d203050c3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:57.471474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af27cf5-7f79-4dee-8c9f-3d0b164e4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:57.472194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27cf5-7f79-4dee-8c9f-3d0b164e4878 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.472538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27cf5-7f79-4dee-8c9f-3d0b164e4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.473434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27cf5-7f79-4dee-8c9f-3d0b164e4878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.476229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af27cf5-7f79-4dee-8c9f-3d0b164e4878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:57.479690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af27cf5-7f79-4dee-8c9f-3d0b164e4878 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:57.502895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1655/3316] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:57.504191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:57.516282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716a7b7-667f-43ed-a6bf-4bb84f37de52 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:57.545717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:57.546466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.547193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.547193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] PATH_INFO: `/v3/projects/8adcdc517cd743ab9a4a626f3709512d/users/a96e0ed81b82493db1349297ee382ec9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.549339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adcdc517cd743ab9a4a626f3709512d, user_id=a96e0ed81b82493db1349297ee382ec9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:57.553274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:57.607259 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1662/3317] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:57 2022] PUT /identity/v3/projects/8adcdc517cd743ab9a4a626f3709512d/users/a96e0ed81b82493db1349297ee382ec9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:57.609404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad126-3b2e-4262-8a33-3cc9f2485d70 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.609404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad126-3b2e-4262-8a33-3cc9f2485d70 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.609677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad126-3b2e-4262-8a33-3cc9f2485d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.676016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-812ad126-3b2e-4262-8a33-3cc9f2485d70 None None] MFA Rules not processed for user `a96e0ed81b82493db1349297ee382ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:57.693184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-812ad126-3b2e-4262-8a33-3cc9f2485d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:57.753969 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:57.850549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:57.853983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:57.925460 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1656/3318] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:57.940011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613055-6af2-43d5-b74b-10d3dea3986b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.940833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613055-6af2-43d5-b74b-10d3dea3986b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.941408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613055-6af2-43d5-b74b-10d3dea3986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.977839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b56f9-483b-4f02-a342-52f7e956f751 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:57.987805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-46613055-6af2-43d5-b74b-10d3dea3986b None None] MFA Rules not processed for user `b69e173eef9b42a9ae6a0e1255ea2b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:57.988643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:57.991270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:57.991540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:57.991816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] PATH_INFO: `/v3/users/7913dc06b5764a5f88399c5a9407feec` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:57.994042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-46613055-6af2-43d5-b74b-10d3dea3986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:57.996961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7913dc06b5764a5f88399c5a9407feec)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:58.001019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:58.017943 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:58.082988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7913dc06b5764a5f88399c5a9407feec'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:58.096228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7913dc06b5764a5f88399c5a9407feec'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:58.097698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7913dc06b5764a5f88399c5a9407feec'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:58.110050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7913dc06b5764a5f88399c5a9407feec'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:58.110050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19fd82e0-3e14-4cca-927c-d0df965d3124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7913dc06b5764a5f88399c5a9407feec'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:58.111370 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1657/3319] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:58.151556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1663/3320] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:57 2022] DELETE /identity/v3/users/7913dc06b5764a5f88399c5a9407feec => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:58.310138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defbb63-b0c4-40f7-941e-07a6b253dfc8 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:58.310460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defbb63-b0c4-40f7-941e-07a6b253dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:58.310884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defbb63-b0c4-40f7-941e-07a6b253dfc8 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:58.312551 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1658/3321] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:16:58.320628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:58.321275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:58.321644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:58.372672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:58.374153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:58.455323 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1664/3322] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:58.488906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defbb63-b0c4-40f7-941e-07a6b253dfc8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:58.490768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9defbb63-b0c4-40f7-941e-07a6b253dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:58.509715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defbb63-b0c4-40f7-941e-07a6b253dfc8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:58.514290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:58.515413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:58.515779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:58.516139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:58.526223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:58.528395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:58.540070 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1659/3323] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:58.550976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:58.566501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:58.659607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b364a46-31fc-47e7-a4c7-a7b2e9aaa9ae None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:58.670037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2a1e6-9b04-4c96-8fb7-a025dd4e256d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:58.671085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a1e6-9b04-4c96-8fb7-a025dd4e256d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:58.673066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a1e6-9b04-4c96-8fb7-a025dd4e256d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:58.673332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a1e6-9b04-4c96-8fb7-a025dd4e256d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:58.675228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2ff2a1e6-9b04-4c96-8fb7-a025dd4e256d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:58.694991 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:58.774923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2a1e6-9b04-4c96-8fb7-a025dd4e256d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:58.776697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2a1e6-9b04-4c96-8fb7-a025dd4e256d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:58.795720 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1665/3324] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:58.890922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:58.894292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:59.021088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac41df-00fb-4166-9c68-4b762e584650 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:59.033148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:59.033942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.034227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.034761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] PATH_INFO: `/v3/projects/aa16ca726eda42c2ab2983a6b22e73c1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.036821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa16ca726eda42c2ab2983a6b22e73c1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:59.038962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:59.135600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa16ca726eda42c2ab2983a6b22e73c1', 'request_id': 'req-10413e99-addf-4d34-994a-fc01c711a436'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:59.137613 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:59.152176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa16ca726eda42c2ab2983a6b22e73c1', 'request_id': 'req-10413e99-addf-4d34-994a-fc01c711a436'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:59.163898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa16ca726eda42c2ab2983a6b22e73c1', 'request_id': 'req-10413e99-addf-4d34-994a-fc01c711a436'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:59.190014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] The token cache is being invalidate because project aa16ca726eda42c2ab2983a6b22e73c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:59.190481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:59.191528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-10413e99-addf-4d34-994a-fc01c711a436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:59.196909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1660/3325] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:58 2022] DELETE /identity/v3/projects/aa16ca726eda42c2ab2983a6b22e73c1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:59.199304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489943-64b2-41db-a9f3-5b3ca606ad5c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.200857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489943-64b2-41db-a9f3-5b3ca606ad5c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.201219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489943-64b2-41db-a9f3-5b3ca606ad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.238402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d9489943-64b2-41db-a9f3-5b3ca606ad5c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:59.239751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d9489943-64b2-41db-a9f3-5b3ca606ad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:59.332816 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1666/3326] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:59.338761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d725-1710-4d8f-ba78-df18a22ae4a4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.339475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d725-1710-4d8f-ba78-df18a22ae4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.339994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d725-1710-4d8f-ba78-df18a22ae4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.386552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2421d725-1710-4d8f-ba78-df18a22ae4a4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:59.388316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2421d725-1710-4d8f-ba78-df18a22ae4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:59.408780 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1661/3327] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:59.413687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9489943-64b2-41db-a9f3-5b3ca606ad5c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:59.430292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9489943-64b2-41db-a9f3-5b3ca606ad5c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:59.456245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:59.457436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.457894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.458360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.459236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:16:59.459789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:59.461762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:59.483213 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1667/3328] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:16:59.487970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d725-1710-4d8f-ba78-df18a22ae4a4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:59.510170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d725-1710-4d8f-ba78-df18a22ae4a4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:59.517303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:59.518098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.518467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.518850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.519593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:59.522997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:59.574655 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1662/3329] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:59 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:59.579863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:59.598471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdea5a-b741-4aa0-b289-adcb61d5936f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:59.789253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:59.798585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.802671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.802671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.802671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:59.806174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:59.832849 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1668/3330] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:59 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:59.836863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:59.859904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa3d5b-7a7e-43a8-9633-eb56bd1da10b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:59.873480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:59.874489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.876291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.878576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.886729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:59.892691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:59.942713 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1663/3331] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:59.944712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:59.960077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368ac9-3105-4051-b0be-dcb6dd803f94 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:59.981684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:59.982854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:59.983204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:59.984365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:59.985374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:59.987389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:00.017830 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1669/3332] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:00.021936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:00.036393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c940c-05d8-4afd-9d8d-be58c465c0ea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:00.050607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674229-744a-477f-994d-78eb02246c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:00.051875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674229-744a-477f-994d-78eb02246c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:00.052223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674229-744a-477f-994d-78eb02246c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:00.052573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674229-744a-477f-994d-78eb02246c97 admin admin] PATH_INFO: `/v3/projects/0726dc6f6f5244019d8f697309296da4/users/1a8d8e6a81c44fbeaef533b3369ecc41/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:00.114326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3674229-744a-477f-994d-78eb02246c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0726dc6f6f5244019d8f697309296da4, user_id=1a8d8e6a81c44fbeaef533b3369ecc41, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:00.117037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3674229-744a-477f-994d-78eb02246c97 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:00.143082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:00.145965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:00.160935 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1664/3333] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:00 2022] PUT /identity/v3/projects/0726dc6f6f5244019d8f697309296da4/users/1a8d8e6a81c44fbeaef533b3369ecc41/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:00.172132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:00.172444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:00.172911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:00.225011 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:00.262876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] MFA Rules not processed for user `1a8d8e6a81c44fbeaef533b3369ecc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:00.264307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:00.366581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33935380-5bce-41e9-b9f9-14259f55fbf2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:00.384816 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1665/3334] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:00.506278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:00.507900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:00.521735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:00.522464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:00.522897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:00.523176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:00.525188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:00.547391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:00.549086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:00.575479 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1670/3335] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:00.614369 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:00.628292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12dd87-a866-4519-8255-e884b0683b5b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:00.643597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078696d-363e-4693-ac4e-e7bd3820578c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:00.645296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078696d-363e-4693-ac4e-e7bd3820578c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:00.646970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078696d-363e-4693-ac4e-e7bd3820578c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:00.647787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078696d-363e-4693-ac4e-e7bd3820578c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:00.665282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078696d-363e-4693-ac4e-e7bd3820578c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:00.667859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078696d-363e-4693-ac4e-e7bd3820578c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:00.679783 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1666/3336] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:17:00.757440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:00.846419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b9e3e-76f4-4946-8e88-116893cb0234 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:00.852108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:00.853192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:00.853699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:00.854182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] PATH_INFO: `/v3/users/1a8d8e6a81c44fbeaef533b3369ecc41` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:00.855591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8d8e6a81c44fbeaef533b3369ecc41)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:00.857958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:00.926724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8d8e6a81c44fbeaef533b3369ecc41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:00.930265 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:00.940628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8d8e6a81c44fbeaef533b3369ecc41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:00.941920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8d8e6a81c44fbeaef533b3369ecc41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:00.951878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8d8e6a81c44fbeaef533b3369ecc41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:00.953484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8d8e6a81c44fbeaef533b3369ecc41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:00.990875 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1671/3337] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:00 2022] DELETE /identity/v3/users/1a8d8e6a81c44fbeaef533b3369ecc41 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:00.992219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:00.992608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:00.993004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:01.038058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:01.039605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:01.151942 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1667/3338] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:01.167405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:01.169355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:01.270050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114ece-6024-4586-a956-a6e82f9ea125 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:01.279728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971941-d7b1-4bd5-a536-a0bc271c121a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:01.281214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971941-d7b1-4bd5-a536-a0bc271c121a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:01.281738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971941-d7b1-4bd5-a536-a0bc271c121a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:01.282231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971941-d7b1-4bd5-a536-a0bc271c121a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:01.295038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971941-d7b1-4bd5-a536-a0bc271c121a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:01.297146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971941-d7b1-4bd5-a536-a0bc271c121a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:01.311238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1672/3339] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:02.247663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:02.249304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:02.271908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055cf35-7364-4d62-849a-686f4f047bb7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:02.289325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:02.290083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:02.290505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:02.290918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] PATH_INFO: `/v3/projects/0726dc6f6f5244019d8f697309296da4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:02.292157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0726dc6f6f5244019d8f697309296da4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:02.294205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:02.397005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0726dc6f6f5244019d8f697309296da4', 'request_id': 'req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:02.412313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0726dc6f6f5244019d8f697309296da4', 'request_id': 'req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:02.429078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0726dc6f6f5244019d8f697309296da4', 'request_id': 'req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:02.454247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] The token cache is being invalidate because project 0726dc6f6f5244019d8f697309296da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:02.455002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:02.455938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdefd46d-2768-4cc4-bfe3-52e5ea61ed11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:02.457672 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1668/3340] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:02 2022] DELETE /identity/v3/projects/0726dc6f6f5244019d8f697309296da4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:02.463794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42667-9290-4b61-96ee-b45a4bf6234a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:02.464393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42667-9290-4b61-96ee-b45a4bf6234a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:02.464393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42667-9290-4b61-96ee-b45a4bf6234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:02.519003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-06a42667-9290-4b61-96ee-b45a4bf6234a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:02.520254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-06a42667-9290-4b61-96ee-b45a4bf6234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:02.616915 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1673/3341] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:02.619255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4dd31-dd85-40a7-ac7a-0ff55b22523c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:02.619819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4dd31-dd85-40a7-ac7a-0ff55b22523c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:02.620275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4dd31-dd85-40a7-ac7a-0ff55b22523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:02.662512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-03f4dd31-dd85-40a7-ac7a-0ff55b22523c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:02.666084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-03f4dd31-dd85-40a7-ac7a-0ff55b22523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:02.691722 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1669/3342] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:17:02.696530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42667-9290-4b61-96ee-b45a4bf6234a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:02.707331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42667-9290-4b61-96ee-b45a4bf6234a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:02.714577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:02.715356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:02.715698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:02.716315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:02.717015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:02.717318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:02.719335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:02.736944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1674/3343] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:02.737594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4dd31-dd85-40a7-ac7a-0ff55b22523c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:02.752539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4dd31-dd85-40a7-ac7a-0ff55b22523c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:02.773127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:02.774516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:02.774801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:02.775072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:02.775890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:02.778265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:02.838131 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1670/3344] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:02 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:02.838665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:02.849495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25384e-54cb-4fea-9016-ca0c79d91ff7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:02.958377 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:02.967331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:02.968004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:02.968457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:02.968920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:02.969566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:02.972086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:03.003038 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1675/3345] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:02 2022] POST /identity/v3/users => generated 281 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:03.004311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:03.020735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dddd71-fa8d-4731-b877-e8df2297366f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:03.041097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:03.041714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:03.042125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:03.042406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:03.043055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:03.047147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:03.068540 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1671/3346] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:03.072304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:03.087699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46ec5-6b95-4b82-abfe-31b87eea925f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:03.095679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e894-39d2-4966-b1fa-46c87aa7283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:03.096572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e894-39d2-4966-b1fa-46c87aa7283d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:03.097193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e894-39d2-4966-b1fa-46c87aa7283d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:03.097638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e894-39d2-4966-b1fa-46c87aa7283d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:03.098452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0e894-39d2-4966-b1fa-46c87aa7283d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:03.101501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0e894-39d2-4966-b1fa-46c87aa7283d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:03.125837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:03.135807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1676/3347] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:17:03.160549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafbc30-0538-4c3b-93f9-a33fc815c224 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:03.165612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:03.166423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:03.166735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:03.167166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] PATH_INFO: `/v3/projects/b55649adf0004272bdd00a533f33cc4f/users/4ba9f119bf074d8cafccd91707c11682/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:03.187749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55649adf0004272bdd00a533f33cc4f, user_id=4ba9f119bf074d8cafccd91707c11682, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:03.191150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:03.221647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1672/3348] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:03 2022] PUT /identity/v3/projects/b55649adf0004272bdd00a533f33cc4f/users/4ba9f119bf074d8cafccd91707c11682/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:03.223732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee42c-f9a2-4309-a494-131df95601b8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:03.224018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee42c-f9a2-4309-a494-131df95601b8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:03.224287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee42c-f9a2-4309-a494-131df95601b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:03.263703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f37ee42c-f9a2-4309-a494-131df95601b8 None None] MFA Rules not processed for user `4ba9f119bf074d8cafccd91707c11682`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:03.265979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f37ee42c-f9a2-4309-a494-131df95601b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:03.357056 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1677/3349] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:03.407663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:03.429168 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:03.527138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82f76-5d97-4078-9070-62b4c527097b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:03.536328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:03.538405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:03.540984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:03.540984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] PATH_INFO: `/v3/users/4ba9f119bf074d8cafccd91707c11682` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:03.544962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba9f119bf074d8cafccd91707c11682)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:03.547670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:03.622217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba9f119bf074d8cafccd91707c11682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:03.634780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba9f119bf074d8cafccd91707c11682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:03.655939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba9f119bf074d8cafccd91707c11682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:03.658291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba9f119bf074d8cafccd91707c11682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:03.673406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba9f119bf074d8cafccd91707c11682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:03.700870 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1673/3350] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:03 2022] DELETE /identity/v3/users/4ba9f119bf074d8cafccd91707c11682 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:03.704753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:03.705304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:03.705878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:03.738038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:03.739409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:03.836530 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1678/3351] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:03.849879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:03.851985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:04.017050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce13b-d5a8-44bb-ac1f-55168e127f6c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:04.031740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:04.032906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:04.033941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:04.034204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:04.034420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:04.035857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:04.060692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:04.064731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:04.090928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1674/3352] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:04.113376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627bec5-0400-4924-9cc7-9210c360d19d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:04.142929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:04.146297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:04.148841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:04.152288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] PATH_INFO: `/v3/users/2a2ecc1a81574d7aa2679307a7985908` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:04.154972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2ecc1a81574d7aa2679307a7985908)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:04.160302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:04.238574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2ecc1a81574d7aa2679307a7985908'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:04.250560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2ecc1a81574d7aa2679307a7985908'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:04.251349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2ecc1a81574d7aa2679307a7985908'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:04.262394 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:04.265985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2ecc1a81574d7aa2679307a7985908'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:04.279392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d9c6042-97d0-4ddd-b08a-7b22ae45c4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2ecc1a81574d7aa2679307a7985908'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:04.298298 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1679/3353] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:04 2022] DELETE /identity/v3/users/2a2ecc1a81574d7aa2679307a7985908 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:04.985925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.004541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0181c-2e63-4480-be5a-eed4af997897 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.046263 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:05.089967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.090635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.090899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.091171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] PATH_INFO: `/v3/projects/985e65b1266f46c196e8a07a9a016210` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.092438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985e65b1266f46c196e8a07a9a016210)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.094632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.150752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985e65b1266f46c196e8a07a9a016210', 'request_id': 'req-bcfb97f7-d495-4e45-a941-5407b4181922'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:05.158436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985e65b1266f46c196e8a07a9a016210', 'request_id': 'req-bcfb97f7-d495-4e45-a941-5407b4181922'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:05.164875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985e65b1266f46c196e8a07a9a016210', 'request_id': 'req-bcfb97f7-d495-4e45-a941-5407b4181922'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:05.182239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] The token cache is being invalidate because project 985e65b1266f46c196e8a07a9a016210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:05.182507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:05.183195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bcfb97f7-d495-4e45-a941-5407b4181922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:05.184903 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1675/3354] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:04 2022] DELETE /identity/v3/projects/985e65b1266f46c196e8a07a9a016210 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:05.190972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df82a7-5830-4b59-adcd-31a611e675c6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.191498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df82a7-5830-4b59-adcd-31a611e675c6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.191498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df82a7-5830-4b59-adcd-31a611e675c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.212797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b9df82a7-5830-4b59-adcd-31a611e675c6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:05.214039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b9df82a7-5830-4b59-adcd-31a611e675c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:05.277357 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1680/3355] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:05.284967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e96e9-f11a-40f9-b2f9-486177194a32 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.285515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e96e9-f11a-40f9-b2f9-486177194a32 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.286047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e96e9-f11a-40f9-b2f9-486177194a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.308744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cb2e96e9-f11a-40f9-b2f9-486177194a32 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:05.310103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb2e96e9-f11a-40f9-b2f9-486177194a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:05.320803 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1676/3356] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:05.324697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df82a7-5830-4b59-adcd-31a611e675c6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.335462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df82a7-5830-4b59-adcd-31a611e675c6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.340502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.341161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.341439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.341710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.342369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:05.342676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.344327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.360811 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1681/3357] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:17:05.361959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e96e9-f11a-40f9-b2f9-486177194a32 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.371461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e96e9-f11a-40f9-b2f9-486177194a32 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.376708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.377368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.377669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.377980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.378570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.380518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.411465 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1677/3358] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:05 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:05.415782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.428588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cba47-ba7d-4c69-b086-33a95c884827 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.491517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.492130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.492410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.492684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.493524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.495751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.518390 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1682/3359] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:05 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:05.522976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.534915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aadfb-3dc8-4094-adc4-15ad56b3c29e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.539742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.540363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.540639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.540942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.541621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.543222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.555839 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1678/3360] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:17:05.559754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.579718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82b0c3-fce7-4378-979a-9b7892d552a6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.584954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c5c8-b035-40db-8817-fbc1c6c75937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.585506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c5c8-b035-40db-8817-fbc1c6c75937 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.585787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c5c8-b035-40db-8817-fbc1c6c75937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.586061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c5c8-b035-40db-8817-fbc1c6c75937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.586724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5c5c8-b035-40db-8817-fbc1c6c75937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.588379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5c5c8-b035-40db-8817-fbc1c6c75937 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.602010 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1683/3361] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:05.606501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.620684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67ba07-4336-4dd5-bd6c-af820dc0569e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.625787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.626660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.627018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.627205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] PATH_INFO: `/v3/projects/37bc012ea49c49eface4c4e899a53460/users/ba233f6cc0734ad9aca8c0fe2899a4f1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.648831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37bc012ea49c49eface4c4e899a53460, user_id=ba233f6cc0734ad9aca8c0fe2899a4f1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.658468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.685828 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1679/3362] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:05 2022] PUT /identity/v3/projects/37bc012ea49c49eface4c4e899a53460/users/ba233f6cc0734ad9aca8c0fe2899a4f1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:05.697152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89c839-fda5-4e11-b742-23c38e5bcdbe None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.697596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89c839-fda5-4e11-b742-23c38e5bcdbe None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.697874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89c839-fda5-4e11-b742-23c38e5bcdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.714189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:05.716674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:05.792905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7f89c839-fda5-4e11-b742-23c38e5bcdbe None None] MFA Rules not processed for user `ba233f6cc0734ad9aca8c0fe2899a4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:05.794512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7f89c839-fda5-4e11-b742-23c38e5bcdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:05.878477 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:05.889488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a30b2-9fea-4c0f-bd1e-c107fb8adc6a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:05.901623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:05.905632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:05.906586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:05.906875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] PATH_INFO: `/v3/projects/b55649adf0004272bdd00a533f33cc4f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:05.908851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55649adf0004272bdd00a533f33cc4f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:05.909757 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:05.911776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:05.977250 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1684/3363] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:05.987903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55649adf0004272bdd00a533f33cc4f', 'request_id': 'req-4ce3a0c4-761b-4433-879e-0fb550230dd8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.000683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55649adf0004272bdd00a533f33cc4f', 'request_id': 'req-4ce3a0c4-761b-4433-879e-0fb550230dd8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.009466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55649adf0004272bdd00a533f33cc4f', 'request_id': 'req-4ce3a0c4-761b-4433-879e-0fb550230dd8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.029394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] The token cache is being invalidate because project b55649adf0004272bdd00a533f33cc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:06.029739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.030677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.035888 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1680/3364] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:05 2022] DELETE /identity/v3/projects/b55649adf0004272bdd00a533f33cc4f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:06.037614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea991-d2f6-4a11-9543-9d2b4afb95f6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.037940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea991-d2f6-4a11-9543-9d2b4afb95f6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.038270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea991-d2f6-4a11-9543-9d2b4afb95f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.085007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.086979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:06.106254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fc2ea991-d2f6-4a11-9543-9d2b4afb95f6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:06.107959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc2ea991-d2f6-4a11-9543-9d2b4afb95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:06.244604 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1685/3365] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:06.252365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc25a8-74ab-4999-a627-69e9c7951a16 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.252699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc25a8-74ab-4999-a627-69e9c7951a16 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.252954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc25a8-74ab-4999-a627-69e9c7951a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.267678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a0c4-761b-4433-879e-0fb550230dd8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.288390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.289059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.289336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.289606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.291406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:06.334000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6bbc25a8-74ab-4999-a627-69e9c7951a16 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:06.335660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6bbc25a8-74ab-4999-a627-69e9c7951a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:06.374454 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1686/3366] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:17:06.378417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.379037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc25a8-74ab-4999-a627-69e9c7951a16 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.386071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.398739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc25a8-74ab-4999-a627-69e9c7951a16 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.404730 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1681/3367] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:17:06.409077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.409906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.410332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.410827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.411992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:06.412900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.415887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.464322 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1687/3368] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:06.466317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.485894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb12a-9a3b-484f-a3a4-c7827a76beec service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.496959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.497750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.498131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.498544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.499769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.502743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.562511 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1682/3369] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:06 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:06.564329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.584192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81961201-2233-4e9c-bfee-27914580ee2d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.720102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.720891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.721273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.721685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.722452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.725992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.760154 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1688/3370] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:06 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:06.763785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.770612 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:06.773259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.780655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd34f8-98b8-471d-8c3b-4fe9a04169a3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.783802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:06.798293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.799257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.799510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.799784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.801537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.803684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.811067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f94fd-78ea-4f39-b2fa-52bb36d76f2e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.818352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.818911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.819236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.819517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] PATH_INFO: `/v3/users/b0bd3eeeb578465a8f5e5eaa3b3fdc85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.820834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bd3eeeb578465a8f5e5eaa3b3fdc85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.822970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.843758 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1683/3371] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:06.845333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.856575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53484f0-3843-422c-bbe9-2ce5c79ae8a8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.861878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.862605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.862999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.863349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.864162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.867364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.881802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1684/3372] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:06.886191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.901701 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:06.911033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7714d-aa7a-4d3a-bb32-6bc9ce0c9bd5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.918704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b6fc2-2da1-4d68-818a-21bc705a0145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.919913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b6fc2-2da1-4d68-818a-21bc705a0145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.920294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.920502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b6fc2-2da1-4d68-818a-21bc705a0145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.920999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b6fc2-2da1-4d68-818a-21bc705a0145 admin admin] PATH_INFO: `/v3/projects/fe917515a56c4577b45df3eb16642a2d/users/3338f52621ec4501b2f0b88ff5cb36fb/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.938059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.938741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.946926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b6fc2-2da1-4d68-818a-21bc705a0145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe917515a56c4577b45df3eb16642a2d, user_id=3338f52621ec4501b2f0b88ff5cb36fb, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.949258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.950740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5388e84d-10c8-450b-8a8c-5434a4fc957d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.953894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b6fc2-2da1-4d68-818a-21bc705a0145 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.980861 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1685/3373] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:06 2022] PUT /identity/v3/projects/fe917515a56c4577b45df3eb16642a2d/users/3338f52621ec4501b2f0b88ff5cb36fb/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:06.985939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.986404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.986817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.992433 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1689/3374] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:06 2022] DELETE /identity/v3/users/b0bd3eeeb578465a8f5e5eaa3b3fdc85 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:07.013628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:07.015044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.133248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.133625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.133959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.162984 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1686/3375] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:07.167221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] MFA Rules not processed for user `22a8b93432dd4d699a28a8db26bc3c98`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:07.168499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.170069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.174222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.243122 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1690/3376] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:07.268758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12a559-c306-4c29-a4fe-a130b559ea95 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.273137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.273856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.274519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.275009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.287447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.289266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.301418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1687/3377] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:17:07.830437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.833021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.850743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c01f1-847e-4093-9c6a-914cc21befe4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.861179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.861937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.862233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.862693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] PATH_INFO: `/v3/projects/6073ae2e8036492faa2a4f7a26489134` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.864226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6073ae2e8036492faa2a4f7a26489134)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.866739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.926074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6073ae2e8036492faa2a4f7a26489134', 'request_id': 'req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.936587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6073ae2e8036492faa2a4f7a26489134', 'request_id': 'req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.945962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6073ae2e8036492faa2a4f7a26489134', 'request_id': 'req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.960724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] The token cache is being invalidate because project 6073ae2e8036492faa2a4f7a26489134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:07.961334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.962156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.964608 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1691/3378] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:07 2022] DELETE /identity/v3/projects/6073ae2e8036492faa2a4f7a26489134 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:07.969636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.983726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fe633-645c-4cfe-9081-9584e5c8af66 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.086818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.087586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.088679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.089482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] PATH_INFO: `/v3/users/5abc5c325ac64b18bb8d88cfafb66db3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.091509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abc5c325ac64b18bb8d88cfafb66db3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.095500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.098315 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:08.212895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.214796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.236237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31adb-d1a8-4412-a874-cd5c7c8e0443 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.237107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abc5c325ac64b18bb8d88cfafb66db3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.252114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.253996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.254889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abc5c325ac64b18bb8d88cfafb66db3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.255715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.256147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] PATH_INFO: `/v3/users/ba233f6cc0734ad9aca8c0fe2899a4f1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.259996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba233f6cc0734ad9aca8c0fe2899a4f1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.266137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.297120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abc5c325ac64b18bb8d88cfafb66db3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.299284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abc5c325ac64b18bb8d88cfafb66db3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.332988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b46609d9-2778-44e2-924f-36ee28e3d79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abc5c325ac64b18bb8d88cfafb66db3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.345975 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1688/3379] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:07 2022] DELETE /identity/v3/users/5abc5c325ac64b18bb8d88cfafb66db3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:08.375577 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:08.385572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba233f6cc0734ad9aca8c0fe2899a4f1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.399003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba233f6cc0734ad9aca8c0fe2899a4f1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.400138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba233f6cc0734ad9aca8c0fe2899a4f1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.409166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba233f6cc0734ad9aca8c0fe2899a4f1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.410265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba233f6cc0734ad9aca8c0fe2899a4f1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.432340 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1692/3380] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:08 2022] DELETE /identity/v3/users/ba233f6cc0734ad9aca8c0fe2899a4f1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:08.437005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.437720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.438191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.463242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:08.465176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.594542 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1689/3381] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:08.619059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.621188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.751131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.753656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.777503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b962d-9a11-415e-bc9d-b294b33442dc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.781416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb220e-47a4-4f1c-ae59-034103a7c7d6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.783891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf25b5-e009-4db1-82ad-8281b172afb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.785271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf25b5-e009-4db1-82ad-8281b172afb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.789824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf25b5-e009-4db1-82ad-8281b172afb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.790910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf25b5-e009-4db1-82ad-8281b172afb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.793065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.794137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.794515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.794886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] PATH_INFO: `/v3/projects/53981a5094de458785f37039740101e2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.796425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=53981a5094de458785f37039740101e2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.802462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.827050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf25b5-e009-4db1-82ad-8281b172afb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.828862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf25b5-e009-4db1-82ad-8281b172afb1 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.844879 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1693/3382] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:08.926135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53981a5094de458785f37039740101e2', 'request_id': 'req-70134a77-65c9-46ef-a30a-ec518ec83fcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.943393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53981a5094de458785f37039740101e2', 'request_id': 'req-70134a77-65c9-46ef-a30a-ec518ec83fcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.968488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53981a5094de458785f37039740101e2', 'request_id': 'req-70134a77-65c9-46ef-a30a-ec518ec83fcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.992644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] The token cache is being invalidate because project 53981a5094de458785f37039740101e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:08.995161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.995875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70134a77-65c9-46ef-a30a-ec518ec83fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.999039 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1690/3383] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:08 2022] DELETE /identity/v3/projects/53981a5094de458785f37039740101e2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:09.004089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ef8af-404c-482e-a2fd-ce1877773482 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.004378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ef8af-404c-482e-a2fd-ce1877773482 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.004650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ef8af-404c-482e-a2fd-ce1877773482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.030522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e42ef8af-404c-482e-a2fd-ce1877773482 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:09.031857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e42ef8af-404c-482e-a2fd-ce1877773482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:09.187201 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1694/3384] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:09.195536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0e3d9-354b-43a2-a7e6-770585568a2d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.196091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0e3d9-354b-43a2-a7e6-770585568a2d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.196091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0e3d9-354b-43a2-a7e6-770585568a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.219400 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:09.246542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a9d0e3d9-354b-43a2-a7e6-770585568a2d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:09.247863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a9d0e3d9-354b-43a2-a7e6-770585568a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:09.257631 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1691/3385] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:09.261729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ef8af-404c-482e-a2fd-ce1877773482 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.282980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ef8af-404c-482e-a2fd-ce1877773482 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.290521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.291162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.291439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.291709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.292377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:09.292678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.294343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.312000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1695/3386] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:09.316084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0e3d9-354b-43a2-a7e6-770585568a2d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.329743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0e3d9-354b-43a2-a7e6-770585568a2d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.339697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.340628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.341156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.341520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.342638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.345030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.390219 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1692/3387] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:09.393700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.410840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c7f2-d153-4b2e-9d68-85f6516fed65 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.504844 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:09.542934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.544673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.548989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.550273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.551123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.558264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.625988 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1696/3388] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:09.631255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.649263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f406f-9bdc-48a5-8ad7-fae5b00aec73 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.659933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.660866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.662408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.662983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.667520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.669624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.699639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1693/3389] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:09.701521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.726588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b928d-9c23-4a8d-a1e7-57c4529e57cf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.747246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58a593-b4ec-4af5-baa2-dacc10a8353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.747905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58a593-b4ec-4af5-baa2-dacc10a8353d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.748188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58a593-b4ec-4af5-baa2-dacc10a8353d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.748462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58a593-b4ec-4af5-baa2-dacc10a8353d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.749693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58a593-b4ec-4af5-baa2-dacc10a8353d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.752418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58a593-b4ec-4af5-baa2-dacc10a8353d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.783910 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1697/3390] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:09.785860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.810327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c5bb6-d699-4443-8552-7a037742461d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.817979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.819224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.820655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.820655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] PATH_INFO: `/v3/projects/cf7a5bb4dadb4bfd80ab9793b96e8795/users/01c0d38c6d9440e88565277af4433660/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.841028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7a5bb4dadb4bfd80ab9793b96e8795, user_id=01c0d38c6d9440e88565277af4433660, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.846094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.865633 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1694/3391] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:09 2022] PUT /identity/v3/projects/cf7a5bb4dadb4bfd80ab9793b96e8795/users/01c0d38c6d9440e88565277af4433660/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:09.876949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd05-135d-4c51-9f8f-c43f478a621e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.877498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd05-135d-4c51-9f8f-c43f478a621e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.877498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd05-135d-4c51-9f8f-c43f478a621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.926762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-804ccd05-135d-4c51-9f8f-c43f478a621e None None] MFA Rules not processed for user `01c0d38c6d9440e88565277af4433660`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:09.929257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-804ccd05-135d-4c51-9f8f-c43f478a621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:09.989263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.991661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:10.069255 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1698/3392] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:10.069255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ccd05-135d-4c51-9f8f-c43f478a621e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.209925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bcfe6-35c7-4412-a380-ed25e892e3f3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.212705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ccd05-135d-4c51-9f8f-c43f478a621e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.217529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.218829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.218965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.219200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.219475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.220209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.220646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.221159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.222071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] PATH_INFO: `/v3/projects/37bc012ea49c49eface4c4e899a53460` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.224897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37bc012ea49c49eface4c4e899a53460)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.226203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.227751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.268310 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1699/3393] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:10 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:10.272526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.340666 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:10.357454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37bc012ea49c49eface4c4e899a53460', 'request_id': 'req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:10.372326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178cef-83cb-49d8-bbcf-d22f72e02c73 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.375203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37bc012ea49c49eface4c4e899a53460', 'request_id': 'req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:10.386681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37bc012ea49c49eface4c4e899a53460', 'request_id': 'req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:10.409240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] The token cache is being invalidate because project 37bc012ea49c49eface4c4e899a53460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:10.409927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:10.410943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aa7cfdd1-f2f7-4562-998e-6c2780b83df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:10.413386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1695/3394] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:09 2022] DELETE /identity/v3/projects/37bc012ea49c49eface4c4e899a53460 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:10.418899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb947d8-8e28-4a8e-b246-ca68cacbb596 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.419258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb947d8-8e28-4a8e-b246-ca68cacbb596 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.419599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb947d8-8e28-4a8e-b246-ca68cacbb596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.450875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7fb947d8-8e28-4a8e-b246-ca68cacbb596 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:10.452542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7fb947d8-8e28-4a8e-b246-ca68cacbb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:10.460308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.460976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.461258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.461667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.462306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.464322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.470238 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1696/3395] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:10.480829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d2a3-e9f4-4758-b42f-360a181b6cf7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.481238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d2a3-e9f4-4758-b42f-360a181b6cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.481501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d2a3-e9f4-4758-b42f-360a181b6cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.508180 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1700/3396] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:10 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:10.509168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8aa6d2a3-e9f4-4758-b42f-360a181b6cf7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:10.512451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8aa6d2a3-e9f4-4758-b42f-360a181b6cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:10.520615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.524294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:10.532824 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1697/3397] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:10.536182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6d2a3-e9f4-4758-b42f-360a181b6cf7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.547063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6d2a3-e9f4-4758-b42f-360a181b6cf7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.549029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952fb7-a75d-4e4d-a07c-c8c777f4ef99 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.553848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.555978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.556729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.557411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.558961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:10.559523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.562449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.563674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.565568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.567476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.568309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.569621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.575184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.583355 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1698/3398] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:10.584623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.590756 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:10.605014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c2ede-5508-4b57-8394-8e5f4216d552 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.612607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.613357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.613634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.613901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.615304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.617774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.660677 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1701/3399] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:10.661544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.694256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ecb8-838f-45fa-8af8-3176f93cb87d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.716117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.716926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.717211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.717574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] PATH_INFO: `/v3/projects/2b902152ea5b4e89b4696eaa3ae6f766/users/a9cc4d8175ed435e8348b5a371e24690/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.728070 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1699/3400] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:10 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:10.728460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.759961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b902152ea5b4e89b4696eaa3ae6f766, user_id=a9cc4d8175ed435e8348b5a371e24690, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.763221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.797451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1702/3401] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:10 2022] PUT /identity/v3/projects/2b902152ea5b4e89b4696eaa3ae6f766/users/a9cc4d8175ed435e8348b5a371e24690/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:10.804103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.881664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42904e0-682c-42ef-a8d3-26b14ea9523f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.956746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd609473-daf3-443d-907c-faf7cb64f484 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.969065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.969529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.969770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.970043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.970706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.972348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.995387 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1703/3402] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:17:10.997771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:11.015047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:11.015959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.015959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.016256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.017139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:11.019341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:11.022132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37429abc-d3c6-41bd-ade2-b73e875898f6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:11.031268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655cac2-5250-4c6a-8ee4-0d9a5523c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:11.033772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655cac2-5250-4c6a-8ee4-0d9a5523c27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.034244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655cac2-5250-4c6a-8ee4-0d9a5523c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.035587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655cac2-5250-4c6a-8ee4-0d9a5523c27f admin admin] PATH_INFO: `/v3/projects/2b902152ea5b4e89b4696eaa3ae6f766/users/a9cc4d8175ed435e8348b5a371e24690/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.039124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655cac2-5250-4c6a-8ee4-0d9a5523c27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b902152ea5b4e89b4696eaa3ae6f766, user_id=a9cc4d8175ed435e8348b5a371e24690, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:11.042602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655cac2-5250-4c6a-8ee4-0d9a5523c27f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:11.072795 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1700/3403] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:10 2022] POST /identity/v3/users => generated 281 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:11.073364 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1704/3404] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:10 2022] PUT /identity/v3/projects/2b902152ea5b4e89b4696eaa3ae6f766/users/a9cc4d8175ed435e8348b5a371e24690/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:11.073459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:11.079413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748eb1e-f213-4787-a5cf-bef75f32f8d3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.079413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748eb1e-f213-4787-a5cf-bef75f32f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.079900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748eb1e-f213-4787-a5cf-bef75f32f8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.091972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a1ffc-8cb9-4d4d-8682-4ba475350ed1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:11.120968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6748eb1e-f213-4787-a5cf-bef75f32f8d3 None None] MFA Rules not processed for user `a9cc4d8175ed435e8348b5a371e24690`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:11.122395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6748eb1e-f213-4787-a5cf-bef75f32f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:11.143313 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:11.194274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:11.195134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.195423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.195841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.196751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:11.198649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:11.220118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1701/3405] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:11.221423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:11.233785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a66ff-bfd0-4e39-9fa4-f849dd247617 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:11.248010 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1705/3406] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:11.249992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.250372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.250732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.253042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:11.253680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.253962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.254239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.254946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:11.257779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:11.275843 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1702/3407] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:11.277344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:11.286205 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:11.295976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcab0f-0be0-45fe-bf9e-f1537d050912 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:11.303969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a76f77-dc8a-44f6-a88f-4b11033b7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:11.305808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76f77-dc8a-44f6-a88f-4b11033b7edb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.306239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76f77-dc8a-44f6-a88f-4b11033b7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.307174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76f77-dc8a-44f6-a88f-4b11033b7edb admin admin] PATH_INFO: `/v3/projects/896a407b1fc145e5b158b767cf40df88/users/ff2839a88bc1462f9cbf71b2b4a3098f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.312269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] MFA Rules not processed for user `01c0d38c6d9440e88565277af4433660`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:11.314780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:11.330416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a76f77-dc8a-44f6-a88f-4b11033b7edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=896a407b1fc145e5b158b767cf40df88, user_id=ff2839a88bc1462f9cbf71b2b4a3098f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:11.334933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a76f77-dc8a-44f6-a88f-4b11033b7edb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:11.368902 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1703/3408] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:11 2022] PUT /identity/v3/projects/896a407b1fc145e5b158b767cf40df88/users/ff2839a88bc1462f9cbf71b2b4a3098f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:11.371736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b45d9-5f27-4f2f-9d49-ca8f15585513 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.373450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b45d9-5f27-4f2f-9d49-ca8f15585513 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.374829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b45d9-5f27-4f2f-9d49-ca8f15585513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.424652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1706/3409] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:11.431807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1e9b45d9-5f27-4f2f-9d49-ca8f15585513 None None] MFA Rules not processed for user `ff2839a88bc1462f9cbf71b2b4a3098f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:11.434898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1e9b45d9-5f27-4f2f-9d49-ca8f15585513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:11.534006 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1704/3410] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:11.543227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:11.548426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:11.737753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754cb8e-91b1-4f3e-9f69-a42eef2862b6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:11.847350 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:11.876268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:11.877351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.877705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.878069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:11.880580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:11.986572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:11.990405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:12.009130 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1707/3411] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:12.958707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b45d9-5f27-4f2f-9d49-ca8f15585513 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:12.975889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b45d9-5f27-4f2f-9d49-ca8f15585513 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:12.984060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac09a-2a56-433d-ba80-3df810c13c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:12.984964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac09a-2a56-433d-ba80-3df810c13c99 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:12.985388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac09a-2a56-433d-ba80-3df810c13c99 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:12.985805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac09a-2a56-433d-ba80-3df810c13c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:12.996223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ac09a-2a56-433d-ba80-3df810c13c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:12.998032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ac09a-2a56-433d-ba80-3df810c13c99 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:13.029888 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1705/3412] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:13.069071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:13.196326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473b04f-66ee-4b8f-89e7-bcf0973db4d1 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:13.201518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:13.202306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:13.202836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:13.203198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] PATH_INFO: `/v3/users/ff2839a88bc1462f9cbf71b2b4a3098f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:13.204460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2839a88bc1462f9cbf71b2b4a3098f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:13.207296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:13.266370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2839a88bc1462f9cbf71b2b4a3098f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:13.276099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2839a88bc1462f9cbf71b2b4a3098f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:13.279053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2839a88bc1462f9cbf71b2b4a3098f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:13.292503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2839a88bc1462f9cbf71b2b4a3098f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:13.293824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2839a88bc1462f9cbf71b2b4a3098f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:13.326634 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1708/3413] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:13 2022] DELETE /identity/v3/users/ff2839a88bc1462f9cbf71b2b4a3098f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:13.328463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:13.328748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:13.329039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:13.353066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:13.354682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:13.522092 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1706/3414] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:13.546293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:13.548090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:13.564142 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:13.628989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd15c-09c2-40a5-90a4-38d56399eb83 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:13.644602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:13.646555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:13.648621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:13.648947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:13.689453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:13.693710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:13.719779 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1709/3415] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:15.384493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:15.386566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:15.469469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:15.480929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b4a0-3aee-4eb9-9683-82ebb99ed958 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:15.483780 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:15.490335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:15.505925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:15.507281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:15.507702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:15.517819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:15.540790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c26ba-938b-44e1-8963-9309829e8cd8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:15.544800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:15.564157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:15.574923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1cd79-014c-4319-819a-77d8f36ae620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:15.575594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1cd79-014c-4319-819a-77d8f36ae620 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:15.575941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1cd79-014c-4319-819a-77d8f36ae620 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:15.576350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1cd79-014c-4319-819a-77d8f36ae620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:15.583008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a8a1cd79-014c-4319-819a-77d8f36ae620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:15.611910 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1710/3416] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:17:15.612731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:15.616405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1cd79-014c-4319-819a-77d8f36ae620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:15.618518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:15.634457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1cd79-014c-4319-819a-77d8f36ae620 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:15.649161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0772125-bedc-4c6f-a897-78110809828c service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:15.661140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:15.664174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:15.664174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:15.664174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] PATH_INFO: `/v3/projects/896a407b1fc145e5b158b767cf40df88` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:15.668992 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1707/3417] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:15.677407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896a407b1fc145e5b158b767cf40df88)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:15.679568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:15.775334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c4999-d990-4514-8089-0323181441ac None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:15.775334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c4999-d990-4514-8089-0323181441ac None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:15.775579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c4999-d990-4514-8089-0323181441ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:15.853528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cf3c4999-d990-4514-8089-0323181441ac None None] MFA Rules not processed for user `3338f52621ec4501b2f0b88ff5cb36fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:15.854675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896a407b1fc145e5b158b767cf40df88', 'request_id': 'req-67cef007-4e34-458a-839e-b4520a6a8f44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:15.858865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf3c4999-d990-4514-8089-0323181441ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:15.873442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896a407b1fc145e5b158b767cf40df88', 'request_id': 'req-67cef007-4e34-458a-839e-b4520a6a8f44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:15.886400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896a407b1fc145e5b158b767cf40df88', 'request_id': 'req-67cef007-4e34-458a-839e-b4520a6a8f44'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:15.916593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] The token cache is being invalidate because project 896a407b1fc145e5b158b767cf40df88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:15.916977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:15.919917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cef007-4e34-458a-839e-b4520a6a8f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:15.939476 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1711/3418] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:15 2022] DELETE /identity/v3/projects/896a407b1fc145e5b158b767cf40df88 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:15.945777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06a7f-50eb-450b-88c6-1f01673e78ba None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:15.946411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06a7f-50eb-450b-88c6-1f01673e78ba None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:15.946806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06a7f-50eb-450b-88c6-1f01673e78ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:15.977210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-58d06a7f-50eb-450b-88c6-1f01673e78ba None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:15.978461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58d06a7f-50eb-450b-88c6-1f01673e78ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:16.032573 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1708/3419] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:17:16.065745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c4999-d990-4514-8089-0323181441ac None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.065745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf3c4999-d990-4514-8089-0323181441ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:16.103592 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1712/3420] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:16.110814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b78a-4481-4f35-a455-6f6da46bfae8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.111168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b78a-4481-4f35-a455-6f6da46bfae8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.111494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b78a-4481-4f35-a455-6f6da46bfae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.143926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4401b78a-4481-4f35-a455-6f6da46bfae8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:16.145339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4401b78a-4481-4f35-a455-6f6da46bfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:16.171238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1713/3421] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:16.172714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401b78a-4481-4f35-a455-6f6da46bfae8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.188312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401b78a-4481-4f35-a455-6f6da46bfae8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.205810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.206566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.206907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.207239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.208021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:16.208127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c4999-d990-4514-8089-0323181441ac None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.208391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.210687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.224983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775071d-257e-4912-a410-0c581db13922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.225208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775071d-257e-4912-a410-0c581db13922 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.225490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775071d-257e-4912-a410-0c581db13922 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.225763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775071d-257e-4912-a410-0c581db13922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.241025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775071d-257e-4912-a410-0c581db13922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.243045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775071d-257e-4912-a410-0c581db13922 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.260730 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1714/3422] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:16.262459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.266131 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1709/3423] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:16.268521 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:16.280296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9792-6dd9-441f-be0c-91bc085dbbd0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.297679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.298309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.298585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.298852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.299621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.301952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.334665 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1715/3424] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:16 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:16.338696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775071d-257e-4912-a410-0c581db13922 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.353295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775071d-257e-4912-a410-0c581db13922 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.426511 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:16.436888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.437664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.438005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.438339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.439809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.441875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.474821 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1710/3425] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:16 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:16.479353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.493157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220598a1-5633-4535-8f19-01a0cb0c9383 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.499202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.500405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.500917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.501262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.501985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.503655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.522646 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1716/3426] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:16.527321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.542652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8bd86-26c1-41c7-875a-2350cdd7d0d6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.550361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deaf13-0b40-45ef-af2b-7789fc1be624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.551694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deaf13-0b40-45ef-af2b-7789fc1be624 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.552173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deaf13-0b40-45ef-af2b-7789fc1be624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.552713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deaf13-0b40-45ef-af2b-7789fc1be624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.553621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deaf13-0b40-45ef-af2b-7789fc1be624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.555510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deaf13-0b40-45ef-af2b-7789fc1be624 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.572299 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1711/3427] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:16.576464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.592297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7edc8-6f83-4324-ac37-2bb79ba2bb9b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.599836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.601171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.601667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.602067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] PATH_INFO: `/v3/projects/9d702749939d4b8cb8471857ba668f07/users/5437fbb8d7fa4c6b8dca85efdc8fc694/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.639425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d702749939d4b8cb8471857ba668f07, user_id=5437fbb8d7fa4c6b8dca85efdc8fc694, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.646902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.664146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1717/3428] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:16 2022] PUT /identity/v3/projects/9d702749939d4b8cb8471857ba668f07/users/5437fbb8d7fa4c6b8dca85efdc8fc694/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:16.669447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57673b-9897-4e5f-ae74-57aa692f9115 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.670579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57673b-9897-4e5f-ae74-57aa692f9115 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.671432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57673b-9897-4e5f-ae74-57aa692f9115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.697094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ca57673b-9897-4e5f-ae74-57aa692f9115 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:16.698414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ca57673b-9897-4e5f-ae74-57aa692f9115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:16.791670 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1712/3429] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:16.805358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:16.807201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:16.882331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca648ca-5bdd-49bc-99bc-89b1caa167ef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:16.886222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:16.886847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:16.887122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:16.888062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:16.902178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:16.903871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:16.916020 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1718/3430] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:19.160913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d66d8-2eba-4f2d-aaa5-3ae259673cc5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:19.162343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d66d8-2eba-4f2d-aaa5-3ae259673cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:19.164337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d66d8-2eba-4f2d-aaa5-3ae259673cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:19.201518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e28d66d8-2eba-4f2d-aaa5-3ae259673cc5 None None] MFA Rules not processed for user `3338f52621ec4501b2f0b88ff5cb36fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:19.210177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e28d66d8-2eba-4f2d-aaa5-3ae259673cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:19.324576 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1713/3431] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:20.971065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:20.976266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:21.152679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc7d1-6917-459e-b742-0e54b74f6596 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:21.174084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2d7f3-e01d-49cf-8f8b-cbc3586e8ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:21.174730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d7f3-e01d-49cf-8f8b-cbc3586e8ebd service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:21.175084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d7f3-e01d-49cf-8f8b-cbc3586e8ebd service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:21.175366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d7f3-e01d-49cf-8f8b-cbc3586e8ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:21.177517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-29a2d7f3-e01d-49cf-8f8b-cbc3586e8ebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:21.283687 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:21.370908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2d7f3-e01d-49cf-8f8b-cbc3586e8ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:21.373135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2d7f3-e01d-49cf-8f8b-cbc3586e8ebd service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:21.435928 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1719/3432] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:26.655205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:26.656206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:26.656885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:26.765662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:26.767286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:26.814331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeec5d-2d0c-48cc-b965-5cc6fa0375cb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:26.814859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeec5d-2d0c-48cc-b965-5cc6fa0375cb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:26.814859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeec5d-2d0c-48cc-b965-5cc6fa0375cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:26.850287 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:26.885956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1714/3433] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:26.892202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5cfeec5d-2d0c-48cc-b965-5cc6fa0375cb None None] MFA Rules not processed for user `5437fbb8d7fa4c6b8dca85efdc8fc694`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:26.894066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5cfeec5d-2d0c-48cc-b965-5cc6fa0375cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:26.966916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:26.968562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:27.052428 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1720/3434] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:27.058859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeec5d-2d0c-48cc-b965-5cc6fa0375cb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:27.080726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeec5d-2d0c-48cc-b965-5cc6fa0375cb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:27.086572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:27.087361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:27.087741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:27.088401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:27.089701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:27.094142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:27.114009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716f85f-3e55-4ce3-b5ab-dbdc982c5c2a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:27.119571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:27.120183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:27.120459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:27.120730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:27.150478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:27.152079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:27.152668 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1721/3435] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:27 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:27.156153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:27.163534 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1715/3436] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:17:27.350790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547cf75-5fb4-4e20-80eb-dc302dace377 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:27.357996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:27.359600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:27.359989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:27.360381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:27.361227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:27.368671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:27.455467 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1722/3437] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:27 2022] POST /identity/v3/users => generated 301 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:27.457700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:27.482032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12db6-8c07-4681-88c8-464e2b209f51 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:27.503540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:27.506352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:27.506653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:27.512148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:27.513668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:27.521637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:27.548821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:27.550789 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1716/3438] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:27.586504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d1dff-bc0f-4d56-b32e-78308182e783 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:27.602557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:27.604699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:27.605012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:27.605288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] PATH_INFO: `/v3/projects/a126dbcfc754443283df46315b071518/users/29e425d4765a488ab78e36323822fd95/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:27.654195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a126dbcfc754443283df46315b071518, user_id=29e425d4765a488ab78e36323822fd95, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:27.661018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:27.691778 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1723/3439] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:27 2022] PUT /identity/v3/projects/a126dbcfc754443283df46315b071518/users/29e425d4765a488ab78e36323822fd95/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:27.696966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:27.731173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd71d3-9c49-4918-9f6c-7047fb4f374e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:28.087547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:28.088307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:28.088713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:28.089172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:28.090301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:28.092044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:28.128733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:28.131299 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1717/3440] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:28.148164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94105e-c5b8-4fc3-99d7-a58bb0316457 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:28.172862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:28.178452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:28.178771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:28.179018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] PATH_INFO: `/v3/projects/a126dbcfc754443283df46315b071518/users/29e425d4765a488ab78e36323822fd95/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:28.202400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a126dbcfc754443283df46315b071518, user_id=29e425d4765a488ab78e36323822fd95, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:28.218527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:28.260178 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:28.291446 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1724/3441] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:28 2022] PUT /identity/v3/projects/a126dbcfc754443283df46315b071518/users/29e425d4765a488ab78e36323822fd95/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:30.861675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:31.062318 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:31.168881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9ab6e-73d0-4641-ac1f-56b8ab16a1e1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:31.417819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44955d-6a6d-4408-b529-5f063da9bfff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:31.421236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44955d-6a6d-4408-b529-5f063da9bfff service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:31.421756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44955d-6a6d-4408-b529-5f063da9bfff service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:31.426063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44955d-6a6d-4408-b529-5f063da9bfff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:31.433099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5a44955d-6a6d-4408-b529-5f063da9bfff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:31.491829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44955d-6a6d-4408-b529-5f063da9bfff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:31.501463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44955d-6a6d-4408-b529-5f063da9bfff service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:31.551406 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1718/3442] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:33.885506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:33.887625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:34.048631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91e71-b1e7-47c7-b79b-d27d935d959b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:34.065853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:34.066522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:34.067168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:34.067168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] PATH_INFO: `/v3/users/b69e173eef9b42a9ae6a0e1255ea2b4c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:34.068254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69e173eef9b42a9ae6a0e1255ea2b4c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:34.070192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:34.183435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69e173eef9b42a9ae6a0e1255ea2b4c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:34.196595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69e173eef9b42a9ae6a0e1255ea2b4c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:34.198200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69e173eef9b42a9ae6a0e1255ea2b4c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:34.212337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69e173eef9b42a9ae6a0e1255ea2b4c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:34.213892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69e173eef9b42a9ae6a0e1255ea2b4c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:34.263941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1725/3443] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:33 2022] DELETE /identity/v3/users/b69e173eef9b42a9ae6a0e1255ea2b4c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:34.268516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:34.269510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:34.269799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:34.309729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:34.311340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:34.480599 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1719/3444] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:34.519037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:34.522644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:34.627238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5213fb9-4d26-4f28-8a9f-a364f45241a0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:34.631013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:34.631721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:34.632065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:34.632418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:34.642955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:34.644486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:34.656850 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1726/3445] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:35.365616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:35.369024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:35.394320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266ac7-3950-48cf-924a-2034e8401ab3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:35.429238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:35.429904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:35.430186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:35.430459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] PATH_INFO: `/v3/projects/a3b035ec7bd0473788f89c45e4950066` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:35.431639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b035ec7bd0473788f89c45e4950066)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:35.435333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:35.549322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b035ec7bd0473788f89c45e4950066', 'request_id': 'req-a0f9c159-b385-4ec9-a246-c4d984497f34'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.562294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b035ec7bd0473788f89c45e4950066', 'request_id': 'req-a0f9c159-b385-4ec9-a246-c4d984497f34'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.579685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b035ec7bd0473788f89c45e4950066', 'request_id': 'req-a0f9c159-b385-4ec9-a246-c4d984497f34'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.585143 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:35.608849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] The token cache is being invalidate because project a3b035ec7bd0473788f89c45e4950066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:35.609630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.610471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.613615 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1720/3446] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:35 2022] DELETE /identity/v3/projects/a3b035ec7bd0473788f89c45e4950066 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:35.617724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:35.631056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba623-77e8-493b-b47a-20520428e57a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:35.668515 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:35.777651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:35.778517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:35.778928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:35.779307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] PATH_INFO: `/v3/users/a96e0ed81b82493db1349297ee382ec9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:35.781709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96e0ed81b82493db1349297ee382ec9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:35.785505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:35.885358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96e0ed81b82493db1349297ee382ec9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.900313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96e0ed81b82493db1349297ee382ec9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.917489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96e0ed81b82493db1349297ee382ec9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.944066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96e0ed81b82493db1349297ee382ec9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:35.946469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-69c378b0-e370-49a9-adfd-62e5060f5481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96e0ed81b82493db1349297ee382ec9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:36.013307 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1727/3447] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:35 2022] DELETE /identity/v3/users/a96e0ed81b82493db1349297ee382ec9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:37.243730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:37.245937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:37.273791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c159-b385-4ec9-a246-c4d984497f34 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:37.396985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:37.397733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:37.398147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:37.398491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] PATH_INFO: `/v3/projects/8adcdc517cd743ab9a4a626f3709512d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:37.399726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8adcdc517cd743ab9a4a626f3709512d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:37.401954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:37.470671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8adcdc517cd743ab9a4a626f3709512d', 'request_id': 'req-b718ead4-16fa-4532-adfc-99ba01d5db9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:37.479404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8adcdc517cd743ab9a4a626f3709512d', 'request_id': 'req-b718ead4-16fa-4532-adfc-99ba01d5db9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:37.495766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8adcdc517cd743ab9a4a626f3709512d', 'request_id': 'req-b718ead4-16fa-4532-adfc-99ba01d5db9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:37.515796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] The token cache is being invalidate because project 8adcdc517cd743ab9a4a626f3709512d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:37.516137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:37.517742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b718ead4-16fa-4532-adfc-99ba01d5db9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:37.519946 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1721/3448] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:37 2022] DELETE /identity/v3/projects/8adcdc517cd743ab9a4a626f3709512d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:37.527405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341ddac-dc72-417c-9f87-fe1830c738bf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:37.527893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341ddac-dc72-417c-9f87-fe1830c738bf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:37.528818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341ddac-dc72-417c-9f87-fe1830c738bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:37.630510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9341ddac-dc72-417c-9f87-fe1830c738bf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:37.632357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9341ddac-dc72-417c-9f87-fe1830c738bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:37.806607 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1728/3449] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:37.815514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5a96-4841-41b2-9088-dba45a21c9cc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:37.815985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5a96-4841-41b2-9088-dba45a21c9cc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:37.816410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5a96-4841-41b2-9088-dba45a21c9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:37.860050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a99d5a96-4841-41b2-9088-dba45a21c9cc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:37.863508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a99d5a96-4841-41b2-9088-dba45a21c9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:37.882179 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1722/3450] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:37.887285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341ddac-dc72-417c-9f87-fe1830c738bf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:37.898041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341ddac-dc72-417c-9f87-fe1830c738bf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:37.916598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:37.917276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:37.917555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:37.917822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:37.918497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:37.918794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:37.920415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:37.944786 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1729/3451] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:37.949276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5a96-4841-41b2-9088-dba45a21c9cc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:37.970025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5a96-4841-41b2-9088-dba45a21c9cc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:37.981646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:37.982283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:37.982559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:37.982807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:37.983722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:37.985517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:38.041120 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1723/3452] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:37 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:38.046035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:38.060801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a0666-dd33-4849-ba0d-7484b304e017 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:38.125566 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:38.198801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:38.199350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.199879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.199879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.200517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:38.202539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:38.250924 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1730/3453] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:38 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:38.255359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:38.275284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7ac79-3c2a-4d44-b138-04839209dde7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:38.292561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:38.293167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.293428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.293702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.294379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:38.296411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:38.334909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1724/3454] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:38.339236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:38.363549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e7d14-2fb9-40ff-8e89-edaae069a9b7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:38.377624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eeffc-efdf-456c-a5f9-bd498a1c6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:38.378526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eeffc-efdf-456c-a5f9-bd498a1c6509 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.378993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eeffc-efdf-456c-a5f9-bd498a1c6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.379429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eeffc-efdf-456c-a5f9-bd498a1c6509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.380269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7eeffc-efdf-456c-a5f9-bd498a1c6509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:38.382115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7eeffc-efdf-456c-a5f9-bd498a1c6509 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:38.425515 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1731/3455] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:38.430547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:38.447234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677225-9ef5-4119-9e93-9929c99d8aee admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:38.466852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:38.467543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.467822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.468174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] PATH_INFO: `/v3/projects/ad45304b99cf41a6a4ab1b908f47cefb/users/7983c2fd79234b14b8f76c282f5b32a8/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.497054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad45304b99cf41a6a4ab1b908f47cefb, user_id=7983c2fd79234b14b8f76c282f5b32a8, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:38.499932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:38.525972 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1725/3456] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:38 2022] PUT /identity/v3/projects/ad45304b99cf41a6a4ab1b908f47cefb/users/7983c2fd79234b14b8f76c282f5b32a8/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:38.531612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.532144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.532231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.567463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:38.571346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:38.679722 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1732/3457] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:38.731863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:38.734001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:38.775893 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:38.917340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf54163-793b-4ed3-9357-23708bd26884 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:38.940700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b31635-f7cb-4a70-baf5-ab270b0e6782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:38.941389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b31635-f7cb-4a70-baf5-ab270b0e6782 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.941670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b31635-f7cb-4a70-baf5-ab270b0e6782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.941944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b31635-f7cb-4a70-baf5-ab270b0e6782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.956662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b31635-f7cb-4a70-baf5-ab270b0e6782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:38.957659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b31635-f7cb-4a70-baf5-ab270b0e6782 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:38.972993 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1726/3458] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:39.934131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:39.935791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:40.228042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba258-262e-4db2-9274-cff9caedd51e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:40.245763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:40.246588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:40.247043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:40.247484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:40.249967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:40.408100 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:40.464078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:40.465764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:40.493604 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1733/3459] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:40.851089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53ba7-498a-4ee8-8e8e-df4035f4f681 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:40.852096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53ba7-498a-4ee8-8e8e-df4035f4f681 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:40.853293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53ba7-498a-4ee8-8e8e-df4035f4f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:40.929655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c6e53ba7-498a-4ee8-8e8e-df4035f4f681 None None] MFA Rules not processed for user `29e425d4765a488ab78e36323822fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:40.956030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c6e53ba7-498a-4ee8-8e8e-df4035f4f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:41.196301 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1727/3460] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:41.217063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:41.219301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:41.371478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2be9-9230-40fe-84a2-d67e3e60c87e service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:41.387489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:41.389143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:41.390132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:41.390792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:41.405850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:41.683180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:41.691497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:41.734846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14f43-38fe-43ce-baf5-a4eb014ad0cc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:41.735369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14f43-38fe-43ce-baf5-a4eb014ad0cc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:41.735772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14f43-38fe-43ce-baf5-a4eb014ad0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:41.766832 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1734/3461] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:41.804619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-faa14f43-38fe-43ce-baf5-a4eb014ad0cc None None] MFA Rules not processed for user `01c0d38c6d9440e88565277af4433660`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:41.809418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-faa14f43-38fe-43ce-baf5-a4eb014ad0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:41.947723 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1728/3462] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 21 01:17:51.722607 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=57 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:51.937131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=76 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:55.159052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:55.160566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:55.182602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca355aa8-c297-459d-a696-66a7515f4ead service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:55.188342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:55.189333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:55.189760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:55.190031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] PATH_INFO: `/v3/users/9648ebb42868486d81c91e753a293f8f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:55.192461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9648ebb42868486d81c91e753a293f8f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:55.194437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:55.311879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9648ebb42868486d81c91e753a293f8f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:55.327353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9648ebb42868486d81c91e753a293f8f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:55.328097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9648ebb42868486d81c91e753a293f8f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:55.342708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9648ebb42868486d81c91e753a293f8f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:55.344366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fde3a489-4cd1-41f4-890e-2cc67167e6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9648ebb42868486d81c91e753a293f8f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:55.381979 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1735/3463] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:55 2022] DELETE /identity/v3/users/9648ebb42868486d81c91e753a293f8f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:55.982506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa14f43-38fe-43ce-baf5-a4eb014ad0cc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:56.006046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:56.008705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:56.009295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:56.021712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa14f43-38fe-43ce-baf5-a4eb014ad0cc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:56.081808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] MFA Rules not processed for user `7983c2fd79234b14b8f76c282f5b32a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:56.084686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:56.204885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:56.205682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:56.206147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:56.206426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] PATH_INFO: `/v3/projects/7026e7b12fc24e5c979db5f97191405d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:56.208249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7026e7b12fc24e5c979db5f97191405d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:56.212297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:56.390174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1736/3464] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:56.405223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:56.408646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:56.414886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7026e7b12fc24e5c979db5f97191405d', 'request_id': 'req-195cf326-58ce-4166-8690-daaa42bc7dcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:56.435905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7026e7b12fc24e5c979db5f97191405d', 'request_id': 'req-195cf326-58ce-4166-8690-daaa42bc7dcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:56.461718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7026e7b12fc24e5c979db5f97191405d', 'request_id': 'req-195cf326-58ce-4166-8690-daaa42bc7dcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:56.511131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] The token cache is being invalidate because project 7026e7b12fc24e5c979db5f97191405d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:56.516789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:56.518583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-195cf326-58ce-4166-8690-daaa42bc7dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:56.526714 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1729/3465] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:55 2022] DELETE /identity/v3/projects/7026e7b12fc24e5c979db5f97191405d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:56.528462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5521ba-3411-4857-bc56-057cc9ea6a39 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:56.529670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5521ba-3411-4857-bc56-057cc9ea6a39 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:56.530879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5521ba-3411-4857-bc56-057cc9ea6a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:56.553708 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:56.574573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fe5521ba-3411-4857-bc56-057cc9ea6a39 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:56.578286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe5521ba-3411-4857-bc56-057cc9ea6a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:56.601893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05909f55-d1d8-4ae4-9a32-98778d5e8242 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:56.721413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:56.722196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:56.722473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:56.722773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:56.724886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:56.732973 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1730/3466] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:56.741743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafbdb8-698c-46f8-8d9e-e1832b7b6e8d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:56.742606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafbdb8-698c-46f8-8d9e-e1832b7b6e8d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:56.743947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafbdb8-698c-46f8-8d9e-e1832b7b6e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:56.785042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2bafbdb8-698c-46f8-8d9e-e1832b7b6e8d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:56.786549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2bafbdb8-698c-46f8-8d9e-e1832b7b6e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:56.808267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1731/3467] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:17:56.812701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafbdb8-698c-46f8-8d9e-e1832b7b6e8d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:56.834738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafbdb8-698c-46f8-8d9e-e1832b7b6e8d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:56.838479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:56.840468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:56.848127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:56.848752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:56.849076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:56.849321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:56.850756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:56.851058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:56.854105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:56.858096 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1737/3468] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:56 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:56.895543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1732/3469] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:56.898881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:56.925857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3c660-331b-4091-934c-ee7f65c577d6 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:56.932709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:56.933689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:56.934315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:56.935222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:56.936088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:56.939865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:57.018966 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1738/3470] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:56 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:17:57.023315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:57.044689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb5346-4188-4a86-bddd-ecab39b8eb60 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:57.067651 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:57.197992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:57.198617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:57.199000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:57.199269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:57.199924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:57.202368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:57.228909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1733/3471] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:57 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:57.232627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:57.245167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7360124-bae1-4a85-8579-91dc00259b09 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:57.252659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:57.253334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:57.253614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:57.253884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:57.254547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:57.256212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:57.272528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1739/3472] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:57.277330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:57.291789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3be57-2c56-4fe3-bebb-e4d3ea2b4897 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:57.297973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db423349-9d72-4dd9-ae67-735443a121f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:57.298898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db423349-9d72-4dd9-ae67-735443a121f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:57.299408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db423349-9d72-4dd9-ae67-735443a121f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:57.299864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db423349-9d72-4dd9-ae67-735443a121f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:57.300878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db423349-9d72-4dd9-ae67-735443a121f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:57.303107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db423349-9d72-4dd9-ae67-735443a121f2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:57.323525 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1734/3473] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:57.329026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:57.349971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2e982-56ed-432c-be06-d1c68ed72bf6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:57.369063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:57.369964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:57.370263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:57.370883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] PATH_INFO: `/v3/projects/9b3c412cc63c4c8e8e5b95907220ea1f/users/012c8932a3134c0d936b2ecc3c1924ff/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:57.424829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3c412cc63c4c8e8e5b95907220ea1f, user_id=012c8932a3134c0d936b2ecc3c1924ff, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:57.432376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:57.471054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff9bf-79c4-4fbe-a8dc-055bcb7119ce None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:57.471693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff9bf-79c4-4fbe-a8dc-055bcb7119ce None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:57.472166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff9bf-79c4-4fbe-a8dc-055bcb7119ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:57.483986 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1740/3474] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:57 2022] PUT /identity/v3/projects/9b3c412cc63c4c8e8e5b95907220ea1f/users/012c8932a3134c0d936b2ecc3c1924ff/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:57.500693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-443ff9bf-79c4-4fbe-a8dc-055bcb7119ce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:57.502517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-443ff9bf-79c4-4fbe-a8dc-055bcb7119ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:57.672708 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1735/3475] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:57.684028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:57.686040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:57.839642 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:57.877321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb351a0-6e5e-4e39-83cd-09e861974c79 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:57.887829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:57.889445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:57.889723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:57.891596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:57.924202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:57.930586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:57.960794 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1741/3476] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:02.301225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63cc0-8741-4a5a-9f2f-2cf5e692c0e6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:02.301720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63cc0-8741-4a5a-9f2f-2cf5e692c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:02.301810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63cc0-8741-4a5a-9f2f-2cf5e692c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:02.343910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fed63cc0-8741-4a5a-9f2f-2cf5e692c0e6 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:02.347295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fed63cc0-8741-4a5a-9f2f-2cf5e692c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:02.558239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:02.561323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:02.565385 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1736/3477] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:02.740326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0e7a5-1f03-4f99-b4e7-c9efd20e7705 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:02.749430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:02.751220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:02.751811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:02.752313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:02.763970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:02.770323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:02.783660 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1742/3478] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:18:08.705678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:08.706285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:08.706285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:08.796049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] MFA Rules not processed for user `012c8932a3134c0d936b2ecc3c1924ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:08.807710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:08.892200 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:08.979809 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1737/3479] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:09.205869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:09.207408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:09.422849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192f878-efd2-42b1-9d21-68ba0db99c3d service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:09.438517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:09.440504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:09.441854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:09.443603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:09.470330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:09.473164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:09.501741 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1743/3480] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:12.644590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:12.646244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:12.710115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be323-d6ab-4d9c-bb28-6df727ecbbc3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:12.733543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:12.735012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:12.735533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:12.736030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] PATH_INFO: `/v3/users/7983c2fd79234b14b8f76c282f5b32a8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:12.737903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7983c2fd79234b14b8f76c282f5b32a8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:12.740872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:12.847617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7983c2fd79234b14b8f76c282f5b32a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:12.865564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7983c2fd79234b14b8f76c282f5b32a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:12.887058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7983c2fd79234b14b8f76c282f5b32a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:12.888137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7983c2fd79234b14b8f76c282f5b32a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:12.921774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7ccb323-a80b-446a-9d62-a8d9c572fbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7983c2fd79234b14b8f76c282f5b32a8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:12.932935 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1738/3481] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:12 2022] DELETE /identity/v3/users/7983c2fd79234b14b8f76c282f5b32a8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:14.245390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:14.271928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdbc7e-ea79-40bd-b953-d6db957d1a76 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:14.481679 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:14.491732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:14.493551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:14.493893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:14.494169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] PATH_INFO: `/v3/projects/ad45304b99cf41a6a4ab1b908f47cefb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:14.508521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad45304b99cf41a6a4ab1b908f47cefb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:14.510737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:14.630467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad45304b99cf41a6a4ab1b908f47cefb', 'request_id': 'req-b02777a0-3e37-4d65-bc40-29badd19c563'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:14.642542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad45304b99cf41a6a4ab1b908f47cefb', 'request_id': 'req-b02777a0-3e37-4d65-bc40-29badd19c563'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:14.661527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad45304b99cf41a6a4ab1b908f47cefb', 'request_id': 'req-b02777a0-3e37-4d65-bc40-29badd19c563'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:14.693270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] The token cache is being invalidate because project ad45304b99cf41a6a4ab1b908f47cefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:14.693741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:14.694691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b02777a0-3e37-4d65-bc40-29badd19c563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:14.700039 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1744/3482] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:14 2022] DELETE /identity/v3/projects/ad45304b99cf41a6a4ab1b908f47cefb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:14.702421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dcada-832e-4e33-bd4d-afae82d88095 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:14.703574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dcada-832e-4e33-bd4d-afae82d88095 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:14.703574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dcada-832e-4e33-bd4d-afae82d88095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:14.802506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e17dcada-832e-4e33-bd4d-afae82d88095 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:14.812919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e17dcada-832e-4e33-bd4d-afae82d88095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:14.951597 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1739/3483] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:18:14.961196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f5eb3-c7b9-4755-8ff4-a1d7255870cf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:14.961537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f5eb3-c7b9-4755-8ff4-a1d7255870cf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:14.961748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f5eb3-c7b9-4755-8ff4-a1d7255870cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.026339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-139f5eb3-c7b9-4755-8ff4-a1d7255870cf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:15.027631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-139f5eb3-c7b9-4755-8ff4-a1d7255870cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:15.070472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dcada-832e-4e33-bd4d-afae82d88095 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:15.071354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1745/3484] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:15.090121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dcada-832e-4e33-bd4d-afae82d88095 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:15.117993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:15.118634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:15.123935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:15.124694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.130755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:15.131663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:15.141511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:15.187905 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1740/3485] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:15.192370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f5eb3-c7b9-4755-8ff4-a1d7255870cf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:15.208919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f5eb3-c7b9-4755-8ff4-a1d7255870cf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:15.220402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:15.221089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:15.221369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:15.221694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.222315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:15.224327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:15.317210 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1746/3486] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:15 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:15.321903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:15.344586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af71f-06b3-4118-967b-0fafdfd0e046 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:15.438840 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:15.575828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:15.580023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:15.580348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:15.580629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.581340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:15.583336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:15.634753 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1741/3487] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:15 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:15.638645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:15.650350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08d3e-4f6f-4cef-b1de-68782c51581c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:15.671871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:15.672528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:15.677471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:15.677471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.677734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:15.679322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:15.700832 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1747/3488] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:15.705243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:15.716261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647b61-aa28-4aed-a78c-f71edfb3661e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:15.723158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22400d1d-28f3-4785-9908-5dbf48067695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:15.725933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400d1d-28f3-4785-9908-5dbf48067695 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:15.726619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400d1d-28f3-4785-9908-5dbf48067695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:15.727196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400d1d-28f3-4785-9908-5dbf48067695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.727924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22400d1d-28f3-4785-9908-5dbf48067695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:15.729743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22400d1d-28f3-4785-9908-5dbf48067695 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:15.772835 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1742/3489] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:18:15.774589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:15.790151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b61de8-6187-4246-9e8f-766e33c46ee9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:15.797981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:15.798852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:15.799230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:15.799466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] PATH_INFO: `/v3/projects/5eb0cf10be5a4aba9fb1c4d079bd38f1/users/21c92ec7190947049a8afabbcd5b5c74/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.819951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb0cf10be5a4aba9fb1c4d079bd38f1, user_id=21c92ec7190947049a8afabbcd5b5c74, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:15.825053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:15.870700 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1748/3490] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:15 2022] PUT /identity/v3/projects/5eb0cf10be5a4aba9fb1c4d079bd38f1/users/21c92ec7190947049a8afabbcd5b5c74/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:15.879410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e497cc-21d9-4506-9f7a-79893bf09c67 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:15.880643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e497cc-21d9-4506-9f7a-79893bf09c67 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:15.881227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e497cc-21d9-4506-9f7a-79893bf09c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:15.983902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-59e497cc-21d9-4506-9f7a-79893bf09c67 None None] MFA Rules not processed for user `21c92ec7190947049a8afabbcd5b5c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:15.988920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-59e497cc-21d9-4506-9f7a-79893bf09c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:16.246999 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1743/3491] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:16.258405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:16.261348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:16.536183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7643a-e213-4cc3-839f-7f499b7a765b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:16.549508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:16.550726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:16.552605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:16.553176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:16.584263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:16.587995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:16.611947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1749/3492] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:16.869422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e049e9-8488-44f3-ac38-2eb1ba2c5e86 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:16.871168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e049e9-8488-44f3-ac38-2eb1ba2c5e86 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:16.871622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e049e9-8488-44f3-ac38-2eb1ba2c5e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:16.902788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f1e049e9-8488-44f3-ac38-2eb1ba2c5e86 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:16.904413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f1e049e9-8488-44f3-ac38-2eb1ba2c5e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:16.994317 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1744/3493] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:17.026172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:17.028156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:17.041736 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:17.195692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ba024-4976-4f78-b309-b11d16415697 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:17.201871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:17.202695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:17.203067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:17.203495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:17.214232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:17.219773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:17.260409 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1750/3494] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:18:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:18:19.805985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ca1e2-d3ee-4818-9130-49d1ee811809 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:19.806537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ca1e2-d3ee-4818-9130-49d1ee811809 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:19.806537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ca1e2-d3ee-4818-9130-49d1ee811809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:19.871124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2c6ca1e2-d3ee-4818-9130-49d1ee811809 None None] MFA Rules not processed for user `01c0d38c6d9440e88565277af4433660`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:19.872669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2c6ca1e2-d3ee-4818-9130-49d1ee811809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:20.022645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:20.024262 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:20.025840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:20.154964 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1745/3495] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:20.217696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e7592-4354-439b-be31-53ae0f636ddc service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:20.235487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:20.239824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:20.240339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:20.240804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] PATH_INFO: `/v3/users/012c8932a3134c0d936b2ecc3c1924ff` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:20.250229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=012c8932a3134c0d936b2ecc3c1924ff)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:20.253123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:20.345019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012c8932a3134c0d936b2ecc3c1924ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:20.365361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012c8932a3134c0d936b2ecc3c1924ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:20.366229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012c8932a3134c0d936b2ecc3c1924ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:20.389494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012c8932a3134c0d936b2ecc3c1924ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:20.391384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-95f11ab3-b9fd-47a9-8b14-3a914f4bec66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012c8932a3134c0d936b2ecc3c1924ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:20.424636 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1751/3496] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:20 2022] DELETE /identity/v3/users/012c8932a3134c0d936b2ecc3c1924ff => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:21.329055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ca1e2-d3ee-4818-9130-49d1ee811809 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:21.410164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ca1e2-d3ee-4818-9130-49d1ee811809 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:21.503529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:21.504417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:21.504892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:21.505325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] PATH_INFO: `/v3/projects/9b3c412cc63c4c8e8e5b95907220ea1f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:21.506667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3c412cc63c4c8e8e5b95907220ea1f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:21.508983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:21.593568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3c412cc63c4c8e8e5b95907220ea1f', 'request_id': 'req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:21.604959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3c412cc63c4c8e8e5b95907220ea1f', 'request_id': 'req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:21.621109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3c412cc63c4c8e8e5b95907220ea1f', 'request_id': 'req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:21.658235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] The token cache is being invalidate because project 9b3c412cc63c4c8e8e5b95907220ea1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:21.658769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:21.659521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-72c7d4c3-e64e-403d-9a72-d1d5f05cfab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:21.662015 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1746/3497] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:21 2022] DELETE /identity/v3/projects/9b3c412cc63c4c8e8e5b95907220ea1f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:21.666834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4e962-6005-4401-b827-6688460f526d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:21.667346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4e962-6005-4401-b827-6688460f526d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:21.667461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4e962-6005-4401-b827-6688460f526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:21.722149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0cf4e962-6005-4401-b827-6688460f526d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:21.724274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0cf4e962-6005-4401-b827-6688460f526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:21.753345 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:21.887820 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1752/3498] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:21.890288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda380-77aa-4d6e-8596-b0803fc6dceb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:21.890580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda380-77aa-4d6e-8596-b0803fc6dceb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:21.890858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda380-77aa-4d6e-8596-b0803fc6dceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:21.975635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9bfda380-77aa-4d6e-8596-b0803fc6dceb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:21.979461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9bfda380-77aa-4d6e-8596-b0803fc6dceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:22.002296 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1747/3499] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:22.003667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4e962-6005-4401-b827-6688460f526d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:22.018169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4e962-6005-4401-b827-6688460f526d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:22.023272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:22.024008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:22.024290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:22.024561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:22.025331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:22.025637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:22.027247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:22.048393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1753/3500] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:22.049841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfda380-77aa-4d6e-8596-b0803fc6dceb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:22.066726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfda380-77aa-4d6e-8596-b0803fc6dceb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:22.073410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:22.074144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:22.074426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:22.074703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:22.075351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:22.077591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:22.151784 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1748/3501] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:22 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:22.153479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:22.169442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133d562-ba8c-498a-8f4d-2fd84d2996f7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:22.372029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:22.373488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:22.375521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:22.375996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:22.378449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:22.380913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:22.445549 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1754/3502] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:22 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:22.446146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:22.460743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96a624-12bc-4fbc-a5b3-ed76087bf816 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:22.485559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:22.486550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:22.488466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:22.488932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:22.489851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:22.493886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:22.525623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:22.526133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1749/3503] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:22.542926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55d7b5-aa67-4e50-90cc-5931fab8d8a4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:22.571868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6800d-c620-4122-ad5b-d60debbe6c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:22.580060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6800d-c620-4122-ad5b-d60debbe6c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:22.580853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6800d-c620-4122-ad5b-d60debbe6c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:22.582906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6800d-c620-4122-ad5b-d60debbe6c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:22.584203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6800d-c620-4122-ad5b-d60debbe6c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:22.593707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6800d-c620-4122-ad5b-d60debbe6c1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:22.635222 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1755/3504] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:22.638715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:22.654133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9260-c54c-4cb9-ba9a-9031f0077304 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:22.688101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:22.690836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:22.691497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:22.692442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] PATH_INFO: `/v3/projects/8a8dfeb2619b493e87feea0ac4845515/users/dc9602780add4840ae86cc277e2fa3eb/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:22.748285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8dfeb2619b493e87feea0ac4845515, user_id=dc9602780add4840ae86cc277e2fa3eb, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:22.751615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:22.779477 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1750/3505] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:22 2022] PUT /identity/v3/projects/8a8dfeb2619b493e87feea0ac4845515/users/dc9602780add4840ae86cc277e2fa3eb/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:22.797548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70098f-c8e1-4477-aaef-d6b777c74d77 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:22.798125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70098f-c8e1-4477-aaef-d6b777c74d77 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:22.798125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70098f-c8e1-4477-aaef-d6b777c74d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:22.852390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cb70098f-c8e1-4477-aaef-d6b777c74d77 None None] MFA Rules not processed for user `dc9602780add4840ae86cc277e2fa3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:22.854109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cb70098f-c8e1-4477-aaef-d6b777c74d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:23.099241 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1756/3506] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:23.230147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:23.238317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:23.280574 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:23.425437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be046a8-7815-4d4c-8597-ffa58c885d33 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:23.435041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da67e14-696f-4fe5-a418-14162312ff15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:23.436045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da67e14-696f-4fe5-a418-14162312ff15 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:23.449720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da67e14-696f-4fe5-a418-14162312ff15 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:23.450245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da67e14-696f-4fe5-a418-14162312ff15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:23.492247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da67e14-696f-4fe5-a418-14162312ff15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:23.494985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da67e14-696f-4fe5-a418-14162312ff15 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:23.536564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1751/3507] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:23.670806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70098f-c8e1-4477-aaef-d6b777c74d77 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:23.693953 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:23.826075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70098f-c8e1-4477-aaef-d6b777c74d77 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:23.840295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:23.841458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:23.843514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:23.845056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] PATH_INFO: `/v3/users/dc9602780add4840ae86cc277e2fa3eb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:23.849398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9602780add4840ae86cc277e2fa3eb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:23.853701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:24.005097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9602780add4840ae86cc277e2fa3eb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.023535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9602780add4840ae86cc277e2fa3eb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.026405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9602780add4840ae86cc277e2fa3eb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.058236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9602780add4840ae86cc277e2fa3eb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.064843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9602780add4840ae86cc277e2fa3eb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.148216 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1757/3508] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:23 2022] DELETE /identity/v3/users/dc9602780add4840ae86cc277e2fa3eb => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:24.150606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba4fc-e61c-4302-a524-bef4d5450288 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:24.151399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba4fc-e61c-4302-a524-bef4d5450288 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:24.152137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba4fc-e61c-4302-a524-bef4d5450288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:24.224837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dddba4fc-e61c-4302-a524-bef4d5450288 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:24.230743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dddba4fc-e61c-4302-a524-bef4d5450288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:24.489345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1752/3509] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:18:24.497557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:24.499443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:24.628420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94a1ff-45d3-4f29-aa5b-9c3afef0c76b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:24.636218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:24.637246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:24.637704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:24.638125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:24.666997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:24.671273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:24.696330 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1758/3510] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:25.460929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:25.460929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:25.460929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:25.475547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:25.477057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:25.513342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371be3b-faf4-470d-90b9-8a35573ba709 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:25.525722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:25.527054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:25.540661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:25.541382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:25.541663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:25.547865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] PATH_INFO: `/v3/projects/8a8dfeb2619b493e87feea0ac4845515` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:25.551566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8dfeb2619b493e87feea0ac4845515)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:25.557754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:25.690025 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:25.720271 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1753/3511] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:25.734850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:25.737328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:25.762034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8dfeb2619b493e87feea0ac4845515', 'request_id': 'req-a7425372-adef-4fd5-98f1-19f2794afa84'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.789789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8dfeb2619b493e87feea0ac4845515', 'request_id': 'req-a7425372-adef-4fd5-98f1-19f2794afa84'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.805037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8dfeb2619b493e87feea0ac4845515', 'request_id': 'req-a7425372-adef-4fd5-98f1-19f2794afa84'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.841396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] The token cache is being invalidate because project 8a8dfeb2619b493e87feea0ac4845515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:25.844090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.846336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7425372-adef-4fd5-98f1-19f2794afa84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.853443 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1759/3512] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:25 2022] DELETE /identity/v3/projects/8a8dfeb2619b493e87feea0ac4845515 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:25.861472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3572-6efd-4d9c-9207-6e80cd0ef101 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:25.862135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3572-6efd-4d9c-9207-6e80cd0ef101 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:25.862584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3572-6efd-4d9c-9207-6e80cd0ef101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:25.890073 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:25.936116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4c8d3572-6efd-4d9c-9207-6e80cd0ef101 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:25.948597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c8d3572-6efd-4d9c-9207-6e80cd0ef101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:25.954797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd038-43fd-4572-98d3-8085e38ad2a2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.083780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.084784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.085410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.086153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.088679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:26.120914 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1760/3513] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:26.143232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081aa2b-b619-498b-acd7-a58da8b2bd3e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.143516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081aa2b-b619-498b-acd7-a58da8b2bd3e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.143784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081aa2b-b619-498b-acd7-a58da8b2bd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.165663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e081aa2b-b619-498b-acd7-a58da8b2bd3e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:26.166993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e081aa2b-b619-498b-acd7-a58da8b2bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:26.180715 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1761/3514] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:26.183132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081aa2b-b619-498b-acd7-a58da8b2bd3e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:26.206144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081aa2b-b619-498b-acd7-a58da8b2bd3e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.218744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.219789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.220084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.221617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.222463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:26.223562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.226874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.227953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.230877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.252093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1754/3515] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:18:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:18:26.253149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1762/3516] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:26.258848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:26.273466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e40401-82b7-40e3-ab3f-0695a38a4fc5 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.281962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.282498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.282812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.283123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.283957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.286027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.338118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1755/3517] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:26 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:26.339825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:26.355770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002257a-cfb9-44fa-bf6d-c0bb69f0291c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.545971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.555693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.558617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.558964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.570398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.582077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.643053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:26.646995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:26.679580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17098243-ba5b-495e-b52c-3097ff50b24d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.694042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.695185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.697345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.697949 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1763/3518] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:26 2022] POST /identity/v3/users => generated 295 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:26.698217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] PATH_INFO: `/v3/users/21c92ec7190947049a8afabbcd5b5c74` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.701219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c92ec7190947049a8afabbcd5b5c74)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.703612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:26.708693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.742283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d60f-c16c-440c-89b1-cc67e614a25f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.750055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.751047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.751478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.751922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.752954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.755623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.771775 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1764/3519] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:26.776337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:26.817606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800fdc-d46f-4b44-85e8-aa06d4c7e920 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.824150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.826439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.827168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.827669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.828991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.830987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.837992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c92ec7190947049a8afabbcd5b5c74'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:26.855445 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1765/3520] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:26.857192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:26.859155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c92ec7190947049a8afabbcd5b5c74'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:26.862908 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:26.873208 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:26.886288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c92ec7190947049a8afabbcd5b5c74'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:26.887347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c92ec7190947049a8afabbcd5b5c74'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:26.890432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3143b4d-fb19-423f-b859-81889737a515 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.910331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ebc61-ae21-4ff8-bf94-c17909c1d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.911469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebc61-ae21-4ff8-bf94-c17909c1d618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.911469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebc61-ae21-4ff8-bf94-c17909c1d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.911759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebc61-ae21-4ff8-bf94-c17909c1d618 admin admin] PATH_INFO: `/v3/projects/9830900560b14834aad5e7231fbbb8c6/users/0958585bb2a74c9daa0b0d55c735782c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.932074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d686a17b-1640-46a0-be2f-46581c6f65fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c92ec7190947049a8afabbcd5b5c74'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:26.956406 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1756/3521] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:26 2022] DELETE /identity/v3/users/21c92ec7190947049a8afabbcd5b5c74 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:26.962882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.963270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.963651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.976797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ebc61-ae21-4ff8-bf94-c17909c1d618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9830900560b14834aad5e7231fbbb8c6, user_id=0958585bb2a74c9daa0b0d55c735782c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.989867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ebc61-ae21-4ff8-bf94-c17909c1d618 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:27.022786 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1766/3522] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:26 2022] PUT /identity/v3/projects/9830900560b14834aad5e7231fbbb8c6/users/0958585bb2a74c9daa0b0d55c735782c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:27.028453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:27.028609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:27.029021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:27.029387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:27.030103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:27.074376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:27.075817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:27.186032 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1757/3523] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:27.219028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:27.220864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:27.266866 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1767/3524] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:27.301454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:27.304142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:27.336735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debdb7d-ef58-403b-bfef-0cd207f06b1d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:27.340892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:27.341683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:27.342104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:27.342542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:27.353030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:27.354808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:27.366948 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1758/3525] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:27.436696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e45620-f73a-4f70-95ff-789f3fe35735 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:27.450670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b8f4-8023-445f-8620-7afdbe95f735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:27.451710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b8f4-8023-445f-8620-7afdbe95f735 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:27.452161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b8f4-8023-445f-8620-7afdbe95f735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:27.452622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b8f4-8023-445f-8620-7afdbe95f735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:27.468659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b8f4-8023-445f-8620-7afdbe95f735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:27.472269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b8f4-8023-445f-8620-7afdbe95f735 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:27.487293 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1768/3526] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:28.926649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:28.928287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:28.958784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1098a6e-f617-463b-ab08-57e15d044fe5 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:28.976858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:28.977867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:28.978344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:28.978797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] PATH_INFO: `/v3/projects/5eb0cf10be5a4aba9fb1c4d079bd38f1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:28.981928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb0cf10be5a4aba9fb1c4d079bd38f1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:28.985528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:29.117490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb0cf10be5a4aba9fb1c4d079bd38f1', 'request_id': 'req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:29.155244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb0cf10be5a4aba9fb1c4d079bd38f1', 'request_id': 'req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:29.171139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb0cf10be5a4aba9fb1c4d079bd38f1', 'request_id': 'req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:29.192472 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:29.207091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] The token cache is being invalidate because project 5eb0cf10be5a4aba9fb1c4d079bd38f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:29.207775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:29.209043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cfa669f0-8f08-4cb8-bf19-b677e0fdfdce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:29.211194 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1759/3527] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:28 2022] DELETE /identity/v3/projects/5eb0cf10be5a4aba9fb1c4d079bd38f1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:29.216478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176017-7bf2-4995-8834-134244f781b9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:29.217065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176017-7bf2-4995-8834-134244f781b9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:29.217262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176017-7bf2-4995-8834-134244f781b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:29.272341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4c176017-7bf2-4995-8834-134244f781b9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:29.276589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c176017-7bf2-4995-8834-134244f781b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:29.464011 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1769/3528] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:29.474333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8552-6abc-4914-9434-29864d3242e4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:29.474610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8552-6abc-4914-9434-29864d3242e4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:29.474884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8552-6abc-4914-9434-29864d3242e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:29.527904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a95b8552-6abc-4914-9434-29864d3242e4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:29.532984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a95b8552-6abc-4914-9434-29864d3242e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:29.560956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1760/3529] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:29.565748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176017-7bf2-4995-8834-134244f781b9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:29.578743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176017-7bf2-4995-8834-134244f781b9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:29.597909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:29.598711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:29.599083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:29.599444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:29.600259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:29.600671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:29.602508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:29.629442 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1770/3530] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:29.633848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8552-6abc-4914-9434-29864d3242e4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:29.649843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8552-6abc-4914-9434-29864d3242e4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:29.661335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:29.661993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:29.662272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:29.662545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:29.667053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:29.669812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:29.746386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1761/3531] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:29 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:29.752076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:29.775476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a90f-5d5f-4b7e-b4c9-89ab6340bf54 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:29.798484 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:29.972806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:29.973954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:29.974382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:29.974817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:29.975524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:29.977740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:30.018898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1771/3532] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:29 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:30.024104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:30.037536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aaa64-9d5a-4642-8a1f-13cc86c0772c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:30.042949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:30.044050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:30.044900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:30.045395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:30.046228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:30.048106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:30.069223 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1762/3533] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:30.070081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:30.098970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7682e-03c0-4938-a1f9-e2a8f79cee3b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:30.112145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c466e3-88fe-495e-bf78-865b6d260f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:30.112897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c466e3-88fe-495e-bf78-865b6d260f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:30.113174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c466e3-88fe-495e-bf78-865b6d260f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:30.113431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c466e3-88fe-495e-bf78-865b6d260f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:30.115333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c466e3-88fe-495e-bf78-865b6d260f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:30.117111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c466e3-88fe-495e-bf78-865b6d260f91 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:30.155503 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1772/3534] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:18:30.160844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:30.175330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac70a-7c1c-4f06-9b9b-6ba72d822363 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:30.207417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:30.208789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:30.208789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:30.209049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] PATH_INFO: `/v3/projects/c1a2f3b0bed743dabb7579f7dd78135f/users/e228e38ee832453f8fc35feb25d65a15/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:30.240279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a2f3b0bed743dabb7579f7dd78135f, user_id=e228e38ee832453f8fc35feb25d65a15, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:30.247069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:30.289536 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1763/3535] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:30 2022] PUT /identity/v3/projects/c1a2f3b0bed743dabb7579f7dd78135f/users/e228e38ee832453f8fc35feb25d65a15/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:30.290954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:30.291472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:30.291664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:30.334821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:30.336647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:30.470443 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1773/3536] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:18:30.491843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:30.497330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:30.669006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853e933-da6b-44e0-a1d8-377c794399c7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:30.675591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:30.676335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:30.676628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:30.676956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:30.699596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:30.701901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:30.727994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1764/3537] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:35.351718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:35.354153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:35.426546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:35.428083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:35.450871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94411a71-07d6-40cf-b6e9-640e6f184dc2 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:35.465153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:35.465831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:35.466112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:35.466388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] PATH_INFO: `/v3/users/22a8b93432dd4d699a28a8db26bc3c98` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:35.467598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a8b93432dd4d699a28a8db26bc3c98)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:35.469689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:35.565227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a8b93432dd4d699a28a8db26bc3c98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:35.588485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a8b93432dd4d699a28a8db26bc3c98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:35.614901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a8b93432dd4d699a28a8db26bc3c98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:35.616291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a8b93432dd4d699a28a8db26bc3c98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:35.619549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b932364-23b8-4017-a7c8-72eeaf0f3a96 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:35.626907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a8b93432dd4d699a28a8db26bc3c98'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:35.631084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fa0ef-7a7b-41a1-a230-2f494adb1978 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:35.631751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa0ef-7a7b-41a1-a230-2f494adb1978 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:35.632013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa0ef-7a7b-41a1-a230-2f494adb1978 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:35.632278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa0ef-7a7b-41a1-a230-2f494adb1978 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:35.638175 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1765/3538] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:35 2022] DELETE /identity/v3/users/22a8b93432dd4d699a28a8db26bc3c98 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:35.639320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-985fa0ef-7a7b-41a1-a230-2f494adb1978 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:35.680608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fa0ef-7a7b-41a1-a230-2f494adb1978 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:35.682842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fa0ef-7a7b-41a1-a230-2f494adb1978 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:35.744136 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1774/3539] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:36.256166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:36.258102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:36.291057 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:36.394288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2685d-851a-4730-819b-36ef7e521bf5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:36.399447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:36.400133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:36.400430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:36.400671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] PATH_INFO: `/v3/projects/7461e4a0b7124b3bbbb6396de9b59656` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:36.402543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7461e4a0b7124b3bbbb6396de9b59656)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:36.404577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:36.484848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7461e4a0b7124b3bbbb6396de9b59656', 'request_id': 'req-b47f878f-59d2-4396-afb2-91c73ad92b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:36.493649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7461e4a0b7124b3bbbb6396de9b59656', 'request_id': 'req-b47f878f-59d2-4396-afb2-91c73ad92b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:36.508903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7461e4a0b7124b3bbbb6396de9b59656', 'request_id': 'req-b47f878f-59d2-4396-afb2-91c73ad92b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:36.535379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] The token cache is being invalidate because project 7461e4a0b7124b3bbbb6396de9b59656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:36.535768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:36.537179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b47f878f-59d2-4396-afb2-91c73ad92b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:36.543542 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1766/3540] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:36 2022] DELETE /identity/v3/projects/7461e4a0b7124b3bbbb6396de9b59656 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:36.551455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067a00-5b3d-4ee6-b355-658e4da92391 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:36.552007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067a00-5b3d-4ee6-b355-658e4da92391 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:36.552007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067a00-5b3d-4ee6-b355-658e4da92391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:36.580092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-81067a00-5b3d-4ee6-b355-658e4da92391 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:36.581402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-81067a00-5b3d-4ee6-b355-658e4da92391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:36.604327 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:36.712450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1775/3541] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:36.720299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa6ee-5b59-45b1-b9ce-22c438d31527 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:36.720585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa6ee-5b59-45b1-b9ce-22c438d31527 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:36.720905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa6ee-5b59-45b1-b9ce-22c438d31527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:36.743259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-683aa6ee-5b59-45b1-b9ce-22c438d31527 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:36.744519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-683aa6ee-5b59-45b1-b9ce-22c438d31527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:36.753999 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1767/3542] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:36.759104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81067a00-5b3d-4ee6-b355-658e4da92391 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:36.771770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81067a00-5b3d-4ee6-b355-658e4da92391 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:36.783868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:36.784566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:36.784885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:36.785184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:36.785895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:36.786191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:36.788415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:36.804831 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1776/3543] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:36.814549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa6ee-5b59-45b1-b9ce-22c438d31527 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:36.838978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa6ee-5b59-45b1-b9ce-22c438d31527 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:36.855283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:36.856154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:36.856549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:36.857085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:36.866959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:36.869407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:36.936107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:36.937789 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1768/3544] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:36 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:36.952959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84941413-5d26-4672-86c8-7bf24fc61acb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:37.027051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:37.027643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.027925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.028659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.028941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:37.031033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:37.067378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:37.077730 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1777/3545] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:36 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:18:37.081211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d6edd-b4a6-4f7a-8b7a-30ef44d13d79 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:37.087324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:37.088034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.088387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.088872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.089460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:37.091530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:37.171062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:37.172667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1769/3546] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:37.204476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8ee98-53a4-47cc-ad21-23a28f21806b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:37.217560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8713-b4dc-4c9e-bf1a-80e0e4eda60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:37.219995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8713-b4dc-4c9e-bf1a-80e0e4eda60d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.221904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8713-b4dc-4c9e-bf1a-80e0e4eda60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.222289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8713-b4dc-4c9e-bf1a-80e0e4eda60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.223146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8713-b4dc-4c9e-bf1a-80e0e4eda60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:37.224995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8713-b4dc-4c9e-bf1a-80e0e4eda60d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:37.252265 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1778/3547] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:18:37.253915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:37.272655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350f43-ee64-4fca-a296-3527cbee297d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:37.289874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a9972-913b-4545-8a2c-6256a647553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:37.291039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9972-913b-4545-8a2c-6256a647553c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.291522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9972-913b-4545-8a2c-6256a647553c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.291658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9972-913b-4545-8a2c-6256a647553c admin admin] PATH_INFO: `/v3/projects/685de79048ca4354aff5608944bcb82f/users/0f8166440a4a4973a19f4bddb36edc37/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.345882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a9972-913b-4545-8a2c-6256a647553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=685de79048ca4354aff5608944bcb82f, user_id=0f8166440a4a4973a19f4bddb36edc37, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:37.350166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a9972-913b-4545-8a2c-6256a647553c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:37.354886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f7fa5-a5c4-448a-96da-0c46ec07ec87 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.356174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f7fa5-a5c4-448a-96da-0c46ec07ec87 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.356457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f7fa5-a5c4-448a-96da-0c46ec07ec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.381564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1770/3548] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:37 2022] PUT /identity/v3/projects/685de79048ca4354aff5608944bcb82f/users/0f8166440a4a4973a19f4bddb36edc37/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:37.388553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.389002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.389285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.410909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d5f7fa5-a5c4-448a-96da-0c46ec07ec87 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:37.411897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d5f7fa5-a5c4-448a-96da-0c46ec07ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:37.434959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] MFA Rules not processed for user `0f8166440a4a4973a19f4bddb36edc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:37.437244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:37.481357 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:37.582022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1779/3549] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:18:37.585396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1771/3550] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:37.590149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f7fa5-a5c4-448a-96da-0c46ec07ec87 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:37.603718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:37.605318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:37.676065 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:37.760157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f7fa5-a5c4-448a-96da-0c46ec07ec87 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:37.778863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69a9c1-2151-465c-8ba9-81d8e315c7a0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:37.786621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:37.786946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:37.787299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.787580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.787853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.788505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:37.788818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.789240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.789653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.790504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:37.823698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:37.826073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:37.844185 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1772/3551] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:18:37.892483 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1780/3552] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:37 2022] POST /identity/v3/projects => generated 367 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:37.893174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:37.924987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e18c8-c98a-4120-812d-78bbebc72f8c service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:38.100701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:38.104692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.104692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.104692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.104692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:38.104692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:38.152654 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1773/3553] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:37 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:38.157541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:38.175704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090143a-4128-46ec-8895-22b59ccc89ec admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:38.193551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:38.194187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.194466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.194742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.195406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:38.197151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:38.213877 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1781/3554] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:38.217725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:38.230243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804f0c-bced-4fe6-aa90-783fc5f4e61a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:38.240499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:38.241540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.242142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.243084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] PATH_INFO: `/v3/projects/74f4c61421a54a51894687126190b59a/users/2e441cc972e244b1892d3c8b5337888b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.274198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f4c61421a54a51894687126190b59a, user_id=2e441cc972e244b1892d3c8b5337888b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:38.276941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:38.302539 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1774/3555] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:38 2022] PUT /identity/v3/projects/74f4c61421a54a51894687126190b59a/users/2e441cc972e244b1892d3c8b5337888b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:38.306955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:38.323942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fd63a-c4e7-4cec-a922-cb0e273e8127 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:38.412116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09847-39fb-40b9-a9f9-4b12aeab7790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:38.412887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09847-39fb-40b9-a9f9-4b12aeab7790 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.413163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09847-39fb-40b9-a9f9-4b12aeab7790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.413437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09847-39fb-40b9-a9f9-4b12aeab7790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.414128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09847-39fb-40b9-a9f9-4b12aeab7790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:38.415959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09847-39fb-40b9-a9f9-4b12aeab7790 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:38.428972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1782/3556] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:38.433281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:38.449758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098d695-188e-41d8-8b9f-004a9ca8b598 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:38.466190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a669a-c491-4dc3-9f51-f4859da23a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:38.466994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a669a-c491-4dc3-9f51-f4859da23a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.467346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a669a-c491-4dc3-9f51-f4859da23a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.467624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a669a-c491-4dc3-9f51-f4859da23a6a admin admin] PATH_INFO: `/v3/projects/74f4c61421a54a51894687126190b59a/users/2e441cc972e244b1892d3c8b5337888b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.478514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a669a-c491-4dc3-9f51-f4859da23a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f4c61421a54a51894687126190b59a, user_id=2e441cc972e244b1892d3c8b5337888b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:38.478514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a669a-c491-4dc3-9f51-f4859da23a6a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:38.481880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300174-3dd4-45b4-bc58-eafc8ed72bc3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.482360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300174-3dd4-45b4-bc58-eafc8ed72bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.482636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300174-3dd4-45b4-bc58-eafc8ed72bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.535500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8c300174-3dd4-45b4-bc58-eafc8ed72bc3 None None] MFA Rules not processed for user `5437fbb8d7fa4c6b8dca85efdc8fc694`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:38.539280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8c300174-3dd4-45b4-bc58-eafc8ed72bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:38.539690 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1775/3557] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:38 2022] PUT /identity/v3/projects/74f4c61421a54a51894687126190b59a/users/2e441cc972e244b1892d3c8b5337888b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:38.554840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c742d-b0a4-4dda-a20b-12c92516716c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.555121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c742d-b0a4-4dda-a20b-12c92516716c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.555396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c742d-b0a4-4dda-a20b-12c92516716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.618611 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:38.645788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8c0c742d-b0a4-4dda-a20b-12c92516716c None None] MFA Rules not processed for user `2e441cc972e244b1892d3c8b5337888b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:38.648990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8c0c742d-b0a4-4dda-a20b-12c92516716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:38.694340 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1783/3558] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:38.702587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf28cd-1c2a-46a3-8876-12485f47460d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.703293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf28cd-1c2a-46a3-8876-12485f47460d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.703718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf28cd-1c2a-46a3-8876-12485f47460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.743973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fcaf28cd-1c2a-46a3-8876-12485f47460d None None] MFA Rules not processed for user `5437fbb8d7fa4c6b8dca85efdc8fc694`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:38.745494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fcaf28cd-1c2a-46a3-8876-12485f47460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:38.773027 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1784/3559] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:38.835794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1776/3560] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:38.840913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf28cd-1c2a-46a3-8876-12485f47460d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:38.859002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf28cd-1c2a-46a3-8876-12485f47460d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:38.869350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:38.870992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:38.871426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:38.871893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:38.872702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:38.873880 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:38.873880 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:38.873880 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:38.876609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:38.917237 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1785/3561] 10.222.0.46 () {60 vars in 1150 bytes} [Sun Aug 21 01:18:38 2022] POST /identity/v3/domains => generated 277 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:38.920936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c742d-b0a4-4dda-a20b-12c92516716c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:38.935504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c742d-b0a4-4dda-a20b-12c92516716c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:39.115927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:39.116574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:39.116955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:39.117238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:39.117932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:39.118976 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:39.118976 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:39.118976 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:39.119881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:39.162957 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1777/3562] 10.222.0.46 () {60 vars in 1150 bytes} [Sun Aug 21 01:18:38 2022] POST /identity/v3/domains => generated 276 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:39.164420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:39.181882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857b326-46f2-4c61-b6e7-548b1d552628 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:39.254875 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:39.334066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:39.334763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:39.335089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:39.335424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:39.336947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:39.342403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:39.388271 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1786/3563] 10.222.0.46 () {60 vars in 1150 bytes} [Sun Aug 21 01:18:39 2022] POST /identity/v3/domains => generated 277 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:39.390996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:39.421850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388070e0-b24b-43a5-b83a-7fc9468b5668 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:39.628169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:39.631426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:39.631886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:39.632878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:39.637249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:39.639236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:39.699649 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1778/3564] 10.222.0.46 () {60 vars in 1150 bytes} [Sun Aug 21 01:18:39 2022] POST /identity/v3/domains => generated 279 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:39.700869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:39.718571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984fea3-2d54-4912-a389-99d9e750dc32 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:39.931819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:39.935182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:39.943963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:39.944524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/0e529eba164c4fc8892e748237525c28` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:39.988652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e529eba164c4fc8892e748237525c28)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:39.993553 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:39.993553 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:39.993553 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:40.000837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:40.067039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e529eba164c4fc8892e748237525c28'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.077170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e529eba164c4fc8892e748237525c28'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.201517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e529eba164c4fc8892e748237525c28', 'request_id': 'req-e97b20d1-9684-4e9e-9945-18b945c6f14c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.217142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e529eba164c4fc8892e748237525c28', 'request_id': 'req-e97b20d1-9684-4e9e-9945-18b945c6f14c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.228854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e529eba164c4fc8892e748237525c28', 'request_id': 'req-e97b20d1-9684-4e9e-9945-18b945c6f14c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.255336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] The token cache is being invalidate because project 0e529eba164c4fc8892e748237525c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:40.255778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.261135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.282805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e529eba164c4fc8892e748237525c28', 'request_id': 'req-e97b20d1-9684-4e9e-9945-18b945c6f14c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.287305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e529eba164c4fc8892e748237525c28', 'request_id': 'req-e97b20d1-9684-4e9e-9945-18b945c6f14c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.288219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e529eba164c4fc8892e748237525c28', 'request_id': 'req-e97b20d1-9684-4e9e-9945-18b945c6f14c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.297863 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:40.314822 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1787/3565] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:18:39 2022] DELETE /identity/v3/domains/0e529eba164c4fc8892e748237525c28 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:40.315744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:40.321836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:40.349166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982825e-4086-4a42-896b-1957dd0ed546 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:40.383334 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:40.490356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:40.491516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:40.492149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:40.492891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:40.493759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:40.503166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:40.543442 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1779/3566] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:18:40 2022] POST /identity/v3/domains => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:18:40.544620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:40.559982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b20d1-9684-4e9e-9945-18b945c6f14c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:40.694824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:40.695524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:40.696155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:40.696441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/07533fe3034048c18eb5b8b04c613e8d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:40.716428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=07533fe3034048c18eb5b8b04c613e8d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:40.718202 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:40.718202 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:40.718202 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:40.720300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:40.765604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.766277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:40.768943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:40.770156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.855958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.857754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:40.865180 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1788/3567] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:40 2022] PATCH /identity/v3/domains/07533fe3034048c18eb5b8b04c613e8d => generated 250 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:40.869223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:40.870996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:40.900315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2f22-a0ff-4645-bdac-6462cd742f2f tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:41.010438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:41.011230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:41.011508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:41.011773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:41.015006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:41.038748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:41.041668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:41.047069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2eabe-462a-45c7-904a-4b16c5a646dd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:41.064733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:41.065521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1780/3568] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:18:41.066440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:41.066955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:41.067579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/07533fe3034048c18eb5b8b04c613e8d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:41.099425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=07533fe3034048c18eb5b8b04c613e8d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:41.102886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:41.135385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.141623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.220384 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:41.262380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d', 'request_id': 'req-18a6a701-3c7a-4520-9351-47b46c7cfb79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.278045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d', 'request_id': 'req-18a6a701-3c7a-4520-9351-47b46c7cfb79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.287763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d', 'request_id': 'req-18a6a701-3c7a-4520-9351-47b46c7cfb79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.319616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] The token cache is being invalidate because project 07533fe3034048c18eb5b8b04c613e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:41.319947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.323994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.348170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d', 'request_id': 'req-18a6a701-3c7a-4520-9351-47b46c7cfb79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.348982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d', 'request_id': 'req-18a6a701-3c7a-4520-9351-47b46c7cfb79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.349667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '07533fe3034048c18eb5b8b04c613e8d', 'request_id': 'req-18a6a701-3c7a-4520-9351-47b46c7cfb79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.375292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:41.375840 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1789/3569] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:18:40 2022] DELETE /identity/v3/domains/07533fe3034048c18eb5b8b04c613e8d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:41.397579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bac4db-9c20-46f6-8a56-328f42a3d1e9 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:41.531220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:41.531894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:41.532171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:41.532442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:41.533149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:41.534767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:41.577219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:41.578063 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1781/3570] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:18:41 2022] POST /identity/v3/domains => generated 278 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:41.579438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:41.609999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6a701-3c7a-4520-9351-47b46c7cfb79 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:41.766910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:41.767722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:41.767996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:41.768266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/c8944b1837134d73be34480d8181b7d5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:41.793140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c8944b1837134d73be34480d8181b7d5)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:41.794786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:41.849030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c8944b1837134d73be34480d8181b7d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.849810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c8944b1837134d73be34480d8181b7d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.910314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c8944b1837134d73be34480d8181b7d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.911085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c8944b1837134d73be34480d8181b7d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:41.913698 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1790/3571] 10.222.0.46 () {60 vars in 1250 bytes} [Sun Aug 21 01:18:41 2022] PATCH /identity/v3/domains/c8944b1837134d73be34480d8181b7d5 => generated 279 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:18:41.918707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:41.920524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:41.945583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857663c-17c4-4185-949e-72eab65f86af tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:41.958978 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:42.061255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:42.062145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:42.062618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:42.062700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/c8944b1837134d73be34480d8181b7d5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:42.091660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=c8944b1837134d73be34480d8181b7d5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:42.093771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:42.099945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:42.100486 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1782/3572] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:18:41 2022] GET /identity/v3/domains/c8944b1837134d73be34480d8181b7d5 => generated 279 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:42.118869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2adac-c719-4d12-ab3a-137c4397fdf2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:42.132181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:42.132664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:42.132664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:42.133161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/c8944b1837134d73be34480d8181b7d5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:42.133981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c8944b1837134d73be34480d8181b7d5)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:42.136336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:42.192720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c8944b1837134d73be34480d8181b7d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.199818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c8944b1837134d73be34480d8181b7d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.257832 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:42.320204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8944b1837134d73be34480d8181b7d5', 'request_id': 'req-8066c58b-d6df-466f-9900-8c56bbbe7b03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.342445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8944b1837134d73be34480d8181b7d5', 'request_id': 'req-8066c58b-d6df-466f-9900-8c56bbbe7b03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.353916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8944b1837134d73be34480d8181b7d5', 'request_id': 'req-8066c58b-d6df-466f-9900-8c56bbbe7b03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.382206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] The token cache is being invalidate because project c8944b1837134d73be34480d8181b7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:42.382426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.383113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.405990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c8944b1837134d73be34480d8181b7d5', 'request_id': 'req-8066c58b-d6df-466f-9900-8c56bbbe7b03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.407330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c8944b1837134d73be34480d8181b7d5', 'request_id': 'req-8066c58b-d6df-466f-9900-8c56bbbe7b03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.409635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c8944b1837134d73be34480d8181b7d5', 'request_id': 'req-8066c58b-d6df-466f-9900-8c56bbbe7b03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:42.430668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:42.431103 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1791/3573] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:18:42 2022] DELETE /identity/v3/domains/c8944b1837134d73be34480d8181b7d5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:42.432477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:42.455533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4ab97-fb2c-41fa-98f9-aec9b5a2b2c3 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:42.577586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:42.582874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:42.583177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:42.583446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:42.584126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:42.590208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:42.636598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:42.648370 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1783/3574] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:18:42 2022] GET /identity/v3/domains => generated 1348 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:42.652203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066c58b-d6df-466f-9900-8c56bbbe7b03 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:42.669266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:42.669975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:42.670291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:42.670616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/c8944b1837134d73be34480d8181b7d5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:42.685700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find domain: c8944b1837134d73be34480d8181b7d5.: keystone.exception.DomainNotFound: Could not find domain: c8944b1837134d73be34480d8181b7d5. Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c8944b1837134d73be34480d8181b7d5. Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:42.692032 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:42.693366 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c8944b1837134d73be34480d8181b7d5. Aug 21 01:18:42.694380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:42.701886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:42.718653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fec71b-85bc-4f81-88de-cc57e921837c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:42.720212 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1792/3575] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:42 2022] PATCH /identity/v3/domains/c8944b1837134d73be34480d8181b7d5 => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:18:42.732926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:42.733603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:42.733932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:42.734204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:42.734900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:42.736586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:42.778794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:42.779641 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1784/3576] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:18:42 2022] POST /identity/v3/domains => generated 277 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:42.792263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3d412-bbbf-47c5-b1c9-886df606ee80 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:42.973701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:42.974797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:42.975308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:42.975788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:42.978706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:42.983787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:43.069138 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1793/3577] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:42 2022] POST /identity/v3/users => generated 346 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:18:43.072684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:43.097197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabcf4b-f827-4791-a557-6add2e7ed574 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:43.125896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:43.129457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:43.129752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:43.130030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/groups` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:43.130736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:43.131883 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:43.131883 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:43.131883 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:43.133262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:43.193808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1785/3578] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:18:43 2022] POST /identity/v3/groups => generated 325 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:43.198851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:43.223134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6e20-90d8-4301-92ee-8921616c216a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:43.254237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:43.254963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:43.255265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:43.255546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:43.258176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=617a0e72c2e64fb697f2b37d1c0a968d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:43.259952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:43.334350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:43.335764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:43.409460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:43.410152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:43.416907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1794/3579] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:43 2022] PATCH /identity/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d => generated 278 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:43.418169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:43.421872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:43.447442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebba782-74e9-4fce-ac0c-22bce3f2bcb2 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:43.702747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:43.706580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:43.707074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:43.707528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:43.763593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=617a0e72c2e64fb697f2b37d1c0a968d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:43.768882 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:43.768882 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:43.768882 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:43.772002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:43.782869 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:43.848401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:43.865487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.204292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8352b1064e504ab68e5e4169f9e96525'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.214196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8352b1064e504ab68e5e4169f9e96525'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.234193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8352b1064e504ab68e5e4169f9e96525'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.235317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8352b1064e504ab68e5e4169f9e96525'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.245766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8352b1064e504ab68e5e4169f9e96525'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.324596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d', 'request_id': 'req-85886e80-76ca-49ef-ade4-4fd59311031b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.335618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d', 'request_id': 'req-85886e80-76ca-49ef-ade4-4fd59311031b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.342415 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:44.346712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d', 'request_id': 'req-85886e80-76ca-49ef-ade4-4fd59311031b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.374604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] The token cache is being invalidate because project 617a0e72c2e64fb697f2b37d1c0a968d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:44.375296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.375891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.396952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d', 'request_id': 'req-85886e80-76ca-49ef-ade4-4fd59311031b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.397809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d', 'request_id': 'req-85886e80-76ca-49ef-ade4-4fd59311031b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.398520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '617a0e72c2e64fb697f2b37d1c0a968d', 'request_id': 'req-85886e80-76ca-49ef-ade4-4fd59311031b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:44.417951 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1786/3580] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:18:43 2022] DELETE /identity/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:44.422515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:44.453976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd7ab-4aa8-4871-a8f7-2446edf24d68 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:44.484568 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:44.625505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:44.627307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:44.627307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:44.627307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:44.654498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=617a0e72c2e64fb697f2b37d1c0a968d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:44.659227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d.: keystone.exception.DomainNotFound: Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:44.676283 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:44.677648 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:44.679187 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:44.688185 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1795/3581] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:18:44 2022] GET /identity/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d => generated 112 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:18:44.693150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:44.696375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:44.723557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886e80-76ca-49ef-ade4-4fd59311031b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:44.732195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:44.733200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:44.733820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:44.734568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/users/8352b1064e504ab68e5e4169f9e96525` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:44.747846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:get_user(user_id=8352b1064e504ab68e5e4169f9e96525)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:44.751685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find user: 8352b1064e504ab68e5e4169f9e96525.: keystone.exception.UserNotFound: Could not find user: 8352b1064e504ab68e5e4169f9e96525. Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 01:18:44.776335 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:44.777580 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8352b1064e504ab68e5e4169f9e96525. Aug 21 01:18:44.778879 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:44.782043 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1787/3582] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:18:44 2022] GET /identity/v3/users/8352b1064e504ab68e5e4169f9e96525 => generated 110 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:18:44.786246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:44.798468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686263-a17a-4937-9fb3-e3628ff75b0c tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:44.806528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:44.807459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:44.808153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:44.808599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/groups/4b4b081c912b4cbb81fe8216f32a3c29` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:44.817883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:get_group(group_id=4b4b081c912b4cbb81fe8216f32a3c29)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:44.821583 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:44.821583 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:44.821583 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:44.823153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find group: 4b4b081c912b4cbb81fe8216f32a3c29.: keystone.exception.GroupNotFound: Could not find group: 4b4b081c912b4cbb81fe8216f32a3c29. Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 21 01:18:44.842367 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:44.843680 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 4b4b081c912b4cbb81fe8216f32a3c29. Aug 21 01:18:44.844939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:44.847474 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1796/3583] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:44 2022] GET /identity/v3/groups/4b4b081c912b4cbb81fe8216f32a3c29 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:18:44.851714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:44.904909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc508a1-bd62-4f4e-bfec-210112d7d5fd tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:44.924420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:44.930503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:44.930796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:44.931209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/groups/4b4b081c912b4cbb81fe8216f32a3c29` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:44.942870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find group: 4b4b081c912b4cbb81fe8216f32a3c29.: keystone.exception.GroupNotFound: Could not find group: 4b4b081c912b4cbb81fe8216f32a3c29. Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 21 01:18:44.949922 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:44.951017 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 4b4b081c912b4cbb81fe8216f32a3c29. Aug 21 01:18:44.955598 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:44.956634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:44.969034 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1788/3584] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:18:44 2022] DELETE /identity/v3/groups/4b4b081c912b4cbb81fe8216f32a3c29 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:18:44.989829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124477-20e0-4586-bd99-69f277f8da77 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:44.997120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:44.998471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:44.998955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:44.999581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/users/8352b1064e504ab68e5e4169f9e96525` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.009913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8352b1064e504ab68e5e4169f9e96525)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:45.014802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find user: 8352b1064e504ab68e5e4169f9e96525.: keystone.exception.UserNotFound: Could not find user: 8352b1064e504ab68e5e4169f9e96525. Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 21 01:18:45.039856 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:45.041035 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8352b1064e504ab68e5e4169f9e96525. Aug 21 01:18:45.042919 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:45.048761 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1797/3585] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:44 2022] DELETE /identity/v3/users/8352b1064e504ab68e5e4169f9e96525 => generated 110 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:18:45.053419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:45.087336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6422a39-e2fc-4d51-9474-fe95c6d21f1a tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:45.105179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:45.105849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:45.106133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:45.106407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.156274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d.: keystone.exception.DomainNotFound: Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:45.181205 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:45.182897 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:45.183821 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:45.186881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1789/3586] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:45 2022] PATCH /identity/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d => generated 112 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:18:45.200395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:45.229217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bc003-c96c-4eff-87cb-b46806e4fdb1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:45.236681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:45.237643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:45.238818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:45.239202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.239953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:45.241732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:45.279891 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1798/3587] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:18:45 2022] GET /identity/v3/domains => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:45.287200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:45.311615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca16a8-6dd7-4240-845e-97dd0c3b8219 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:45.323692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:45.324510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:45.324920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:45.325289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.326262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:45.329401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:45.335063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:45.389276 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1790/3588] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:18:45 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:45.397298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:45.423444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a7199-b03c-44f1-b6f2-5a1058cb42ee tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:45.438909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:45.442024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:45.442791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:45.443409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.444166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1134947121) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:45.446795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:45.453656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:45.483763 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1799/3589] 10.222.0.46 () {58 vars in 1199 bytes} [Sun Aug 21 01:18:45 2022] GET /identity/v3/domains?name=tempest-test_domain-1134947121 => generated 409 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:45.489378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:45.511880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a980055-fab5-4e2a-97a5-4a4a7eff26e6 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:45.521687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:45.526640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:45.527084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:45.527454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.549824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d.: keystone.exception.DomainNotFound: Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:45.569998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:18:45.571026 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 617a0e72c2e64fb697f2b37d1c0a968d. Aug 21 01:18:45.571939 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:45.573050 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1791/3590] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:45 2022] PATCH /identity/v3/domains/617a0e72c2e64fb697f2b37d1c0a968d => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:18:45.576502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:45.599809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febbf29-6247-4ab0-9136-630aa64f4c9b tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:45.628270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:45.631946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:45.634126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:45.634613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/a745cdeb51284289811e9b34c9cc5425` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.694694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a745cdeb51284289811e9b34c9cc5425)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:45.700555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:45.812553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:45.814953 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1800/3591] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:45 2022] PATCH /identity/v3/domains/a745cdeb51284289811e9b34c9cc5425 => generated 277 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:45.828339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b204-7b93-4299-9faf-c5c9707f0fcc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:45.849608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:45.851156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:45.851897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:45.852312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/a745cdeb51284289811e9b34c9cc5425` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:45.884220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a745cdeb51284289811e9b34c9cc5425)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:45.886430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:45.934264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:45.965385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.111131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425', 'request_id': 'req-ac7f824c-7675-4805-8bf0-dd513f298d73'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.127143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425', 'request_id': 'req-ac7f824c-7675-4805-8bf0-dd513f298d73'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.141881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425', 'request_id': 'req-ac7f824c-7675-4805-8bf0-dd513f298d73'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.170244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] The token cache is being invalidate because project a745cdeb51284289811e9b34c9cc5425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:46.170548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.171962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.197099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425', 'request_id': 'req-ac7f824c-7675-4805-8bf0-dd513f298d73'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.197988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425', 'request_id': 'req-ac7f824c-7675-4805-8bf0-dd513f298d73'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.199463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac7f824c-7675-4805-8bf0-dd513f298d73 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a745cdeb51284289811e9b34c9cc5425', 'request_id': 'req-ac7f824c-7675-4805-8bf0-dd513f298d73'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.221895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1792/3592] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:18:45 2022] DELETE /identity/v3/domains/a745cdeb51284289811e9b34c9cc5425 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:46.226743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:46.229558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:46.256628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae761-e78e-4a1b-8c7c-a5ab5266ec00 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:46.475112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d26c5-2915-4dd0-b92b-a3447a62e63b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:46.475684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d26c5-2915-4dd0-b92b-a3447a62e63b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:46.475684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d26c5-2915-4dd0-b92b-a3447a62e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:46.498270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:46.498270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:46.498270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:46.499830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/c958db4e1f2f49129dc1166ae4618163` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:46.507794 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:46.540636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c958db4e1f2f49129dc1166ae4618163)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:46.546432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:46.607424 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:46.614468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.616173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.622675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2c1d26c5-2915-4dd0-b92b-a3447a62e63b None None] MFA Rules not processed for user `0958585bb2a74c9daa0b0d55c735782c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:46.633922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2c1d26c5-2915-4dd0-b92b-a3447a62e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:46.736017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.736648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:46.742846 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1801/3593] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:46 2022] PATCH /identity/v3/domains/c958db4e1f2f49129dc1166ae4618163 => generated 277 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:46.760852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:46.766338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:46.828097 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1793/3594] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:46.864227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:46.868811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:46.869369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:46.929131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] MFA Rules not processed for user `0958585bb2a74c9daa0b0d55c735782c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:46.930838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:46.935762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf3ef2-1146-4930-9057-009c6ec61b26 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:46.949384 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1794/3595] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:46.950443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:46.951527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:46.951998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:46.952335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/c958db4e1f2f49129dc1166ae4618163` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:46.981112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c958db4e1f2f49129dc1166ae4618163)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:46.984679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:47.092168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.099506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.177302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:47.179400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:47.282504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163', 'request_id': 'req-0b876fac-0861-4b2d-88c2-194fd79ca0cc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.314827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163', 'request_id': 'req-0b876fac-0861-4b2d-88c2-194fd79ca0cc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.339624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163', 'request_id': 'req-0b876fac-0861-4b2d-88c2-194fd79ca0cc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.375017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] The token cache is being invalidate because project c958db4e1f2f49129dc1166ae4618163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:47.375313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.377883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.405187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163', 'request_id': 'req-0b876fac-0861-4b2d-88c2-194fd79ca0cc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.406920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163', 'request_id': 'req-0b876fac-0861-4b2d-88c2-194fd79ca0cc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.407715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c958db4e1f2f49129dc1166ae4618163', 'request_id': 'req-0b876fac-0861-4b2d-88c2-194fd79ca0cc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:47.437667 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1802/3596] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:18:46 2022] DELETE /identity/v3/domains/c958db4e1f2f49129dc1166ae4618163 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:47.441939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:47.448913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283cd9e-486c-42fc-8527-0ae1e2f9ee01 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:47.451734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:47.463909 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:47.579191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876fac-0861-4b2d-88c2-194fd79ca0cc tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:47.589517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:47.590165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:47.590447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:47.590719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:47.599516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:47.628623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:47.629276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:47.629548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:47.630158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:47.636974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:47.693978 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:47.768419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:47.771417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:47.797889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:47.811824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:47.814797 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1795/3597] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:18:47.815868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:47.819905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:47.856894 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1803/3598] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:48.001936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd61648-0775-43bc-8f27-6dde5731563f service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:48.007802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:48.008519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:48.008840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:48.009149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/2a956065c8064fe5bbbdaa017a3a0394` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:48.049948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2a956065c8064fe5bbbdaa017a3a0394)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:48.051187 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:48.051187 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:48.051187 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:48.055731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:48.102882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.105165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.176462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.185438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.187008 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1796/3599] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:18:47 2022] PATCH /identity/v3/domains/2a956065c8064fe5bbbdaa017a3a0394 => generated 278 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:48.192418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:48.207063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d93e-1d64-420b-adaa-af2c96995d99 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:48.423823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e441cc972e244b1892d3c8b5337888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f4c61421a54a51894687126190b59a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:48.424387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:48.424671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:48.425000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] PATH_INFO: `/v3/domains/2a956065c8064fe5bbbdaa017a3a0394` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:48.451122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2a956065c8064fe5bbbdaa017a3a0394)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:48.453606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:48.536224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.546232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.578107 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:48.644627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394', 'request_id': 'req-c07afa84-9d76-4d24-9833-0e94dcf29fc5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.671462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394', 'request_id': 'req-c07afa84-9d76-4d24-9833-0e94dcf29fc5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.697769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394', 'request_id': 'req-c07afa84-9d76-4d24-9833-0e94dcf29fc5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.741086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] The token cache is being invalidate because project 2a956065c8064fe5bbbdaa017a3a0394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:48.742375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.743972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.764723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394', 'request_id': 'req-c07afa84-9d76-4d24-9833-0e94dcf29fc5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.766367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394', 'request_id': 'req-c07afa84-9d76-4d24-9833-0e94dcf29fc5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.767262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2a956065c8064fe5bbbdaa017a3a0394', 'request_id': 'req-c07afa84-9d76-4d24-9833-0e94dcf29fc5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:48.782560 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1804/3600] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:18:48 2022] DELETE /identity/v3/domains/2a956065c8064fe5bbbdaa017a3a0394 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:48.786543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:48.788136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:48.937559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1e52-4ebf-47a4-9836-dbcd4feca8d1 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:49.003613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:49.005570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:49.007300 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:49.086539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:49.087901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:49.093684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:49.094297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] PATH_INFO: `/v3/users/0f8166440a4a4973a19f4bddb36edc37` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:49.097023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8166440a4a4973a19f4bddb36edc37)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:49.114596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:49.169407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07afa84-9d76-4d24-9833-0e94dcf29fc5 tempest-DomainsTestJSON-1116489217 tempest-DomainsTestJSON-1116489217-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:49.174867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10dd31-e58f-440c-af5a-ace1a3c6a20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:49.175669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10dd31-e58f-440c-af5a-ace1a3c6a20e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:49.175993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10dd31-e58f-440c-af5a-ace1a3c6a20e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:49.177340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10dd31-e58f-440c-af5a-ace1a3c6a20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:49.186459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ae10dd31-e58f-440c-af5a-ace1a3c6a20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:49.199117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10dd31-e58f-440c-af5a-ace1a3c6a20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:49.200957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10dd31-e58f-440c-af5a-ace1a3c6a20e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:49.218098 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1805/3601] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:18:49.310190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8166440a4a4973a19f4bddb36edc37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:49.326643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8166440a4a4973a19f4bddb36edc37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:49.363647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228350a9-6e76-48c9-8438-aea5bed71019 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:49.364100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228350a9-6e76-48c9-8438-aea5bed71019 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:49.364191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228350a9-6e76-48c9-8438-aea5bed71019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:49.386986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8166440a4a4973a19f4bddb36edc37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:49.388856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8166440a4a4973a19f4bddb36edc37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:49.415631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-228350a9-6e76-48c9-8438-aea5bed71019 None None] MFA Rules not processed for user `e228e38ee832453f8fc35feb25d65a15`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:49.417075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-228350a9-6e76-48c9-8438-aea5bed71019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:49.424989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f77cd0a1-add6-4583-b1a8-135dbadf8126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8166440a4a4973a19f4bddb36edc37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:49.446428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1797/3602] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:48 2022] DELETE /identity/v3/users/0f8166440a4a4973a19f4bddb36edc37 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:49.448063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:49.452210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:49.452890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:49.494419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:49.496000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:49.605492 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1806/3603] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:49.614209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:49.614492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:49.614762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:49.662013 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1798/3604] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:49.672039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:49.673875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] MFA Rules not processed for user `e228e38ee832453f8fc35feb25d65a15`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:49.675030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:49.677539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:49.717211 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:49.859109 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:49.871111 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1807/3605] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:49.882535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:49.883609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1df69-3657-4614-8783-6aa8352ef8cc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:49.887087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:49.905088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:49.906123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:49.911321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:49.911611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:49.933136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:49.934658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:49.983673 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1799/3606] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:50.127278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fbbdb-7826-47d4-a0e3-7fc1fb786aea None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:50.138766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:50.140572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:50.141658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:50.142297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:50.194241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:50.210284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:50.250999 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1808/3607] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:51.325172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:51.326643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:51.367126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6222073-e2d0-4b3c-b3e2-353c5bbd69b2 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:51.387854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:51.388853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:51.389376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:51.401288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] PATH_INFO: `/v3/projects/685de79048ca4354aff5608944bcb82f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:51.403016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=685de79048ca4354aff5608944bcb82f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:51.405238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:51.561196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '685de79048ca4354aff5608944bcb82f', 'request_id': 'req-4e70f492-da73-4f93-9946-179f24d1e0d0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:51.577755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '685de79048ca4354aff5608944bcb82f', 'request_id': 'req-4e70f492-da73-4f93-9946-179f24d1e0d0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:51.616371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '685de79048ca4354aff5608944bcb82f', 'request_id': 'req-4e70f492-da73-4f93-9946-179f24d1e0d0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:51.656835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] The token cache is being invalidate because project 685de79048ca4354aff5608944bcb82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:51.661445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:51.672665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:51.680644 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1800/3608] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:51 2022] DELETE /identity/v3/projects/685de79048ca4354aff5608944bcb82f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:51.681813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:51.712110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13a865-36e7-4857-9951-a33ad56c876d service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:52.049878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:52.051277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:52.051553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:52.051908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] PATH_INFO: `/v3/users/2e441cc972e244b1892d3c8b5337888b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:52.061124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e441cc972e244b1892d3c8b5337888b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:52.069416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:52.212061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e441cc972e244b1892d3c8b5337888b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:52.214308 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:52.227246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e441cc972e244b1892d3c8b5337888b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:52.227844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e441cc972e244b1892d3c8b5337888b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:52.259425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e441cc972e244b1892d3c8b5337888b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:52.260199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3a3d74bf-9a5b-4741-86d8-a11de8453f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e441cc972e244b1892d3c8b5337888b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:52.306864 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1809/3609] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:51 2022] DELETE /identity/v3/users/2e441cc972e244b1892d3c8b5337888b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:54.382389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:54.384732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:54.417982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f492-da73-4f93-9946-179f24d1e0d0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:54.529328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:54.530005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:54.530283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:54.530801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] PATH_INFO: `/v3/projects/74f4c61421a54a51894687126190b59a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:54.532134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f4c61421a54a51894687126190b59a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:54.534216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:54.657091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f4c61421a54a51894687126190b59a', 'request_id': 'req-9797e045-9b82-49f2-ab67-0541a9aa4119'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:54.682480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f4c61421a54a51894687126190b59a', 'request_id': 'req-9797e045-9b82-49f2-ab67-0541a9aa4119'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:54.692057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f4c61421a54a51894687126190b59a', 'request_id': 'req-9797e045-9b82-49f2-ab67-0541a9aa4119'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:54.711990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] The token cache is being invalidate because project 74f4c61421a54a51894687126190b59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:54.712455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:54.714176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9797e045-9b82-49f2-ab67-0541a9aa4119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:54.720626 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1801/3610] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:54 2022] DELETE /identity/v3/projects/74f4c61421a54a51894687126190b59a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:54.724954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12705a0-0b56-4f47-ab84-6f208145e354 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:54.725446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12705a0-0b56-4f47-ab84-6f208145e354 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:54.725564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12705a0-0b56-4f47-ab84-6f208145e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:54.781922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e12705a0-0b56-4f47-ab84-6f208145e354 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:54.787751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e12705a0-0b56-4f47-ab84-6f208145e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:54.946895 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1810/3611] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:54.958483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a62e-ecef-46e3-80c6-ea3bd8fc729d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:54.958859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a62e-ecef-46e3-80c6-ea3bd8fc729d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:54.959225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a62e-ecef-46e3-80c6-ea3bd8fc729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:54.970469 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:54.989477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ce115-7bd4-4533-b875-a027b6e21330 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:54.989678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ce115-7bd4-4533-b875-a027b6e21330 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:54.990001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ce115-7bd4-4533-b875-a027b6e21330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:55.018568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-665ce115-7bd4-4533-b875-a027b6e21330 None None] MFA Rules not processed for user `01c0d38c6d9440e88565277af4433660`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:55.019811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-665ce115-7bd4-4533-b875-a027b6e21330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:55.028614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ee64a62e-ecef-46e3-80c6-ea3bd8fc729d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:55.030202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ee64a62e-ecef-46e3-80c6-ea3bd8fc729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:55.066879 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1802/3612] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:55.073442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64a62e-ecef-46e3-80c6-ea3bd8fc729d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:55.133342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64a62e-ecef-46e3-80c6-ea3bd8fc729d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:55.164578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:55.165252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:55.165528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:55.165797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:55.166466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:18:55.166761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:55.168386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:55.234313 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1803/3613] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:55.236694 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1811/3614] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:18:55.254704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:55.295803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913a51e-a6cb-47ea-bcd6-de111d45f0cb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:55.311638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:55.313094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:55.313622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:55.314420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:55.315376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:55.317640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:55.408154 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1804/3615] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:55 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:55.412178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ce115-7bd4-4533-b875-a027b6e21330 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:55.441494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ce115-7bd4-4533-b875-a027b6e21330 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:55.650385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:55.651401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:55.651691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:55.651986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:55.652591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:55.661378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:55.703362 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:55.710186 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1812/3616] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:55 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:55.714326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:55.738109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ee6b-debc-4d7b-b3e9-7746ab800e5f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:55.755752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:55.758544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:55.758826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:55.759117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:55.761222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:55.767189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:55.812832 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1805/3617] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:55.817521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:55.835856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266172e3-cc78-4146-a18f-75b2355ed4eb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:55.853267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ccfe3-c02e-491c-8e47-8b14a68678fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:55.853800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ccfe3-c02e-491c-8e47-8b14a68678fa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:55.854079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ccfe3-c02e-491c-8e47-8b14a68678fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:55.854349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ccfe3-c02e-491c-8e47-8b14a68678fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:55.855002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ccfe3-c02e-491c-8e47-8b14a68678fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:55.860962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ccfe3-c02e-491c-8e47-8b14a68678fa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:55.884390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:55.884759 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1813/3618] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:55.899241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c6fe-6bb6-4ca8-80f5-56ba23376ed2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:55.922823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:55.923535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:55.923789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:55.924063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] PATH_INFO: `/v3/projects/c1a2d92aee5d480697f6e2073132c55f/users/8bb77628f16a4292bff00bf1deedfffd/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:55.982772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a2d92aee5d480697f6e2073132c55f, user_id=8bb77628f16a4292bff00bf1deedfffd, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:55.985815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:56.016088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1806/3619] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:55 2022] PUT /identity/v3/projects/c1a2d92aee5d480697f6e2073132c55f/users/8bb77628f16a4292bff00bf1deedfffd/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:56.036635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa1e7-9160-49c1-81ff-de94f5577446 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:56.038379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa1e7-9160-49c1-81ff-de94f5577446 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:56.038813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa1e7-9160-49c1-81ff-de94f5577446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:56.186203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fcbaa1e7-9160-49c1-81ff-de94f5577446 None None] MFA Rules not processed for user `8bb77628f16a4292bff00bf1deedfffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:56.201713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fcbaa1e7-9160-49c1-81ff-de94f5577446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:56.540209 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1814/3620] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:56.545554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:56.710860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c3b45-0f39-48ac-a88b-e6b680209c0d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:56.715930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:56.716560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:56.717146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:56.717422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:56.718835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:56.721035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:56.785027 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1807/3621] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:56 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:56.787318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa1e7-9160-49c1-81ff-de94f5577446 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:56.818197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa1e7-9160-49c1-81ff-de94f5577446 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:57.029658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:57.030313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:57.030739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:57.030968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:57.031775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:57.045962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:57.097252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1815/3622] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:18:56 2022] POST /identity/v3/users => generated 300 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:57.101815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:57.118067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb2c75-1d65-4f6a-9600-2053ef52473a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:57.148348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:57.149033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:57.149467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:57.149779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:57.150516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:57.158709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:57.190478 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1808/3623] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:18:57.194528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:57.212122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1a9a-d86d-4dba-8a9c-953fd594619c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:57.227591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:57.228111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:57.228405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:57.229055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] PATH_INFO: `/v3/projects/739026f3f5274a5ca1d4e73a4ab85511/users/76c729040f344352aa5d970c5cdca0dc/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:57.310732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] RBAC: Authorizing `identity:create_grant(project_id=739026f3f5274a5ca1d4e73a4ab85511, user_id=76c729040f344352aa5d970c5cdca0dc, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:57.320330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:57.379030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1816/3624] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:57 2022] PUT /identity/v3/projects/739026f3f5274a5ca1d4e73a4ab85511/users/76c729040f344352aa5d970c5cdca0dc/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:57.383462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:57.399663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037b16-81df-4412-b33d-f0455ada2894 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:57.595089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ef4a-501f-4d19-ab9b-55bbfa2369e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:57.596602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ef4a-501f-4d19-ab9b-55bbfa2369e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:57.597119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ef4a-501f-4d19-ab9b-55bbfa2369e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:57.601206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ef4a-501f-4d19-ab9b-55bbfa2369e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:57.602042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9ef4a-501f-4d19-ab9b-55bbfa2369e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:57.606420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9ef4a-501f-4d19-ab9b-55bbfa2369e2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:57.611365 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:57.638057 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1809/3625] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:18:57.638919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:57.654832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4af7e9-2e6c-4e72-bb22-10ccf4f7418b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:57.676752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:57.678421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:57.678909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:57.679358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] PATH_INFO: `/v3/projects/739026f3f5274a5ca1d4e73a4ab85511/users/76c729040f344352aa5d970c5cdca0dc/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:57.681655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] RBAC: Authorizing `identity:create_grant(project_id=739026f3f5274a5ca1d4e73a4ab85511, user_id=76c729040f344352aa5d970c5cdca0dc, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:57.689722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:57.735306 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1817/3626] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:18:57 2022] PUT /identity/v3/projects/739026f3f5274a5ca1d4e73a4ab85511/users/76c729040f344352aa5d970c5cdca0dc/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:57.746947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b8c-9da0-450a-ac1e-28b43e62c507 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:57.747246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b8c-9da0-450a-ac1e-28b43e62c507 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:57.749338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b8c-9da0-450a-ac1e-28b43e62c507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:57.786537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0f161b8c-9da0-450a-ac1e-28b43e62c507 None None] MFA Rules not processed for user `76c729040f344352aa5d970c5cdca0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:57.788242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0f161b8c-9da0-450a-ac1e-28b43e62c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:57.909810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1810/3627] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:57.914146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:57.935465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884b3b-2964-4b0c-85fd-8b4c073488af admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:57.950144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:57.951041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:57.951504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:57.953169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:57.956140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:57.968160 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:57.968160 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:57.968160 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:57.970485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.010660 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1818/3628] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:18:57 2022] POST /identity/v3/services => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:58.014857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161b8c-9da0-450a-ac1e-28b43e62c507 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.035134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161b8c-9da0-450a-ac1e-28b43e62c507 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.091329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.093586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.095790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.098115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.099066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.100712 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:58.100712 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:58.100712 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:58.104696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: On instance['enabled']: Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: On instance['enabled']: Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: 'False' Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise error Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application 'False' Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.175522 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:18:58.177133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application 'False' Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.178160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1811/3629] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:18:58 2022] POST /identity/v3/endpoints => generated 283 bytes in 163 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:18:58.182270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.204442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a939f-37fb-4997-b3db-56c03a17b525 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.241413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.242050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.242329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.242602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.243274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.249457 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:58.249457 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:58.249457 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:58.250620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: On instance['enabled']: Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: On instance['enabled']: Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: 'True' Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise error Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application 'True' Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:58.290967 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:18:58.292345 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application 'True' Aug 21 01:18:58.293532 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:58.294734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1819/3630] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:18:58 2022] POST /identity/v3/endpoints => generated 281 bytes in 112 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:18:58.299168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.331331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8b3c-8b37-40ff-a224-f844ea0c2c46 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.350637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.351439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.351719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.351991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.354025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.361301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.446723 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1711896893. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:18:58.446723 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:18:58.446723 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:58.510704 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1812/3631] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:18:58 2022] POST /identity/v3/endpoints => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:58.514951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.542966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3319-2424-41bf-a498-775ad083fbbe tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.572195 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:58.586008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.587068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.587592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.587965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/regions/tempest-region-1711896893` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.589474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1711896893)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.590260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.592633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1820/3632] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:18:58 2022] GET /identity/v3/regions/tempest-region-1711896893 => generated 180 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:58.596662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.612460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1606-379f-4469-9da2-2211760d9800 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.624935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.625624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.625882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.626160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints/00ca105cf9a34b6f9f75a2f32a43f61a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.634558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=00ca105cf9a34b6f9f75a2f32a43f61a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.636992 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:58.636992 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:58.636992 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:58.637934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: On instance['enabled']: Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: On instance['enabled']: Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: 'False' Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise error Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application 'False' Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.646463 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:18:58.647928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application 'False' Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:18:58.648998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1813/3633] 10.222.0.46 () {60 vars in 1255 bytes} [Sun Aug 21 01:18:58 2022] PATCH /identity/v3/endpoints/00ca105cf9a34b6f9f75a2f32a43f61a => generated 283 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:18:58.652117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.664683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065e21-8404-488a-87df-bc41e23923dd tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.671859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.672514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.672993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.673269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints/00ca105cf9a34b6f9f75a2f32a43f61a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.674469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=00ca105cf9a34b6f9f75a2f32a43f61a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.675536 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:58.675536 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:58.675536 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:58.676560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.689903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '00ca105cf9a34b6f9f75a2f32a43f61a', 'request_id': 'req-1fa2805e-54cc-449e-bc06-7c2938899827'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:58.719984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1821/3634] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:58 2022] DELETE /identity/v3/endpoints/00ca105cf9a34b6f9f75a2f32a43f61a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:58.723914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.746298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62edc1-7030-4046-8ee4-31aaf5682ef5 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.789920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.791038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.791729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.792259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/regions/tempest-region-1711896893` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.799905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1711896893)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.802232 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:58.802232 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:58.802232 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:58.804118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.841966 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1814/3635] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:18:58 2022] DELETE /identity/v3/regions/tempest-region-1711896893 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:58.847018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:58.860237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2805e-54cc-449e-bc06-7c2938899827 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:58.927999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:58.928798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:58.929185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:58.929555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:58.930351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:58.932052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:58.985427 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1685163484. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:18:58.985427 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:18:58.985427 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:59.036129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:59.037704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1822/3636] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:18:58 2022] POST /identity/v3/endpoints => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:18:59.052101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a11107-aceb-4350-854b-14ce6bdd3020 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:59.100595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:59.101438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:59.101823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:59.102193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/regions/tempest-region-1685163484` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:59.102888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1685163484)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:59.104819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:59.114027 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1815/3637] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:18:59 2022] GET /identity/v3/regions/tempest-region-1685163484 => generated 180 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:18:59.115695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:59.138839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c4e40-864f-4431-ac02-eb515ab110f1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:59.149753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:59.150670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:59.151147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:59.151595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints/596842ec9f554b20b54dcd34e4660530` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:59.159844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=596842ec9f554b20b54dcd34e4660530)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:59.162514 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:59.162514 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:59.162514 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:59.163777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: On instance['enabled']: Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: On instance['enabled']: Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: 'True' Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise error Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application 'True' Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:59.171729 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:18:59.173391 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['enabled']: Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application 'True' Aug 21 01:18:59.174804 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:18:59.183449 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1823/3638] 10.222.0.46 () {60 vars in 1255 bytes} [Sun Aug 21 01:18:59 2022] PATCH /identity/v3/endpoints/596842ec9f554b20b54dcd34e4660530 => generated 281 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 21 01:18:59.183914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:59.199289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b683e-b942-4312-9228-cd6fc8b94e8f tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:59.213734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:59.214382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:59.214662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:59.214937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/endpoints/596842ec9f554b20b54dcd34e4660530` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:59.216257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=596842ec9f554b20b54dcd34e4660530)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:59.217408 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:59.217408 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:59.217408 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:59.218367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:59.243234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '596842ec9f554b20b54dcd34e4660530', 'request_id': 'req-2a033b01-54a2-472d-bc68-a9231bc90c4c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:59.258686 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1816/3639] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:59 2022] DELETE /identity/v3/endpoints/596842ec9f554b20b54dcd34e4660530 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:18:59.263029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:59.283143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84c783-82d6-4547-b5ca-b05688542b71 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:59.319962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:59.321142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:59.321545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:59.321909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/regions/tempest-region-1685163484` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:59.323647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1685163484)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:59.325030 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:59.325030 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:18:59.325030 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:18:59.328676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:59.369410 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1824/3640] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:18:59 2022] DELETE /identity/v3/regions/tempest-region-1685163484 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:59.374457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:59.395275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033b01-54a2-472d-bc68-a9231bc90c4c tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:59.427399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c360ff-8c01-47bd-9116-0f5badc53059 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c729040f344352aa5d970c5cdca0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739026f3f5274a5ca1d4e73a4ab85511', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:59.428044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c360ff-8c01-47bd-9116-0f5badc53059 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:59.428320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c360ff-8c01-47bd-9116-0f5badc53059 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:59.428728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c360ff-8c01-47bd-9116-0f5badc53059 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] PATH_INFO: `/v3/services/ad97b5b1bae54862965194f5c91313dd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:59.429399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c360ff-8c01-47bd-9116-0f5badc53059 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ad97b5b1bae54862965194f5c91313dd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:59.430369 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-44c360ff-8c01-47bd-9116-0f5badc53059 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:18:59.430369 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:18:59.430369 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:18:59.431257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c360ff-8c01-47bd-9116-0f5badc53059 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:59.432908 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:59.487109 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1817/3641] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:59 2022] DELETE /identity/v3/services/ad97b5b1bae54862965194f5c91313dd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:59.491009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:59.737861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd7638-43c7-4433-a66a-569e6e49fef1 tempest-EndpointsNegativeTestJSON-2098501130 tempest-EndpointsNegativeTestJSON-2098501130-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:59.755766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:59.757283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:59.757940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:59.759026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] PATH_INFO: `/v3/users/8bb77628f16a4292bff00bf1deedfffd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:59.761332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb77628f16a4292bff00bf1deedfffd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:59.765457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:59.841535 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:59.856496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb77628f16a4292bff00bf1deedfffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:59.868883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb77628f16a4292bff00bf1deedfffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:59.870040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb77628f16a4292bff00bf1deedfffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:59.898851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb77628f16a4292bff00bf1deedfffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:59.901400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb77628f16a4292bff00bf1deedfffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:59.949451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1825/3642] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:59 2022] DELETE /identity/v3/users/8bb77628f16a4292bff00bf1deedfffd => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:59.953717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:59.954173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:59.954540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:59.985891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:59.987761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:00.070909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1818/3643] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:00.082480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:00.085525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:00.275030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f80b-982c-45eb-80d0-3601e6bc9481 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:00.278772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:00.279384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:00.279657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:00.279924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:00.311354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:00.312926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:00.340234 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1826/3644] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:01.007166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:01.013606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:01.049062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:01.051079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:01.122133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cb70-4928-4cc8-a187-62c96bab3668 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:01.137073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:01.142168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:01.143894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:01.144393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] PATH_INFO: `/v3/projects/c1a2d92aee5d480697f6e2073132c55f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:01.148365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a2d92aee5d480697f6e2073132c55f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:01.151404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:01.286044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a2d92aee5d480697f6e2073132c55f', 'request_id': 'req-805c81b6-7d3f-43d1-a401-67f452191b0f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.303029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a2d92aee5d480697f6e2073132c55f', 'request_id': 'req-805c81b6-7d3f-43d1-a401-67f452191b0f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.319462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a2d92aee5d480697f6e2073132c55f', 'request_id': 'req-805c81b6-7d3f-43d1-a401-67f452191b0f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.341895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] The token cache is being invalidate because project c1a2d92aee5d480697f6e2073132c55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:01.342428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.343901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.347826 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1827/3645] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:01 2022] DELETE /identity/v3/projects/c1a2d92aee5d480697f6e2073132c55f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:01.352733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:01.353150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaa16e-9a08-4233-8efd-0ba675145454 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:01.357698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:01.511748 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:01.562097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:01.563231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:01.563663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:01.564834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:01.566794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:01.580605 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:01.630166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c81b6-7d3f-43d1-a401-67f452191b0f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:01.647199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:01.647996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:01.648275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:01.664638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] PATH_INFO: `/v3/users/76c729040f344352aa5d970c5cdca0dc` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:01.666251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c729040f344352aa5d970c5cdca0dc)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:01.668220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:01.706237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:01.710114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:01.747185 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1819/3646] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:01.765888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c729040f344352aa5d970c5cdca0dc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.777832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c729040f344352aa5d970c5cdca0dc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.778780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c729040f344352aa5d970c5cdca0dc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.789040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c729040f344352aa5d970c5cdca0dc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.789925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f8f7f1e5-3f5c-47e6-951a-e573346596ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c729040f344352aa5d970c5cdca0dc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:01.821445 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1828/3647] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:01 2022] DELETE /identity/v3/users/76c729040f344352aa5d970c5cdca0dc => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:02.378541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:02.403935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d3336-185b-451d-99c5-ff16e5de256c service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:02.644605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:02.645301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:02.645572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:02.645845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] PATH_INFO: `/v3/projects/739026f3f5274a5ca1d4e73a4ab85511` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:02.658283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] RBAC: Authorizing `identity:delete_project(project_id=739026f3f5274a5ca1d4e73a4ab85511)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:02.662850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:02.823994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739026f3f5274a5ca1d4e73a4ab85511', 'request_id': 'req-e4eb0169-63af-4f2f-ab03-e525defe804d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:02.848590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739026f3f5274a5ca1d4e73a4ab85511', 'request_id': 'req-e4eb0169-63af-4f2f-ab03-e525defe804d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:02.873836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739026f3f5274a5ca1d4e73a4ab85511', 'request_id': 'req-e4eb0169-63af-4f2f-ab03-e525defe804d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:02.910525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] The token cache is being invalidate because project 739026f3f5274a5ca1d4e73a4ab85511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:02.910826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:02.917624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb0169-63af-4f2f-ab03-e525defe804d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:02.929109 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1820/3648] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:02 2022] DELETE /identity/v3/projects/739026f3f5274a5ca1d4e73a4ab85511 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:02.931672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea7d0-a3b0-424a-85c4-ec0e0726ad33 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:02.933293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea7d0-a3b0-424a-85c4-ec0e0726ad33 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:02.933788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea7d0-a3b0-424a-85c4-ec0e0726ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:02.985375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6c2ea7d0-a3b0-424a-85c4-ec0e0726ad33 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:02.996431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6c2ea7d0-a3b0-424a-85c4-ec0e0726ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:03.245260 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1829/3649] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:03.254660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de3de-2c5c-491b-869f-a9bbb946e043 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:03.254938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de3de-2c5c-491b-869f-a9bbb946e043 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:03.255460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de3de-2c5c-491b-869f-a9bbb946e043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:03.304249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-799de3de-2c5c-491b-869f-a9bbb946e043 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:03.305535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-799de3de-2c5c-491b-869f-a9bbb946e043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:03.331449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1821/3650] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:03.336368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ea7d0-a3b0-424a-85c4-ec0e0726ad33 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:03.351677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ea7d0-a3b0-424a-85c4-ec0e0726ad33 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:03.362824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:03.363830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:03.363954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:03.364280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:03.365157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:03.365461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:03.368429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:03.408938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de3de-2c5c-491b-869f-a9bbb946e043 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:03.419052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de3de-2c5c-491b-869f-a9bbb946e043 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:03.419758 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1830/3651] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:03.431288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:03.431923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:03.432200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:03.440075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:03.441053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:03.443090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:03.509474 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1822/3652] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:03 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:03.511512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:03.528801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e344ee-c87b-4684-8df2-7d54a1a160cb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:03.680212 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:03.734941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:03.735595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:03.735878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:03.736149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:03.736849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:03.739944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:03.787737 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1831/3653] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:03 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:03.792507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:03.798175 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:03.808485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a741d-1666-4b2e-baef-567c8ffbe61a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:03.819907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:03.820549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:03.824935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:03.825344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:03.827036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:03.829531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:03.859938 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1823/3654] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:03.864369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:03.881808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca977bf-b298-4cb2-93c1-c685d2d1c5ab admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:03.894122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4978abc-a47d-4da8-9d61-f0d2800e9208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:03.895160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978abc-a47d-4da8-9d61-f0d2800e9208 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:03.896126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978abc-a47d-4da8-9d61-f0d2800e9208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:03.896598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978abc-a47d-4da8-9d61-f0d2800e9208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:03.897467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4978abc-a47d-4da8-9d61-f0d2800e9208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:03.901368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4978abc-a47d-4da8-9d61-f0d2800e9208 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:03.936581 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1832/3655] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:19:03.938110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:03.952143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f88c1-d409-46f4-834a-fa85d8777694 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:03.966663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:03.967356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:03.967635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:03.967910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] PATH_INFO: `/v3/projects/15d010a1f187460cb174de1497d61129/users/96f3aa93f8ee43938d4ccec53d40e4fa/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:04.002522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d010a1f187460cb174de1497d61129, user_id=96f3aa93f8ee43938d4ccec53d40e4fa, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:04.011340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:04.056192 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1824/3656] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:03 2022] PUT /identity/v3/projects/15d010a1f187460cb174de1497d61129/users/96f3aa93f8ee43938d4ccec53d40e4fa/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:04.060824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131783-c571-4c9f-be4c-1845bb1ec004 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:04.061179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131783-c571-4c9f-be4c-1845bb1ec004 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:04.061591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131783-c571-4c9f-be4c-1845bb1ec004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:04.168635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1f131783-c571-4c9f-be4c-1845bb1ec004 None None] MFA Rules not processed for user `96f3aa93f8ee43938d4ccec53d40e4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:04.169930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1f131783-c571-4c9f-be4c-1845bb1ec004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:04.335601 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1833/3657] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:04.339744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:04.465054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c0518-59bc-4e8a-90d8-6439a9953145 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:04.482315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:04.483045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:04.484178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:04.484481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:04.485807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:04.488552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:04.589745 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1825/3658] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:04 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:04.590398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f131783-c571-4c9f-be4c-1845bb1ec004 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:04.605677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f131783-c571-4c9f-be4c-1845bb1ec004 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:04.686213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:04.687819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:04.687819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:04.687819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:04.688380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:04.691093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:04.735446 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1834/3659] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:04 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:04.737569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:04.754751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7293c-dfb4-4942-bae2-7befe369cff8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:04.763130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:04.764660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:04.765313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:04.766066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:04.767752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:04.770067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:04.843531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1826/3660] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:19:04.845762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:04.877164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c94cf-c602-494a-b295-774875cfbeea admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:04.891268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:04.893039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:04.893039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:04.893320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] PATH_INFO: `/v3/projects/2173929db5d84b86a4560cf182493a8b/users/c153349990be4565b0c8b60f4af18f90/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:04.939960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173929db5d84b86a4560cf182493a8b, user_id=c153349990be4565b0c8b60f4af18f90, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:04.952511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:04.988049 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1835/3661] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:04 2022] PUT /identity/v3/projects/2173929db5d84b86a4560cf182493a8b/users/c153349990be4565b0c8b60f4af18f90/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:04.988428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:05.006354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded05ab-2a34-438a-8bc3-80c3124d3de2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:05.147562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff2691-a5e2-47cc-99f8-fc770b4eeac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:05.148276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2691-a5e2-47cc-99f8-fc770b4eeac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:05.148591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2691-a5e2-47cc-99f8-fc770b4eeac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:05.148858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2691-a5e2-47cc-99f8-fc770b4eeac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:05.149488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff2691-a5e2-47cc-99f8-fc770b4eeac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:05.151746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff2691-a5e2-47cc-99f8-fc770b4eeac9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:05.163992 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1827/3662] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:05.168197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:05.180218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92861f-5e14-406d-a83f-7da1f5e69637 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:05.185655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:05.186466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:05.186851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:05.187078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] PATH_INFO: `/v3/projects/2173929db5d84b86a4560cf182493a8b/users/c153349990be4565b0c8b60f4af18f90/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:05.190411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173929db5d84b86a4560cf182493a8b, user_id=c153349990be4565b0c8b60f4af18f90, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:05.195185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:05.218038 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1836/3663] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:05 2022] PUT /identity/v3/projects/2173929db5d84b86a4560cf182493a8b/users/c153349990be4565b0c8b60f4af18f90/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:05.230176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623499bb-f55e-46dc-98dc-330d75ba65f4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:05.230460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623499bb-f55e-46dc-98dc-330d75ba65f4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:05.230740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623499bb-f55e-46dc-98dc-330d75ba65f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:05.298416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-623499bb-f55e-46dc-98dc-330d75ba65f4 None None] MFA Rules not processed for user `c153349990be4565b0c8b60f4af18f90`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:05.306632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-623499bb-f55e-46dc-98dc-330d75ba65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:05.363557 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:05.449105 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1828/3664] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:05.454262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:05.464112 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:05.479840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77a7d-60f9-4d43-8159-48773e99594d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:05.507615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:05.507615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:05.508091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:05.508468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:05.509857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:05.512276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:05.566396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1837/3665] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:05 2022] POST /identity/v3/projects => generated 334 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:05.568242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623499bb-f55e-46dc-98dc-330d75ba65f4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:05.583328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623499bb-f55e-46dc-98dc-330d75ba65f4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:05.695211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:05.695941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:05.696822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:05.697223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:05.698094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:05.702070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:05.789368 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1829/3666] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:05 2022] POST /identity/v3/projects => generated 332 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:05.793552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:05.815088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7836d46-e53a-4468-95eb-9727bd8cccad tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:05.977953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:05.979404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:05.979841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:05.980270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:05.981122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:06.000186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:06.131496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1838/3667] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:05 2022] POST /identity/v3/projects => generated 358 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:06.131711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:06.147611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd21077-d421-462b-a4e3-f8a039df7ed5 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:06.318744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:06.319410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:06.319695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:06.319983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:06.320669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:06.322910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:06.381826 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1830/3668] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:19:06 2022] GET /identity/v3/projects => generated 7977 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:06.384425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:06.400829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69a10-22a5-4978-84e9-f9084a370dbd tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:06.413181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:06.413813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:06.414098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:06.414375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:06.415068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:06.415376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:06.416607 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:06.416607 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:19:06.416607 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:19:06.417800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:06.473910 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1839/3669] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:19:06 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:06.478922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:06.496043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5f98-2882-4f15-a226-67caaff30a90 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:06.507551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:06.508192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:06.508483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:06.508829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:06.509450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Adding query filter params (parent_id=50327070952f4372a00c721412164220) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:06.509763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:06.511631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:06.552130 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1831/3670] 10.222.0.46 () {58 vars in 1216 bytes} [Sun Aug 21 01:19:06 2022] GET /identity/v3/projects?parent_id=50327070952f4372a00c721412164220 => generated 498 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:06.553305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:06.565484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ab7d-1d4f-46e1-be88-322dd8caad0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:06.572936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:06.573598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:06.573882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:06.574309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects/29b65356877f4d7fb3bad94d2a4a2d47` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:06.575479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29b65356877f4d7fb3bad94d2a4a2d47)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:06.578314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:06.651362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b65356877f4d7fb3bad94d2a4a2d47', 'request_id': 'req-e41f2c22-bf67-4083-becf-6a2b760373d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:06.664734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b65356877f4d7fb3bad94d2a4a2d47', 'request_id': 'req-e41f2c22-bf67-4083-becf-6a2b760373d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:06.685064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b65356877f4d7fb3bad94d2a4a2d47', 'request_id': 'req-e41f2c22-bf67-4083-becf-6a2b760373d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:06.720828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] The token cache is being invalidate because project 29b65356877f4d7fb3bad94d2a4a2d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:06.721522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:06.761393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:06.780459 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1840/3671] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:06 2022] DELETE /identity/v3/projects/29b65356877f4d7fb3bad94d2a4a2d47 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:06.782376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:06.786248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:06.828925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcfc0b-29fe-49f9-9432-c07eb124ed0f tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:06.921439 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:07.024743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:07.025800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:07.026370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:07.026891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects/50327070952f4372a00c721412164220` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:07.029763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=50327070952f4372a00c721412164220)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:07.034040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:07.133697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50327070952f4372a00c721412164220', 'request_id': 'req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.148142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50327070952f4372a00c721412164220', 'request_id': 'req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.162791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50327070952f4372a00c721412164220', 'request_id': 'req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.205015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] The token cache is being invalidate because project 50327070952f4372a00c721412164220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:07.206294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.207893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.210214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1832/3672] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:06 2022] DELETE /identity/v3/projects/50327070952f4372a00c721412164220 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:07.213961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:07.226248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2c22-bf67-4083-becf-6a2b760373d1 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:07.258139 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:07.296595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c153349990be4565b0c8b60f4af18f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173929db5d84b86a4560cf182493a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:07.297638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:07.298076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:07.298498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] PATH_INFO: `/v3/projects/a0206aafaaba4c86a675495b6a5caeb4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:07.300097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a0206aafaaba4c86a675495b6a5caeb4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:07.302446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:07.402321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0206aafaaba4c86a675495b6a5caeb4', 'request_id': 'req-2a2f3578-a876-4fb4-8e84-af09b2430d73'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.423776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0206aafaaba4c86a675495b6a5caeb4', 'request_id': 'req-2a2f3578-a876-4fb4-8e84-af09b2430d73'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.436857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0206aafaaba4c86a675495b6a5caeb4', 'request_id': 'req-2a2f3578-a876-4fb4-8e84-af09b2430d73'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.458465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] The token cache is being invalidate because project a0206aafaaba4c86a675495b6a5caeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:07.459042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.459860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a2f3578-a876-4fb4-8e84-af09b2430d73 tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.462313 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1841/3673] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:07 2022] DELETE /identity/v3/projects/a0206aafaaba4c86a675495b6a5caeb4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:07.466327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:07.469822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:07.606062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fc7e2-8f33-42d4-9f2e-05d137b67d0a tempest-ListProjectsTestJSON-1265359764 tempest-ListProjectsTestJSON-1265359764-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:07.620993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:07.622120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:07.622572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:07.648198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:07.650167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:07.692348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:07.693290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:07.693667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:07.694035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] PATH_INFO: `/v3/users/96f3aa93f8ee43938d4ccec53d40e4fa` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:07.695300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f3aa93f8ee43938d4ccec53d40e4fa)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:07.697568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:07.705148 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:07.763520 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1842/3674] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:07.779616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:07.782611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:07.784576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f3aa93f8ee43938d4ccec53d40e4fa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.819909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f3aa93f8ee43938d4ccec53d40e4fa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.848898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f3aa93f8ee43938d4ccec53d40e4fa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.850078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f3aa93f8ee43938d4ccec53d40e4fa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.864303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d94c7778-1171-4f04-a0e8-fc0445aa9ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f3aa93f8ee43938d4ccec53d40e4fa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:07.880121 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1833/3675] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:07 2022] DELETE /identity/v3/users/96f3aa93f8ee43938d4ccec53d40e4fa => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:07.881805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:07.882094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:07.884135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:07.930130 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:07.930848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:07.932176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:07.974657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1c9a-bb8f-45ef-9c32-87219adcc50e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:08.067037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:08.069874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:08.070813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:08.071810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:08.077716 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1834/3676] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:08.080532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:08.093336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:08.094823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:08.188543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:08.190895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:08.192276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11b9a-601d-4b23-a5ae-9e11dbfa3ad1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:08.222146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1843/3677] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:19:08.223526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:08.228905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:08.229579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:08.229579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:08.259292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:08.261099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:08.279104 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1835/3678] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:19:08.987735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:08.989884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:09.015244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13693b-f5e2-4122-a0a5-19917e69b786 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:09.021883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:09.022756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:09.023381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:09.024082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] PATH_INFO: `/v3/projects/15d010a1f187460cb174de1497d61129` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:09.025473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d010a1f187460cb174de1497d61129)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:09.027580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:09.114668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d010a1f187460cb174de1497d61129', 'request_id': 'req-d5dbea79-6a14-48dc-b380-b729c58334f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.124094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d010a1f187460cb174de1497d61129', 'request_id': 'req-d5dbea79-6a14-48dc-b380-b729c58334f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.131827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d010a1f187460cb174de1497d61129', 'request_id': 'req-d5dbea79-6a14-48dc-b380-b729c58334f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.147415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] The token cache is being invalidate because project 15d010a1f187460cb174de1497d61129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:09.147706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.148412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5dbea79-6a14-48dc-b380-b729c58334f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.150414 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1844/3679] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:08 2022] DELETE /identity/v3/projects/15d010a1f187460cb174de1497d61129 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:09.154943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:09.170736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedebae-e210-4775-9677-5ad6d4e4dc78 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:09.202101 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:09.235855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:09.236411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:09.236683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:09.236973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] PATH_INFO: `/v3/users/c153349990be4565b0c8b60f4af18f90` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:09.238317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c153349990be4565b0c8b60f4af18f90)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:09.240569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:09.308401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c153349990be4565b0c8b60f4af18f90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.319794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c153349990be4565b0c8b60f4af18f90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.338681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c153349990be4565b0c8b60f4af18f90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.339707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c153349990be4565b0c8b60f4af18f90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.357374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c153349990be4565b0c8b60f4af18f90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.364396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1836/3680] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:09 2022] DELETE /identity/v3/users/c153349990be4565b0c8b60f4af18f90 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:09.718802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada2a60-7707-4529-9b82-66377be9eab4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:09.719329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada2a60-7707-4529-9b82-66377be9eab4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:09.719329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada2a60-7707-4529-9b82-66377be9eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:09.756723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cada2a60-7707-4529-9b82-66377be9eab4 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:09.758288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cada2a60-7707-4529-9b82-66377be9eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:09.785309 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:09.874944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1845/3681] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:19:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:09.889796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:09.893342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:10.033903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29db52-029f-4dbd-9835-0293f8f82725 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:10.046319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:10.047242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:10.047669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:10.048098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:10.057873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:10.060011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:10.076473 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1837/3682] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:19:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:10.672789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:10.673419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:10.673972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:10.710764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:10.716007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:10.733370 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1846/3683] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:10.741466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:10.764407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453dff-27d8-4635-90d5-b5687c93b5ac service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:10.778976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269a0f6-d5e8-418e-9087-a6d125586f98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:10.779656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269a0f6-d5e8-418e-9087-a6d125586f98 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:10.779935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269a0f6-d5e8-418e-9087-a6d125586f98 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:10.780201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269a0f6-d5e8-418e-9087-a6d125586f98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:10.803711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269a0f6-d5e8-418e-9087-a6d125586f98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:10.805549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269a0f6-d5e8-418e-9087-a6d125586f98 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:10.826926 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1838/3684] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:19:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:11.256326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:11.258090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:11.399113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c28e6-78d6-4d9e-8192-ec928d478425 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:11.418457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:11.418457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:11.418801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:11.419000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] PATH_INFO: `/v3/projects/2173929db5d84b86a4560cf182493a8b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:11.420119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2173929db5d84b86a4560cf182493a8b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:11.422931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:11.574509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2173929db5d84b86a4560cf182493a8b', 'request_id': 'req-eba6ca7f-8b62-4580-a1b2-a267afa848df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:11.603116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2173929db5d84b86a4560cf182493a8b', 'request_id': 'req-eba6ca7f-8b62-4580-a1b2-a267afa848df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:11.612844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2173929db5d84b86a4560cf182493a8b', 'request_id': 'req-eba6ca7f-8b62-4580-a1b2-a267afa848df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:11.629941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] The token cache is being invalidate because project 2173929db5d84b86a4560cf182493a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:11.630119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:11.630772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eba6ca7f-8b62-4580-a1b2-a267afa848df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:11.632949 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1847/3685] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:11 2022] DELETE /identity/v3/projects/2173929db5d84b86a4560cf182493a8b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:11.637606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ece1e1-8110-483a-b516-838c9848a689 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:11.638273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ece1e1-8110-483a-b516-838c9848a689 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:11.639426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ece1e1-8110-483a-b516-838c9848a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:11.667616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-41ece1e1-8110-483a-b516-838c9848a689 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:11.669096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-41ece1e1-8110-483a-b516-838c9848a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:11.706163 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:11.791715 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1839/3686] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:11.800339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de92a1-94d1-4452-bbfa-9dffaf8f833a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:11.801464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de92a1-94d1-4452-bbfa-9dffaf8f833a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:11.801952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de92a1-94d1-4452-bbfa-9dffaf8f833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:11.849670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-83de92a1-94d1-4452-bbfa-9dffaf8f833a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:11.854491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-83de92a1-94d1-4452-bbfa-9dffaf8f833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:11.872263 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1848/3687] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:11.873632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ece1e1-8110-483a-b516-838c9848a689 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:11.892725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ece1e1-8110-483a-b516-838c9848a689 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:11.916395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:11.919856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:11.920248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:11.920672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:11.921504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:11.922813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:11.925143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:11.945796 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1840/3688] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:11.951069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de92a1-94d1-4452-bbfa-9dffaf8f833a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:11.965630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de92a1-94d1-4452-bbfa-9dffaf8f833a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:11.972998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:11.974054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:11.974542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:11.975213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:11.976161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:11.978541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:12.024500 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1849/3689] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:11 2022] POST /identity/v3/projects => generated 397 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:12.032503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:12.058828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10558d8-5dd6-4d4e-911f-d23c85b42d4f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:12.139046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:12.139816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:12.140376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:12.140811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:12.141666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:12.143709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:12.193673 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1841/3690] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:12 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:12.194311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:12.209070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b131202-e2f9-491e-a418-1c742666d6a0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:12.226343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:12.226969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:12.227241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:12.227507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:12.228156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:12.229769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:12.268907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1850/3691] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:12.273027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:12.289836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19ef4c-de15-4158-8ae6-9cef730a306a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:12.300212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc8a60-cdbc-4c61-b264-90f7922be062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:12.301060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8a60-cdbc-4c61-b264-90f7922be062 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:12.301439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8a60-cdbc-4c61-b264-90f7922be062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:12.301941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8a60-cdbc-4c61-b264-90f7922be062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:12.302727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc8a60-cdbc-4c61-b264-90f7922be062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:12.304682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc8a60-cdbc-4c61-b264-90f7922be062 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:12.319840 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1842/3692] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:12.324001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:12.329707 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:12.340423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbc2e-ea06-40c4-be19-9b0909853170 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:12.352870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:12.354072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:12.354449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:12.354987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] PATH_INFO: `/v3/projects/c2d8675f21b94e759bb894f68e4a8dfd/users/c8ec8654e8eb429cb350a6a36dede373/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:12.383334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d8675f21b94e759bb894f68e4a8dfd, user_id=c8ec8654e8eb429cb350a6a36dede373, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:12.387782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:12.425207 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1851/3693] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:12 2022] PUT /identity/v3/projects/c2d8675f21b94e759bb894f68e4a8dfd/users/c8ec8654e8eb429cb350a6a36dede373/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:12.428667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316ef69-2644-4cef-bfb6-6128513ed930 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:12.429020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316ef69-2644-4cef-bfb6-6128513ed930 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:12.429261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316ef69-2644-4cef-bfb6-6128513ed930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:12.485060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d316ef69-2644-4cef-bfb6-6128513ed930 None None] MFA Rules not processed for user `c8ec8654e8eb429cb350a6a36dede373`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:12.486338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d316ef69-2644-4cef-bfb6-6128513ed930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:12.643164 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1843/3694] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:12.647358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:12.799962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7cba-4cb9-44ea-9eef-6099f851cd0b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:12.818050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:12.818770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:12.818960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:12.819239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:12.819854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:12.823817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:12.875848 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1852/3695] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:12 2022] POST /identity/v3/projects => generated 397 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:12.879918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316ef69-2644-4cef-bfb6-6128513ed930 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:12.899263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316ef69-2644-4cef-bfb6-6128513ed930 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:12.924351 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:13.002301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.003364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.004459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.005152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.006909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.009562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.040383 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1844/3696] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:12 2022] POST /identity/v3/users => generated 305 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:13.044044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.055494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287c194-4175-4d3d-90a4-04d8b8640a71 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.060938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.061879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.062307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.062747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.063535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.065602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.081259 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1853/3697] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:13.082766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.095722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e5068-1d6d-4bb9-9500-4f5c74170dc1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.101668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.102399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.102795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.103340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] PATH_INFO: `/v3/projects/63ff567ed5214479979baaf233443673/users/d325606efa4748f9802a932de470a624/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.122546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ff567ed5214479979baaf233443673, user_id=d325606efa4748f9802a932de470a624, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.156070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.178882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1845/3698] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:13 2022] PUT /identity/v3/projects/63ff567ed5214479979baaf233443673/users/d325606efa4748f9802a932de470a624/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:13.180622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.193280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037709-82e8-4f7e-8cff-32113022578e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.268315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87303173-547a-4e07-91df-fe8489d77178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.269350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303173-547a-4e07-91df-fe8489d77178 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.269769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303173-547a-4e07-91df-fe8489d77178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.270185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303173-547a-4e07-91df-fe8489d77178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.271018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87303173-547a-4e07-91df-fe8489d77178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.273019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87303173-547a-4e07-91df-fe8489d77178 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.309566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.311680 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1854/3699] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:13.322651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cab1-18f0-4cb6-8b85-988700850de8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.328441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.329191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.329471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.329729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] PATH_INFO: `/v3/projects/63ff567ed5214479979baaf233443673/users/d325606efa4748f9802a932de470a624/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.331787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ff567ed5214479979baaf233443673, user_id=d325606efa4748f9802a932de470a624, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.334502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.356297 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1846/3700] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:13 2022] PUT /identity/v3/projects/63ff567ed5214479979baaf233443673/users/d325606efa4748f9802a932de470a624/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:13.369190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964f62-bb23-4506-a436-03752a76c791 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.369721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964f62-bb23-4506-a436-03752a76c791 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.370193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964f62-bb23-4506-a436-03752a76c791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.439480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9f964f62-bb23-4506-a436-03752a76c791 None None] MFA Rules not processed for user `d325606efa4748f9802a932de470a624`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:13.441972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9f964f62-bb23-4506-a436-03752a76c791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:13.496259 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:13.553528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1855/3701] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:13.554011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.656555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0c594-8ad6-4421-a6e6-9a5be1fa2008 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.662172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8ec8654e8eb429cb350a6a36dede373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2d8675f21b94e759bb894f68e4a8dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.663029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.663305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.663703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.673376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 21 01:19:13.682527 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 21 01:19:13.683658 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.686561 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1847/3702] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:13 2022] POST /identity/v3/projects => generated 136 bytes in 133 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:19:13.693248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f964f62-bb23-4506-a436-03752a76c791 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.702945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f964f62-bb23-4506-a436-03752a76c791 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.707836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd325606efa4748f9802a932de470a624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ff567ed5214479979baaf233443673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.708372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.708653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.709092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.709771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.711982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Invalid input for field 'name': '' is too short Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: On instance['name']: Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: On instance['name']: Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: '' Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise error Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application '' Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.719301 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:19:13.720748 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application '' Aug 21 01:19:13.721789 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.725145 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1856/3703] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:13 2022] POST /identity/v3/projects => generated 283 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:19:13.726350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.756409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c5832-7956-4b36-92ab-52a2a7139151 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.764535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd325606efa4748f9802a932de470a624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ff567ed5214479979baaf233443673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.765670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.766065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.766597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.769148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.774238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: On instance['name']: Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: On instance['name']: Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise error Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:19:13.805494 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:13.806789 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:19:13.807928 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.812655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.820813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1848/3704] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:13 2022] POST /identity/v3/projects => generated 412 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 21 01:19:13.826166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af751bcc-ef05-41d2-b9e0-a5424fd92602 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.841669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd325606efa4748f9802a932de470a624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ff567ed5214479979baaf233443673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.842327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.842600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.842906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] PATH_INFO: `/v3/projects/d9d6c377db10445883e339bb1d799849` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.853426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9d6c377db10445883e339bb1d799849)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.857557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Could not find project: d9d6c377db10445883e339bb1d799849.: keystone.exception.ProjectNotFound: Could not find project: d9d6c377db10445883e339bb1d799849. Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 21 01:19:13.872809 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d9d6c377db10445883e339bb1d799849. Aug 21 01:19:13.873829 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:13.876875 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1857/3705] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:13 2022] DELETE /identity/v3/projects/d9d6c377db10445883e339bb1d799849 => generated 113 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:13.882528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.895430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfba816-ab01-4a0a-8dd4-1c7665ff3de6 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.900845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8ec8654e8eb429cb350a6a36dede373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2d8675f21b94e759bb894f68e4a8dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.901786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.902344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.903579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.904457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 21 01:19:13.915052 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._list_projects() Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 21 01:19:13.916172 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:13.919272 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1849/3706] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:19:13 2022] GET /identity/v3/projects => generated 135 bytes in 37 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:13.924510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:13.936987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9196-7bcc-4dcb-9c72-fa23b131606e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:13.943289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd325606efa4748f9802a932de470a624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ff567ed5214479979baaf233443673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:13.944312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:13.944824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:13.945307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:13.946653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:13.948825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:14.032181 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1858/3707] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:13 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:14.036342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:14.054287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d587d-d618-4a5c-8d53-8cf12b1ce694 tempest-ProjectsNegativeStaticTestJSON-1018825904 tempest-ProjectsNegativeStaticTestJSON-1018825904-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:14.202226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd325606efa4748f9802a932de470a624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ff567ed5214479979baaf233443673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:14.202909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:14.203373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:14.203958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:14.205244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:14.207134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:14.240298 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:14.262059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.sql.core [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1453733930' for key 'project.ixu_project_name_domain_id'") Aug 21 01:19:14.262059 n-d-master-1 devstack@keystone.service[81885]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 01:19:14.262059 n-d-master-1 devstack@keystone.service[81885]: [parameters: {'id': 'c3492dc23ec641ea8481c6dbbc1211f8', 'name': 'tempest-project-dup-1453733930', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 01:19:14.262059 n-d-master-1 devstack@keystone.service[81885]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81885) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1453733930, project id c3492dc23ec641ea8481c6dbbc1211f8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1453733930, project id c3492dc23ec641ea8481c6dbbc1211f8. Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application conn.query(q) Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:19:14.279575 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result.read() Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1453733930' for key 'project.ixu_project_name_domain_id'") Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 01:19:14.281269 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application yield resource Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise self.value Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 01:19:14.283057 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application session.commit() Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.flush() Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application compat.raise_( Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 01:19:14.284532 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 01:19:14.285989 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application conn.query(q) Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result.read() Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:19:14.287290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1453733930' for key 'project.ixu_project_name_domain_id'") Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [parameters: {'id': 'c3492dc23ec641ea8481c6dbbc1211f8', 'name': 'tempest-project-dup-1453733930', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:14.288451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1453733930 at domain ID default. Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:14.289566 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1453733930, project id c3492dc23ec641ea8481c6dbbc1211f8. Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:14.293316 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1850/3708] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:14 2022] POST /identity/v3/projects => generated 285 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 01:19:14.294977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:14.311866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05f83-7127-436c-97ef-bca890e9a83e tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:14.328043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd325606efa4748f9802a932de470a624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ff567ed5214479979baaf233443673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:14.328799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:14.329833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:14.331400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] PATH_INFO: `/v3/projects/703f4df5ddbb479088acbe4fbae9c1f7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:14.332677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorizing `identity:delete_project(project_id=703f4df5ddbb479088acbe4fbae9c1f7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:14.337887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:14.466679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703f4df5ddbb479088acbe4fbae9c1f7', 'request_id': 'req-606297cf-ab47-4bf4-af83-7e196a259613'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.484285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703f4df5ddbb479088acbe4fbae9c1f7', 'request_id': 'req-606297cf-ab47-4bf4-af83-7e196a259613'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.494647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703f4df5ddbb479088acbe4fbae9c1f7', 'request_id': 'req-606297cf-ab47-4bf4-af83-7e196a259613'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.523415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] The token cache is being invalidate because project 703f4df5ddbb479088acbe4fbae9c1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:14.523762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.525290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-606297cf-ab47-4bf4-af83-7e196a259613 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.527150 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1859/3709] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:14 2022] DELETE /identity/v3/projects/703f4df5ddbb479088acbe4fbae9c1f7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:14.533174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:14.535769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:14.700074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad131649-e4d9-4ba8-8e34-c05f4e5f9543 tempest-ProjectsNegativeStaticTestJSON-1495997240 tempest-ProjectsNegativeStaticTestJSON-1495997240-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:14.824821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:14.825844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:14.826354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:14.826938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] PATH_INFO: `/v3/users/c8ec8654e8eb429cb350a6a36dede373` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:14.828669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ec8654e8eb429cb350a6a36dede373)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:14.831933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:14.915391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ec8654e8eb429cb350a6a36dede373'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.941712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ec8654e8eb429cb350a6a36dede373'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.961219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ec8654e8eb429cb350a6a36dede373'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.962265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ec8654e8eb429cb350a6a36dede373'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.972208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ec8654e8eb429cb350a6a36dede373'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:14.996683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1851/3710] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:14 2022] DELETE /identity/v3/users/c8ec8654e8eb429cb350a6a36dede373 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:15.018488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:15.018901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:15.019239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:15.044179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:15.046314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:15.121763 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1860/3711] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:15.157992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:15.159792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:15.241218 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:15.302367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9937895-f8e5-4831-8e43-bd7a6e0171c2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:15.306908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:15.307534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:15.307967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:15.308241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:15.319926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:15.321655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:15.336183 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1852/3712] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:16.168222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:16.170280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:16.191757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de3bc-f7de-4b71-80e0-995bcea28ec9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:16.210748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:16.211411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:16.211695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:16.212028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] PATH_INFO: `/v3/projects/c2d8675f21b94e759bb894f68e4a8dfd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:16.213399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d8675f21b94e759bb894f68e4a8dfd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:16.215816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:16.248655 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:16.361856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d8675f21b94e759bb894f68e4a8dfd', 'request_id': 'req-32381ad6-ba00-4df6-84cf-b5c92cef4025'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.376416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d8675f21b94e759bb894f68e4a8dfd', 'request_id': 'req-32381ad6-ba00-4df6-84cf-b5c92cef4025'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.386226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d8675f21b94e759bb894f68e4a8dfd', 'request_id': 'req-32381ad6-ba00-4df6-84cf-b5c92cef4025'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.408151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] The token cache is being invalidate because project c2d8675f21b94e759bb894f68e4a8dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:16.408524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.410269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.419294 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1861/3713] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:16 2022] DELETE /identity/v3/projects/c2d8675f21b94e759bb894f68e4a8dfd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:16.420499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:16.435533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f4d52-7f5c-4676-af67-8b7506ed3376 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:16.586115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:16.586903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:16.596024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:16.596372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] PATH_INFO: `/v3/users/d325606efa4748f9802a932de470a624` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:16.601995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d325606efa4748f9802a932de470a624)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:16.607104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:16.710045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd325606efa4748f9802a932de470a624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.729782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd325606efa4748f9802a932de470a624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.755362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd325606efa4748f9802a932de470a624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.756117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd325606efa4748f9802a932de470a624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.771105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ba320d21-c670-4d6c-9b72-c4e2ebbf9f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd325606efa4748f9802a932de470a624'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:16.782970 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1853/3714] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:16 2022] DELETE /identity/v3/users/d325606efa4748f9802a932de470a624 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:17.424912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:17.426484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:17.479551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381ad6-ba00-4df6-84cf-b5c92cef4025 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:17.595717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:17.596444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:17.596730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:17.597030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] PATH_INFO: `/v3/projects/63ff567ed5214479979baaf233443673` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:17.598228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ff567ed5214479979baaf233443673)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:17.606482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:17.749363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ff567ed5214479979baaf233443673', 'request_id': 'req-533c78ee-509d-45de-a903-6fa1065fb910'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:17.764616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ff567ed5214479979baaf233443673', 'request_id': 'req-533c78ee-509d-45de-a903-6fa1065fb910'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:17.787630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ff567ed5214479979baaf233443673', 'request_id': 'req-533c78ee-509d-45de-a903-6fa1065fb910'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:17.808236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] The token cache is being invalidate because project 63ff567ed5214479979baaf233443673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:17.809080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:17.811694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-533c78ee-509d-45de-a903-6fa1065fb910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:17.814014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1862/3715] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:17 2022] DELETE /identity/v3/projects/63ff567ed5214479979baaf233443673 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:17.819585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d7c8-9df0-4f7f-a89d-44e6c5ccead2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:17.820083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d7c8-9df0-4f7f-a89d-44e6c5ccead2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:17.820190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d7c8-9df0-4f7f-a89d-44e6c5ccead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:17.865867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4ab3d7c8-9df0-4f7f-a89d-44e6c5ccead2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:17.870770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4ab3d7c8-9df0-4f7f-a89d-44e6c5ccead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:17.945820 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:17.976521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1854/3716] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:17.983910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9420c-96d8-4729-b4fb-a4b4afa56c78 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:17.984248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9420c-96d8-4729-b4fb-a4b4afa56c78 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:17.984575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9420c-96d8-4729-b4fb-a4b4afa56c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.018367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b7c9420c-96d8-4729-b4fb-a4b4afa56c78 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:18.020067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7c9420c-96d8-4729-b4fb-a4b4afa56c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:18.036844 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1863/3717] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:18.037041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d7c8-9df0-4f7f-a89d-44e6c5ccead2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.046249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d7c8-9df0-4f7f-a89d-44e6c5ccead2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:18.054521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:18.055098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.055381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.055657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.056329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:18.056633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:18.058627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:18.087710 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1855/3718] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:19:18.091894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9420c-96d8-4729-b4fb-a4b4afa56c78 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.109365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9420c-96d8-4729-b4fb-a4b4afa56c78 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:18.123378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:18.148005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.148005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.148005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.148707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:18.150703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:18.227899 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1864/3719] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:18 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:18.228844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.247118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e74cac-ef4d-4447-be37-41bcc66d6509 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:18.332185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:18.333057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.333343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.333622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.335214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:18.338192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:18.377338 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1856/3720] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:18 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:18.380698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.386628 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:18.396281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd024ad4-657e-49d1-bc2b-cc352e49b860 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:18.413652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:18.414462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.415357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.415357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.415925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:18.418761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:18.447653 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1865/3721] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:18.448212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.473728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9fe20-bf96-4045-aebb-4fb93ad6bb9a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:18.485345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a6b7-9bba-4f68-aad5-c9e1b96be19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:18.486107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a6b7-9bba-4f68-aad5-c9e1b96be19f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.486538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a6b7-9bba-4f68-aad5-c9e1b96be19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.487264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a6b7-9bba-4f68-aad5-c9e1b96be19f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.487474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a6b7-9bba-4f68-aad5-c9e1b96be19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:18.489168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a6b7-9bba-4f68-aad5-c9e1b96be19f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:18.518868 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1857/3722] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:18.522672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.536787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1f314-003e-491e-a4bc-cc41392fa502 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:18.547726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:18.548565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.548948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.549313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] PATH_INFO: `/v3/projects/996e15701fb9458fb34fb466ea0369ec/users/d78bf3c7e6fc44a48f7c3e8da86afffd/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.566906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996e15701fb9458fb34fb466ea0369ec, user_id=d78bf3c7e6fc44a48f7c3e8da86afffd, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:18.569869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:18.597915 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1866/3723] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:18 2022] PUT /identity/v3/projects/996e15701fb9458fb34fb466ea0369ec/users/d78bf3c7e6fc44a48f7c3e8da86afffd/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:18.600088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7fc8e-e96a-4f79-8f01-f180470eadea None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.600616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7fc8e-e96a-4f79-8f01-f180470eadea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.601120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7fc8e-e96a-4f79-8f01-f180470eadea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.638538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e7b7fc8e-e96a-4f79-8f01-f180470eadea None None] MFA Rules not processed for user `d78bf3c7e6fc44a48f7c3e8da86afffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:18.640224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e7b7fc8e-e96a-4f79-8f01-f180470eadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:18.723199 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1858/3724] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:18.728009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.857862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4d591-0563-4236-97ff-93ac4916e549 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:18.865029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:18.866448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:18.866966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:18.867516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:18.868597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:18.870956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:18.922742 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1867/3725] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:18 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:18.923969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7fc8e-e96a-4f79-8f01-f180470eadea None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:18.941088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7fc8e-e96a-4f79-8f01-f180470eadea None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:19.007758 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:19.034258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:19.035100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:19.035387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:19.035661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:19.036304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:19.040149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:19.073773 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1859/3726] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:18 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:19.075277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:19.093414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477f362-80eb-4ab0-8439-7e7b99e9e0cb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:19.098893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:19.099780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:19.100061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:19.100328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:19.101144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:19.102921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:19.148049 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1868/3727] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:19.149788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:19.170167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab4a03-351f-4da0-bebb-b8af2dfefeee admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:19.184489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:19.185118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:19.185736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:19.186364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] PATH_INFO: `/v3/projects/3c5869a7fd464514ba8fb2b7ac1942ee/users/aed51840bfdc4a5dbb20f23462de9644/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:19.214728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5869a7fd464514ba8fb2b7ac1942ee, user_id=aed51840bfdc4a5dbb20f23462de9644, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:19.218172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:19.253235 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1860/3728] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:19 2022] PUT /identity/v3/projects/3c5869a7fd464514ba8fb2b7ac1942ee/users/aed51840bfdc4a5dbb20f23462de9644/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:19.255108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:19.273061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67d6a-d37f-4c3a-b822-9a8a58cbc17a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:19.389621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8e1b-41f9-4f7b-a475-219a520843ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:19.392155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8e1b-41f9-4f7b-a475-219a520843ce admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:19.392446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8e1b-41f9-4f7b-a475-219a520843ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:19.392725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8e1b-41f9-4f7b-a475-219a520843ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:19.393613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b8e1b-41f9-4f7b-a475-219a520843ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:19.403274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b8e1b-41f9-4f7b-a475-219a520843ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:19.441324 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1869/3729] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:19.458091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:19.479741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76110b3-0f2c-4b1f-a5e1-944510354ce7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:19.491409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:19.492093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:19.492372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:19.492646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] PATH_INFO: `/v3/projects/3c5869a7fd464514ba8fb2b7ac1942ee/users/aed51840bfdc4a5dbb20f23462de9644/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:19.505704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5869a7fd464514ba8fb2b7ac1942ee, user_id=aed51840bfdc4a5dbb20f23462de9644, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:19.514085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:19.547525 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1861/3730] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:19 2022] PUT /identity/v3/projects/3c5869a7fd464514ba8fb2b7ac1942ee/users/aed51840bfdc4a5dbb20f23462de9644/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:19.653920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbd057-3e42-4a99-95dd-93601125817b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:19.653920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbd057-3e42-4a99-95dd-93601125817b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:19.653920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbd057-3e42-4a99-95dd-93601125817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:19.732934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-aecbd057-3e42-4a99-95dd-93601125817b None None] MFA Rules not processed for user `aed51840bfdc4a5dbb20f23462de9644`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:19.734376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aecbd057-3e42-4a99-95dd-93601125817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:19.829143 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:19.905181 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1870/3731] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:19.911247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:19.925879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7cedb-bb78-4b99-923c-8679d19f8a5a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:19.933437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:19.934427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:19.934933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:19.935432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:19.936297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:19.940046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:20.012686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbd057-3e42-4a99-95dd-93601125817b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:20.013399 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1862/3732] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:19 2022] POST /identity/v3/projects => generated 329 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:20.033779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbd057-3e42-4a99-95dd-93601125817b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:20.220396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:20.221376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.221376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.221621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.222287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:20.230425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:20.283426 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1871/3733] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:20 2022] POST /identity/v3/users => generated 413 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:20.287072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:20.302615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07766efe-af19-4e48-83bf-7a0672e02ee9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:20.317445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:20.318508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.319008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.319517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.320416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:20.322241 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:20.322241 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:19:20.322241 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:19:20.327763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:20.356336 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1863/3734] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:20 2022] POST /identity/v3/roles => generated 243 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:20.357921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:20.372383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29caf83-1cb0-4a2e-851f-9ccea97b53e9 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:20.378635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:20.379392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.379764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.380130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.380971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:20.382102 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:20.382102 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:19:20.382102 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:19:20.383271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:20.405989 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1872/3735] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:20 2022] POST /identity/v3/roles => generated 246 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:20.410267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:20.422434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d1ff-443b-41a4-b586-9b7060bdddde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:20.427632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:20.428707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.429184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.429552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/0663ccd7d1844c55a892906d9412db7c/users/e8bf796e12df45a58c2233e5281fd176/roles/389c66ba868c4c41931b64a4b1e25502` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.448615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0663ccd7d1844c55a892906d9412db7c, user_id=e8bf796e12df45a58c2233e5281fd176, role_id=389c66ba868c4c41931b64a4b1e25502)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:20.453143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:20.475350 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1864/3736] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:20 2022] PUT /identity/v3/projects/0663ccd7d1844c55a892906d9412db7c/users/e8bf796e12df45a58c2233e5281fd176/roles/389c66ba868c4c41931b64a4b1e25502 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:20.482171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:20.495529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc000e5-dabf-4dd0-842f-44efc391e062 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:20.582370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff832-2759-4759-a200-9db3cb0adb81 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:20.584108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff832-2759-4759-a200-9db3cb0adb81 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.584650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff832-2759-4759-a200-9db3cb0adb81 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.585299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff832-2759-4759-a200-9db3cb0adb81 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/0663ccd7d1844c55a892906d9412db7c/users/e8bf796e12df45a58c2233e5281fd176/roles/c5fc009d35fc4e1aa989bf244dfe351d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.588222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff832-2759-4759-a200-9db3cb0adb81 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0663ccd7d1844c55a892906d9412db7c, user_id=e8bf796e12df45a58c2233e5281fd176, role_id=c5fc009d35fc4e1aa989bf244dfe351d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:20.596967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff832-2759-4759-a200-9db3cb0adb81 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:20.629157 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1873/3737] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:20 2022] PUT /identity/v3/projects/0663ccd7d1844c55a892906d9412db7c/users/e8bf796e12df45a58c2233e5281fd176/roles/c5fc009d35fc4e1aa989bf244dfe351d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:20.630530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:20.667714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1b19a-5bc0-4686-9a88-d9ca90482896 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:20.754329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86db32-43dd-4675-b2e7-d587419f4b8c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.754923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86db32-43dd-4675-b2e7-d587419f4b8c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.754923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86db32-43dd-4675-b2e7-d587419f4b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.788422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1c86db32-43dd-4675-b2e7-d587419f4b8c None None] MFA Rules not processed for user `3fbef527355e40f3af441a57cd5807be`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:20.790305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1c86db32-43dd-4675-b2e7-d587419f4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:20.799976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573554-ad87-4020-ab60-f7cbac7fe4f6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:20.800674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573554-ad87-4020-ab60-f7cbac7fe4f6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.800995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573554-ad87-4020-ab60-f7cbac7fe4f6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.802018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573554-ad87-4020-ab60-f7cbac7fe4f6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.802763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573554-ad87-4020-ab60-f7cbac7fe4f6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:20.804924 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-25573554-ad87-4020-ab60-f7cbac7fe4f6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:20.804924 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:19:20.804924 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:19:20.806293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573554-ad87-4020-ab60-f7cbac7fe4f6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:20.835880 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:20.860317 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1865/3738] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:20 2022] GET /identity/v3/users => generated 8924 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:20.862189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872c319-4d38-41e1-a603-b5998c6c2beb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:20.862623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872c319-4d38-41e1-a603-b5998c6c2beb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:20.862977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872c319-4d38-41e1-a603-b5998c6c2beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:20.916115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3872c319-4d38-41e1-a603-b5998c6c2beb None None] MFA Rules not processed for user `e8bf796e12df45a58c2233e5281fd176`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:20.918040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3872c319-4d38-41e1-a603-b5998c6c2beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:20.947153 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1874/3739] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:20.954270 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:21.032020 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1866/3740] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:21.052175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3629f2-5d17-441c-b20b-728e029847d2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.052833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3629f2-5d17-441c-b20b-728e029847d2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.053209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3629f2-5d17-441c-b20b-728e029847d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.092949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7b3629f2-5d17-441c-b20b-728e029847d2 None None] MFA Rules not processed for user `e8bf796e12df45a58c2233e5281fd176`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:21.094529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b3629f2-5d17-441c-b20b-728e029847d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:21.105269 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1875/3741] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:21.110122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872c319-4d38-41e1-a603-b5998c6c2beb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:21.121325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872c319-4d38-41e1-a603-b5998c6c2beb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:21.126525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8bf796e12df45a58c2233e5281fd176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0663ccd7d1844c55a892906d9412db7c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-124257395', 'tempest-DelegatedRole-211821920'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:21.127559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.128198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.128634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.129517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] RBAC: Authorizing `identity:create_trust()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:21.131937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:21.258423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1867/3742] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:19:21 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:21.262285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3629f2-5d17-441c-b20b-728e029847d2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:21.277725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3629f2-5d17-441c-b20b-728e029847d2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:21.283365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:21.284072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.286228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.286228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.286720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:21.288037 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:21.288037 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:19:21.288037 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:19:21.289718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:21.310915 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1876/3743] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:19:21 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:19:21.315605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:21.333262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2b94-de2f-454f-876b-d3d0304e8980 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:21.338599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8bf796e12df45a58c2233e5281fd176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0663ccd7d1844c55a892906d9412db7c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-124257395', 'tempest-DelegatedRole-211821920'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:21.339743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.340025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.340301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] PATH_INFO: `/v3/OS-TRUST/trusts/642f69d47aa34ae0beaf1b376e7a6ed3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.353640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] RBAC: Authorizing `identity:delete_trust(trust_id=642f69d47aa34ae0beaf1b376e7a6ed3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:21.355174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:21.384726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '642f69d47aa34ae0beaf1b376e7a6ed3', 'request_id': 'req-69ce3716-ceee-4a67-ac21-4ef072ce34cd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:21.396199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '642f69d47aa34ae0beaf1b376e7a6ed3', 'request_id': 'req-69ce3716-ceee-4a67-ac21-4ef072ce34cd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:21.396925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '642f69d47aa34ae0beaf1b376e7a6ed3', 'request_id': 'req-69ce3716-ceee-4a67-ac21-4ef072ce34cd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:21.406661 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1868/3744] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:19:21 2022] DELETE /identity/v3/OS-TRUST/trusts/642f69d47aa34ae0beaf1b376e7a6ed3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:21.410977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:21.413126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:21.430423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03c82-2fb9-40ee-8004-695a9ca62a34 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:21.443230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8bf796e12df45a58c2233e5281fd176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0663ccd7d1844c55a892906d9412db7c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-124257395', 'tempest-DelegatedRole-211821920'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:21.460576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.460834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.461888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] PATH_INFO: `/v3/OS-TRUST/trusts/642f69d47aa34ae0beaf1b376e7a6ed3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Could not find trust: 642f69d47aa34ae0beaf1b376e7a6ed3.: keystone.exception.TrustNotFound: Could not find trust: 642f69d47aa34ae0beaf1b376e7a6ed3. Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 21 01:19:21.500588 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 642f69d47aa34ae0beaf1b376e7a6ed3. Aug 21 01:19:21.501740 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:21.507942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1877/3745] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:21 2022] GET /identity/v3/OS-TRUST/trusts/642f69d47aa34ae0beaf1b376e7a6ed3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:21.508868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:21.510619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:21.530778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce3716-ceee-4a67-ac21-4ef072ce34cd tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:21.535895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:21.536566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.536880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.537160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/c5fc009d35fc4e1aa989bf244dfe351d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.538778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5fc009d35fc4e1aa989bf244dfe351d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:21.540069 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:21.540069 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:19:21.540069 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:19:21.541026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:21.609625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role c5fc009d35fc4e1aa989bf244dfe351d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:21.609951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:21.613319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:21.619699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:21.620617 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1869/3746] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:21 2022] DELETE /identity/v3/roles/c5fc009d35fc4e1aa989bf244dfe351d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:21.621599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:21.648584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516389-9ddd-46a9-9d32-f1512ca0a9c8 tempest-TrustsV3TestJSON-1903459613 tempest-user-675671205] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:21.780803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:21.780803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.781563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.781563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/389c66ba868c4c41931b64a4b1e25502` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.783015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=389c66ba868c4c41931b64a4b1e25502)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:21.784100 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:21.784100 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:19:21.784100 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:19:21.785002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:21.869711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role 389c66ba868c4c41931b64a4b1e25502 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:21.870199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:21.871065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:21.874209 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1878/3747] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:21 2022] DELETE /identity/v3/roles/389c66ba868c4c41931b64a4b1e25502 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:21.878632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:21.896130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2098557-355d-46bc-8c4d-f19da951be52 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:21.930839 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:21.990636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:21.991590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:21.991878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:21.992221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users/e8bf796e12df45a58c2233e5281fd176` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:21.997024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e8bf796e12df45a58c2233e5281fd176)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:21.998192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:22.107511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bf796e12df45a58c2233e5281fd176'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.123969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bf796e12df45a58c2233e5281fd176'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.153108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bf796e12df45a58c2233e5281fd176'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.154439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bf796e12df45a58c2233e5281fd176'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.177262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-773086db-5aae-4959-bf11-32db4dfbba7f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bf796e12df45a58c2233e5281fd176'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.195480 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1870/3748] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:21 2022] DELETE /identity/v3/users/e8bf796e12df45a58c2233e5281fd176 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:22.197118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:22.198916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:22.236415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85065ba-3eab-4795-8cf0-0d1dd8b59db6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:22.272221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:22.272850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:22.273762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:22.315175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] MFA Rules not processed for user `01c0d38c6d9440e88565277af4433660`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:22.318313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:22.406163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:22.409317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:22.409785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:22.410071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/0663ccd7d1844c55a892906d9412db7c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:22.415986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0663ccd7d1844c55a892906d9412db7c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:22.420271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:22.443924 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:22.512491 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1871/3749] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:22.533274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0663ccd7d1844c55a892906d9412db7c', 'request_id': 'req-1596a831-6798-480a-a725-f2c04ea5ba9c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.545691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0663ccd7d1844c55a892906d9412db7c', 'request_id': 'req-1596a831-6798-480a-a725-f2c04ea5ba9c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.558121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0663ccd7d1844c55a892906d9412db7c', 'request_id': 'req-1596a831-6798-480a-a725-f2c04ea5ba9c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.579744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] The token cache is being invalidate because project 0663ccd7d1844c55a892906d9412db7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:22.580186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.581052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:22.588266 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1879/3750] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:22 2022] DELETE /identity/v3/projects/0663ccd7d1844c55a892906d9412db7c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:22.589818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:22.591510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:22.609126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2485e-be48-4588-a0de-2ccf33e60522 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:22.710378 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:22.743148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:22.743728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:22.744061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:22.744579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:22.745273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:22.747717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:22.812722 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1872/3751] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:22 2022] POST /identity/v3/projects => generated 329 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:22.813152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:22.815038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:22.838682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a831-6798-480a-a725-f2c04ea5ba9c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:22.938245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:22.940134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:22.940621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:22.940914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:22.941698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:22.943707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:22.974847 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1880/3752] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:22 2022] POST /identity/v3/users => generated 413 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:22.978844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:22.991103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57d012-10f5-4455-8172-b6ac2e6f5d7c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:22.998709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:22.999900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.000190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.000465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.002054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:23.004222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:23.032486 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1873/3753] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:22 2022] POST /identity/v3/roles => generated 244 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:23.034038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:23.051659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7a98b-0571-4111-9615-e902e53ea1af tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:23.058787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:23.059425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.059707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.059984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.060649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:23.062758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:23.088686 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1881/3754] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:23 2022] POST /identity/v3/roles => generated 247 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:23.090062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:23.104517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7c3cb-6580-475d-bc7d-ec20cc6b47c8 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:23.112635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:23.116476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.116828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.117122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/bdf612066a074fb9bdb002ed9181f170/users/f8fbb68b1e5f4418bf3f4a25c9954f66/roles/17a2d0745deb4f9db341310aa790436a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.160962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bdf612066a074fb9bdb002ed9181f170, user_id=f8fbb68b1e5f4418bf3f4a25c9954f66, role_id=17a2d0745deb4f9db341310aa790436a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:23.171801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:23.203506 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1874/3755] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:23 2022] PUT /identity/v3/projects/bdf612066a074fb9bdb002ed9181f170/users/f8fbb68b1e5f4418bf3f4a25c9954f66/roles/17a2d0745deb4f9db341310aa790436a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:23.207767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:23.224483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb05e-356d-4626-a0ae-4ccb4e3c886a tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:23.389884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af7b0-9e73-4228-aaf4-f901aff860e7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:23.390584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af7b0-9e73-4228-aaf4-f901aff860e7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.390865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af7b0-9e73-4228-aaf4-f901aff860e7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.391143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af7b0-9e73-4228-aaf4-f901aff860e7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/bdf612066a074fb9bdb002ed9181f170/users/f8fbb68b1e5f4418bf3f4a25c9954f66/roles/ac576283bc514702983e62134c74e6cd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.395533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af7b0-9e73-4228-aaf4-f901aff860e7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bdf612066a074fb9bdb002ed9181f170, user_id=f8fbb68b1e5f4418bf3f4a25c9954f66, role_id=ac576283bc514702983e62134c74e6cd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:23.398256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af7b0-9e73-4228-aaf4-f901aff860e7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:23.427985 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1882/3756] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:23 2022] PUT /identity/v3/projects/bdf612066a074fb9bdb002ed9181f170/users/f8fbb68b1e5f4418bf3f4a25c9954f66/roles/ac576283bc514702983e62134c74e6cd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:23.429446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:23.446730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9d3e-0a74-4d1a-87a5-a5a8f82a0e1b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:23.569763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a28b1-559b-4913-8775-fc20075370f5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:23.570647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a28b1-559b-4913-8775-fc20075370f5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.570931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a28b1-559b-4913-8775-fc20075370f5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.571410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a28b1-559b-4913-8775-fc20075370f5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.572701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a28b1-559b-4913-8775-fc20075370f5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:23.574713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a28b1-559b-4913-8775-fc20075370f5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:23.623107 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1875/3757] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:23 2022] GET /identity/v3/users => generated 8924 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:23.624561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7d87-f67c-43a1-8526-6c5932e27a65 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.625373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7d87-f67c-43a1-8526-6c5932e27a65 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.625668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7d87-f67c-43a1-8526-6c5932e27a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.681968 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:23.726411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-476c7d87-f67c-43a1-8526-6c5932e27a65 None None] MFA Rules not processed for user `f8fbb68b1e5f4418bf3f4a25c9954f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:23.727806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-476c7d87-f67c-43a1-8526-6c5932e27a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:23.853291 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1883/3758] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:23.864443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2861-ce82-40d8-9130-b09b82a65a45 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.864718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2861-ce82-40d8-9130-b09b82a65a45 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.865012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2861-ce82-40d8-9130-b09b82a65a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.889784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c47e2861-ce82-40d8-9130-b09b82a65a45 None None] MFA Rules not processed for user `f8fbb68b1e5f4418bf3f4a25c9954f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:23.891486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c47e2861-ce82-40d8-9130-b09b82a65a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:23.900269 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1876/3759] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:23.904753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7d87-f67c-43a1-8526-6c5932e27a65 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:23.920391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7d87-f67c-43a1-8526-6c5932e27a65 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:23.948039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8fbb68b1e5f4418bf3f4a25c9954f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf612066a074fb9bdb002ed9181f170', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1390125059', 'tempest-DelegatedRole-2141991271'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:23.949020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:23.949340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:23.950337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:23.951963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: Authorizing `identity:create_trust()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:23.957186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:24.164552 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1884/3760] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:19:23 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:24.166186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e2861-ce82-40d8-9130-b09b82a65a45 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:24.181904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e2861-ce82-40d8-9130-b09b82a65a45 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:24.211561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8fbb68b1e5f4418bf3f4a25c9954f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf612066a074fb9bdb002ed9181f170', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1390125059', 'tempest-DelegatedRole-2141991271'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:24.213242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:24.213749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:24.214595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:24.215319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:24.220734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:24.242781 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1877/3761] 10.222.0.46 () {58 vars in 1252 bytes} [Sun Aug 21 01:19:24 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=f8fbb68b1e5f4418bf3f4a25c9954f66 => generated 611 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:24.244408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:24.261366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea6091-24e7-40cc-b9ef-5e13d1a2ccd0 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:24.268571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8fbb68b1e5f4418bf3f4a25c9954f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf612066a074fb9bdb002ed9181f170', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1390125059', 'tempest-DelegatedRole-2141991271'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:24.269400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:24.269681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:24.269952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] PATH_INFO: `/v3/OS-TRUST/trusts/22dc54ab9c904b74875291b366459fbe` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:24.285357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: Authorizing `identity:delete_trust(trust_id=22dc54ab9c904b74875291b366459fbe)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:24.286782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:24.328694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '22dc54ab9c904b74875291b366459fbe', 'request_id': 'req-d0011467-f054-45dc-8b02-a4d73ea30fd8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:24.368551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '22dc54ab9c904b74875291b366459fbe', 'request_id': 'req-d0011467-f054-45dc-8b02-a4d73ea30fd8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:24.369787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '22dc54ab9c904b74875291b366459fbe', 'request_id': 'req-d0011467-f054-45dc-8b02-a4d73ea30fd8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:24.392851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1885/3762] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:19:24 2022] DELETE /identity/v3/OS-TRUST/trusts/22dc54ab9c904b74875291b366459fbe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:24.397846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:24.400241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:24.415437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6e180-fd8d-4498-a4ee-a8455bf956c5 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:24.420657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8fbb68b1e5f4418bf3f4a25c9954f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf612066a074fb9bdb002ed9181f170', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1390125059', 'tempest-DelegatedRole-2141991271'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:24.423409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:24.423961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:24.424460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] PATH_INFO: `/v3/OS-TRUST/trusts/22dc54ab9c904b74875291b366459fbe` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Could not find trust: 22dc54ab9c904b74875291b366459fbe.: keystone.exception.TrustNotFound: Could not find trust: 22dc54ab9c904b74875291b366459fbe. Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 21 01:19:24.436367 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 22dc54ab9c904b74875291b366459fbe. Aug 21 01:19:24.437736 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:24.446135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1878/3763] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:24 2022] GET /identity/v3/OS-TRUST/trusts/22dc54ab9c904b74875291b366459fbe => generated 111 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:24.446598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:24.449529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:24.496578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0011467-f054-45dc-8b02-a4d73ea30fd8 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:24.513664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:24.515042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:24.516834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:24.517156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/ac576283bc514702983e62134c74e6cd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:24.522193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ac576283bc514702983e62134c74e6cd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:24.523912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:24.605576 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:24.626289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role ac576283bc514702983e62134c74e6cd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:24.626651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:24.627588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:24.631690 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1886/3764] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:24 2022] DELETE /identity/v3/roles/ac576283bc514702983e62134c74e6cd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:24.635854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:24.637797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:24.666771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991a6c-76ae-4079-b8da-d33c03557416 tempest-TrustsV3TestJSON-1323397725 tempest-user-196581411] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:24.846173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:24.847416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:24.847759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:24.848107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/17a2d0745deb4f9db341310aa790436a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:24.850060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=17a2d0745deb4f9db341310aa790436a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:24.852215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:24.854516 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:24.922288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role 17a2d0745deb4f9db341310aa790436a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:24.922839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:24.923852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:24.926862 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1879/3765] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:24 2022] DELETE /identity/v3/roles/17a2d0745deb4f9db341310aa790436a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:24.931431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:24.960401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b36329-f10e-496e-a88a-08df5ff59fdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:25.074383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:25.075120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:25.075370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:25.075630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users/f8fbb68b1e5f4418bf3f4a25c9954f66` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:25.082213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f8fbb68b1e5f4418bf3f4a25c9954f66)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:25.085046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:25.166992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8fbb68b1e5f4418bf3f4a25c9954f66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.183306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8fbb68b1e5f4418bf3f4a25c9954f66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.184931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8fbb68b1e5f4418bf3f4a25c9954f66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.206554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8fbb68b1e5f4418bf3f4a25c9954f66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.207670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8fbb68b1e5f4418bf3f4a25c9954f66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.253746 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1887/3766] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:24 2022] DELETE /identity/v3/users/f8fbb68b1e5f4418bf3f4a25c9954f66 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:25.259563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:25.261322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:25.286561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50897-67ea-40b4-84c2-8bed90a81e4c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:25.387716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:25.389030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:25.389545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:25.390067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/bdf612066a074fb9bdb002ed9181f170` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:25.391471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bdf612066a074fb9bdb002ed9181f170)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:25.393873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:25.505126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf612066a074fb9bdb002ed9181f170', 'request_id': 'req-0801a263-e071-4d22-b96b-5f8c5ad62536'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.523679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf612066a074fb9bdb002ed9181f170', 'request_id': 'req-0801a263-e071-4d22-b96b-5f8c5ad62536'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.540055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf612066a074fb9bdb002ed9181f170', 'request_id': 'req-0801a263-e071-4d22-b96b-5f8c5ad62536'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.563734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] The token cache is being invalidate because project bdf612066a074fb9bdb002ed9181f170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:25.564431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.565314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:25.572413 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1880/3767] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:25 2022] DELETE /identity/v3/projects/bdf612066a074fb9bdb002ed9181f170 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:25.576169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:25.577979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:25.593208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63694-bb12-43e3-a420-3ab252c2ae3d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:25.778916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:25.779730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:25.781394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:25.781678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:25.786087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:25.788079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:25.852639 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1888/3768] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:25 2022] POST /identity/v3/projects => generated 329 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:25.856285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:25.857791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:25.901431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801a263-e071-4d22-b96b-5f8c5ad62536 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:25.968830 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:25.981611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:25.982360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:25.984108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:25.984623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:25.985557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:25.988181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:26.052472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1881/3769] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:25 2022] POST /identity/v3/users => generated 416 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:26.069730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:26.078143 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:26.091759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8597-1e7b-4eda-a88b-425920903ca5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:26.111922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:26.112957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:26.113241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:26.114007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:26.114753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:26.119198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:26.194280 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1889/3770] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:26 2022] POST /identity/v3/roles => generated 243 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:26.198328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:26.228423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112bc4c-70d2-4b8f-8500-cd5cee23d510 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:26.260055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:26.260833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:26.261037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:26.261308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:26.262007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:26.263706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:26.300725 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1882/3771] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:26 2022] POST /identity/v3/roles => generated 247 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:26.306934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:26.322939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b5b24-284e-4153-be8b-4274219693d5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:26.336917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:26.337775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:26.338060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:26.338324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/7d4d23f26def43b1a599ed10d241f5c7/users/a515f6aa756246569a1b8ed0f300fa1d/roles/e2f34552cb7746bfbf16cc35a36016eb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:26.377857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d4d23f26def43b1a599ed10d241f5c7, user_id=a515f6aa756246569a1b8ed0f300fa1d, role_id=e2f34552cb7746bfbf16cc35a36016eb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:26.380632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:26.413832 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1890/3772] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:26 2022] PUT /identity/v3/projects/7d4d23f26def43b1a599ed10d241f5c7/users/a515f6aa756246569a1b8ed0f300fa1d/roles/e2f34552cb7746bfbf16cc35a36016eb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:26.418426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:26.435811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d1f8-bcbc-4069-a894-7dd274eb0cea tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:26.574094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479336-e5fd-4c43-a1a6-f80779ac6c5b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:26.574801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479336-e5fd-4c43-a1a6-f80779ac6c5b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:26.575077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479336-e5fd-4c43-a1a6-f80779ac6c5b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:26.575452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479336-e5fd-4c43-a1a6-f80779ac6c5b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/7d4d23f26def43b1a599ed10d241f5c7/users/a515f6aa756246569a1b8ed0f300fa1d/roles/dc237a33134345c1914b372503b207dd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:26.590002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479336-e5fd-4c43-a1a6-f80779ac6c5b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d4d23f26def43b1a599ed10d241f5c7, user_id=a515f6aa756246569a1b8ed0f300fa1d, role_id=dc237a33134345c1914b372503b207dd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:26.593296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479336-e5fd-4c43-a1a6-f80779ac6c5b tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:26.619273 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1883/3773] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:26 2022] PUT /identity/v3/projects/7d4d23f26def43b1a599ed10d241f5c7/users/a515f6aa756246569a1b8ed0f300fa1d/roles/dc237a33134345c1914b372503b207dd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:26.620572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:26.635863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1256f6-c8ac-4c62-8040-0147a5b2f1f7 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:26.785180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e25c6-6617-46bb-b63a-780c682abbf4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:26.786270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e25c6-6617-46bb-b63a-780c682abbf4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:26.786764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e25c6-6617-46bb-b63a-780c682abbf4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:26.787245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e25c6-6617-46bb-b63a-780c682abbf4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:26.788210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e25c6-6617-46bb-b63a-780c682abbf4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:26.791691 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-b82e25c6-6617-46bb-b63a-780c682abbf4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:19:26.791691 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:19:26.791691 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:19:26.795505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e25c6-6617-46bb-b63a-780c682abbf4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:26.851100 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1891/3774] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:26 2022] GET /identity/v3/users => generated 8927 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:26.852146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74140a99-47ae-43ce-b5c8-dac8ff75169a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:26.852437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74140a99-47ae-43ce-b5c8-dac8ff75169a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:26.852702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74140a99-47ae-43ce-b5c8-dac8ff75169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:26.945199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-74140a99-47ae-43ce-b5c8-dac8ff75169a None None] MFA Rules not processed for user `a515f6aa756246569a1b8ed0f300fa1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:26.946738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-74140a99-47ae-43ce-b5c8-dac8ff75169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:27.113061 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1884/3775] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:27.117889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eac57-2a37-4681-b309-00272cd114ac None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.118674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eac57-2a37-4681-b309-00272cd114ac None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.119177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eac57-2a37-4681-b309-00272cd114ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.165700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c38eac57-2a37-4681-b309-00272cd114ac None None] MFA Rules not processed for user `a515f6aa756246569a1b8ed0f300fa1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:27.172326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c38eac57-2a37-4681-b309-00272cd114ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:27.197818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74140a99-47ae-43ce-b5c8-dac8ff75169a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.200618 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1892/3776] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:27.216346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74140a99-47ae-43ce-b5c8-dac8ff75169a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.233146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.233953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.234229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.234503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.235196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:create_trust()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.236386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.352058 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:27.402939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1885/3777] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:19:27 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:27.408212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eac57-2a37-4681-b309-00272cd114ac None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.430254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eac57-2a37-4681-b309-00272cd114ac None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.439907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.440786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.441223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.441630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.452005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:get_trust(trust_id=130aa2deffe24e28861100af50612104)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.453908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.469164 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1893/3778] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:27 2022] GET /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104 => generated 858 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:27.469544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.479770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eab27d-92ef-4473-97cf-49c89634db0b tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.499950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.501060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.501350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.501620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.517498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=130aa2deffe24e28861100af50612104)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.518698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.537236 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1886/3779] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:19:27 2022] GET /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:19:27.542221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.565272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3761fd2-98d0-400e-b1f1-812a23c66894 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.570907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.572211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.572616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.573281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/e2f34552cb7746bfbf16cc35a36016eb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.582831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:get_role_for_trust(trust_id=130aa2deffe24e28861100af50612104, role_id=e2f34552cb7746bfbf16cc35a36016eb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.584488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.602696 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1894/3780] 10.222.0.46 () {58 vars in 1368 bytes} [Sun Aug 21 01:19:27 2022] GET /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/e2f34552cb7746bfbf16cc35a36016eb => generated 243 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:27.603380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.616418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079295-896e-4671-a480-c46b5ed55c37 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.621624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.623002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.623598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.624541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/e2f34552cb7746bfbf16cc35a36016eb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.632556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:get_role_for_trust(trust_id=130aa2deffe24e28861100af50612104, role_id=e2f34552cb7746bfbf16cc35a36016eb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.634471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.643036 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1887/3781] 10.222.0.46 () {58 vars in 1369 bytes} [Sun Aug 21 01:19:27 2022] HEAD /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/e2f34552cb7746bfbf16cc35a36016eb => generated 0 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:27.648364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.662260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e023eb-c3ca-4ef1-9838-2951c8aaa433 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.671858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.673538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.673833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.674102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/dc237a33134345c1914b372503b207dd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.692520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:get_role_for_trust(trust_id=130aa2deffe24e28861100af50612104, role_id=dc237a33134345c1914b372503b207dd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.694769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Could not find role: dc237a33134345c1914b372503b207dd.: keystone.exception.RoleNotFound: Could not find role: dc237a33134345c1914b372503b207dd. Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 01:19:27.734947 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: dc237a33134345c1914b372503b207dd. Aug 21 01:19:27.736700 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:27.740797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.743384 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1895/3782] 10.222.0.46 () {58 vars in 1368 bytes} [Sun Aug 21 01:19:27 2022] GET /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/dc237a33134345c1914b372503b207dd => generated 110 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:27.758563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f173c5f-99cf-48e5-bd26-99d8a72b8be6 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.769991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.772022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.772510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.773927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/dc237a33134345c1914b372503b207dd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.796173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:get_role_for_trust(trust_id=130aa2deffe24e28861100af50612104, role_id=dc237a33134345c1914b372503b207dd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.798573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Could not find role: dc237a33134345c1914b372503b207dd.: keystone.exception.RoleNotFound: Could not find role: dc237a33134345c1914b372503b207dd. Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 01:19:27.841715 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: dc237a33134345c1914b372503b207dd. Aug 21 01:19:27.843261 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:27.847755 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1888/3783] 10.222.0.46 () {58 vars in 1369 bytes} [Sun Aug 21 01:19:27 2022] HEAD /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104/roles/dc237a33134345c1914b372503b207dd => generated 0 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:27.852049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.863990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6746-dfc1-4642-b048-618dabc4ab85 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:27.875664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:27.876466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:27.876751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:27.877200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:27.892030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorizing `identity:delete_trust(trust_id=130aa2deffe24e28861100af50612104)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:27.894043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:27.931031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '130aa2deffe24e28861100af50612104', 'request_id': 'req-997e032e-e72d-47ca-a630-16ef68767455'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:27.962267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '130aa2deffe24e28861100af50612104', 'request_id': 'req-997e032e-e72d-47ca-a630-16ef68767455'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:27.963014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '130aa2deffe24e28861100af50612104', 'request_id': 'req-997e032e-e72d-47ca-a630-16ef68767455'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:27.976211 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1896/3784] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:19:27 2022] DELETE /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:27.996793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:27.998808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:28.024333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4523b8-62c3-45a8-ad47-8d13dc898bdd tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:28.037027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a515f6aa756246569a1b8ed0f300fa1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4d23f26def43b1a599ed10d241f5c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-305520413', 'tempest-NotDelegatedRole-1061053239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:28.038122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:28.038648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:28.039134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] PATH_INFO: `/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Could not find trust: 130aa2deffe24e28861100af50612104.: keystone.exception.TrustNotFound: Could not find trust: 130aa2deffe24e28861100af50612104. Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 21 01:19:28.062169 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 130aa2deffe24e28861100af50612104. Aug 21 01:19:28.063290 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:28.071406 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1889/3785] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:27 2022] GET /identity/v3/OS-TRUST/trusts/130aa2deffe24e28861100af50612104 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:28.075841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:28.077470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:28.100921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e032e-e72d-47ca-a630-16ef68767455 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:28.105850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:28.106518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:28.106800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:28.107077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/dc237a33134345c1914b372503b207dd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:28.122836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dc237a33134345c1914b372503b207dd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:28.126166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:28.183231 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:28.232808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role dc237a33134345c1914b372503b207dd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:28.232808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.233585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.235908 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1897/3786] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:28 2022] DELETE /identity/v3/roles/dc237a33134345c1914b372503b207dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:28.240048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:28.243373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:28.278702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2631893-b5ee-40d6-9d90-07cd6931cf29 tempest-TrustsV3TestJSON-1325520870 tempest-user-1491525289] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:28.355660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:28.356404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:28.357287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:28.357287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/e2f34552cb7746bfbf16cc35a36016eb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:28.360836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e2f34552cb7746bfbf16cc35a36016eb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:28.360836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:28.427156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role e2f34552cb7746bfbf16cc35a36016eb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:28.427752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.428595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.431160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1890/3787] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:28 2022] DELETE /identity/v3/roles/e2f34552cb7746bfbf16cc35a36016eb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:28.435329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:28.453105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307098f-c263-4fbe-8c73-68b2adfcb2b3 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:28.598285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:28.599662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:28.600209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:28.600595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users/a515f6aa756246569a1b8ed0f300fa1d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:28.602008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a515f6aa756246569a1b8ed0f300fa1d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:28.604299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:28.698769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a515f6aa756246569a1b8ed0f300fa1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.709770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a515f6aa756246569a1b8ed0f300fa1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.710472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a515f6aa756246569a1b8ed0f300fa1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.719821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a515f6aa756246569a1b8ed0f300fa1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.721302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a515f6aa756246569a1b8ed0f300fa1d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:28.747944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1898/3788] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:28 2022] DELETE /identity/v3/users/a515f6aa756246569a1b8ed0f300fa1d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:28.748955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:28.752312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:28.775572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e853-fe8b-4ceb-9db0-9137027b7131 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:28.848270 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:28.900433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:28.901239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:28.901574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:28.903461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/7d4d23f26def43b1a599ed10d241f5c7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:28.904935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d4d23f26def43b1a599ed10d241f5c7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:28.910919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.011522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4d23f26def43b1a599ed10d241f5c7', 'request_id': 'req-11741d39-d2db-469b-9eb6-99923c744b2c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:29.022278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4d23f26def43b1a599ed10d241f5c7', 'request_id': 'req-11741d39-d2db-469b-9eb6-99923c744b2c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:29.030901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4d23f26def43b1a599ed10d241f5c7', 'request_id': 'req-11741d39-d2db-469b-9eb6-99923c744b2c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:29.055185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] The token cache is being invalidate because project 7d4d23f26def43b1a599ed10d241f5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:29.055185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:29.056204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:29.063492 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1891/3789] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:28 2022] DELETE /identity/v3/projects/7d4d23f26def43b1a599ed10d241f5c7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:29.065441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:29.067171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:29.084492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9100b-27c7-48fe-be8e-d122ee9fff87 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:29.178104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:29.180999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.181462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.181912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:29.182731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:29.186616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.195102 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:29.235543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1899/3790] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:29 2022] POST /identity/v3/projects => generated 329 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:29.236736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:29.240842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:29.276602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741d39-d2db-469b-9eb6-99923c744b2c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:29.363520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:29.364214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.364497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.364856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:29.365694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:29.373278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.404956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1892/3791] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:29 2022] POST /identity/v3/users => generated 416 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:29.407808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:29.425100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec627a9-7020-48a9-a4e8-86742c959efa tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:29.432342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:29.433531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.434035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.434551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:29.435569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:29.438506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.492652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1900/3792] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:29 2022] POST /identity/v3/roles => generated 241 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:29.493915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:29.509647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a199021-faff-4f58-b482-f6da66c0489f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:29.519669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:29.520536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.520933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.521812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:29.522571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:29.524262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.543675 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1893/3793] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:29 2022] POST /identity/v3/roles => generated 246 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:29.547929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:29.562016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b379f-ee98-40ca-b7de-0c8111a96374 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:29.567399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:29.568095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.568372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.568641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/1ab021bc4978464ca8fdcb9a1315d1d0/users/2f91f968b9ff4f16bfe24e58a6c87639/roles/98a534793c1f453da6e0ac3bc77efed7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:29.589505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1ab021bc4978464ca8fdcb9a1315d1d0, user_id=2f91f968b9ff4f16bfe24e58a6c87639, role_id=98a534793c1f453da6e0ac3bc77efed7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:29.592204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.615791 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1901/3794] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:29 2022] PUT /identity/v3/projects/1ab021bc4978464ca8fdcb9a1315d1d0/users/2f91f968b9ff4f16bfe24e58a6c87639/roles/98a534793c1f453da6e0ac3bc77efed7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:29.619642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:29.637890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c446-d8b6-4dbb-a5ee-ab476d54f592 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:29.739233 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:29.782107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e7522-4c04-46c7-97cc-24d83c6deaa6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:29.783389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7522-4c04-46c7-97cc-24d83c6deaa6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.783883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7522-4c04-46c7-97cc-24d83c6deaa6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.785694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7522-4c04-46c7-97cc-24d83c6deaa6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/1ab021bc4978464ca8fdcb9a1315d1d0/users/2f91f968b9ff4f16bfe24e58a6c87639/roles/2bb8b931a47d4d2e885aa42b5cc06528` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:29.788900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e7522-4c04-46c7-97cc-24d83c6deaa6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1ab021bc4978464ca8fdcb9a1315d1d0, user_id=2f91f968b9ff4f16bfe24e58a6c87639, role_id=2bb8b931a47d4d2e885aa42b5cc06528)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:29.792123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e7522-4c04-46c7-97cc-24d83c6deaa6 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.817690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:29.820167 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1894/3795] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:29 2022] PUT /identity/v3/projects/1ab021bc4978464ca8fdcb9a1315d1d0/users/2f91f968b9ff4f16bfe24e58a6c87639/roles/2bb8b931a47d4d2e885aa42b5cc06528 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:29.837469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b94ca-33b6-4e48-9ffd-ae17870ddc54 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:29.927623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c754-e000-4120-8819-fb175a8da188 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:29.928158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c754-e000-4120-8819-fb175a8da188 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.928449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c754-e000-4120-8819-fb175a8da188 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.928734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c754-e000-4120-8819-fb175a8da188 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:29.929477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0c754-e000-4120-8819-fb175a8da188 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:29.933072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0c754-e000-4120-8819-fb175a8da188 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:29.985150 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1902/3796] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:29 2022] GET /identity/v3/users => generated 8927 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:29.990629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffe1aa-f1da-4672-bbe6-805f0fb898e5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:29.992034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffe1aa-f1da-4672-bbe6-805f0fb898e5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:29.992034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffe1aa-f1da-4672-bbe6-805f0fb898e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:30.061889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c9ffe1aa-f1da-4672-bbe6-805f0fb898e5 None None] MFA Rules not processed for user `2f91f968b9ff4f16bfe24e58a6c87639`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:30.063578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c9ffe1aa-f1da-4672-bbe6-805f0fb898e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:30.183391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1895/3797] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:30.194818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4d416-ef0b-4186-b30e-dd7520ee9e35 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:30.195824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4d416-ef0b-4186-b30e-dd7520ee9e35 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:30.196109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4d416-ef0b-4186-b30e-dd7520ee9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:30.222993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-76d4d416-ef0b-4186-b30e-dd7520ee9e35 None None] MFA Rules not processed for user `2f91f968b9ff4f16bfe24e58a6c87639`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:30.224245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-76d4d416-ef0b-4186-b30e-dd7520ee9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:30.234006 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1903/3798] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:30.239163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffe1aa-f1da-4672-bbe6-805f0fb898e5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:30.249928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffe1aa-f1da-4672-bbe6-805f0fb898e5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:30.255313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91f968b9ff4f16bfe24e58a6c87639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ab021bc4978464ca8fdcb9a1315d1d0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929715715', 'tempest-DelegatedRole-6347181'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:30.255488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:30.255737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:30.256013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:30.256723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] RBAC: Authorizing `identity:create_trust()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:30.258126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 21 01:19:30.414294 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 21 01:19:30.416223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 21 01:19:30.419141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 21 01:19:30.419141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 21 01:19:30.419141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 21 01:19:30.419141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 21 01:19:30.419141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 21 01:19:30.419141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:30.419141 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1896/3799] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:19:30 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 179 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:19:30.422558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4d416-ef0b-4186-b30e-dd7520ee9e35 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:30.438141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4d416-ef0b-4186-b30e-dd7520ee9e35 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:30.453538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:30.454965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:30.455437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:30.455887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/2bb8b931a47d4d2e885aa42b5cc06528` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:30.462663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2bb8b931a47d4d2e885aa42b5cc06528)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:30.464513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:30.540429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role 2bb8b931a47d4d2e885aa42b5cc06528 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:30.541103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:30.542871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:30.549731 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1904/3800] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:30 2022] DELETE /identity/v3/roles/2bb8b931a47d4d2e885aa42b5cc06528 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:30.551166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:30.557229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:30.596507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea80f6-529b-4e56-ae9d-4b7dbd08e780 tempest-TrustsV3TestJSON-1479831638 tempest-user-1984231894] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:30.682587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:30.683653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:30.684148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:30.684574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/98a534793c1f453da6e0ac3bc77efed7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:30.686440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=98a534793c1f453da6e0ac3bc77efed7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:30.688715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:30.693485 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:30.741572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role 98a534793c1f453da6e0ac3bc77efed7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:30.742198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:30.743473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:30.745871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1897/3801] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:30 2022] DELETE /identity/v3/roles/98a534793c1f453da6e0ac3bc77efed7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:30.751315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:30.784970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc6e23-7818-45cf-ba15-d5f6fd8422bc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:30.871304 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:30.879898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:30.893718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:30.897722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:30.898557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users/2f91f968b9ff4f16bfe24e58a6c87639` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:30.900548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2f91f968b9ff4f16bfe24e58a6c87639)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:30.902799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.018208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f91f968b9ff4f16bfe24e58a6c87639'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.044816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f91f968b9ff4f16bfe24e58a6c87639'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.045568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f91f968b9ff4f16bfe24e58a6c87639'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.073233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f91f968b9ff4f16bfe24e58a6c87639'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.074903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f91f968b9ff4f16bfe24e58a6c87639'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.103956 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1905/3802] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:30 2022] DELETE /identity/v3/users/2f91f968b9ff4f16bfe24e58a6c87639 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:31.105504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.107177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:31.140361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90e65f-33cd-4ccf-b6cf-195f3c825bde tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:31.222373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:31.223054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:31.223494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:31.223768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/1ab021bc4978464ca8fdcb9a1315d1d0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:31.238031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ab021bc4978464ca8fdcb9a1315d1d0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:31.238031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.333647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab021bc4978464ca8fdcb9a1315d1d0', 'request_id': 'req-499dd2ca-5758-4007-bbed-942afcedc682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.344052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab021bc4978464ca8fdcb9a1315d1d0', 'request_id': 'req-499dd2ca-5758-4007-bbed-942afcedc682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.363203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab021bc4978464ca8fdcb9a1315d1d0', 'request_id': 'req-499dd2ca-5758-4007-bbed-942afcedc682'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.381291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] The token cache is being invalidate because project 1ab021bc4978464ca8fdcb9a1315d1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:31.381574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.382413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:31.384294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1898/3803] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:31 2022] DELETE /identity/v3/projects/1ab021bc4978464ca8fdcb9a1315d1d0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:31.389759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.392334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:31.406973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208047dc-8ec5-4bbd-81c5-3564452fd264 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:31.489314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:31.490211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:31.490643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:31.491197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:31.492106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:31.495022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.533339 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1906/3804] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:31 2022] POST /identity/v3/projects => generated 327 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:31.534893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.537485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:31.552214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dd2ca-5758-4007-bbed-942afcedc682 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:31.611673 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:31.620533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:31.621469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:31.621809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:31.622534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:31.623287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:31.625676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.658512 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1899/3805] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:31 2022] POST /identity/v3/users => generated 413 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:31.662526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.682892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241938a-1468-4f0b-930c-cb1381476376 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:31.688600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:31.689612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:31.689891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:31.690162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:31.690885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:31.692569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.713028 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1907/3806] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:31 2022] POST /identity/v3/roles => generated 243 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:31.717345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.730768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621a87c-2ca1-4807-bdeb-935cab5a5f70 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:31.738396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:31.739035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:31.739310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:31.739591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:31.740510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:31.742175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.760172 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1900/3807] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:31 2022] POST /identity/v3/roles => generated 247 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:31.764961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.776426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326daef-1dfb-4066-b073-e6c02c883690 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:31.781473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:31.782714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:31.782714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:31.782714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/3e70966a11ff4a5b944145fa1827e33d/users/c3768d0eab0d407cb8c04a483c8740cb/roles/a345c7a8866d4f4aafec39c262ced2cb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:31.800456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3e70966a11ff4a5b944145fa1827e33d, user_id=c3768d0eab0d407cb8c04a483c8740cb, role_id=a345c7a8866d4f4aafec39c262ced2cb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:31.803184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.823273 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1908/3808] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:31 2022] PUT /identity/v3/projects/3e70966a11ff4a5b944145fa1827e33d/users/c3768d0eab0d407cb8c04a483c8740cb/roles/a345c7a8866d4f4aafec39c262ced2cb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:31.834700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.853048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c371e7f-b2e4-4d62-9fc3-76431e4598b5 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:31.925895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3e4a-4816-43fd-b9e1-aa83ccc60b25 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:31.926621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3e4a-4816-43fd-b9e1-aa83ccc60b25 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:31.926905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3e4a-4816-43fd-b9e1-aa83ccc60b25 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:31.927210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3e4a-4816-43fd-b9e1-aa83ccc60b25 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/3e70966a11ff4a5b944145fa1827e33d/users/c3768d0eab0d407cb8c04a483c8740cb/roles/fe25a9efe259496c90b2ceb98fa65c97` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:31.934145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3e4a-4816-43fd-b9e1-aa83ccc60b25 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3e70966a11ff4a5b944145fa1827e33d, user_id=c3768d0eab0d407cb8c04a483c8740cb, role_id=fe25a9efe259496c90b2ceb98fa65c97)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:31.937382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3e4a-4816-43fd-b9e1-aa83ccc60b25 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:31.954874 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1901/3809] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:31 2022] PUT /identity/v3/projects/3e70966a11ff4a5b944145fa1827e33d/users/c3768d0eab0d407cb8c04a483c8740cb/roles/fe25a9efe259496c90b2ceb98fa65c97 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:31.958887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:31.984223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a99cf-6a18-4a59-a1e6-87d0ffa67795 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.017787 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:32.095056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d858d7-8755-4132-96b3-156954ed7979 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.096076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d858d7-8755-4132-96b3-156954ed7979 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.096457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d858d7-8755-4132-96b3-156954ed7979 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.096741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d858d7-8755-4132-96b3-156954ed7979 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.097445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d858d7-8755-4132-96b3-156954ed7979 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.099501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d858d7-8755-4132-96b3-156954ed7979 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.164327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1d065-d192-4005-8f01-d5f0a72da7c2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.164725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1d065-d192-4005-8f01-d5f0a72da7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.164968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1d065-d192-4005-8f01-d5f0a72da7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.175381 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1909/3810] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:31 2022] GET /identity/v3/users => generated 8924 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:19:32.225891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4eb1d065-d192-4005-8f01-d5f0a72da7c2 None None] MFA Rules not processed for user `c3768d0eab0d407cb8c04a483c8740cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:32.227963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4eb1d065-d192-4005-8f01-d5f0a72da7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:32.323386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1902/3811] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:32.335617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f15bd-6a1b-4d97-9fca-8e6c8dc99223 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.335765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f15bd-6a1b-4d97-9fca-8e6c8dc99223 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.335977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f15bd-6a1b-4d97-9fca-8e6c8dc99223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.356512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e71f15bd-6a1b-4d97-9fca-8e6c8dc99223 None None] MFA Rules not processed for user `c3768d0eab0d407cb8c04a483c8740cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:32.357797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e71f15bd-6a1b-4d97-9fca-8e6c8dc99223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:32.366495 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1910/3812] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:32.370830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1d065-d192-4005-8f01-d5f0a72da7c2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.380931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1d065-d192-4005-8f01-d5f0a72da7c2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.385221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.385868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.386730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.386730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.387091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:create_trust()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.388287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.451273 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:32.478052 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1903/3813] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:19:32 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:32.482406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f15bd-6a1b-4d97-9fca-8e6c8dc99223 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.491522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f15bd-6a1b-4d97-9fca-8e6c8dc99223 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.497609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.498272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.498551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.498826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.512162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:get_trust(trust_id=b69af542567847f184de116bae6d573a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.514438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.523217 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1911/3814] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:32 2022] GET /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a => generated 833 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:32.527849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.541378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5fc7-5c53-4f6d-975a-5fdaf0434a24 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.547350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.548116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.548445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.548966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.559207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b69af542567847f184de116bae6d573a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.560728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.571401 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1904/3815] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:19:32 2022] GET /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:32.577058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.591123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55434f5-5ea5-4129-9944-6898b43c88a5 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.596145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.598658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.598658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.598658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/a345c7a8866d4f4aafec39c262ced2cb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.604713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b69af542567847f184de116bae6d573a, role_id=a345c7a8866d4f4aafec39c262ced2cb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.606330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.614627 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1912/3816] 10.222.0.46 () {58 vars in 1368 bytes} [Sun Aug 21 01:19:32 2022] GET /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/a345c7a8866d4f4aafec39c262ced2cb => generated 243 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:32.618641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.630046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8a00-1ebd-476d-8b76-bda35dc6eb0f tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.634913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.635595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.635870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.636138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/a345c7a8866d4f4aafec39c262ced2cb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.644476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b69af542567847f184de116bae6d573a, role_id=a345c7a8866d4f4aafec39c262ced2cb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.646082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.653433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1905/3817] 10.222.0.46 () {58 vars in 1369 bytes} [Sun Aug 21 01:19:32 2022] HEAD /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/a345c7a8866d4f4aafec39c262ced2cb => generated 0 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 21 01:19:32.658297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.669183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abe886-6690-4e5a-a006-f9a53548e0cb tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.674036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.674729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.675009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.675425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/fe25a9efe259496c90b2ceb98fa65c97` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.689724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b69af542567847f184de116bae6d573a, role_id=fe25a9efe259496c90b2ceb98fa65c97)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.691261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Could not find role: fe25a9efe259496c90b2ceb98fa65c97.: keystone.exception.RoleNotFound: Could not find role: fe25a9efe259496c90b2ceb98fa65c97. Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 01:19:32.703068 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fe25a9efe259496c90b2ceb98fa65c97. Aug 21 01:19:32.704337 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:32.707160 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1913/3818] 10.222.0.46 () {58 vars in 1368 bytes} [Sun Aug 21 01:19:32 2022] GET /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/fe25a9efe259496c90b2ceb98fa65c97 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:32.708154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.718868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17340a-9646-49cb-824c-00c6916a4122 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.723430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.724080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.724353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.724623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/fe25a9efe259496c90b2ceb98fa65c97` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.732796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b69af542567847f184de116bae6d573a, role_id=fe25a9efe259496c90b2ceb98fa65c97)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.734365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Could not find role: fe25a9efe259496c90b2ceb98fa65c97.: keystone.exception.RoleNotFound: Could not find role: fe25a9efe259496c90b2ceb98fa65c97. Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 01:19:32.747109 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fe25a9efe259496c90b2ceb98fa65c97. Aug 21 01:19:32.748133 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:32.748615 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1906/3819] 10.222.0.46 () {58 vars in 1369 bytes} [Sun Aug 21 01:19:32 2022] HEAD /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a/roles/fe25a9efe259496c90b2ceb98fa65c97 => generated 0 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:32.752797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.763079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f794a-f480-4789-8073-23394eeae148 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.768263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.768454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.768711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.769027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.775533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorizing `identity:delete_trust(trust_id=b69af542567847f184de116bae6d573a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.777226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.796716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b69af542567847f184de116bae6d573a', 'request_id': 'req-9bee276a-61fa-435c-a8f1-a414cfdf8104'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:32.806271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b69af542567847f184de116bae6d573a', 'request_id': 'req-9bee276a-61fa-435c-a8f1-a414cfdf8104'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:32.806943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b69af542567847f184de116bae6d573a', 'request_id': 'req-9bee276a-61fa-435c-a8f1-a414cfdf8104'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:32.814744 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1914/3820] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:19:32 2022] DELETE /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:32.818771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.820529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:32.834082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e2c3-07e6-40e1-932a-875fc66ab7a2 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.838688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3768d0eab0d407cb8c04a483c8740cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e70966a11ff4a5b944145fa1827e33d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1030545388', 'tempest-DelegatedRole-247466612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.839371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.839682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.839954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] PATH_INFO: `/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Could not find trust: b69af542567847f184de116bae6d573a.: keystone.exception.TrustNotFound: Could not find trust: b69af542567847f184de116bae6d573a. Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 21 01:19:32.849223 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b69af542567847f184de116bae6d573a. Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:32.850401 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1907/3821] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:32 2022] GET /identity/v3/OS-TRUST/trusts/b69af542567847f184de116bae6d573a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:32.854955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.856843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:32.875731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee276a-61fa-435c-a8f1-a414cfdf8104 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:32.880627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:32.881321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:32.881600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:32.881876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/fe25a9efe259496c90b2ceb98fa65c97` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:32.883280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fe25a9efe259496c90b2ceb98fa65c97)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:32.885077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:32.950293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role fe25a9efe259496c90b2ceb98fa65c97 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:32.950855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:32.951842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:32.957705 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1915/3822] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:32 2022] DELETE /identity/v3/roles/fe25a9efe259496c90b2ceb98fa65c97 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:32.962967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:32.966077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:32.984333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ddb3-6bce-4247-8cb5-84ca825eebc3 tempest-TrustsV3TestJSON-93534983 tempest-user-254889541] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.089244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.090076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.090533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.090822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/a345c7a8866d4f4aafec39c262ced2cb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.093639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a345c7a8866d4f4aafec39c262ced2cb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.097972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.158908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role a345c7a8866d4f4aafec39c262ced2cb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:33.159318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.159892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.165376 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1908/3823] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:32 2022] DELETE /identity/v3/roles/a345c7a8866d4f4aafec39c262ced2cb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:33.166338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:33.178916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fe183-9868-4728-ba15-79aea0c9eff4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.232658 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:33.263228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.263584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.263955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.264325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users/c3768d0eab0d407cb8c04a483c8740cb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.265996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c3768d0eab0d407cb8c04a483c8740cb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.268974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.350691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3768d0eab0d407cb8c04a483c8740cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.361821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3768d0eab0d407cb8c04a483c8740cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.362989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3768d0eab0d407cb8c04a483c8740cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.370914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3768d0eab0d407cb8c04a483c8740cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.371608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3768d0eab0d407cb8c04a483c8740cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.392682 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1916/3824] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:33 2022] DELETE /identity/v3/users/c3768d0eab0d407cb8c04a483c8740cb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:33.397230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:33.399849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:33.415693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052e5ab-a418-49f2-9809-604839b63047 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.469797 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:33.495282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.496052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.497046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.497377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/3e70966a11ff4a5b944145fa1827e33d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.498906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e70966a11ff4a5b944145fa1827e33d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.501365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.558050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e70966a11ff4a5b944145fa1827e33d', 'request_id': 'req-61440e9f-acd4-48fe-aa57-efad98ea5a0d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.565939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e70966a11ff4a5b944145fa1827e33d', 'request_id': 'req-61440e9f-acd4-48fe-aa57-efad98ea5a0d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.572726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e70966a11ff4a5b944145fa1827e33d', 'request_id': 'req-61440e9f-acd4-48fe-aa57-efad98ea5a0d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.588632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] The token cache is being invalidate because project 3e70966a11ff4a5b944145fa1827e33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:33.588953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.589657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:33.591228 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1909/3825] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:33 2022] DELETE /identity/v3/projects/3e70966a11ff4a5b944145fa1827e33d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:33.597414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:33.599052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:33.614025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fef369-adfb-4f08-bf33-8f4345be0d91 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.679578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.680208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.680490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.680787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.681493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.683446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.712555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1917/3826] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:19:33 2022] POST /identity/v3/projects => generated 329 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:33.718399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:33.720127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:33.735712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61440e9f-acd4-48fe-aa57-efad98ea5a0d tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.802078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.802707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.802986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.803267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.803951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.805943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.832756 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1910/3827] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:33 2022] POST /identity/v3/users => generated 413 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:33.834140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:33.854843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4abb0b-cbbe-48b6-9b6a-16e256d09bdd tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.864793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.865462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.865777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.866054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.866724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.868371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.887065 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1918/3828] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:33 2022] POST /identity/v3/roles => generated 244 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:33.891034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:33.906645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a203e8-e649-4e85-976a-fdc9b5a24043 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.912623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.913382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.913740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.914043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.915056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.917105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.936303 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1911/3829] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:19:33 2022] POST /identity/v3/roles => generated 246 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:33.941071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:33.954173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167969df-4720-4206-8557-54c8291571df tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:33.959780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:33.960512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:33.960823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:33.961105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/ea9274691dc942ec9b0e39ad85bf0d42/users/1e6ed98ff5ef4650907a4a698299fd4b/roles/779dd00351794f5b96a3693b2bfa3421` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:33.979068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ea9274691dc942ec9b0e39ad85bf0d42, user_id=1e6ed98ff5ef4650907a4a698299fd4b, role_id=779dd00351794f5b96a3693b2bfa3421)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:33.981844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:33.999833 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1919/3830] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:33 2022] PUT /identity/v3/projects/ea9274691dc942ec9b0e39ad85bf0d42/users/1e6ed98ff5ef4650907a4a698299fd4b/roles/779dd00351794f5b96a3693b2bfa3421 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:34.005559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:34.016836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4252b1-f778-4b9f-ac6e-d985fe6e1b0f tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:34.093345 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:34.138374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c398f-1a48-4754-95cc-cfcdf8edab6c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:34.139501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c398f-1a48-4754-95cc-cfcdf8edab6c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.140121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c398f-1a48-4754-95cc-cfcdf8edab6c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.140819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c398f-1a48-4754-95cc-cfcdf8edab6c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/ea9274691dc942ec9b0e39ad85bf0d42/users/1e6ed98ff5ef4650907a4a698299fd4b/roles/08e63d3c168c4d05a0404ed41a726cde` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.145152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c398f-1a48-4754-95cc-cfcdf8edab6c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ea9274691dc942ec9b0e39ad85bf0d42, user_id=1e6ed98ff5ef4650907a4a698299fd4b, role_id=08e63d3c168c4d05a0404ed41a726cde)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:34.149925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c398f-1a48-4754-95cc-cfcdf8edab6c tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:34.202756 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1912/3831] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:34 2022] PUT /identity/v3/projects/ea9274691dc942ec9b0e39ad85bf0d42/users/1e6ed98ff5ef4650907a4a698299fd4b/roles/08e63d3c168c4d05a0404ed41a726cde => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:34.205404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:34.225671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6148a-ebbc-4493-beb5-21a8afc8e6dc tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:34.234184 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:34.340341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17a5fe-6b83-4730-a57e-fed00cc67e82 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:34.340855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a5fe-6b83-4730-a57e-fed00cc67e82 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.341157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a5fe-6b83-4730-a57e-fed00cc67e82 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.341484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a5fe-6b83-4730-a57e-fed00cc67e82 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.342281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17a5fe-6b83-4730-a57e-fed00cc67e82 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:34.344638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17a5fe-6b83-4730-a57e-fed00cc67e82 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:34.412641 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1920/3832] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:34 2022] GET /identity/v3/users => generated 8924 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:34.419268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823379f-e3a4-41bf-a76c-dfcb2a1fb222 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.419268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823379f-e3a4-41bf-a76c-dfcb2a1fb222 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.421405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823379f-e3a4-41bf-a76c-dfcb2a1fb222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.463647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5823379f-e3a4-41bf-a76c-dfcb2a1fb222 None None] MFA Rules not processed for user `1e6ed98ff5ef4650907a4a698299fd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:34.464941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5823379f-e3a4-41bf-a76c-dfcb2a1fb222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:34.541167 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1913/3833] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:34.551835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0208b-1c63-4b21-be87-e4cc1112e107 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.552240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0208b-1c63-4b21-be87-e4cc1112e107 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.552653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0208b-1c63-4b21-be87-e4cc1112e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.578200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c0a0208b-1c63-4b21-be87-e4cc1112e107 None None] MFA Rules not processed for user `1e6ed98ff5ef4650907a4a698299fd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:34.579492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c0a0208b-1c63-4b21-be87-e4cc1112e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:34.590715 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1921/3834] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:34.591946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823379f-e3a4-41bf-a76c-dfcb2a1fb222 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:34.615466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823379f-e3a4-41bf-a76c-dfcb2a1fb222 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:34.624813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:34.625538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.626552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.626836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.627559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:create_trust()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:34.629544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:34.746198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0208b-1c63-4b21-be87-e4cc1112e107 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:34.751845 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1914/3835] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:19:34 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:34.757427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0208b-1c63-4b21-be87-e4cc1112e107 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:34.766561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:34.766561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.766561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.769637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.777470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:get_trust(trust_id=63f97a5074db4a3880ad4c44d7b1f174)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:34.780065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:34.810429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:34.818105 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1922/3836] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:34 2022] GET /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174 => generated 835 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:19:34.823079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56e6f1-b120-4365-b8a0-2df863f0bea4 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:34.831740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:34.832573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.832987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.833621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.866843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=63f97a5074db4a3880ad4c44d7b1f174)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:34.872315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:34.909689 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1915/3837] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:19:34 2022] GET /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles => generated 371 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:19:34.914511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:34.932546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac73609-33d0-49a4-9a7a-aafe62178188 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:34.943142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:34.945288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:34.947275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:34.947737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/779dd00351794f5b96a3693b2bfa3421` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:34.977088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63f97a5074db4a3880ad4c44d7b1f174, role_id=779dd00351794f5b96a3693b2bfa3421)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:34.982772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:34.993539 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1923/3838] 10.222.0.46 () {58 vars in 1368 bytes} [Sun Aug 21 01:19:34 2022] GET /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/779dd00351794f5b96a3693b2bfa3421 => generated 244 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:34.999089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.041930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f31e20-7719-4411-afb4-edf8fa1dd867 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.051125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.052227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.052724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.053404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/779dd00351794f5b96a3693b2bfa3421` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.067304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63f97a5074db4a3880ad4c44d7b1f174, role_id=779dd00351794f5b96a3693b2bfa3421)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:35.070315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:35.081971 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1916/3839] 10.222.0.46 () {58 vars in 1369 bytes} [Sun Aug 21 01:19:34 2022] HEAD /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/779dd00351794f5b96a3693b2bfa3421 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 21 01:19:35.086268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.104263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b217-520e-4d63-843a-75283ccbbb34 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.120942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.122617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.124133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.129452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/08e63d3c168c4d05a0404ed41a726cde` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.153219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63f97a5074db4a3880ad4c44d7b1f174, role_id=08e63d3c168c4d05a0404ed41a726cde)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:35.155154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Could not find role: 08e63d3c168c4d05a0404ed41a726cde.: keystone.exception.RoleNotFound: Could not find role: 08e63d3c168c4d05a0404ed41a726cde. Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 01:19:35.182485 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 08e63d3c168c4d05a0404ed41a726cde. Aug 21 01:19:35.183888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:35.189487 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1924/3840] 10.222.0.46 () {58 vars in 1368 bytes} [Sun Aug 21 01:19:35 2022] GET /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/08e63d3c168c4d05a0404ed41a726cde => generated 110 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:35.189938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.203885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3409f1-aec4-41ec-920d-945d8d31e88b tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.209108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.209872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.210388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.210742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/08e63d3c168c4d05a0404ed41a726cde` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.224969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:get_role_for_trust(trust_id=63f97a5074db4a3880ad4c44d7b1f174, role_id=08e63d3c168c4d05a0404ed41a726cde)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:35.227139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Could not find role: 08e63d3c168c4d05a0404ed41a726cde.: keystone.exception.RoleNotFound: Could not find role: 08e63d3c168c4d05a0404ed41a726cde. Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 01:19:35.241431 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 08e63d3c168c4d05a0404ed41a726cde. Aug 21 01:19:35.242505 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:35.242949 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1917/3841] 10.222.0.46 () {58 vars in 1369 bytes} [Sun Aug 21 01:19:35 2022] HEAD /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174/roles/08e63d3c168c4d05a0404ed41a726cde => generated 0 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:19:35.247075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.262352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5106-ff68-4d82-b939-5dd90bb79b73 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.269086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.270318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.270795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.271297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.287041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorizing `identity:delete_trust(trust_id=63f97a5074db4a3880ad4c44d7b1f174)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:35.288799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:35.335921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '63f97a5074db4a3880ad4c44d7b1f174', 'request_id': 'req-7532dc68-18e6-4755-87a4-f21f3885f65a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.353087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '63f97a5074db4a3880ad4c44d7b1f174', 'request_id': 'req-7532dc68-18e6-4755-87a4-f21f3885f65a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.354003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '63f97a5074db4a3880ad4c44d7b1f174', 'request_id': 'req-7532dc68-18e6-4755-87a4-f21f3885f65a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.362878 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1925/3842] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:19:35 2022] DELETE /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:35.367007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.368886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:35.378023 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:35.385702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b27a-432b-4dec-a3ed-6e64ac482359 tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.391553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6ed98ff5ef4650907a4a698299fd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9274691dc942ec9b0e39ad85bf0d42', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-692398095', 'tempest-DelegatedRole-1628840409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.392506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.393033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.393467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] PATH_INFO: `/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Could not find trust: 63f97a5074db4a3880ad4c44d7b1f174.: keystone.exception.TrustNotFound: Could not find trust: 63f97a5074db4a3880ad4c44d7b1f174. Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 21 01:19:35.408330 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 63f97a5074db4a3880ad4c44d7b1f174. Aug 21 01:19:35.409630 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:35.410426 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1918/3843] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:19:35 2022] GET /identity/v3/OS-TRUST/trusts/63f97a5074db4a3880ad4c44d7b1f174 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:19:35.417145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.418920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:35.438683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532dc68-18e6-4755-87a4-f21f3885f65a tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.448086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.449072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.449505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.449936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/08e63d3c168c4d05a0404ed41a726cde` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.452720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=08e63d3c168c4d05a0404ed41a726cde)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:35.454674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:35.531593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role 08e63d3c168c4d05a0404ed41a726cde has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:35.532594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.534533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.537862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1926/3844] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:35 2022] DELETE /identity/v3/roles/08e63d3c168c4d05a0404ed41a726cde => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:35.542207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.545105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:35.590562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e42e-4dbc-4e3e-acf2-43f3ab1c6e6f tempest-TrustsV3TestJSON-1606898696 tempest-user-988985885] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.687138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.687971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.688341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.689743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/roles/779dd00351794f5b96a3693b2bfa3421` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.691871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_role(role_id=779dd00351794f5b96a3693b2bfa3421)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:35.694872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:35.758708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invalidating the token cache because role 779dd00351794f5b96a3693b2bfa3421 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:35.759071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.770070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.791903 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1919/3845] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:35 2022] DELETE /identity/v3/roles/779dd00351794f5b96a3693b2bfa3421 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:35.793070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:35.818658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e10f0-0da3-4d0f-beef-c02fd3c86542 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:35.843694 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:35.896733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:35.897431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:35.897715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:35.898146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/users/1e6ed98ff5ef4650907a4a698299fd4b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:35.899959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1e6ed98ff5ef4650907a4a698299fd4b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:35.901832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:35.977101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6ed98ff5ef4650907a4a698299fd4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.994825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6ed98ff5ef4650907a4a698299fd4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:35.996668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6ed98ff5ef4650907a4a698299fd4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.018033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6ed98ff5ef4650907a4a698299fd4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.018819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6ed98ff5ef4650907a4a698299fd4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.050727 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1927/3846] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:35 2022] DELETE /identity/v3/users/1e6ed98ff5ef4650907a4a698299fd4b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:36.054715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:36.056181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:36.071749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ddaa-3c5e-4b0c-b025-49a821027290 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:36.154230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed51840bfdc4a5dbb20f23462de9644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5869a7fd464514ba8fb2b7ac1942ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:36.154909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:36.155189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:36.155554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] PATH_INFO: `/v3/projects/ea9274691dc942ec9b0e39ad85bf0d42` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:36.156880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ea9274691dc942ec9b0e39ad85bf0d42)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:36.159081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:36.291158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9274691dc942ec9b0e39ad85bf0d42', 'request_id': 'req-6fc481ce-ea46-408b-8997-a9965d23d7d4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.304005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9274691dc942ec9b0e39ad85bf0d42', 'request_id': 'req-6fc481ce-ea46-408b-8997-a9965d23d7d4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.310717 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:36.315884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9274691dc942ec9b0e39ad85bf0d42', 'request_id': 'req-6fc481ce-ea46-408b-8997-a9965d23d7d4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.375029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] The token cache is being invalidate because project ea9274691dc942ec9b0e39ad85bf0d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:36.376128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.380555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fc481ce-ea46-408b-8997-a9965d23d7d4 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.383726 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1920/3847] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:36 2022] DELETE /identity/v3/projects/ea9274691dc942ec9b0e39ad85bf0d42 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:36.390549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:36.392866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:36.535995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13398266-19e2-4bd4-9890-c08d9adb3c79 tempest-TrustsV3TestJSON-555020451 tempest-TrustsV3TestJSON-555020451-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:36.597876 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:36.618020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:36.619153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:36.619625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:36.620070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] PATH_INFO: `/v3/users/d78bf3c7e6fc44a48f7c3e8da86afffd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:36.622067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78bf3c7e6fc44a48f7c3e8da86afffd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:36.624277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:36.744118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78bf3c7e6fc44a48f7c3e8da86afffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.765909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78bf3c7e6fc44a48f7c3e8da86afffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.766887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78bf3c7e6fc44a48f7c3e8da86afffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.786981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78bf3c7e6fc44a48f7c3e8da86afffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.788669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78bf3c7e6fc44a48f7c3e8da86afffd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:36.817726 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1928/3848] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:36 2022] DELETE /identity/v3/users/d78bf3c7e6fc44a48f7c3e8da86afffd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:36.825999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:36.826475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:36.826921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:36.878451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:36.879761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:36.980056 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1921/3849] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:37.046797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:37.049478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:37.202315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3190-a23b-419f-96d5-f6770244f2e0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:37.216919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:37.217152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:37.217385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:37.217658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:37.238170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:37.239783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:37.261390 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1929/3850] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:39.070564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:39.072111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:39.108593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1234-5565-49b1-b9ac-b0a6b842709b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:39.119880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:39.129507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:39.129959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:39.130399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] PATH_INFO: `/v3/projects/996e15701fb9458fb34fb466ea0369ec` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:39.132500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=996e15701fb9458fb34fb466ea0369ec)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:39.137046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:39.267918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996e15701fb9458fb34fb466ea0369ec', 'request_id': 'req-0dbae188-435c-46a8-acfd-d0670e78a515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.289096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996e15701fb9458fb34fb466ea0369ec', 'request_id': 'req-0dbae188-435c-46a8-acfd-d0670e78a515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.317554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996e15701fb9458fb34fb466ea0369ec', 'request_id': 'req-0dbae188-435c-46a8-acfd-d0670e78a515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.362226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] The token cache is being invalidate because project 996e15701fb9458fb34fb466ea0369ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:39.362529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.363230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.367646 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1922/3851] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:39 2022] DELETE /identity/v3/projects/996e15701fb9458fb34fb466ea0369ec => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:39.369054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:39.386596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582401eb-e18a-4190-999d-abf3bef7b706 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:39.539907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:39.540962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:39.541348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:39.541746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] PATH_INFO: `/v3/users/aed51840bfdc4a5dbb20f23462de9644` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:39.543628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed51840bfdc4a5dbb20f23462de9644)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:39.546910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:39.578935 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:39.656073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed51840bfdc4a5dbb20f23462de9644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.681989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed51840bfdc4a5dbb20f23462de9644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.683751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed51840bfdc4a5dbb20f23462de9644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.700303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed51840bfdc4a5dbb20f23462de9644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.701810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed51840bfdc4a5dbb20f23462de9644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:39.742014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1930/3852] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:39 2022] DELETE /identity/v3/users/aed51840bfdc4a5dbb20f23462de9644 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:40.391540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:40.393736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:40.420465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbae188-435c-46a8-acfd-d0670e78a515 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:40.573666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:40.574647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:40.575120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:40.575535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] PATH_INFO: `/v3/users/0958585bb2a74c9daa0b0d55c735782c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:40.579714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0958585bb2a74c9daa0b0d55c735782c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:40.582016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:40.616244 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:40.678936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0958585bb2a74c9daa0b0d55c735782c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:40.694656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0958585bb2a74c9daa0b0d55c735782c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:40.726652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0958585bb2a74c9daa0b0d55c735782c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:40.727768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0958585bb2a74c9daa0b0d55c735782c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:40.751670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dacd1fec-33bf-421b-9a21-daca8905cba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0958585bb2a74c9daa0b0d55c735782c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:40.760645 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1923/3853] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:40 2022] DELETE /identity/v3/users/0958585bb2a74c9daa0b0d55c735782c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:41.550738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:41.553006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:41.576942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616df73-5c64-473c-868c-1fa12676ad92 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:41.727716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:41.728745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:41.729123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:41.729612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] PATH_INFO: `/v3/projects/9830900560b14834aad5e7231fbbb8c6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:41.730933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9830900560b14834aad5e7231fbbb8c6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:41.734555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:41.838486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9830900560b14834aad5e7231fbbb8c6', 'request_id': 'req-6c346738-50e8-4585-a4d0-432b6305924a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:41.851325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9830900560b14834aad5e7231fbbb8c6', 'request_id': 'req-6c346738-50e8-4585-a4d0-432b6305924a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:41.865467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9830900560b14834aad5e7231fbbb8c6', 'request_id': 'req-6c346738-50e8-4585-a4d0-432b6305924a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:41.887250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] The token cache is being invalidate because project 9830900560b14834aad5e7231fbbb8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:41.887543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:41.888227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6c346738-50e8-4585-a4d0-432b6305924a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:41.890396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1931/3854] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:41 2022] DELETE /identity/v3/projects/9830900560b14834aad5e7231fbbb8c6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:41.895027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13d9c-cecf-49ee-afdb-7693bea82eaf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:41.895496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13d9c-cecf-49ee-afdb-7693bea82eaf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:41.895914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13d9c-cecf-49ee-afdb-7693bea82eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:41.935069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-28b13d9c-cecf-49ee-afdb-7693bea82eaf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:41.937101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-28b13d9c-cecf-49ee-afdb-7693bea82eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:42.033292 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1924/3855] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:42.035405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc1d-c150-41d6-8eb4-86da54ec59d1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.035690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc1d-c150-41d6-8eb4-86da54ec59d1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.035961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc1d-c150-41d6-8eb4-86da54ec59d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.069785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b50ecc1d-c150-41d6-8eb4-86da54ec59d1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:42.071721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b50ecc1d-c150-41d6-8eb4-86da54ec59d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:42.081103 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1932/3856] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:42.085182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b13d9c-cecf-49ee-afdb-7693bea82eaf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:42.104884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b13d9c-cecf-49ee-afdb-7693bea82eaf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:42.110343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:42.111130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.112326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.112754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.113564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:42.114091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:42.115948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:42.178251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1925/3857] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:42.179499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ecc1d-c150-41d6-8eb4-86da54ec59d1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:42.198012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ecc1d-c150-41d6-8eb4-86da54ec59d1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:42.208749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:42.209396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.211151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.211422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.212106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:42.214370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:42.270064 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:42.311475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:42.311737 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1933/3858] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:42 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:42.326689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d1a7-cbe4-4ce6-aa7c-4f9fd748b995 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:42.469794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:42.470822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.471862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.472407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.473370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:42.475891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:42.521305 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1926/3859] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:42 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:42.525132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:42.544661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545173-90dc-4d56-b158-9488436774b7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:42.558856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:42.560315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.560747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.561183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.562233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:42.564522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:42.583595 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1934/3860] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:42.587838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:42.607629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463483e-4f44-4551-8637-15d808255341 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:42.617598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890dda-896c-40b0-a76d-8197d20e20ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:42.622282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890dda-896c-40b0-a76d-8197d20e20ae admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.622821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890dda-896c-40b0-a76d-8197d20e20ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.623246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890dda-896c-40b0-a76d-8197d20e20ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.624559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb890dda-896c-40b0-a76d-8197d20e20ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:42.626418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb890dda-896c-40b0-a76d-8197d20e20ae admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:42.633915 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:42.672810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1927/3861] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:19:42.765957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:42.783523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027f8f-1ee8-4360-beff-5c519a91ddfa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:42.789612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:42.790455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.790802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.791150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] PATH_INFO: `/v3/projects/30ccb279d8144dd39f613a6b57f42067/users/0c247647f8e34c638bec5e68826171e5/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.810072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ccb279d8144dd39f613a6b57f42067, user_id=0c247647f8e34c638bec5e68826171e5, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:42.813432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:42.838627 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1935/3862] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:42 2022] PUT /identity/v3/projects/30ccb279d8144dd39f613a6b57f42067/users/0c247647f8e34c638bec5e68826171e5/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:42.843974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:42.844262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:42.844520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:42.891888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:42.893132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:42.991528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:42.993354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:43.017880 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1928/3863] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:43.047017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:43.050291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:43.141415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790a22b-04f0-4c15-a283-30b1e9ba09f1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:43.152992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd26cf-6856-4917-b824-94fa1d430cb7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:43.158682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:43.159317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.159602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.160793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.177420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:43.178109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:43.182337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:43.183211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.185198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.185837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] PATH_INFO: `/v3/projects/3c5869a7fd464514ba8fb2b7ac1942ee` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.195861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5869a7fd464514ba8fb2b7ac1942ee)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:43.205134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:43.209837 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1929/3864] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:43.294972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5869a7fd464514ba8fb2b7ac1942ee', 'request_id': 'req-fb757d31-85d6-40b8-bbcd-626af9f18aac'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:43.318900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5869a7fd464514ba8fb2b7ac1942ee', 'request_id': 'req-fb757d31-85d6-40b8-bbcd-626af9f18aac'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:43.326247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:43.328302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:43.344978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5869a7fd464514ba8fb2b7ac1942ee', 'request_id': 'req-fb757d31-85d6-40b8-bbcd-626af9f18aac'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:43.394540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] The token cache is being invalidate because project 3c5869a7fd464514ba8fb2b7ac1942ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:43.394937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:43.396650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb757d31-85d6-40b8-bbcd-626af9f18aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:43.401252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1936/3865] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:42 2022] DELETE /identity/v3/projects/3c5869a7fd464514ba8fb2b7ac1942ee => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:43.405951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b945a-6648-4199-9107-9b8adc533320 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.406381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b945a-6648-4199-9107-9b8adc533320 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.406750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b945a-6648-4199-9107-9b8adc533320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.450587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-154b945a-6648-4199-9107-9b8adc533320 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:43.452560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-154b945a-6648-4199-9107-9b8adc533320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:43.514046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad96bd-0e21-471b-b380-024772d25880 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:43.535484 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:43.555365 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:43.562655 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1937/3866] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:43.565036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883cb3-daab-4343-a574-868f5e60425c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.565545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883cb3-daab-4343-a574-868f5e60425c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.565964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883cb3-daab-4343-a574-868f5e60425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.590260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-de883cb3-daab-4343-a574-868f5e60425c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:43.592752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de883cb3-daab-4343-a574-868f5e60425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:43.608402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1938/3867] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:43.608860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:43.610233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.611691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.612438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883cb3-daab-4343-a574-868f5e60425c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:43.612932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.618885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:43.625487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883cb3-daab-4343-a574-868f5e60425c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:43.640271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:43.641493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:43.641625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.641952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.642321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.643086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:43.643506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:43.643731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:43.645430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:43.660277 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1930/3868] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:19:43.664055 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1939/3869] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:43.668972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:43.684173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880229-2eda-4eef-8ce6-6bb283ddf9ad service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:43.690754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:43.692243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.693659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.693659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.694122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:43.696628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:43.744128 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1931/3870] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:43 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:43.745790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:43.773063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a583a-85a4-41cf-9002-9c459fff6054 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:43.962644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:43.963437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:43.963815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:43.964180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:43.964948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:43.968708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:44.002471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1940/3871] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:43 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:44.003870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:44.022724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f2d1-9d66-4b02-9756-a78f533a0ff2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:44.036637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:44.037392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:44.037745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:44.038475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:44.038812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:44.040885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:44.054024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1932/3872] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:44.057861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:44.075697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca091bf-8916-47c0-b302-516d721dac18 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:44.085649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14004b66-6f49-44bb-8936-4c6d3b75488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:44.086840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004b66-6f49-44bb-8936-4c6d3b75488b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:44.087376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004b66-6f49-44bb-8936-4c6d3b75488b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:44.088005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004b66-6f49-44bb-8936-4c6d3b75488b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:44.089065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14004b66-6f49-44bb-8936-4c6d3b75488b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:44.092075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14004b66-6f49-44bb-8936-4c6d3b75488b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:44.113323 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1941/3873] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:44.117852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:44.148988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa2ba0-b8ec-4ca9-bb78-2bf3d0cc9476 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:44.158194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:44.159101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:44.159490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:44.159856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] PATH_INFO: `/v3/projects/26f93778f15a446ebd90d4ca67540a35/users/30c7983f6f844490bfac9082efae791a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:44.198252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f93778f15a446ebd90d4ca67540a35, user_id=30c7983f6f844490bfac9082efae791a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:44.201828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:44.241066 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1933/3874] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:44 2022] PUT /identity/v3/projects/26f93778f15a446ebd90d4ca67540a35/users/30c7983f6f844490bfac9082efae791a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:44.243165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3af29-444e-4498-8914-5ce354cea94e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:44.243453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3af29-444e-4498-8914-5ce354cea94e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:44.243724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3af29-444e-4498-8914-5ce354cea94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:44.328481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9fd3af29-444e-4498-8914-5ce354cea94e None None] MFA Rules not processed for user `30c7983f6f844490bfac9082efae791a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:44.329939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9fd3af29-444e-4498-8914-5ce354cea94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:44.509019 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1942/3875] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:44.513398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:44.701312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa5951-8afc-49d3-9362-39283d7d80cb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:44.718753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:44.720690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:44.721206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:44.723725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:44.724688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:44.734657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:44.830494 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1934/3876] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:44 2022] POST /identity/v3/projects => generated 381 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:44.834522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3af29-444e-4498-8914-5ce354cea94e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:44.858095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3af29-444e-4498-8914-5ce354cea94e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:44.921598 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:44.987857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:44.989800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:44.990942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:44.991878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.005063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:45.007716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:45.040948 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1943/3877] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:44 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:45.044836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:45.060625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c5d-aef3-4fb1-b620-57d96a74ad07 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:45.066995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:45.067796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:45.068143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:45.068491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.069482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:45.071260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:45.095054 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1935/3878] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:19:45.096836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:45.109753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674364-1bc4-4489-bec6-67578f6b5589 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:45.118183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212edb1-6c9c-450c-a43f-2e394001c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:45.119556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212edb1-6c9c-450c-a43f-2e394001c791 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:45.119556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212edb1-6c9c-450c-a43f-2e394001c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:45.119720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212edb1-6c9c-450c-a43f-2e394001c791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.120315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212edb1-6c9c-450c-a43f-2e394001c791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:45.122040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212edb1-6c9c-450c-a43f-2e394001c791 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:45.143665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:45.144503 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1944/3879] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:45.158272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250136-df62-4444-8d60-f029f1c6467c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:45.164754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:45.165754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:45.166636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:45.166982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] PATH_INFO: `/v3/projects/301da7bd6ffb42608080a7d10260b29a/users/5962423067d3435995b2f962bb495e83/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.194441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301da7bd6ffb42608080a7d10260b29a, user_id=5962423067d3435995b2f962bb495e83, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:45.197997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:45.220366 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1936/3880] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:45 2022] PUT /identity/v3/projects/301da7bd6ffb42608080a7d10260b29a/users/5962423067d3435995b2f962bb495e83/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:45.231099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145a51-e3e6-4849-af78-424789a31d96 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:45.231424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145a51-e3e6-4849-af78-424789a31d96 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:45.231656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145a51-e3e6-4849-af78-424789a31d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.266573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-96145a51-e3e6-4849-af78-424789a31d96 None None] MFA Rules not processed for user `5962423067d3435995b2f962bb495e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:45.268226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-96145a51-e3e6-4849-af78-424789a31d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:45.455888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1945/3881] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:45.463453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:45.518092 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:45.594060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c0aa-6d32-4180-8bd9-a84b851b5947 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:45.600357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc03325-9ebd-4dc0-814f-c7228476780e tempest-IdentityV3ProjectsTest-1467396277 tempest-IdentityV3ProjectsTest-1467396277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30c7983f6f844490bfac9082efae791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26f93778f15a446ebd90d4ca67540a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:45.600792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03325-9ebd-4dc0-814f-c7228476780e tempest-IdentityV3ProjectsTest-1467396277 tempest-IdentityV3ProjectsTest-1467396277-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:45.601175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03325-9ebd-4dc0-814f-c7228476780e tempest-IdentityV3ProjectsTest-1467396277 tempest-IdentityV3ProjectsTest-1467396277-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:45.601564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03325-9ebd-4dc0-814f-c7228476780e tempest-IdentityV3ProjectsTest-1467396277 tempest-IdentityV3ProjectsTest-1467396277-project] PATH_INFO: `/v3/users/30c7983f6f844490bfac9082efae791a/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.604104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc03325-9ebd-4dc0-814f-c7228476780e tempest-IdentityV3ProjectsTest-1467396277 tempest-IdentityV3ProjectsTest-1467396277-project] RBAC: Authorizing `identity:list_user_projects(user_id=30c7983f6f844490bfac9082efae791a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:45.606261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc03325-9ebd-4dc0-814f-c7228476780e tempest-IdentityV3ProjectsTest-1467396277 tempest-IdentityV3ProjectsTest-1467396277-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:45.687021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1937/3882] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:19:45 2022] GET /identity/v3/users/30c7983f6f844490bfac9082efae791a/projects => generated 517 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:45.687646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ede50-86cd-4a69-9b64-04d1c46327e9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:45.689810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ede50-86cd-4a69-9b64-04d1c46327e9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:45.691120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ede50-86cd-4a69-9b64-04d1c46327e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.800160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bb7ede50-86cd-4a69-9b64-04d1c46327e9 None None] MFA Rules not processed for user `30c7983f6f844490bfac9082efae791a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:45.803717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb7ede50-86cd-4a69-9b64-04d1c46327e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:45.838144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266fff-7d1c-41c1-8c90-25e42d3bdfe0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:45.838665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266fff-7d1c-41c1-8c90-25e42d3bdfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:45.839033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266fff-7d1c-41c1-8c90-25e42d3bdfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:45.841126 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1946/3883] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:45.883583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7a266fff-7d1c-41c1-8c90-25e42d3bdfe0 None None] MFA Rules not processed for user `30c7983f6f844490bfac9082efae791a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:45.884988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7a266fff-7d1c-41c1-8c90-25e42d3bdfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:46.003272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.models.token_model [None req-7a266fff-7d1c-41c1-8c90-25e42d3bdfe0 None None] User 30c7983f6f844490bfac9082efae791a has no access to project 301da7bd6ffb42608080a7d10260b29a {{(pid=81885) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 21 01:19:46.008394 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.server.flask.application [None req-7a266fff-7d1c-41c1-8c90-25e42d3bdfe0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.46: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 21 01:19:46.015913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ede50-86cd-4a69-9b64-04d1c46327e9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:46.018884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1938/3884] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 181 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 21 01:19:46.234761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ede50-86cd-4a69-9b64-04d1c46327e9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:46.245994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:46.247837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:46.248127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:46.262489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] PATH_INFO: `/v3/users/30c7983f6f844490bfac9082efae791a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:46.268726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c7983f6f844490bfac9082efae791a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:46.275205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:46.360714 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:46.404245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c7983f6f844490bfac9082efae791a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:46.436045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c7983f6f844490bfac9082efae791a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:46.438322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c7983f6f844490bfac9082efae791a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:46.460617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c7983f6f844490bfac9082efae791a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:46.468000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c7983f6f844490bfac9082efae791a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:46.528505 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1947/3885] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:46 2022] DELETE /identity/v3/users/30c7983f6f844490bfac9082efae791a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:46.533234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471fc97-12a4-48f3-9ec1-74e14d539c6e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:46.533751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471fc97-12a4-48f3-9ec1-74e14d539c6e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:46.533751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471fc97-12a4-48f3-9ec1-74e14d539c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:46.558504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9471fc97-12a4-48f3-9ec1-74e14d539c6e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:46.559786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9471fc97-12a4-48f3-9ec1-74e14d539c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:46.728508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1939/3886] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:46.753745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:46.755398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:46.839502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3662a-25f1-4db4-ac38-fb9513310f37 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:46.839810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3662a-25f1-4db4-ac38-fb9513310f37 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:46.840150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3662a-25f1-4db4-ac38-fb9513310f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:46.904320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c4b3662a-25f1-4db4-ac38-fb9513310f37 None None] MFA Rules not processed for user `0c247647f8e34c638bec5e68826171e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:46.905625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c4b3662a-25f1-4db4-ac38-fb9513310f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:46.916896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacd8e4-7b22-446f-bc79-638e6d4a4d4c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:46.931216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:46.933107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:46.934356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:46.934884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:46.965267 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:46.974891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:46.979625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:47.025942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1948/3887] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:47.029408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:47.033965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:47.035114 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1940/3888] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:47.044992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ad8e-b3b6-4c90-b91d-ef90fbcdfd13 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:47.045394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ad8e-b3b6-4c90-b91d-ef90fbcdfd13 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:47.045583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ad8e-b3b6-4c90-b91d-ef90fbcdfd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:47.085153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f053ad8e-b3b6-4c90-b91d-ef90fbcdfd13 None None] MFA Rules not processed for user `0c247647f8e34c638bec5e68826171e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:47.086532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f053ad8e-b3b6-4c90-b91d-ef90fbcdfd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:47.116172 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1941/3889] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:47.117774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7758-09fc-4319-870f-5207fda50769 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:47.118179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7758-09fc-4319-870f-5207fda50769 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:47.118533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7758-09fc-4319-870f-5207fda50769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:47.152885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-524f7758-09fc-4319-870f-5207fda50769 None None] MFA Rules not processed for user `0c247647f8e34c638bec5e68826171e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:47.155258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-524f7758-09fc-4319-870f-5207fda50769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:47.176134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1942/3890] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:47.221699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f7758-09fc-4319-870f-5207fda50769 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:47.221699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-524f7758-09fc-4319-870f-5207fda50769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:47.256574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64978e5-bb60-49a2-833d-be7ca1c046c7 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:47.264481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f7758-09fc-4319-870f-5207fda50769 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:47.269579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:47.271981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:47.272992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:47.273701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:47.280086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:47.282076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:47.282788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:47.283067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:47.283341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] PATH_INFO: `/v3/users/e228e38ee832453f8fc35feb25d65a15` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:47.292226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e228e38ee832453f8fc35feb25d65a15)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:47.301896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:47.348078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:47.353586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:47.401437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e228e38ee832453f8fc35feb25d65a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:47.411197 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1949/3891] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:47.423766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e228e38ee832453f8fc35feb25d65a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:47.454140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e228e38ee832453f8fc35feb25d65a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:47.454961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e228e38ee832453f8fc35feb25d65a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:47.473711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e228e38ee832453f8fc35feb25d65a15'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:47.481983 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1943/3892] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:47 2022] DELETE /identity/v3/users/e228e38ee832453f8fc35feb25d65a15 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:47.546829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:47.548439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:47.639223 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:47.697294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8a17e-7a8d-4cae-9002-24bcdfb094da service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:47.887099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde37893-5145-439c-9166-09c84818d67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:47.889690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde37893-5145-439c-9166-09c84818d67f service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:47.890877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde37893-5145-439c-9166-09c84818d67f service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:47.891318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde37893-5145-439c-9166-09c84818d67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:47.896678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fde37893-5145-439c-9166-09c84818d67f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:48.079323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde37893-5145-439c-9166-09c84818d67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:48.081238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde37893-5145-439c-9166-09c84818d67f service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:48.096972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1950/3893] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:48.108213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:48.109844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:48.325530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0b76-fe98-496b-87bb-9237983cd26d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:48.332695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:48.333607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:48.336666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:48.337422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] PATH_INFO: `/v3/projects/c1a2f3b0bed743dabb7579f7dd78135f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:48.339246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a2f3b0bed743dabb7579f7dd78135f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:48.341256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:48.400811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde37893-5145-439c-9166-09c84818d67f service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:48.403756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fde37893-5145-439c-9166-09c84818d67f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:48.436655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde37893-5145-439c-9166-09c84818d67f service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:48.447344 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:48.449414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:48.450760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:48.451176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:48.451733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] PATH_INFO: `/v3/projects/26f93778f15a446ebd90d4ca67540a35` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:48.454849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f93778f15a446ebd90d4ca67540a35)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:48.458349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:48.493581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a2f3b0bed743dabb7579f7dd78135f', 'request_id': 'req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.529394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a2f3b0bed743dabb7579f7dd78135f', 'request_id': 'req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.552950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a2f3b0bed743dabb7579f7dd78135f', 'request_id': 'req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.579623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] The token cache is being invalidate because project c1a2f3b0bed743dabb7579f7dd78135f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:48.579915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.580906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6dcd481b-dcf3-461e-9275-a1c71bc08dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.587389 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1944/3894] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:48 2022] DELETE /identity/v3/projects/c1a2f3b0bed743dabb7579f7dd78135f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:48.587579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f93778f15a446ebd90d4ca67540a35', 'request_id': 'req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.589462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd401-8382-452b-b98a-53cea5dfb597 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:48.589740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd401-8382-452b-b98a-53cea5dfb597 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:48.590013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd401-8382-452b-b98a-53cea5dfb597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:48.605311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f93778f15a446ebd90d4ca67540a35', 'request_id': 'req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.622959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f93778f15a446ebd90d4ca67540a35', 'request_id': 'req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.641452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-deadd401-8382-452b-b98a-53cea5dfb597 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:48.641673 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:48.642705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-deadd401-8382-452b-b98a-53cea5dfb597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:48.655823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] The token cache is being invalidate because project 26f93778f15a446ebd90d4ca67540a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:48.655823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.655823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.660511 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1951/3895] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:48 2022] DELETE /identity/v3/projects/26f93778f15a446ebd90d4ca67540a35 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:48.662664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:48.665610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:48.804149 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1945/3896] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:48.805690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ef40-8d6f-4ed4-8327-7e058435d715 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:48.805988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ef40-8d6f-4ed4-8327-7e058435d715 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:48.806248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ef40-8d6f-4ed4-8327-7e058435d715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:48.832701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894157b0-55d0-4d9c-9ccb-40bd96b1e14a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:48.848841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:48.850142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:48.850611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:48.851272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2234ef40-8d6f-4ed4-8327-7e058435d715 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:48.851500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] PATH_INFO: `/v3/users/5962423067d3435995b2f962bb495e83` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:48.852531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2234ef40-8d6f-4ed4-8327-7e058435d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:48.853285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5962423067d3435995b2f962bb495e83)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:48.855570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:48.875737 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1946/3897] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:48.876742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ef40-8d6f-4ed4-8327-7e058435d715 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:48.902842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ef40-8d6f-4ed4-8327-7e058435d715 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:48.914329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:48.916487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:48.916873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:48.918780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:48.919688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:48.921334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:48.937607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:48.984137 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1947/3898] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:48.985001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5962423067d3435995b2f962bb495e83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:48.985851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:49.007996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b542-f8d9-4340-976a-fa58a7646124 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:49.008164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5962423067d3435995b2f962bb495e83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:49.010537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5962423067d3435995b2f962bb495e83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:49.017046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:49.018575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.019572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.020049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.021468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5962423067d3435995b2f962bb495e83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:49.021602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:49.022297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5962423067d3435995b2f962bb495e83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:49.025779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:49.064752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1952/3899] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:48 2022] DELETE /identity/v3/users/5962423067d3435995b2f962bb495e83 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:49.077520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:49.079244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:49.085250 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1948/3900] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:48 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:49.160126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6402-e5a8-41f3-ae8b-7a241a51aaf1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:49.190250 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:49.239968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:49.240633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.240955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.241228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.242046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:49.244051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:49.275688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:49.277937 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1953/3901] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:49 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:49.288605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3ed7-edeb-4584-a7bf-7fab040a6ee8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:49.298186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:49.298604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.298830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.299079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.300249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:49.302046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:49.345343 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1949/3902] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:19:49.348157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:49.358844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984006f2-3503-4fe9-86b4-b5e84f6a21c1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:49.366132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999cc87-be88-4ffa-a57e-98f02e4796e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:49.366991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999cc87-be88-4ffa-a57e-98f02e4796e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.367342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999cc87-be88-4ffa-a57e-98f02e4796e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.367712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999cc87-be88-4ffa-a57e-98f02e4796e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.369009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999cc87-be88-4ffa-a57e-98f02e4796e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:49.370905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999cc87-be88-4ffa-a57e-98f02e4796e1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:49.388293 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1954/3903] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:49.389884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:49.401424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe4be-998c-4d5b-ba08-65eca74ed99e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:49.413056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619debd6-61ee-4934-9bf4-60fe299c73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:49.413768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619debd6-61ee-4934-9bf4-60fe299c73cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.414047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619debd6-61ee-4934-9bf4-60fe299c73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.414319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619debd6-61ee-4934-9bf4-60fe299c73cf admin admin] PATH_INFO: `/v3/projects/f535e3a028764f5cb0ee9b5ef7b4c9ae/users/d7ac40aef2424a0b966d43d19b28cb88/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.466368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619debd6-61ee-4934-9bf4-60fe299c73cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f535e3a028764f5cb0ee9b5ef7b4c9ae, user_id=d7ac40aef2424a0b966d43d19b28cb88, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:49.469844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619debd6-61ee-4934-9bf4-60fe299c73cf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:49.497925 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1950/3904] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:49 2022] PUT /identity/v3/projects/f535e3a028764f5cb0ee9b5ef7b4c9ae/users/d7ac40aef2424a0b966d43d19b28cb88/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:49.510250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2476893-1e6f-4d04-a3d3-d44012b39272 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.510250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2476893-1e6f-4d04-a3d3-d44012b39272 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.510586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2476893-1e6f-4d04-a3d3-d44012b39272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.593443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b2476893-1e6f-4d04-a3d3-d44012b39272 None None] MFA Rules not processed for user `d7ac40aef2424a0b966d43d19b28cb88`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:49.598317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b2476893-1e6f-4d04-a3d3-d44012b39272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:49.728306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.729301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.729715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.734212 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1955/3905] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:49.803318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] MFA Rules not processed for user `0c247647f8e34c638bec5e68826171e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:49.804605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:49.954014 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:49.955095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d267-9bdb-4cf5-8843-4d53addf622e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:49.955095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d267-9bdb-4cf5-8843-4d53addf622e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:49.955377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d267-9bdb-4cf5-8843-4d53addf622e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:49.993933 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1951/3906] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:49.994159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6611d267-9bdb-4cf5-8843-4d53addf622e None None] MFA Rules not processed for user `01c0d38c6d9440e88565277af4433660`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:49.995040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6611d267-9bdb-4cf5-8843-4d53addf622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:50.197799 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1956/3907] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:50.262343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:50.263885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:50.524249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf11d4a-3ed2-4ec3-8e43-99a62c43573c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:50.546060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:50.548935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:50.549264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:50.549628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:50.563443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:50.570540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:50.584960 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1952/3908] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:50.641745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d267-9bdb-4cf5-8843-4d53addf622e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:50.687299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:50.689989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:50.819230 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:50.863940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d267-9bdb-4cf5-8843-4d53addf622e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:50.888691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:50.889403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:50.890042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:50.890415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] PATH_INFO: `/v3/users/d7ac40aef2424a0b966d43d19b28cb88` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:50.905744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ac40aef2424a0b966d43d19b28cb88)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:50.907734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:50.948706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a529-5e0c-4ae1-9e70-32f75290efc5 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:50.963418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:50.964489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:50.965007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:50.965308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] PATH_INFO: `/v3/projects/301da7bd6ffb42608080a7d10260b29a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:50.970643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301da7bd6ffb42608080a7d10260b29a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:50.973147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:51.015076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ac40aef2424a0b966d43d19b28cb88'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.027263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ac40aef2424a0b966d43d19b28cb88'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.028201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ac40aef2424a0b966d43d19b28cb88'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.041046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ac40aef2424a0b966d43d19b28cb88'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.048984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37cf6618-6a53-4490-9b18-103c948dcb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ac40aef2424a0b966d43d19b28cb88'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.085622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301da7bd6ffb42608080a7d10260b29a', 'request_id': 'req-aaa2207a-6431-4758-baba-956bd7ce4e69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.086933 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1957/3909] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:50 2022] DELETE /identity/v3/users/d7ac40aef2424a0b966d43d19b28cb88 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:51.091306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.091815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.092254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.098010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301da7bd6ffb42608080a7d10260b29a', 'request_id': 'req-aaa2207a-6431-4758-baba-956bd7ce4e69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.122134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301da7bd6ffb42608080a7d10260b29a', 'request_id': 'req-aaa2207a-6431-4758-baba-956bd7ce4e69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.145969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] The token cache is being invalidate because project 301da7bd6ffb42608080a7d10260b29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:51.146336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.147804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aaa2207a-6431-4758-baba-956bd7ce4e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:51.148307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:51.153172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:51.153554 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1953/3910] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:50 2022] DELETE /identity/v3/projects/301da7bd6ffb42608080a7d10260b29a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:51.155355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67ba3-0f02-46ce-8e09-6596baed1e26 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.157894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67ba3-0f02-46ce-8e09-6596baed1e26 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.158281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67ba3-0f02-46ce-8e09-6596baed1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.179972 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:51.208281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-00c67ba3-0f02-46ce-8e09-6596baed1e26 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:51.209745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00c67ba3-0f02-46ce-8e09-6596baed1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:51.308864 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1958/3911] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:51.329307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:51.332284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:51.353705 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1954/3912] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:51.355125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f187-712b-4cb4-85a4-f701d0c5ec82 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.355411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f187-712b-4cb4-85a4-f701d0c5ec82 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.355685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f187-712b-4cb4-85a4-f701d0c5ec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.380954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-27c0f187-712b-4cb4-85a4-f701d0c5ec82 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:51.382222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27c0f187-712b-4cb4-85a4-f701d0c5ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:51.395147 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1955/3913] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:51.396137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f187-712b-4cb4-85a4-f701d0c5ec82 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:51.408118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f187-712b-4cb4-85a4-f701d0c5ec82 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:51.414687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:51.415366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.415681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.416307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.417196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:51.417503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:51.419116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:51.434717 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1956/3914] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:51.437893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e25bf7-600f-4b8e-b5e4-128836f62f5a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:51.439711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:51.442631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09161fe-f9bb-4bc8-a1de-96f816f96eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:51.443497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09161fe-f9bb-4bc8-a1de-96f816f96eee service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.443779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09161fe-f9bb-4bc8-a1de-96f816f96eee service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.444050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09161fe-f9bb-4bc8-a1de-96f816f96eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.458729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e443906-2244-47ce-9092-86eaecedcd3e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:51.463991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09161fe-f9bb-4bc8-a1de-96f816f96eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:51.465449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09161fe-f9bb-4bc8-a1de-96f816f96eee service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:51.485055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:51.485729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.486730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.487147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.487861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:51.490027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:51.492816 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1959/3915] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:19:51.534076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88cf2-8de4-4b7f-8e38-91aaeae09952 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.534371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88cf2-8de4-4b7f-8e38-91aaeae09952 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.534691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88cf2-8de4-4b7f-8e38-91aaeae09952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.545279 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:51.603781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-93f88cf2-8de4-4b7f-8e38-91aaeae09952 None None] MFA Rules not processed for user `0c247647f8e34c638bec5e68826171e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:51.609177 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1957/3916] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:51 2022] POST /identity/v3/projects => generated 359 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:51.610178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:51.611651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93f88cf2-8de4-4b7f-8e38-91aaeae09952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:51.731845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1960/3917] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:51.770438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70d62-efed-4844-a39f-9bf68afacb51 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:51.785170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:51.785834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.786165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.786437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.788959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:51.792797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:51.843000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88cf2-8de4-4b7f-8e38-91aaeae09952 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:51.843202 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1958/3918] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:51 2022] POST /identity/v3/users => generated 280 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:51.862642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88cf2-8de4-4b7f-8e38-91aaeae09952 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:51.878536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:51.880243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:51.881881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:51.882660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:51.884312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:51.906514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:51.965535 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1961/3919] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:19:51.967384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:51.985309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62abe-329f-44ba-8563-e9086478830d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:52.005505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6924829-4ac2-4c71-b899-772c85d39334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:52.013428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924829-4ac2-4c71-b899-772c85d39334 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.015690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924829-4ac2-4c71-b899-772c85d39334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.016231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924829-4ac2-4c71-b899-772c85d39334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.018002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6924829-4ac2-4c71-b899-772c85d39334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:52.021855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6924829-4ac2-4c71-b899-772c85d39334 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:52.075482 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1959/3920] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:52.080836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:52.096819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac21ba-24e6-44d8-a837-901b7b701f88 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:52.107756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:52.110139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.111245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.111694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] PATH_INFO: `/v3/projects/e2764a4bf5d34c8a8c664d7e48d4a453/users/b181698b14904e4cb7ba5257e37de7a9/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.146836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2764a4bf5d34c8a8c664d7e48d4a453, user_id=b181698b14904e4cb7ba5257e37de7a9, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:52.151935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:52.181603 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1962/3921] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:52 2022] PUT /identity/v3/projects/e2764a4bf5d34c8a8c664d7e48d4a453/users/b181698b14904e4cb7ba5257e37de7a9/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:52.197058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2466-0a9c-4345-9817-d1f7f26d1ed9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.197373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2466-0a9c-4345-9817-d1f7f26d1ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.197807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2466-0a9c-4345-9817-d1f7f26d1ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.276965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a6ef2466-0a9c-4345-9817-d1f7f26d1ed9 None None] MFA Rules not processed for user `b181698b14904e4cb7ba5257e37de7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:52.279081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6ef2466-0a9c-4345-9817-d1f7f26d1ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:52.374358 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:52.430039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:52.432253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:52.510643 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1960/3922] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:52.512057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777bbfb-cd52-4084-9120-efeb927b152e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.513020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777bbfb-cd52-4084-9120-efeb927b152e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.515109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777bbfb-cd52-4084-9120-efeb927b152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.560070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4777bbfb-cd52-4084-9120-efeb927b152e None None] MFA Rules not processed for user `b181698b14904e4cb7ba5257e37de7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:52.565827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4777bbfb-cd52-4084-9120-efeb927b152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:52.578271 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1961/3923] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:52 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:19:52.584216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1ad6-9122-4cd3-815e-85c46871fcfb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.585367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1ad6-9122-4cd3-815e-85c46871fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.585710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1ad6-9122-4cd3-815e-85c46871fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.654327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eb7c1ad6-9122-4cd3-815e-85c46871fcfb None None] MFA Rules not processed for user `b181698b14904e4cb7ba5257e37de7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:52.655499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb7c1ad6-9122-4cd3-815e-85c46871fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:52.662553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48204399-64d3-4073-90a9-2ed5bc29f206 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:52.664884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1962/3924] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:52 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 01:19:52.669347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c1ad6-9122-4cd3-815e-85c46871fcfb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:52.674405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:52.675292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.675716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.676101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] PATH_INFO: `/v3/projects/f535e3a028764f5cb0ee9b5ef7b4c9ae` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.679013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f535e3a028764f5cb0ee9b5ef7b4c9ae)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:52.681871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:52.698036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c1ad6-9122-4cd3-815e-85c46871fcfb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:52.709752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b181698b14904e4cb7ba5257e37de7a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:52.710578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.710862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.711231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.727947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorizing `identity:check_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:52.731370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:52.752261 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1963/3925] 10.222.0.46 () {56 vars in 1264 bytes} [Sun Aug 21 01:19:52 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 21 01:19:52.757584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:52.775756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f535e3a028764f5cb0ee9b5ef7b4c9ae', 'request_id': 'req-7677c5d3-47c8-483b-b174-b7a906ddba96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:52.788950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f535e3a028764f5cb0ee9b5ef7b4c9ae', 'request_id': 'req-7677c5d3-47c8-483b-b174-b7a906ddba96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:52.795500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f522c-4e5d-4e08-a04c-caf2eb6909b5 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:52.811209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f535e3a028764f5cb0ee9b5ef7b4c9ae', 'request_id': 'req-7677c5d3-47c8-483b-b174-b7a906ddba96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:52.831061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] The token cache is being invalidate because project f535e3a028764f5cb0ee9b5ef7b4c9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:52.831480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:52.833196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7677c5d3-47c8-483b-b174-b7a906ddba96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:52.835989 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1963/3926] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:52 2022] DELETE /identity/v3/projects/f535e3a028764f5cb0ee9b5ef7b4c9ae => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:52.841793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6233-23ea-4a12-9685-fcfafdc6f18f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.842079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6233-23ea-4a12-9685-fcfafdc6f18f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.842477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6233-23ea-4a12-9685-fcfafdc6f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:52.855669 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:52.899635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e60a6233-23ea-4a12-9685-fcfafdc6f18f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:52.901053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e60a6233-23ea-4a12-9685-fcfafdc6f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:52.992694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b181698b14904e4cb7ba5257e37de7a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:52.994260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:52.994543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:52.994821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.000247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.011762 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1964/3927] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:53.022878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0986-eb50-4881-891d-8c0134cb1a2b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.023177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0986-eb50-4881-891d-8c0134cb1a2b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.023461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0986-eb50-4881-891d-8c0134cb1a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.029198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.033683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.051194 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1964/3928] 10.222.0.46 () {56 vars in 1263 bytes} [Sun Aug 21 01:19:52 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:53.054117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3f1a0986-eb50-4881-891d-8c0134cb1a2b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:53.054980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.056015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3f1a0986-eb50-4881-891d-8c0134cb1a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.056419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.076404 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1965/3929] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:53.078598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a0986-eb50-4881-891d-8c0134cb1a2b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.079259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934884b4-6187-420a-b78b-7fb489e8bae0 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.085182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b181698b14904e4cb7ba5257e37de7a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.085919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.086198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.086474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.092843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a0986-eb50-4881-891d-8c0134cb1a2b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.095303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.097078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.103828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.104471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.104747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.105055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.106647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:53.106968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.110511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.117973 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1965/3930] 10.222.0.46 () {56 vars in 1266 bytes} [Sun Aug 21 01:19:53 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:53.122983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.134453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b48d-c6ef-4664-8174-cfe369074776 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.139871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226c0e7-4a8d-4410-a2e7-a4afc7578bec tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b181698b14904e4cb7ba5257e37de7a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.140947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c0e7-4a8d-4410-a2e7-a4afc7578bec tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.141429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c0e7-4a8d-4410-a2e7-a4afc7578bec tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.142066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c0e7-4a8d-4410-a2e7-a4afc7578bec tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.144289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c226c0e7-4a8d-4410-a2e7-a4afc7578bec tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.158087 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1966/3931] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:53.166935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-c226c0e7-4a8d-4410-a2e7-a4afc7578bec tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 21 01:19:53.175974 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 21 01:19:53.177449 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 21 01:19:53.179155 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.179155 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.179155 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 21 01:19:53.179155 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 21 01:19:53.179155 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 21 01:19:53.179155 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:19:53.181993 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1966/3932] 10.222.0.46 () {56 vars in 1264 bytes} [Sun Aug 21 01:19:53 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 21 01:19:53.186439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e27ac-41ab-4db4-a26f-170f3f7f90a1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.187443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c4d8-21d9-4db5-81bb-f9363e07f3e3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.187988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c4d8-21d9-4db5-81bb-f9363e07f3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.188433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c4d8-21d9-4db5-81bb-f9363e07f3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.200522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.201196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.201477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.201753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.204805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.208936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.246134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-74a1c4d8-21d9-4db5-81bb-f9363e07f3e3 None None] MFA Rules not processed for user `b181698b14904e4cb7ba5257e37de7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:53.250659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-74a1c4d8-21d9-4db5-81bb-f9363e07f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.259012 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1967/3933] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:53 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 01:19:53.259438 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1967/3934] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:53 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:53.260202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1c4d8-21d9-4db5-81bb-f9363e07f3e3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.263405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.450887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f6b24-e006-4bd6-91e6-5c846c372f7c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.457807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b181698b14904e4cb7ba5257e37de7a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.458782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.459744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.459744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.472339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.475602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.487228 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1968/3935] 10.222.0.46 () {56 vars in 1263 bytes} [Sun Aug 21 01:19:53 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:53.491527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.511983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1c4d8-21d9-4db5-81bb-f9363e07f3e3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.520263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d5304-311d-4bd3-b669-b49f8ab76494 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.528535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.531161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b181698b14904e4cb7ba5257e37de7a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.531723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.532127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.532460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.532660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.533157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.533530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.535814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.540573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.544378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.546724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.569550 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:53.578796 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1969/3936] 10.222.0.46 () {56 vars in 1266 bytes} [Sun Aug 21 01:19:53 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:53.584295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.592210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1968/3937] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:53 2022] POST /identity/v3/users => generated 299 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:53.594375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.614318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef3bcb-158d-4231-8cc4-a1e9fe63ecf7 tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.618002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde9bae-99c7-430c-b0a1-a077d89ceacf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.622108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b181698b14904e4cb7ba5257e37de7a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.623589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.624349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.624716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.626952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.631384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.632559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.632880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.633162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.633898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.635796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.654768 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1969/3938] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:53.656228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.680618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c818f-a517-40f6-8eb6-803166c0684e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 21 01:19:53.681156 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 21 01:19:53.682527 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 21 01:19:53.683738 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:19:53.683738 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:19:53.683738 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 21 01:19:53.683738 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 21 01:19:53.683738 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 21 01:19:53.683738 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:19:53.691283 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1970/3939] 10.222.0.46 () {56 vars in 1263 bytes} [Sun Aug 21 01:19:53 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 01:19:53.696545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.698244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.698419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.699187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.699763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.700228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.701105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.703244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.729949 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1970/3940] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:53.734367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:53.735510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f71eb-71f9-4e9d-b9e9-08abc1a3e76c tempest-TokensV3Test-361627890 tempest-TokensV3Test-361627890-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.745630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.747467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.748181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d848-0dcb-4e08-b9c9-67c687cfb1e8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:53.748563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.749869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] PATH_INFO: `/v3/users/b181698b14904e4cb7ba5257e37de7a9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.752589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b181698b14904e4cb7ba5257e37de7a9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.755931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ed498-060b-455e-b40b-043ac0178f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:53.756977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed498-060b-455e-b40b-043ac0178f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.757412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed498-060b-455e-b40b-043ac0178f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.757839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed498-060b-455e-b40b-043ac0178f6f admin admin] PATH_INFO: `/v3/projects/9770e31bc3be400aab624a2fdbead32c/users/5f4ac45d762a419ab95c6880dccc4335/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.760142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.777606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ed498-060b-455e-b40b-043ac0178f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9770e31bc3be400aab624a2fdbead32c, user_id=5f4ac45d762a419ab95c6880dccc4335, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:53.780921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ed498-060b-455e-b40b-043ac0178f6f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:53.800947 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1971/3941] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:53 2022] PUT /identity/v3/projects/9770e31bc3be400aab624a2fdbead32c/users/5f4ac45d762a419ab95c6880dccc4335/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:53.813603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.814900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.816993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.830723 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:53.871496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] MFA Rules not processed for user `5f4ac45d762a419ab95c6880dccc4335`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:53.874814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:53.875406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b181698b14904e4cb7ba5257e37de7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:53.885889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b181698b14904e4cb7ba5257e37de7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:53.886679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b181698b14904e4cb7ba5257e37de7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:53.896134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b181698b14904e4cb7ba5257e37de7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:53.897825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-22d2da20-edb4-4446-99ab-7731735dd985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b181698b14904e4cb7ba5257e37de7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:53.919866 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1971/3942] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:53 2022] DELETE /identity/v3/users/b181698b14904e4cb7ba5257e37de7a9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:53.924536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:53.924953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:53.925293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:53.953053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:53.954361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:54.043150 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1972/3943] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:54.091893 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1972/3944] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:54.104174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:54.106213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:54.231932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151fa60-2c44-4057-833c-8990743501f7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:54.388287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b624-1588-4cac-882f-d4ae78102f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:54.388979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b624-1588-4cac-882f-d4ae78102f13 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:54.389504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b624-1588-4cac-882f-d4ae78102f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:54.390131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b624-1588-4cac-882f-d4ae78102f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:54.414001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b624-1588-4cac-882f-d4ae78102f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:54.415476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b624-1588-4cac-882f-d4ae78102f13 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:54.432906 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:54.459104 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1973/3945] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:54.748414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:54.750748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:54.922496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf006f3d-f8ce-4507-981a-9dd83df31435 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:54.929533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:54.930451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:54.930808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:54.931148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:54.992736 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:55.017741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:55.020207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:55.035234 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1973/3946] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:19:55.125116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:55.126550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:55.127297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:55.169961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] MFA Rules not processed for user `5f4ac45d762a419ab95c6880dccc4335`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:55.172367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:55.184742 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1974/3947] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:56.008326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:56.010848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:56.044501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656e388-df76-48d3-b8c8-b2178fe2eef1 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:56.056029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:56.057103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:56.058938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:56.060469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] PATH_INFO: `/v3/projects/e2764a4bf5d34c8a8c664d7e48d4a453` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:56.063740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2764a4bf5d34c8a8c664d7e48d4a453)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:56.066307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:56.201004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'request_id': 'req-04cceb35-851d-4fb6-90b8-ccefccc4aae7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.225016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'request_id': 'req-04cceb35-851d-4fb6-90b8-ccefccc4aae7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.249827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:56.252053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:56.268270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2764a4bf5d34c8a8c664d7e48d4a453', 'request_id': 'req-04cceb35-851d-4fb6-90b8-ccefccc4aae7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.283098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbe4fa-bd22-4661-b759-b9b890b4ced5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:56.302011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] The token cache is being invalidate because project e2764a4bf5d34c8a8c664d7e48d4a453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:56.306879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.308455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04cceb35-851d-4fb6-90b8-ccefccc4aae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.321073 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1974/3948] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:56 2022] DELETE /identity/v3/projects/e2764a4bf5d34c8a8c664d7e48d4a453 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:56.322885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2dbb3-9a2c-4d09-afed-7ec1608dc83e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:56.325627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2dbb3-9a2c-4d09-afed-7ec1608dc83e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:56.326135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2dbb3-9a2c-4d09-afed-7ec1608dc83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:56.393586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3ec2dbb3-9a2c-4d09-afed-7ec1608dc83e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:56.400655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3ec2dbb3-9a2c-4d09-afed-7ec1608dc83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:56.472255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:56.473076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:56.473421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:56.473755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] PATH_INFO: `/v3/users/5f4ac45d762a419ab95c6880dccc4335` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:56.477030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4ac45d762a419ab95c6880dccc4335)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:56.479038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:56.567629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1975/3949] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:56.569978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da9b3-382e-4235-a6c8-c5ef0641c6ea None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:56.570331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da9b3-382e-4235-a6c8-c5ef0641c6ea None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:56.570616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da9b3-382e-4235-a6c8-c5ef0641c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:56.614473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2b2da9b3-382e-4235-a6c8-c5ef0641c6ea None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:56.618044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2b2da9b3-382e-4235-a6c8-c5ef0641c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:56.618725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4ac45d762a419ab95c6880dccc4335'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.634131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4ac45d762a419ab95c6880dccc4335'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.651841 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1976/3950] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:56.658886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da9b3-382e-4235-a6c8-c5ef0641c6ea None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:56.661341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4ac45d762a419ab95c6880dccc4335'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.662347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4ac45d762a419ab95c6880dccc4335'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.689968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da9b3-382e-4235-a6c8-c5ef0641c6ea None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:56.691405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88515498-3270-42ad-9652-b5d51277f2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4ac45d762a419ab95c6880dccc4335'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:56.704921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:56.708197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:56.710159 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1975/3951] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:56 2022] DELETE /identity/v3/users/5f4ac45d762a419ab95c6880dccc4335 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:56.713404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:56.713769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:56.715126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:56.715619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:56.715763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:56.716240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:56.717789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:56.721541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:56.760521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:56.761449 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1977/3952] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:56.762431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:56.762681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:56.770595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:56.807821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98818b-a409-47d2-ab39-af8ca7ae2abe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:56.876975 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1976/3953] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:56.888429 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:56.936575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:56.937885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:56.938258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:56.938627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:56.939733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:56.963109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:56.990822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:56.992414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:57.021245 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:57.046917 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1978/3954] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:56 2022] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:57.051676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:57.159433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d5bd0-8ab8-409f-ad5f-c7f71531c9c2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:57.248662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965f9bf-4e0d-4c60-92b5-2f405af6718e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:57.271689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:57.272787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.273228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.273656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.274446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:57.276581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:57.301666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:57.302752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.303030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.303521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.340646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:57.343479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:57.355464 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1979/3955] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:57 2022] POST /identity/v3/users => generated 299 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:57.356412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:57.373273 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1977/3956] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:57.379622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9d653-d1f0-4ae1-a19d-cc47d31786f7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:57.395776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:57.396420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.396704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.397007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.397671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:57.399801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:57.429353 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1980/3957] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:57.429682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:57.441861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45594432-bb27-4a9f-8cb2-1d4d2bfd869e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:57.458605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:57.459372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.459813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.460086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] PATH_INFO: `/v3/projects/fe6f8b45627444018086bcc69d9a54c6/users/143c9d04a1fc424591bbab1cf15aec61/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.497108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6f8b45627444018086bcc69d9a54c6, user_id=143c9d04a1fc424591bbab1cf15aec61, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:57.500381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:57.524311 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1978/3958] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:57 2022] PUT /identity/v3/projects/fe6f8b45627444018086bcc69d9a54c6/users/143c9d04a1fc424591bbab1cf15aec61/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:19:57.528815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:57.539869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cfa3c-4559-4958-ab57-c16ffcf86173 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:57.609480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2452d08-5493-4eb4-80f4-6541a62cc76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:57.610506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2452d08-5493-4eb4-80f4-6541a62cc76c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.610935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2452d08-5493-4eb4-80f4-6541a62cc76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.611204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2452d08-5493-4eb4-80f4-6541a62cc76c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.611991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2452d08-5493-4eb4-80f4-6541a62cc76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:57.613922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2452d08-5493-4eb4-80f4-6541a62cc76c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:57.628873 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1981/3959] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:57.630063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:57.642938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bf0f8-5367-48c5-8d56-8191142ae7ac admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:57.649488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:57.650345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.650792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.651131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] PATH_INFO: `/v3/projects/fe6f8b45627444018086bcc69d9a54c6/users/143c9d04a1fc424591bbab1cf15aec61/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.653538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6f8b45627444018086bcc69d9a54c6, user_id=143c9d04a1fc424591bbab1cf15aec61, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:57.657481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:57.672814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1979/3960] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:57 2022] PUT /identity/v3/projects/fe6f8b45627444018086bcc69d9a54c6/users/143c9d04a1fc424591bbab1cf15aec61/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:57.684340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f00949-9e0c-404c-9795-8f985d30b0f3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.684679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f00949-9e0c-404c-9795-8f985d30b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.685035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f00949-9e0c-404c-9795-8f985d30b0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.722249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-81f00949-9e0c-404c-9795-8f985d30b0f3 None None] MFA Rules not processed for user `143c9d04a1fc424591bbab1cf15aec61`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:57.723483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-81f00949-9e0c-404c-9795-8f985d30b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:57.761229 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:57.814991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:57.815837 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1982/3961] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:57.897038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351525b-8047-4884-83ff-c6a0375b99dc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:57.904461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:57.905330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:57.905602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:57.906097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:57.907407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:57.909479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:57.951276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f00949-9e0c-404c-9795-8f985d30b0f3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:57.960369 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1980/3962] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:57 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:57.975895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f00949-9e0c-404c-9795-8f985d30b0f3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:58.065292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:58.066088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.066577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.066934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.067673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:58.069792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:58.107393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1983/3963] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:57 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:58.108889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:58.125078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1847c-aa9e-4f23-84ad-255e18e2c2f3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:58.134266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:58.135608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.136242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.137191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.138442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:58.141873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:58.179294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:58.195734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc3937-4f19-4826-92b6-82a9459b8ad3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:58.197049 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1981/3964] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:58.206295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32a69-ae6a-4fb2-87c5-ad5a4f0c2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:58.206999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32a69-ae6a-4fb2-87c5-ad5a4f0c2f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.207284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32a69-ae6a-4fb2-87c5-ad5a4f0c2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.207558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32a69-ae6a-4fb2-87c5-ad5a4f0c2f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.208222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32a69-ae6a-4fb2-87c5-ad5a4f0c2f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:58.209860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32a69-ae6a-4fb2-87c5-ad5a4f0c2f94 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:58.269017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:58.272570 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1984/3965] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:58.290556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e03d9-acef-42ab-a11d-0229e046d12c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:58.309482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:58.310967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.311577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.312063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] PATH_INFO: `/v3/projects/5cf1e0ffb6724fb6a1859490ecca8954/users/be84325b9aaf420ea77cddf221fe6fc5/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.322412 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:58.357950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf1e0ffb6724fb6a1859490ecca8954, user_id=be84325b9aaf420ea77cddf221fe6fc5, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:58.362945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:58.396593 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1982/3966] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:58 2022] PUT /identity/v3/projects/5cf1e0ffb6724fb6a1859490ecca8954/users/be84325b9aaf420ea77cddf221fe6fc5/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:58.398870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.399374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.399920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.454070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] MFA Rules not processed for user `be84325b9aaf420ea77cddf221fe6fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:58.455581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:58.551734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1985/3967] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:19:58.558583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:58.560521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:58.635564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:58.637928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:58.725161 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:58.726431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b658-4fb8-4eb4-85bb-b79267f6279c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:58.737102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef66ad-b82d-4d8e-836d-f4419a287d25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:58.738035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef66ad-b82d-4d8e-836d-f4419a287d25 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.738668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef66ad-b82d-4d8e-836d-f4419a287d25 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.739854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef66ad-b82d-4d8e-836d-f4419a287d25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.770597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d1807-390a-49b9-bbec-26546bf21042 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:58.776923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:58.778195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.778195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.778429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] PATH_INFO: `/v3/projects/9770e31bc3be400aab624a2fdbead32c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.779898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9770e31bc3be400aab624a2fdbead32c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:58.781724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:58.863208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9770e31bc3be400aab624a2fdbead32c', 'request_id': 'req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:58.878895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef66ad-b82d-4d8e-836d-f4419a287d25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:58.882407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef66ad-b82d-4d8e-836d-f4419a287d25 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:58.897500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9770e31bc3be400aab624a2fdbead32c', 'request_id': 'req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:58.902657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1983/3968] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:19:58.907978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9770e31bc3be400aab624a2fdbead32c', 'request_id': 'req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:58.919764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] The token cache is being invalidate because project 9770e31bc3be400aab624a2fdbead32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:58.920133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:58.920980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c903cbb-aa4d-43fe-b2bc-299f4b6d5af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:58.923065 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1986/3969] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:58 2022] DELETE /identity/v3/projects/9770e31bc3be400aab624a2fdbead32c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:58.927910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aed3b-7fe4-436a-a933-423a99110769 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:58.928390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aed3b-7fe4-436a-a933-423a99110769 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:58.928890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aed3b-7fe4-436a-a933-423a99110769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:58.976975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-be1aed3b-7fe4-436a-a933-423a99110769 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:58.976975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-be1aed3b-7fe4-436a-a933-423a99110769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:59.265924 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1984/3970] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:59.274667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a332c-05bf-412d-b7eb-2603832bdf45 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.275224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a332c-05bf-412d-b7eb-2603832bdf45 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.275224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a332c-05bf-412d-b7eb-2603832bdf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.309944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-702a332c-05bf-412d-b7eb-2603832bdf45 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:59.309944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-702a332c-05bf-412d-b7eb-2603832bdf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:59.323563 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1987/3971] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:19:59.331793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aed3b-7fe4-436a-a933-423a99110769 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:59.343988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aed3b-7fe4-436a-a933-423a99110769 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:59.365755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:59.366561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.366829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.369242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.370149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:19:59.372631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:59.377152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:59.415352 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1985/3972] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:19:59.416746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a332c-05bf-412d-b7eb-2603832bdf45 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:59.428551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a332c-05bf-412d-b7eb-2603832bdf45 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:59.437178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:59.437875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.438151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.438420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.439391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:59.441323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:59.474955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:59.477333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:59.501617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1988/3973] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:19:59 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:19:59.502026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2809a5-5f12-459d-a33a-ca828c4fbded admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:59.508389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:59.516551 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:59.605270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:59.605270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.605657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.605967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] PATH_INFO: `/v3/users/143c9d04a1fc424591bbab1cf15aec61` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.607498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143c9d04a1fc424591bbab1cf15aec61)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:59.611657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:59.644191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff064af0-dee7-4951-b3b6-ae7f0d8c7514 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:59.660950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:59.661683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.662057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.662447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.663178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:59.667542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:59.709629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1989/3974] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:19:59 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:19:59.711336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:59.723716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfedcb-fc6c-47f5-ba80-5b8ca3776b98 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:59.729102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:59.730750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.731201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.731511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.732384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:59.735027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:59.745940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143c9d04a1fc424591bbab1cf15aec61'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:59.750737 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1990/3975] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:59.754811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:59.769520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873b96b-6bf7-465b-b69e-bfab408a21fc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:59.777425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:59.778380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.778747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143c9d04a1fc424591bbab1cf15aec61'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:59.778874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.779295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.780714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:59.782616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:59.806936 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1991/3976] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:19:59.806936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:59.821595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b802-8481-42be-b033-2d2fe7238e25 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:59.823354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143c9d04a1fc424591bbab1cf15aec61'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:59.826800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143c9d04a1fc424591bbab1cf15aec61'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:59.827260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83469c-af4f-466c-8d26-63494a029072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:59.828080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83469c-af4f-466c-8d26-63494a029072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.828481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83469c-af4f-466c-8d26-63494a029072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.828874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83469c-af4f-466c-8d26-63494a029072 admin admin] PATH_INFO: `/v3/projects/8f1f63bfe1664d079f0e22116f6f4e18/users/79c5db05d52f4b8d91b430a8b459a09b/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.832113 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:59.854628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83469c-af4f-466c-8d26-63494a029072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f63bfe1664d079f0e22116f6f4e18, user_id=79c5db05d52f4b8d91b430a8b459a09b, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:59.857828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83469c-af4f-466c-8d26-63494a029072 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:59.879566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2c5ba5a0-6996-4c3e-972d-e8363680afe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143c9d04a1fc424591bbab1cf15aec61'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:59.883556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1992/3977] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:19:59 2022] PUT /identity/v3/projects/8f1f63bfe1664d079f0e22116f6f4e18/users/79c5db05d52f4b8d91b430a8b459a09b/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:59.902592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.902949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.903233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.908813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1986/3978] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:59 2022] DELETE /identity/v3/users/143c9d04a1fc424591bbab1cf15aec61 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:59.912304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:59.914157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:59.914507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:59.930426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:59.931999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:59.970785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:19:59.974248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:00.042692 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1993/3979] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:00.054337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:00.057230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:00.075937 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1987/3980] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:20:00.093992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:00.095751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:00.171417 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:00.176285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acdefa-e85a-4fe0-b1fa-a829c83b39fa None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:00.182278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:00.183390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:00.183912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:00.184337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:00.199464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:00.201530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:00.214493 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1994/3981] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:00.218192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dfdfb-bbdc-48e1-9153-1e21e0290247 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:00.222823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:00.223469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:00.223743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:00.224161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:00.237820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:00.239780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:00.255793 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1988/3982] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:01.051398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:01.053126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:01.083358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec0576-79a9-49ba-9519-52009ddcbc7d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:01.093488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:01.094504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:01.095096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:01.096316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] PATH_INFO: `/v3/projects/fe6f8b45627444018086bcc69d9a54c6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:01.105390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6f8b45627444018086bcc69d9a54c6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:01.107021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:01.224413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6f8b45627444018086bcc69d9a54c6', 'request_id': 'req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.240146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6f8b45627444018086bcc69d9a54c6', 'request_id': 'req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.260290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6f8b45627444018086bcc69d9a54c6', 'request_id': 'req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.285282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] The token cache is being invalidate because project fe6f8b45627444018086bcc69d9a54c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:01.285914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.287024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.291153 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1995/3983] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:01 2022] DELETE /identity/v3/projects/fe6f8b45627444018086bcc69d9a54c6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:01.298137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:01.308718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35999d4-3734-41dd-9d0b-c812a6d4996f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:01.381356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:01.382097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:01.382465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:01.382743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] PATH_INFO: `/v3/users/be84325b9aaf420ea77cddf221fe6fc5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:01.384189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be84325b9aaf420ea77cddf221fe6fc5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:01.386418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:01.444614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be84325b9aaf420ea77cddf221fe6fc5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.457755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be84325b9aaf420ea77cddf221fe6fc5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.486511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be84325b9aaf420ea77cddf221fe6fc5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.487701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be84325b9aaf420ea77cddf221fe6fc5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.498864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-791d16c6-f8dd-4f8f-b35f-1a6334e9ac92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be84325b9aaf420ea77cddf221fe6fc5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:01.519959 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1989/3984] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:01 2022] DELETE /identity/v3/users/be84325b9aaf420ea77cddf221fe6fc5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:02.103601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:02.105040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:02.140545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b481d8-014a-4e7d-9fd5-8bd1edc8189c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:02.147641 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:02.230064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:02.230974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:02.231316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:02.231769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] PATH_INFO: `/v3/projects/5cf1e0ffb6724fb6a1859490ecca8954` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:02.233393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf1e0ffb6724fb6a1859490ecca8954)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:02.236638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:02.318549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf1e0ffb6724fb6a1859490ecca8954', 'request_id': 'req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:02.344592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf1e0ffb6724fb6a1859490ecca8954', 'request_id': 'req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:02.363620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf1e0ffb6724fb6a1859490ecca8954', 'request_id': 'req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:02.386138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] The token cache is being invalidate because project 5cf1e0ffb6724fb6a1859490ecca8954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:02.386407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:02.387211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eb65ea9-4321-45e6-9dc9-b8f6a521d99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:02.389612 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1996/3985] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:02 2022] DELETE /identity/v3/projects/5cf1e0ffb6724fb6a1859490ecca8954 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:02.394814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4394-a42f-4a0d-a98c-db8cffa16424 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:02.395939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4394-a42f-4a0d-a98c-db8cffa16424 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:02.396554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4394-a42f-4a0d-a98c-db8cffa16424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:02.437665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-583f4394-a42f-4a0d-a98c-db8cffa16424 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:02.439365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-583f4394-a42f-4a0d-a98c-db8cffa16424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:02.559098 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:02.597152 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1990/3986] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:02.607075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7ff0-02c7-41ab-8271-21630e458981 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:02.607440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7ff0-02c7-41ab-8271-21630e458981 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:02.607772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7ff0-02c7-41ab-8271-21630e458981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:02.658158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-206f7ff0-02c7-41ab-8271-21630e458981 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:02.659524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-206f7ff0-02c7-41ab-8271-21630e458981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:02.679433 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1997/3987] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:02.680479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4394-a42f-4a0d-a98c-db8cffa16424 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:02.694450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4394-a42f-4a0d-a98c-db8cffa16424 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:02.711543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:02.712407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:02.713203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:02.713651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:02.714957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:20:02.715273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:02.716928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:02.746135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1991/3988] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:20:02.750411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7ff0-02c7-41ab-8271-21630e458981 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:02.766222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7ff0-02c7-41ab-8271-21630e458981 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:02.777848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:02.778468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:02.778742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:02.779022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:02.779649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:02.781790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:02.832512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1998/3989] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:20:02 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:02.834555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:02.850928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be01d8-2f5e-4d37-9e22-2e761d636659 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:02.973939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:02.974846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:02.975314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:02.975768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:02.977885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:02.980036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:03.045668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1992/3990] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:20:02 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:03.046979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:03.066400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a67ae-3f43-4b6c-97b1-17e46a9d50ec admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:03.096505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:03.097788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:03.098113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:03.098477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:03.099146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:03.103115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:03.124193 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 1999/3991] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:20:03.125595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:03.158726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc0b0-5a64-4b71-80e0-a4be96e21f54 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:03.168476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5d334-8dbb-4954-84be-c528211acb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:03.169353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d334-8dbb-4954-84be-c528211acb14 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:03.169691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d334-8dbb-4954-84be-c528211acb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:03.170030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d334-8dbb-4954-84be-c528211acb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:03.170849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5d334-8dbb-4954-84be-c528211acb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:03.175022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5d334-8dbb-4954-84be-c528211acb14 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:03.189247 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1993/3992] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:03.190847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:03.207720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acda349-080d-4a9c-b3d2-ac36de34d0e2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:03.226606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:03.229179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:03.229471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:03.229831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] PATH_INFO: `/v3/projects/ca3778dc268b4b59b41b1d4738798515/users/2e81723bb80a43eb9e9be7e276f902e1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:03.263198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3778dc268b4b59b41b1d4738798515, user_id=2e81723bb80a43eb9e9be7e276f902e1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:03.267268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:03.338421 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2000/3993] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:20:03 2022] PUT /identity/v3/projects/ca3778dc268b4b59b41b1d4738798515/users/2e81723bb80a43eb9e9be7e276f902e1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:20:03.348738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fef970-2ba1-4aa8-be22-fe5b6776ae02 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:03.349521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fef970-2ba1-4aa8-be22-fe5b6776ae02 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:03.350010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fef970-2ba1-4aa8-be22-fe5b6776ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:03.419310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d0fef970-2ba1-4aa8-be22-fe5b6776ae02 None None] MFA Rules not processed for user `2e81723bb80a43eb9e9be7e276f902e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:03.421790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0fef970-2ba1-4aa8-be22-fe5b6776ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:03.538145 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1994/3994] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:03.558821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:03.563001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:03.630822 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:03.657384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783b34b-adc8-4675-92cc-d59c47898639 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:03.662461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:03.663190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:03.663539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:03.663883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:03.675314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:03.677003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:03.700861 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2001/3995] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:03.882316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192048-e086-446d-83bb-503931b85fb6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:03.883695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192048-e086-446d-83bb-503931b85fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:03.884288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192048-e086-446d-83bb-503931b85fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:03.926182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ea192048-e086-446d-83bb-503931b85fb6 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:03.933889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ea192048-e086-446d-83bb-503931b85fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:04.031422 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:04.047310 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1995/3996] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:04.085714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:04.090448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:04.282261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60bef6-1d0e-4b9f-8f58-ac2dd3f8eb20 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:04.289767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:04.290643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:04.291084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:04.291510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:04.303853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:04.306262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:04.318434 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2002/3997] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:04.730137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de369-87c5-40a6-a6d7-996b4060e21c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:04.730746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de369-87c5-40a6-a6d7-996b4060e21c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:04.731031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de369-87c5-40a6-a6d7-996b4060e21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:04.763111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e80de369-87c5-40a6-a6d7-996b4060e21c None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:04.767341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e80de369-87c5-40a6-a6d7-996b4060e21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:04.794469 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1996/3998] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:04.815084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:04.842973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a83d92-ee24-4a8d-b4c4-0c1add1d5ecb service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:04.851386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:04.852078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:04.852360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:04.852861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:04.870033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:04.872219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:04.895077 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2003/3999] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:05.371048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4adb-bb3b-4977-ba4f-52cc9bf285fd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:05.371785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4adb-bb3b-4977-ba4f-52cc9bf285fd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:05.372269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4adb-bb3b-4977-ba4f-52cc9bf285fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:05.395136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4cdc4adb-bb3b-4977-ba4f-52cc9bf285fd None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:05.397188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4cdc4adb-bb3b-4977-ba4f-52cc9bf285fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:05.413975 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1997/4000] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:05.422145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:05.439242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4de9e-fb99-4cbf-ae02-ce39868c635f service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:05.446451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:05.447585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:05.448023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:05.448464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:05.462583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:05.465621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:05.478651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2004/4001] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:05.959499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c03f-84bc-4665-a1a1-121a7a2ae907 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:05.959993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c03f-84bc-4665-a1a1-121a7a2ae907 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:05.960078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c03f-84bc-4665-a1a1-121a7a2ae907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:05.983605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0582c03f-84bc-4665-a1a1-121a7a2ae907 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:05.985659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0582c03f-84bc-4665-a1a1-121a7a2ae907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:06.009514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1998/4002] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:06.026944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:06.067280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e09a2f-6a0c-4b00-b9b6-25a77ad61069 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:06.089167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:06.090848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:06.093665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:06.093665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:06.155991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:06.162980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:06.187295 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2005/4003] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:06.691429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfcfb-8180-43d2-8d22-68dd664a92bc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:06.692692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfcfb-8180-43d2-8d22-68dd664a92bc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:06.693206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfcfb-8180-43d2-8d22-68dd664a92bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:06.718190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a77bfcfb-8180-43d2-8d22-68dd664a92bc None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:06.720458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a77bfcfb-8180-43d2-8d22-68dd664a92bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:06.737574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 1999/4004] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:06.745114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:06.759288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29b44-d894-4f39-abeb-cf1b61032003 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:06.766349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:06.767427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:06.767897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:06.768356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:06.782712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:06.785174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:06.796583 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2006/4005] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:07.157777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945c4f-25a2-4383-81a8-84258451dfbd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:07.158768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945c4f-25a2-4383-81a8-84258451dfbd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:07.159250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945c4f-25a2-4383-81a8-84258451dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:07.182089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-66945c4f-25a2-4383-81a8-84258451dfbd None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:07.183754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-66945c4f-25a2-4383-81a8-84258451dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:07.207213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:07.208202 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2000/4006] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:07.220462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a99e-a356-47a8-967f-92f3382fea9d service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:07.226356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:07.227357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:07.227839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:07.228363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:07.238203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:07.240297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:07.263743 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2007/4007] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:08.556517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cad59-205d-4d3b-ac41-172969ae6fa8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:08.557184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cad59-205d-4d3b-ac41-172969ae6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:08.557709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cad59-205d-4d3b-ac41-172969ae6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:08.580584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a68cad59-205d-4d3b-ac41-172969ae6fa8 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:08.581876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a68cad59-205d-4d3b-ac41-172969ae6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:08.590936 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2001/4008] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:08.605734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:08.619073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9a2d-4433-4f43-935c-e20b133d505e service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:08.624140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:08.624756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:08.625048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:08.625496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:08.634854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:08.636474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:08.646894 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2008/4009] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:08.817813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926ba03-a3c8-4c23-a39c-85621e499075 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:08.818101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926ba03-a3c8-4c23-a39c-85621e499075 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:08.818426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926ba03-a3c8-4c23-a39c-85621e499075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:08.838240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0926ba03-a3c8-4c23-a39c-85621e499075 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:08.839551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0926ba03-a3c8-4c23-a39c-85621e499075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:08.848062 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2002/4010] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:08.869973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:08.884352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120204-5947-46e8-ab58-534f25a050af service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:08.889855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:08.890478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:08.890749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:08.891013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:08.900107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:08.901708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:08.913762 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2009/4011] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:20:09.138780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8991-b6bb-4056-9d25-953dc097ab22 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:09.139075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8991-b6bb-4056-9d25-953dc097ab22 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:09.139425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8991-b6bb-4056-9d25-953dc097ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:09.174951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5ecd8991-b6bb-4056-9d25-953dc097ab22 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:09.176609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ecd8991-b6bb-4056-9d25-953dc097ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:09.185032 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2003/4012] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:09.198862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:09.216430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25a1af-207a-4091-9290-8034fc3a683c service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:09.223361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:09.224051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:09.224490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:09.225605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:09.236577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:09.238352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:09.249734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2010/4013] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:09.515197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f740a6f-b4eb-4692-a4e1-fa5080d18630 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:09.515701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f740a6f-b4eb-4692-a4e1-fa5080d18630 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:09.516335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f740a6f-b4eb-4692-a4e1-fa5080d18630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:09.546884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1f740a6f-b4eb-4692-a4e1-fa5080d18630 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:09.548454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1f740a6f-b4eb-4692-a4e1-fa5080d18630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:09.565740 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2004/4014] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:09.574575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:09.592347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df3a59-84a7-4ff4-adc4-c2e38a5bd20e service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:09.600021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:09.601031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:09.601516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:09.601939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:09.614948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:09.617611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:09.641617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2011/4015] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:09.914448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8b4d-2660-4a00-b2c5-b6f34f02b899 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:09.915004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8b4d-2660-4a00-b2c5-b6f34f02b899 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:09.915424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8b4d-2660-4a00-b2c5-b6f34f02b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:09.937596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-28ed8b4d-2660-4a00-b2c5-b6f34f02b899 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:09.939991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-28ed8b4d-2660-4a00-b2c5-b6f34f02b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:09.950708 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2005/4016] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:09.964810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:09.977611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22e09-f714-4d34-9344-a78106367979 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:09.983497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:09.984313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:09.984738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:09.985187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:09.992737 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:09.996692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:09.999091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:10.010532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2012/4017] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:10.207976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c297a-55b4-4601-ba2f-1ae94842c3b2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:10.208251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c297a-55b4-4601-ba2f-1ae94842c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:10.208743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c297a-55b4-4601-ba2f-1ae94842c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:10.231722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bf2c297a-55b4-4601-ba2f-1ae94842c3b2 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:10.233442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bf2c297a-55b4-4601-ba2f-1ae94842c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:10.247768 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2006/4018] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:10.255799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:10.269059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e91aaf-7c14-4750-a440-254ad0b9aeb5 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:10.274976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2eac-e62a-4fa5-81b0-9f6eeff94ca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:10.275856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2eac-e62a-4fa5-81b0-9f6eeff94ca3 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:10.276800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2eac-e62a-4fa5-81b0-9f6eeff94ca3 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:10.277292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2eac-e62a-4fa5-81b0-9f6eeff94ca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:10.288991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b2eac-e62a-4fa5-81b0-9f6eeff94ca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:10.290943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b2eac-e62a-4fa5-81b0-9f6eeff94ca3 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:10.309099 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2013/4019] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:10.460218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c297a-55b4-4601-ba2f-1ae94842c3b2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:10.586597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c297a-55b4-4601-ba2f-1ae94842c3b2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:10.606680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:10.607572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:10.608491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:10.608922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] PATH_INFO: `/v3/users/2e81723bb80a43eb9e9be7e276f902e1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:10.610608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e81723bb80a43eb9e9be7e276f902e1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:10.628936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:10.729188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e81723bb80a43eb9e9be7e276f902e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:10.748872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e81723bb80a43eb9e9be7e276f902e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:10.768456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e81723bb80a43eb9e9be7e276f902e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:10.769592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e81723bb80a43eb9e9be7e276f902e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:10.795474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e81723bb80a43eb9e9be7e276f902e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:10.799301 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:10.811300 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2007/4020] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:10 2022] DELETE /identity/v3/users/2e81723bb80a43eb9e9be7e276f902e1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:10.815808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:10.816292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:10.816391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:11.109540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:11.109540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:11.228859 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2014/4021] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:11.241855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:11.243341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:11.375568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45ce0-c19e-4eb0-9a44-65973e34225b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:11.390532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c469-0fa8-46d3-aeca-4d6a50a72bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:11.391530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c469-0fa8-46d3-aeca-4d6a50a72bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:11.391920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c469-0fa8-46d3-aeca-4d6a50a72bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:11.392292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c469-0fa8-46d3-aeca-4d6a50a72bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:11.403288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c469-0fa8-46d3-aeca-4d6a50a72bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:11.405229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c469-0fa8-46d3-aeca-4d6a50a72bb1 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:11.422107 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2008/4022] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:11.920563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:11.922129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:11.942700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebf091-37ce-4b20-951b-94c57b77bcfd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:11.953328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:11.954002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:11.954270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:11.954732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] PATH_INFO: `/v3/projects/ca3778dc268b4b59b41b1d4738798515` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:11.958514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3778dc268b4b59b41b1d4738798515)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:11.962046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:12.073897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3778dc268b4b59b41b1d4738798515', 'request_id': 'req-da03e148-1810-47f2-9e07-fbd4ac0d2bba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:12.088015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3778dc268b4b59b41b1d4738798515', 'request_id': 'req-da03e148-1810-47f2-9e07-fbd4ac0d2bba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:12.099816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3778dc268b4b59b41b1d4738798515', 'request_id': 'req-da03e148-1810-47f2-9e07-fbd4ac0d2bba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:12.122367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] The token cache is being invalidate because project ca3778dc268b4b59b41b1d4738798515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:12.122666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:12.159798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da03e148-1810-47f2-9e07-fbd4ac0d2bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:12.166820 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2015/4023] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:11 2022] DELETE /identity/v3/projects/ca3778dc268b4b59b41b1d4738798515 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:12.172483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c8f8-a267-4cd7-9370-9cc55a79d4da None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:12.173374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c8f8-a267-4cd7-9370-9cc55a79d4da None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:12.173672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c8f8-a267-4cd7-9370-9cc55a79d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:12.210230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bfa5c8f8-a267-4cd7-9370-9cc55a79d4da None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:12.211845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bfa5c8f8-a267-4cd7-9370-9cc55a79d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:12.455703 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2009/4024] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:20:12.469694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bf18e-daa8-4f45-b8ff-a40aa2ede59c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:12.470637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bf18e-daa8-4f45-b8ff-a40aa2ede59c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:12.471008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bf18e-daa8-4f45-b8ff-a40aa2ede59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:12.530714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c50bf18e-daa8-4f45-b8ff-a40aa2ede59c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:12.533739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c50bf18e-daa8-4f45-b8ff-a40aa2ede59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:12.571812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c8f8-a267-4cd7-9370-9cc55a79d4da None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:12.572028 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2016/4025] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:12.603265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c8f8-a267-4cd7-9370-9cc55a79d4da None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:12.628212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:12.630654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:12.633602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:12.634337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:12.635837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:20:12.636584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:12.640323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:12.684952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bf18e-daa8-4f45-b8ff-a40aa2ede59c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:12.685318 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2010/4026] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:20:12.706579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bf18e-daa8-4f45-b8ff-a40aa2ede59c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:12.713682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:12.721411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:12.721714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:12.721996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:12.722659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:12.729237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:12.798972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2017/4027] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:12.803968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:12.840303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b26e-04c5-46cf-bb53-0594d703cb47 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:13.057381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:13.058294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:13.058776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:13.059479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:13.060543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:13.065137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:13.141395 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2011/4028] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:20:12 2022] POST /identity/v3/users => generated 292 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:13.146827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:13.163124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1538ade-ddf0-4fa7-8fc5-d0314efa8058 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:13.170524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:13.171578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:13.172090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:13.172596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:13.173486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:13.177302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:13.202671 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2018/4029] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:13.206410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:13.223272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3041f-8fff-45e0-b200-c154edbc5be1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:13.253347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:13.255484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:13.261335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:13.261822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:13.262868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:13.269591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:13.306042 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2012/4030] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:13.307331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:13.328212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4d61-be19-4a15-ae96-20b465f908df admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:13.341680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343cc70-f840-429b-b1a1-7c98dfc6fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:13.344837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343cc70-f840-429b-b1a1-7c98dfc6fa62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:13.347417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343cc70-f840-429b-b1a1-7c98dfc6fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:13.347980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343cc70-f840-429b-b1a1-7c98dfc6fa62 admin admin] PATH_INFO: `/v3/projects/3c0545a72a744cf2a76c3954706d5d61/users/6b1d9e73255649b3b67d194c23354ba4/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:13.384220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343cc70-f840-429b-b1a1-7c98dfc6fa62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0545a72a744cf2a76c3954706d5d61, user_id=6b1d9e73255649b3b67d194c23354ba4, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:13.395355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:13.395930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343cc70-f840-429b-b1a1-7c98dfc6fa62 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:13.397465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:13.431241 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:13.455059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2019/4031] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:20:13 2022] PUT /identity/v3/projects/3c0545a72a744cf2a76c3954706d5d61/users/6b1d9e73255649b3b67d194c23354ba4/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:13.484116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:13.485774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:13.487036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:13.512899 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:13.590985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] MFA Rules not processed for user `6b1d9e73255649b3b67d194c23354ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:13.592396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:13.670864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c7054-b081-449d-86f6-e74d5191c450 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:13.782766 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2020/4032] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:13.801230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:13.804301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:13.853535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2922c-6347-44db-8c78-2f9253038740 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:13.854336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2922c-6347-44db-8c78-2f9253038740 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:13.854754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2922c-6347-44db-8c78-2f9253038740 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:13.855033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2922c-6347-44db-8c78-2f9253038740 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:13.859703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-66a2922c-6347-44db-8c78-2f9253038740 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:13.873580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2922c-6347-44db-8c78-2f9253038740 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:13.875562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2922c-6347-44db-8c78-2f9253038740 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:13.917544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802093e-9105-48d7-89ca-03e173fd2362 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:13.923111 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2013/4033] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:13.928386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f16f8-8218-4be3-b584-78bb692b32a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:13.929588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f16f8-8218-4be3-b584-78bb692b32a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:13.930670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f16f8-8218-4be3-b584-78bb692b32a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:13.932310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f16f8-8218-4be3-b584-78bb692b32a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:13.952530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f16f8-8218-4be3-b584-78bb692b32a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:13.955920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f16f8-8218-4be3-b584-78bb692b32a6 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:13.980692 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2021/4034] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:14.126945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b0e6-70f9-481a-bd55-4f0fee880201 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:14.127231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b0e6-70f9-481a-bd55-4f0fee880201 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:14.127560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b0e6-70f9-481a-bd55-4f0fee880201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:14.169141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a448b0e6-70f9-481a-bd55-4f0fee880201 None None] MFA Rules not processed for user `3fbef527355e40f3af441a57cd5807be`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:14.170429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a448b0e6-70f9-481a-bd55-4f0fee880201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:14.226687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:14.226687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:14.227290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:14.314624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:14.315871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:14.389467 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2014/4035] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:14.497826 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2022/4036] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:14.510247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a146-394b-4499-b590-6945638228af None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:14.510703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a146-394b-4499-b590-6945638228af None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:14.511056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a146-394b-4499-b590-6945638228af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:14.552698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2191a146-394b-4499-b590-6945638228af None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:14.555467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2191a146-394b-4499-b590-6945638228af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:14.574001 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2015/4037] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:15.428954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:15.431622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:15.520457 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:15.629814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ded08a-6907-402b-85be-3f8574b2657d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:15.645554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:15.646211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:15.646486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:15.646753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:15.665535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:15.667535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:15.691378 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2023/4038] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:24.534679 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=82 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:25.682208 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=23 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:26.565063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a146-394b-4499-b590-6945638228af None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:26.583876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a146-394b-4499-b590-6945638228af None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:26.596986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bdbc9-cc4e-4da9-aa75-5b0f635184b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:26.599032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bdbc9-cc4e-4da9-aa75-5b0f635184b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:26.599518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bdbc9-cc4e-4da9-aa75-5b0f635184b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:26.600034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bdbc9-cc4e-4da9-aa75-5b0f635184b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:26.602230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b2bdbc9-cc4e-4da9-aa75-5b0f635184b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:26.897711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bdbc9-cc4e-4da9-aa75-5b0f635184b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:26.901070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bdbc9-cc4e-4da9-aa75-5b0f635184b2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:26.928638 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2016/4039] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:29.237220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:29.250719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e825f33-9527-46b1-8258-833f17746cf2 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:29.256268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:29.257548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:29.258254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:29.258749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] PATH_INFO: `/v3/users/6b1d9e73255649b3b67d194c23354ba4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:29.260410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1d9e73255649b3b67d194c23354ba4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:29.262886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:29.375714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1d9e73255649b3b67d194c23354ba4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:29.391827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1d9e73255649b3b67d194c23354ba4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:29.392446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1d9e73255649b3b67d194c23354ba4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:29.418734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1d9e73255649b3b67d194c23354ba4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:29.421203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1d9e73255649b3b67d194c23354ba4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:29.459006 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2024/4040] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:29 2022] DELETE /identity/v3/users/6b1d9e73255649b3b67d194c23354ba4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:29.460649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:29.462104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:29.462831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:29.493184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:29.495061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:29.587563 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2017/4041] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:29.617238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:29.618260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:29.682295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5b557-03e4-4a60-9f57-768a9e25c58d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:29.686743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6143b-35f1-4387-9ee7-44ae5167badd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:29.687370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6143b-35f1-4387-9ee7-44ae5167badd service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:29.687644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6143b-35f1-4387-9ee7-44ae5167badd service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:29.687911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6143b-35f1-4387-9ee7-44ae5167badd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:29.698231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6143b-35f1-4387-9ee7-44ae5167badd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:29.699687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6143b-35f1-4387-9ee7-44ae5167badd service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:29.710320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2025/4042] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:30.366679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:30.368507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:30.382973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104483a9-9d04-435f-b59f-59a59b3f9726 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:30.393156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:30.393823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:30.394096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:30.394568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] PATH_INFO: `/v3/projects/3c0545a72a744cf2a76c3954706d5d61` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:30.395552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c0545a72a744cf2a76c3954706d5d61)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:30.397818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:30.461365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c0545a72a744cf2a76c3954706d5d61', 'request_id': 'req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:30.469083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c0545a72a744cf2a76c3954706d5d61', 'request_id': 'req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:30.475994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c0545a72a744cf2a76c3954706d5d61', 'request_id': 'req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:30.491036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] The token cache is being invalidate because project 3c0545a72a744cf2a76c3954706d5d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:30.491725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:30.492609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cae5a11-b2c5-4cab-97c7-b12a60ac95b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:30.494214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2018/4043] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:30 2022] DELETE /identity/v3/projects/3c0545a72a744cf2a76c3954706d5d61 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:30.499118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bab9-83b3-4631-bbbf-7564f8ebdec4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:30.499612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bab9-83b3-4631-bbbf-7564f8ebdec4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:30.500533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bab9-83b3-4631-bbbf-7564f8ebdec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:30.520634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7fb6bab9-83b3-4631-bbbf-7564f8ebdec4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:30.521978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7fb6bab9-83b3-4631-bbbf-7564f8ebdec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:30.635612 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2026/4044] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:20:30.637266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57dadd-88af-40a1-839c-f1d650a30807 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:30.637611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57dadd-88af-40a1-839c-f1d650a30807 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:30.637950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57dadd-88af-40a1-839c-f1d650a30807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:30.693349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6c57dadd-88af-40a1-839c-f1d650a30807 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:30.696678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6c57dadd-88af-40a1-839c-f1d650a30807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:30.712195 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2019/4045] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:30.722417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6bab9-83b3-4631-bbbf-7564f8ebdec4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:30.738004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6bab9-83b3-4631-bbbf-7564f8ebdec4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:30.750404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:30.751065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:30.751851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:30.751851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:30.752237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:20:30.752537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:30.754181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:30.789773 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2027/4046] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:20:30.790339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57dadd-88af-40a1-839c-f1d650a30807 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:30.801251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57dadd-88af-40a1-839c-f1d650a30807 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:30.806308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:30.807126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:30.807563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:30.808112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:30.808959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:30.811383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:30.825303 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:30.865465 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2020/4047] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:20:30 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:20:30.871081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:30.876945 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:30.883091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe24db-42f0-4009-baa8-12607f0bf7ed admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:30.961288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:30.962913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:30.963769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:30.964111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:30.964850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:30.966937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:30.996039 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2028/4048] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:20:30 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:30.999912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:31.016794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85884eb9-785c-4978-9495-b4a6ed42a71e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:31.024709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:31.026167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:31.026689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:31.027196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:31.028588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:31.031058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:31.045863 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2021/4049] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:31.050393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:31.061891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d015-fa07-4d0b-a328-7f0fddeb49ae admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:31.068045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146b0b9-f69b-4d98-8e03-810042f4f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:31.068728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146b0b9-f69b-4d98-8e03-810042f4f787 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:31.069074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146b0b9-f69b-4d98-8e03-810042f4f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:31.069367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146b0b9-f69b-4d98-8e03-810042f4f787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:31.070047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146b0b9-f69b-4d98-8e03-810042f4f787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:31.071767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146b0b9-f69b-4d98-8e03-810042f4f787 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:31.092308 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2029/4050] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:31.093924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:31.111012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35501973-a1c5-42c7-99ed-5f69c737af49 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:31.118073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:31.118875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:31.119250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:31.119626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] PATH_INFO: `/v3/projects/096fe2e72b39403f8565d377cd7151ae/users/4d84c723d2d64286a6d9445ee2244af4/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:31.149694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=096fe2e72b39403f8565d377cd7151ae, user_id=4d84c723d2d64286a6d9445ee2244af4, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:31.152617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:31.185201 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2022/4051] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:20:31 2022] PUT /identity/v3/projects/096fe2e72b39403f8565d377cd7151ae/users/4d84c723d2d64286a6d9445ee2244af4/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:20:31.195832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:31.196289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:31.196711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:31.235672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] MFA Rules not processed for user `4d84c723d2d64286a6d9445ee2244af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:31.236960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:31.406408 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2030/4052] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:20:31.427111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:31.429447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:31.601262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7b728-728a-44a5-9de5-4531e26feeec admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:31.609283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:31.610223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:31.610666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:31.611137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:31.621485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:31.623332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:31.639770 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2023/4053] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:40.064632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:40.067677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:40.171833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e7abc-cf91-428f-aa5c-ac4b8b39fb09 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:40.178506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:40.180044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:40.181090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:40.181527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] PATH_INFO: `/v3/users/25d98f9b858449a0af6ed328aa334600` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:40.182929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d98f9b858449a0af6ed328aa334600)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:40.185282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:40.217995 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:40.286435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d98f9b858449a0af6ed328aa334600'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.295548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d98f9b858449a0af6ed328aa334600'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.296288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d98f9b858449a0af6ed328aa334600'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.304953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d98f9b858449a0af6ed328aa334600'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.305785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d98f9b858449a0af6ed328aa334600'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.330156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2031/4054] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:40 2022] DELETE /identity/v3/users/25d98f9b858449a0af6ed328aa334600 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:40.698433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:40.715515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a73d-956e-47cb-94f8-485d27cd0052 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:40.800409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:40.801158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:40.801524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:40.801980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] PATH_INFO: `/v3/projects/503c042abb9448a393e983403fa0c1fe` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:40.803704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=503c042abb9448a393e983403fa0c1fe)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:40.805729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:40.868707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503c042abb9448a393e983403fa0c1fe', 'request_id': 'req-2139b3ab-a45a-4566-94a1-213b1281ce6f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.876036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503c042abb9448a393e983403fa0c1fe', 'request_id': 'req-2139b3ab-a45a-4566-94a1-213b1281ce6f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.884720 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:40.886258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503c042abb9448a393e983403fa0c1fe', 'request_id': 'req-2139b3ab-a45a-4566-94a1-213b1281ce6f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.911719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] The token cache is being invalidate because project 503c042abb9448a393e983403fa0c1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:40.912044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.912646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:40.914428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2024/4055] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:40 2022] DELETE /identity/v3/projects/503c042abb9448a393e983403fa0c1fe => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:40.918539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:40.920252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:40.942765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60752f-b740-42a9-a1e1-71b88453013c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:41.019430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:41.021058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:41.021336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:41.021886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] PATH_INFO: `/v3/users/757e7fda7bba4d379b96cfabdac2c4c3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:41.023173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757e7fda7bba4d379b96cfabdac2c4c3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:41.025375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:41.095566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757e7fda7bba4d379b96cfabdac2c4c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:41.115032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757e7fda7bba4d379b96cfabdac2c4c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:41.116756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757e7fda7bba4d379b96cfabdac2c4c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:41.160042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757e7fda7bba4d379b96cfabdac2c4c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:41.166490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6be4b708-71c7-44db-87c3-7a07a364e2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757e7fda7bba4d379b96cfabdac2c4c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:41.256941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2032/4056] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:40 2022] DELETE /identity/v3/users/757e7fda7bba4d379b96cfabdac2c4c3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:20:42.269138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:42.271256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:42.287851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139b3ab-a45a-4566-94a1-213b1281ce6f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:42.369586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:42.371032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:42.371316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:42.371588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] PATH_INFO: `/v3/projects/24fe69ac3ed846c896fa32c71e116208` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:42.373842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fe69ac3ed846c896fa32c71e116208)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:42.376111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:42.462701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fe69ac3ed846c896fa32c71e116208', 'request_id': 'req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:42.470937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fe69ac3ed846c896fa32c71e116208', 'request_id': 'req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:42.504978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fe69ac3ed846c896fa32c71e116208', 'request_id': 'req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:42.531689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] The token cache is being invalidate because project 24fe69ac3ed846c896fa32c71e116208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:42.532159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:42.532994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8043bd1b-b344-4dc3-b6c8-3cb6563289b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:42.538259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2025/4057] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:42 2022] DELETE /identity/v3/projects/24fe69ac3ed846c896fa32c71e116208 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:42.540355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1237-1514-462b-aeac-b37a77baf7b4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:42.540942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1237-1514-462b-aeac-b37a77baf7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:42.541135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1237-1514-462b-aeac-b37a77baf7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:42.569373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-aa0d1237-1514-462b-aeac-b37a77baf7b4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:42.573022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aa0d1237-1514-462b-aeac-b37a77baf7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:42.579462 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:42.707753 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2033/4058] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:42.716251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7078-de8f-455f-a8b4-e9ffdf2280e6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:42.716601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7078-de8f-455f-a8b4-e9ffdf2280e6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:42.717258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7078-de8f-455f-a8b4-e9ffdf2280e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:42.763786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9abe7078-de8f-455f-a8b4-e9ffdf2280e6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:42.769421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9abe7078-de8f-455f-a8b4-e9ffdf2280e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:42.799994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2026/4059] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:42.804513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d1237-1514-462b-aeac-b37a77baf7b4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:42.843012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d1237-1514-462b-aeac-b37a77baf7b4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:42.854045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:42.854732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:42.855016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:42.856070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:42.857092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:20:42.857756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:42.859703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:42.882373 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2034/4060] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:20:42.885785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe7078-de8f-455f-a8b4-e9ffdf2280e6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:42.909171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe7078-de8f-455f-a8b4-e9ffdf2280e6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:42.924609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:42.925557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:42.925663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:42.925890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:42.926547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:42.928512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:42.984751 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2027/4061] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:20:42 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:42.985628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:43.015966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5673f18-18eb-471a-bd2c-1b42f04dba06 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:43.191803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:43.192905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:43.194254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:43.194624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:43.195565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:43.198401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:43.269153 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2035/4062] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:20:42 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:43.269635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:43.305425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e48cf4-8e49-48c7-8498-c6e6b64c823b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:43.336499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:43.337662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:43.340226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:43.341954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:43.345203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:43.350402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:43.385746 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2028/4063] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:20:43.387500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:43.402545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6083fd-c2c0-4804-8241-e6e999c0dfc8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:43.415869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988afd1-5e5b-490f-9830-a7e93e8d5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:43.416246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988afd1-5e5b-490f-9830-a7e93e8d5ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:43.416625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988afd1-5e5b-490f-9830-a7e93e8d5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:43.416923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988afd1-5e5b-490f-9830-a7e93e8d5ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:43.417677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988afd1-5e5b-490f-9830-a7e93e8d5ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:43.420058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988afd1-5e5b-490f-9830-a7e93e8d5ba6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:43.457782 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2036/4064] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:43.461454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:43.480359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a3e4-d0c1-4c5d-b0bc-b24ac6ec9281 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:43.506209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:43.508557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:43.509138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:43.509494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] PATH_INFO: `/v3/projects/16542ba8c29e4ed0a5565945c0f87334/users/302454d9f56c4899895e341b0ddc6e1a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:43.553112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16542ba8c29e4ed0a5565945c0f87334, user_id=302454d9f56c4899895e341b0ddc6e1a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:43.558050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:43.579242 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2029/4065] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:20:43 2022] PUT /identity/v3/projects/16542ba8c29e4ed0a5565945c0f87334/users/302454d9f56c4899895e341b0ddc6e1a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:43.584467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:43.584908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:43.585034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:43.609396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:43.611443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:43.742755 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2037/4066] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:43.760017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:43.762499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:43.794228 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:43.905037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110ffc2-2c29-4392-893a-af78f59fa058 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:43.909632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662312-d46a-43bf-af61-6ae1d39f806e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:43.910258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662312-d46a-43bf-af61-6ae1d39f806e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:43.910544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662312-d46a-43bf-af61-6ae1d39f806e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:43.910815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662312-d46a-43bf-af61-6ae1d39f806e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:43.943976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662312-d46a-43bf-af61-6ae1d39f806e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:43.945597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662312-d46a-43bf-af61-6ae1d39f806e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:43.956330 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2030/4067] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:50.203560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:50.205638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:50.222190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1ab61-02b0-464f-b82f-6eebd6fab5df None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:50.228559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:50.229234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:50.229692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:50.230119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] PATH_INFO: `/v3/users/01c0d38c6d9440e88565277af4433660` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:50.231429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c0d38c6d9440e88565277af4433660)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:50.233652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:50.255393 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:50.346861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c0d38c6d9440e88565277af4433660'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:50.389144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c0d38c6d9440e88565277af4433660'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:50.390261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c0d38c6d9440e88565277af4433660'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:50.405484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c0d38c6d9440e88565277af4433660'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:50.406993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c0d38c6d9440e88565277af4433660'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:50.464393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2038/4068] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:50 2022] DELETE /identity/v3/users/01c0d38c6d9440e88565277af4433660 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:50.468858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:50.469723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:50.470217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:50.494121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:50.496377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:50.591456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2031/4069] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:50.606935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:50.609714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:50.780005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40920ca1-1f28-4697-a9ce-27e844fb0e10 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:50.789898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:50.790603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:50.790880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:50.791147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:50.817512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:50.818996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:50.847948 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2039/4070] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:52.192724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:52.194217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:52.219455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5154d3-5392-495f-a8dd-708b8cd0c48b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:52.228320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:52.229391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:52.229907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:52.230412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] PATH_INFO: `/v3/projects/cf7a5bb4dadb4bfd80ab9793b96e8795` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:52.232536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7a5bb4dadb4bfd80ab9793b96e8795)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:52.235238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:52.382769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'request_id': 'req-9a5ba45a-b8f3-47a3-bd40-eba29c633147'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.418548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'request_id': 'req-9a5ba45a-b8f3-47a3-bd40-eba29c633147'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.443254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'request_id': 'req-9a5ba45a-b8f3-47a3-bd40-eba29c633147'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.465818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] The token cache is being invalidate because project cf7a5bb4dadb4bfd80ab9793b96e8795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:52.466258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.469082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.472221 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2032/4071] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:52 2022] DELETE /identity/v3/projects/cf7a5bb4dadb4bfd80ab9793b96e8795 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:52.476008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:52.499494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeb8dd-553f-4d09-87b3-00f8bcae2a19 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:52.651114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:52.652133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:52.652637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:52.653130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] PATH_INFO: `/v3/users/a9cc4d8175ed435e8348b5a371e24690` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:52.656155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cc4d8175ed435e8348b5a371e24690)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:52.659986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:52.750622 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:52.790823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cc4d8175ed435e8348b5a371e24690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.803635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cc4d8175ed435e8348b5a371e24690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.804431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cc4d8175ed435e8348b5a371e24690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.814951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cc4d8175ed435e8348b5a371e24690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.815992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3fd1083a-7bfa-4266-befc-84a965aee669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cc4d8175ed435e8348b5a371e24690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:52.840439 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2040/4072] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:52 2022] DELETE /identity/v3/users/a9cc4d8175ed435e8348b5a371e24690 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:53.515480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:53.520072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:53.553719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ba45a-b8f3-47a3-bd40-eba29c633147 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:53.649619 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:53.700021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:53.715286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:53.720475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:53.721194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] PATH_INFO: `/v3/projects/2b902152ea5b4e89b4696eaa3ae6f766` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:53.724281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b902152ea5b4e89b4696eaa3ae6f766)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:53.728638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:53.834072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b902152ea5b4e89b4696eaa3ae6f766', 'request_id': 'req-71ade259-c67b-426c-89e4-0d3618aba391'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:53.846119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b902152ea5b4e89b4696eaa3ae6f766', 'request_id': 'req-71ade259-c67b-426c-89e4-0d3618aba391'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:53.864707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b902152ea5b4e89b4696eaa3ae6f766', 'request_id': 'req-71ade259-c67b-426c-89e4-0d3618aba391'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:53.902265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] The token cache is being invalidate because project 2b902152ea5b4e89b4696eaa3ae6f766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:53.902668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:53.905281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-71ade259-c67b-426c-89e4-0d3618aba391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:53.908163 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2033/4073] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:53 2022] DELETE /identity/v3/projects/2b902152ea5b4e89b4696eaa3ae6f766 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:53.913438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705b2c9-0851-48ed-b94c-9e40b0517b85 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:53.914292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705b2c9-0851-48ed-b94c-9e40b0517b85 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:53.914724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705b2c9-0851-48ed-b94c-9e40b0517b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:53.950554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a705b2c9-0851-48ed-b94c-9e40b0517b85 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:53.953189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a705b2c9-0851-48ed-b94c-9e40b0517b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:54.046162 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2041/4074] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:54.054252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1002dd-3d7f-4103-8a95-ca055bb161c9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.054870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1002dd-3d7f-4103-8a95-ca055bb161c9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.055342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1002dd-3d7f-4103-8a95-ca055bb161c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.089368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-da1002dd-3d7f-4103-8a95-ca055bb161c9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:54.094878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-da1002dd-3d7f-4103-8a95-ca055bb161c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:54.109149 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2034/4075] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:54.113208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705b2c9-0851-48ed-b94c-9e40b0517b85 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.124424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705b2c9-0851-48ed-b94c-9e40b0517b85 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:54.146146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:54.147076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.147519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.147875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.148931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:20:54.149329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:54.151096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:54.168814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2042/4076] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:20:54.171550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1002dd-3d7f-4103-8a95-ca055bb161c9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.184020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1002dd-3d7f-4103-8a95-ca055bb161c9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:54.200000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:54.200847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.201135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.201406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.202286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:54.207603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:54.250882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2035/4077] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:54.253603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.264884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95f70-a182-4b8b-be28-e3c96bcc6c8f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:54.330454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:54.331133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.331762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.332052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.332684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:54.334991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:54.370558 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2043/4078] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:54.371683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.384410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a95f7-7405-4d3f-91dc-9394fe7ebb85 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:54.389577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:54.390460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.390900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.391332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.392339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:54.394171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:54.413892 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2036/4079] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:20:54.421428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.434229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9229-6759-4465-a85b-bdcfbcd527bf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:54.447442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36d193-9ffa-4703-87f0-4c67b5a356f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:54.448334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36d193-9ffa-4703-87f0-4c67b5a356f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.448616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36d193-9ffa-4703-87f0-4c67b5a356f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.448921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36d193-9ffa-4703-87f0-4c67b5a356f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.451372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36d193-9ffa-4703-87f0-4c67b5a356f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:54.457471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36d193-9ffa-4703-87f0-4c67b5a356f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:54.489895 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2044/4080] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:54.495232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.510883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d3d85-1cbd-4ebb-95ae-c9e81ac7f95d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:54.522355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:54.523243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.523519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.525673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] PATH_INFO: `/v3/projects/455906e73f8b41e6be650330230baffc/users/7992efef4e984f01a1e0eda2eefe4b4e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.553143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=455906e73f8b41e6be650330230baffc, user_id=7992efef4e984f01a1e0eda2eefe4b4e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:54.557177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:54.589204 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2037/4081] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:20:54 2022] PUT /identity/v3/projects/455906e73f8b41e6be650330230baffc/users/7992efef4e984f01a1e0eda2eefe4b4e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:54.590282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14fa94-ce06-4751-8951-65ad7d27905c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.590574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14fa94-ce06-4751-8951-65ad7d27905c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.590849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14fa94-ce06-4751-8951-65ad7d27905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.628138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8d14fa94-ce06-4751-8951-65ad7d27905c None None] MFA Rules not processed for user `7992efef4e984f01a1e0eda2eefe4b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:54.629715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8d14fa94-ce06-4751-8951-65ad7d27905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:54.639604 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:54.738413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2045/4082] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:54.742737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.767048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9245c4-757c-4d25-9854-856e8de818f5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.767338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9245c4-757c-4d25-9854-856e8de818f5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.767612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9245c4-757c-4d25-9854-856e8de818f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.814602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fd9245c4-757c-4d25-9854-856e8de818f5 None None] MFA Rules not processed for user `302454d9f56c4899895e341b0ddc6e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:54.815821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fd9245c4-757c-4d25-9854-856e8de818f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:54.841977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2fb43-d2ae-454e-b65b-d7f9a9c6b7ba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:54.849428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:54.850212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.850487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.850763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.851547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:54.853562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:54.869034 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:54.895294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2038/4083] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:20:54.899707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:54.914418 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2046/4084] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:20:54.926560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c28f-cd11-4c66-a468-417935dc1584 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:54.926846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c28f-cd11-4c66-a468-417935dc1584 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:54.927125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c28f-cd11-4c66-a468-417935dc1584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:54.972872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f026c28f-cd11-4c66-a468-417935dc1584 None None] MFA Rules not processed for user `302454d9f56c4899895e341b0ddc6e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:54.974395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f026c28f-cd11-4c66-a468-417935dc1584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:55.032422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954bf1c-f8c6-4e92-a1c7-22b79622efb9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:55.047851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:55.048666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:55.048975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:55.049248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:55.049883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:55.054695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:55.056870 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2047/4085] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:20:55.088486 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2039/4086] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:20:54 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:20:55.092391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c28f-cd11-4c66-a468-417935dc1584 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:55.107265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c28f-cd11-4c66-a468-417935dc1584 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:55.114190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:55.114816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:55.115094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:55.115367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:55.116019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:55.117770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:55.129860 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2048/4087] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:55.136322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:55.148694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:55.154273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:55.169858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993fa4e-12f7-4fd4-86e5-3c04ba455fdd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:55.177615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:55.178356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:55.178641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:55.178921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] PATH_INFO: `/v3/projects/9f89ee45152441a3a529b96700a2bfe3/users/bf0b58b84a32494894f69e9eef5eadb9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:55.198015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f89ee45152441a3a529b96700a2bfe3, user_id=bf0b58b84a32494894f69e9eef5eadb9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:55.200840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:55.223752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2049/4088] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:20:55 2022] PUT /identity/v3/projects/9f89ee45152441a3a529b96700a2bfe3/users/bf0b58b84a32494894f69e9eef5eadb9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:55.225235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:55.232134 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:55.259083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251fbfa-02ca-4c21-a189-e91bfadb66f0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:55.368383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b733c9-8909-4dd7-8d99-2cb5cec335ec admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:55.376387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:55.377177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:55.378084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:55.378568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:55.379324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:55.383079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:55.396879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:55.397702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:55.398141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:55.398570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:55.400187 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2050/4089] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:20:55.401436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:55.413518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1dff8-b952-488c-b1e5-cd4c2bfbbb6f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:55.418499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6ba5-faec-4c0d-b513-15669bf9f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:55.419328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6ba5-faec-4c0d-b513-15669bf9f40b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:55.419687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6ba5-faec-4c0d-b513-15669bf9f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:55.420609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6ba5-faec-4c0d-b513-15669bf9f40b admin admin] PATH_INFO: `/v3/projects/9f89ee45152441a3a529b96700a2bfe3/users/bf0b58b84a32494894f69e9eef5eadb9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:55.423112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6ba5-faec-4c0d-b513-15669bf9f40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f89ee45152441a3a529b96700a2bfe3, user_id=bf0b58b84a32494894f69e9eef5eadb9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:55.425892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6ba5-faec-4c0d-b513-15669bf9f40b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:55.426605 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:55.440522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2051/4090] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:20:55 2022] PUT /identity/v3/projects/9f89ee45152441a3a529b96700a2bfe3/users/bf0b58b84a32494894f69e9eef5eadb9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:55.451738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362a05e-5616-4df5-903f-53e91b07f36c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:55.452151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362a05e-5616-4df5-903f-53e91b07f36c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:55.452529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362a05e-5616-4df5-903f-53e91b07f36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:55.482772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:55.484537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:55.487842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4362a05e-5616-4df5-903f-53e91b07f36c None None] MFA Rules not processed for user `bf0b58b84a32494894f69e9eef5eadb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:55.489378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4362a05e-5616-4df5-903f-53e91b07f36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:55.496449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2040/4091] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:20:55.629589 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2052/4092] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:20:56.043002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:56.045299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:56.066772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e54e-2fa7-4869-9480-16a13dabdeda service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:56.164458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:56.165445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:56.165823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:56.166188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:56.180233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:56.182161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:56.197629 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2041/4093] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:57.871329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362a05e-5616-4df5-903f-53e91b07f36c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:57.894659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362a05e-5616-4df5-903f-53e91b07f36c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:57.904857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9547367-6a41-44af-aba9-e690b15e71a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:57.905557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547367-6a41-44af-aba9-e690b15e71a2 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:57.905838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547367-6a41-44af-aba9-e690b15e71a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:57.906160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547367-6a41-44af-aba9-e690b15e71a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:58.064887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547367-6a41-44af-aba9-e690b15e71a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:58.071076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547367-6a41-44af-aba9-e690b15e71a2 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:58.118703 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2053/4094] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:58.197264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:58.362856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914a217-2dc3-4583-8dd6-22df4a318456 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:58.367919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:58.369566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:58.370029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:58.370448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] PATH_INFO: `/v3/users/7992efef4e984f01a1e0eda2eefe4b4e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:58.372090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7992efef4e984f01a1e0eda2eefe4b4e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:58.377369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:58.455064 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:58.457349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7992efef4e984f01a1e0eda2eefe4b4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:58.472437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7992efef4e984f01a1e0eda2eefe4b4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:58.492006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7992efef4e984f01a1e0eda2eefe4b4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:58.492757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7992efef4e984f01a1e0eda2eefe4b4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:58.503219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7992efef4e984f01a1e0eda2eefe4b4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:58.515658 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2042/4095] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:58 2022] DELETE /identity/v3/users/7992efef4e984f01a1e0eda2eefe4b4e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:58.521263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:58.521546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:58.521822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:58.546709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:20:58.547985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:58.553797 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:58.635219 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2054/4096] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:20:58.644786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:58.647753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:58.893262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35c3e-4fd8-4f32-918c-c67e4d6a2a4b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:58.909871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:58.910886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:58.911398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:58.911834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:58.936982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:58.944217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:58.961760 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2043/4097] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:59.665864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:59.671184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:59.708455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c6be6-d49a-4057-abe0-6fbb5f1e3a68 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:59.716696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:59.717758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:59.718222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:59.718610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] PATH_INFO: `/v3/projects/455906e73f8b41e6be650330230baffc` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:59.720191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=455906e73f8b41e6be650330230baffc)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:59.723447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:59.813366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455906e73f8b41e6be650330230baffc', 'request_id': 'req-39121b8a-5a2c-4ee9-b327-c15ea021ed06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:59.829910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455906e73f8b41e6be650330230baffc', 'request_id': 'req-39121b8a-5a2c-4ee9-b327-c15ea021ed06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:59.842047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455906e73f8b41e6be650330230baffc', 'request_id': 'req-39121b8a-5a2c-4ee9-b327-c15ea021ed06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:59.874265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] The token cache is being invalidate because project 455906e73f8b41e6be650330230baffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:20:59.874521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:59.875246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:20:59.880033 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2055/4098] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:20:59 2022] DELETE /identity/v3/projects/455906e73f8b41e6be650330230baffc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:20:59.881363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:59.902124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb39c1-3c5e-45f9-83fa-9f89770c523e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:00.051991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:00.053290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:00.053863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:00.055379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] PATH_INFO: `/v3/users/bf0b58b84a32494894f69e9eef5eadb9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:00.057225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0b58b84a32494894f69e9eef5eadb9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:00.060294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:00.175456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0b58b84a32494894f69e9eef5eadb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:00.192856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0b58b84a32494894f69e9eef5eadb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:00.208832 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:00.217270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0b58b84a32494894f69e9eef5eadb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:00.218540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0b58b84a32494894f69e9eef5eadb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:00.234740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88767e9f-9833-412e-939f-9e2cbd650f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0b58b84a32494894f69e9eef5eadb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:00.247468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2044/4099] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:20:59 2022] DELETE /identity/v3/users/bf0b58b84a32494894f69e9eef5eadb9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:00.748876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:00.750538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:00.767153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39121b8a-5a2c-4ee9-b327-c15ea021ed06 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:00.881585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:00.882531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:00.882908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:00.883342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] PATH_INFO: `/v3/projects/9f89ee45152441a3a529b96700a2bfe3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:00.884794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f89ee45152441a3a529b96700a2bfe3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:00.887306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:00.957708 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:00.975274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f89ee45152441a3a529b96700a2bfe3', 'request_id': 'req-a22fe375-4c80-4458-8652-6b63d2d7243b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:00.991247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f89ee45152441a3a529b96700a2bfe3', 'request_id': 'req-a22fe375-4c80-4458-8652-6b63d2d7243b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:01.001373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f89ee45152441a3a529b96700a2bfe3', 'request_id': 'req-a22fe375-4c80-4458-8652-6b63d2d7243b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:01.015253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] The token cache is being invalidate because project 9f89ee45152441a3a529b96700a2bfe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:21:01.015562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:01.016327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a22fe375-4c80-4458-8652-6b63d2d7243b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:01.024357 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2056/4100] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:21:00 2022] DELETE /identity/v3/projects/9f89ee45152441a3a529b96700a2bfe3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:01.026576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8487ad3-945b-4b04-9f0b-f69a482c5182 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.027101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8487ad3-945b-4b04-9f0b-f69a482c5182 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.027339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8487ad3-945b-4b04-9f0b-f69a482c5182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.067955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a8487ad3-945b-4b04-9f0b-f69a482c5182 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:01.069414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a8487ad3-945b-4b04-9f0b-f69a482c5182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:01.109664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc740ae-8894-4fe7-8b9c-e4b76e6f6f14 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.109947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc740ae-8894-4fe7-8b9c-e4b76e6f6f14 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.110228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc740ae-8894-4fe7-8b9c-e4b76e6f6f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.153463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cdc740ae-8894-4fe7-8b9c-e4b76e6f6f14 None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:01.155677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cdc740ae-8894-4fe7-8b9c-e4b76e6f6f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:01.198724 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2045/4101] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:01.207365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbcaa7-9a4e-49ca-9a4e-dcec25773197 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.207923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbcaa7-9a4e-49ca-9a4e-dcec25773197 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.208369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbcaa7-9a4e-49ca-9a4e-dcec25773197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.249070 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2057/4102] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:01.252297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-10dbcaa7-9a4e-49ca-9a4e-dcec25773197 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:01.253761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10dbcaa7-9a4e-49ca-9a4e-dcec25773197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:01.263547 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2046/4103] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:21:01.271568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc740ae-8894-4fe7-8b9c-e4b76e6f6f14 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:01.308283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc740ae-8894-4fe7-8b9c-e4b76e6f6f14 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:01.326598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:01.327384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.327661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.327933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.329684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:21:01.329814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:01.332137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:01.349044 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2058/4104] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:21:01.353447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbcaa7-9a4e-49ca-9a4e-dcec25773197 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:01.367206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbcaa7-9a4e-49ca-9a4e-dcec25773197 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:01.373614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:01.374559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.375042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.375544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.376488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:01.379157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:01.422598 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2047/4105] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:21:01 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:01.426125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:01.440127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aed0c-ac60-4169-96d2-9f21673c0a79 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:01.570976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:01.571757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.572220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.572586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.573368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:01.575537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:01.614181 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2059/4106] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:21:01 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:01.615470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:01.646384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1b03-9054-4ecc-b466-8049a28d15db admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:01.663349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:01.663988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.664273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.664546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.666657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:01.671298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:01.703454 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2048/4107] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:01.711389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:01.723835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a2ef-e72f-4694-a146-6259157cea89 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:01.741472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f72ec0-dfcf-4dc3-b623-03dfd81b929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:01.743435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72ec0-dfcf-4dc3-b623-03dfd81b929c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.743846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72ec0-dfcf-4dc3-b623-03dfd81b929c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.744216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72ec0-dfcf-4dc3-b623-03dfd81b929c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.745891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f72ec0-dfcf-4dc3-b623-03dfd81b929c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:01.747701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f72ec0-dfcf-4dc3-b623-03dfd81b929c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:01.765914 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2060/4108] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:01.766562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:01.784967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d113-2064-44f3-889f-7419cfa36a22 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:01.798237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:01.798969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.799246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.799524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] PATH_INFO: `/v3/projects/d7dad4a071034d3e940ee0a40771e14c/users/19660b367696400b98bb3b356039ab70/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.839992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dad4a071034d3e940ee0a40771e14c, user_id=19660b367696400b98bb3b356039ab70, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:01.843483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:01.866408 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2049/4109] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:01 2022] PUT /identity/v3/projects/d7dad4a071034d3e940ee0a40771e14c/users/19660b367696400b98bb3b356039ab70/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:21:01.879293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0faf19-94a2-41d8-938b-1b3edca586c8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:01.879585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0faf19-94a2-41d8-938b-1b3edca586c8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:01.879822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0faf19-94a2-41d8-938b-1b3edca586c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:01.954018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ad0faf19-94a2-41d8-938b-1b3edca586c8 None None] MFA Rules not processed for user `19660b367696400b98bb3b356039ab70`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:01.956392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ad0faf19-94a2-41d8-938b-1b3edca586c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:01.988476 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:02.076677 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2061/4110] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:02.077419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:02.244145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3af037-2909-4644-928a-948a039f4311 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:02.261209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:02.261877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:02.262150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:02.262418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:02.263064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:02.266188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:02.331787 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2050/4111] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:21:02 2022] POST /identity/v3/projects => generated 399 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:02.337375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0faf19-94a2-41d8-938b-1b3edca586c8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:02.370249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0faf19-94a2-41d8-938b-1b3edca586c8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:02.518056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:02.518687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:02.519028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:02.519300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:02.519949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:02.522132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:02.570708 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2062/4112] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:21:02 2022] POST /identity/v3/users => generated 306 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:02.572056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:02.579777 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:02.587444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e7d7-79f4-4ce9-bdd6-cc8a047b00e9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:02.603105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:02.603760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:02.604035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:02.604303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:02.604984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:02.606784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:02.632880 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2051/4113] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:02.638317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:02.652821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48be95d-daba-4564-aecd-768729a80c78 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:02.666352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:02.667077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:02.667353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:02.667838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] PATH_INFO: `/v3/projects/3db733b6fe74441cb1238ed1b58acff0/users/de8d52caf8e746d9ba3a89a3d850e96a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:02.702835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db733b6fe74441cb1238ed1b58acff0, user_id=de8d52caf8e746d9ba3a89a3d850e96a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:02.705569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:02.733585 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2063/4114] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:02 2022] PUT /identity/v3/projects/3db733b6fe74441cb1238ed1b58acff0/users/de8d52caf8e746d9ba3a89a3d850e96a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:02.737967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:02.757210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c6942-c77c-4f69-9d3f-582016eaedc0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:02.892475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556c303-4009-4bda-9076-69756488fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:02.893208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c303-4009-4bda-9076-69756488fcbb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:02.893487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c303-4009-4bda-9076-69756488fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:02.893758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c303-4009-4bda-9076-69756488fcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:02.894778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556c303-4009-4bda-9076-69756488fcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:02.896434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556c303-4009-4bda-9076-69756488fcbb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:02.911228 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2052/4115] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:02.915017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:02.947559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b8f5a-a16b-41ab-aad2-cd8334b48989 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:02.957606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:02.959415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:02.961417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:02.961731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] PATH_INFO: `/v3/projects/3db733b6fe74441cb1238ed1b58acff0/users/de8d52caf8e746d9ba3a89a3d850e96a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:02.971441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db733b6fe74441cb1238ed1b58acff0, user_id=de8d52caf8e746d9ba3a89a3d850e96a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:02.974196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:03.031540 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2064/4116] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:02 2022] PUT /identity/v3/projects/3db733b6fe74441cb1238ed1b58acff0/users/de8d52caf8e746d9ba3a89a3d850e96a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:03.042660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358808b-0640-4fbd-82be-cdb0b57d1262 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:03.043049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358808b-0640-4fbd-82be-cdb0b57d1262 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:03.043304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358808b-0640-4fbd-82be-cdb0b57d1262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:03.103696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5358808b-0640-4fbd-82be-cdb0b57d1262 None None] MFA Rules not processed for user `de8d52caf8e746d9ba3a89a3d850e96a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:03.111435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5358808b-0640-4fbd-82be-cdb0b57d1262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:03.349987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2053/4117] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:03.362112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:03.364119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:03.527820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266c37c-949c-45b0-a9b2-5598d5e19e8a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:03.535995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:03.537165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:03.537886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:03.538338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:03.548950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:03.550874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:03.577241 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2065/4118] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:04.667370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358808b-0640-4fbd-82be-cdb0b57d1262 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:04.683391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358808b-0640-4fbd-82be-cdb0b57d1262 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:04.692213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9aef7-f2db-4c23-b31e-91d8db3d55ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:04.693312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9aef7-f2db-4c23-b31e-91d8db3d55ff service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:04.693760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9aef7-f2db-4c23-b31e-91d8db3d55ff service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:04.694198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9aef7-f2db-4c23-b31e-91d8db3d55ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:04.757752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9aef7-f2db-4c23-b31e-91d8db3d55ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:04.759374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9aef7-f2db-4c23-b31e-91d8db3d55ff service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:04.769676 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2054/4119] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:04.796246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:04.811335 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:04.934398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6da14-5483-496b-935d-72249b5f53ae service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:04.940470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:04.941395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:04.942183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:04.942781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] PATH_INFO: `/v3/users/19660b367696400b98bb3b356039ab70` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:04.955406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19660b367696400b98bb3b356039ab70)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:04.958300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:05.032558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19660b367696400b98bb3b356039ab70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:05.043253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19660b367696400b98bb3b356039ab70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:05.044106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19660b367696400b98bb3b356039ab70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:05.053333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19660b367696400b98bb3b356039ab70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:05.054198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19660b367696400b98bb3b356039ab70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:05.079263 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2066/4120] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:21:04 2022] DELETE /identity/v3/users/19660b367696400b98bb3b356039ab70 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:05.081037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:05.081399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:05.081813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:05.105155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:05.106507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:05.119109 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:05.230102 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2055/4121] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:21:05.262333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:05.264712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:05.346732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94a72b-01cc-4cc7-8de7-e07f4ae1cd64 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:05.350773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:05.351533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:05.351883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:05.352389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:05.363200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:05.364859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:05.375921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2067/4122] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:06.064637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:06.066278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:06.078934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c2398-d495-4264-853c-de2e15eecabc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:06.084219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:06.085115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:06.085399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:06.085886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] PATH_INFO: `/v3/projects/d7dad4a071034d3e940ee0a40771e14c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:06.087239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dad4a071034d3e940ee0a40771e14c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:06.089475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:06.213737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dad4a071034d3e940ee0a40771e14c', 'request_id': 'req-7298f418-fa2e-406b-bbf2-6540291dfd01'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.226801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dad4a071034d3e940ee0a40771e14c', 'request_id': 'req-7298f418-fa2e-406b-bbf2-6540291dfd01'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.237028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dad4a071034d3e940ee0a40771e14c', 'request_id': 'req-7298f418-fa2e-406b-bbf2-6540291dfd01'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.259608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] The token cache is being invalidate because project d7dad4a071034d3e940ee0a40771e14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:21:06.259849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.261102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.264217 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2056/4123] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:21:06 2022] DELETE /identity/v3/projects/d7dad4a071034d3e940ee0a40771e14c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:06.268348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:06.283587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a6732-e1d3-4c83-9e3d-a7ea7e4b9d30 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:06.322611 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:06.393225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:06.393884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:06.394164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:06.394585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] PATH_INFO: `/v3/users/de8d52caf8e746d9ba3a89a3d850e96a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:06.396338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8d52caf8e746d9ba3a89a3d850e96a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:06.398898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:06.487755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8d52caf8e746d9ba3a89a3d850e96a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.508397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8d52caf8e746d9ba3a89a3d850e96a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.510158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8d52caf8e746d9ba3a89a3d850e96a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.521958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8d52caf8e746d9ba3a89a3d850e96a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.533310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8d52caf8e746d9ba3a89a3d850e96a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:06.559804 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2068/4124] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:21:06 2022] DELETE /identity/v3/users/de8d52caf8e746d9ba3a89a3d850e96a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:07.013706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:07.015353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:07.157287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f418-fa2e-406b-bbf2-6540291dfd01 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:07.205724 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:07.260961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dbfa6-ce39-4e69-8964-a9362981e5a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:07.262103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbfa6-ce39-4e69-8964-a9362981e5a9 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:07.262556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbfa6-ce39-4e69-8964-a9362981e5a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:07.263601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbfa6-ce39-4e69-8964-a9362981e5a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:07.266937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b9dbfa6-ce39-4e69-8964-a9362981e5a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:07.360260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dbfa6-ce39-4e69-8964-a9362981e5a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:07.364422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dbfa6-ce39-4e69-8964-a9362981e5a9 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:07.386380 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2057/4125] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:08.684116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:08.685845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:08.819454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb3af-ffab-44e9-b876-1c2edeec52aa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:08.832177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:08.835026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:08.835391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:08.835736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] PATH_INFO: `/v3/projects/3db733b6fe74441cb1238ed1b58acff0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:08.837095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db733b6fe74441cb1238ed1b58acff0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:08.840643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:08.942715 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:08.949182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db733b6fe74441cb1238ed1b58acff0', 'request_id': 'req-175de13f-704d-4ffd-bf47-1eb5415d08ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:08.962972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db733b6fe74441cb1238ed1b58acff0', 'request_id': 'req-175de13f-704d-4ffd-bf47-1eb5415d08ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:08.974473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db733b6fe74441cb1238ed1b58acff0', 'request_id': 'req-175de13f-704d-4ffd-bf47-1eb5415d08ff'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:08.988322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] The token cache is being invalidate because project 3db733b6fe74441cb1238ed1b58acff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:21:08.988607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:08.989331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-175de13f-704d-4ffd-bf47-1eb5415d08ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:08.991549 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2069/4126] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:21:08 2022] DELETE /identity/v3/projects/3db733b6fe74441cb1238ed1b58acff0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:21:08.996883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a7e60-d597-41a8-8d55-52bfb78f3985 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:08.997772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a7e60-d597-41a8-8d55-52bfb78f3985 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:08.998569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a7e60-d597-41a8-8d55-52bfb78f3985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.031545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f08a7e60-d597-41a8-8d55-52bfb78f3985 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:09.034024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f08a7e60-d597-41a8-8d55-52bfb78f3985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:09.138621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2058/4127] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:09.150926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc56f83-66be-4e46-bb21-c2585b0a5306 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.151216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc56f83-66be-4e46-bb21-c2585b0a5306 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.151494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc56f83-66be-4e46-bb21-c2585b0a5306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.184172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-abc56f83-66be-4e46-bb21-c2585b0a5306 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:09.186046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-abc56f83-66be-4e46-bb21-c2585b0a5306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:09.207807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2070/4128] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:09.208905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a7e60-d597-41a8-8d55-52bfb78f3985 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:09.222320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a7e60-d597-41a8-8d55-52bfb78f3985 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:09.238449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:09.239210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.239578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.239977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.240863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:21:09.241226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:09.243289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:09.287663 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2059/4129] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:21:09.291426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc56f83-66be-4e46-bb21-c2585b0a5306 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:09.306612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc56f83-66be-4e46-bb21-c2585b0a5306 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:09.324635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:09.327503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.328108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.328526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.329636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:09.336507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:09.417808 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2071/4130] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:21:09 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:09.422355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:09.437436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f7f71-f37e-4ed6-a2cb-0150e06311cd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:09.544972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:09.545690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.546031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.546345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.547116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:09.549423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:09.558582 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:09.586382 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2060/4131] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:21:09 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:09.592924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:09.605425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563dad1-2509-4d74-b777-ca60b724cb64 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:09.624638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:09.625617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.632642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.633209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.634827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:09.639454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:09.677264 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2072/4132] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:09.681400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:09.697502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5f13-0984-4a08-b56b-0914c9ba7690 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:09.712282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb4c32-4b7d-41ef-8158-f31ff1469111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:09.713900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4c32-4b7d-41ef-8158-f31ff1469111 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.714186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4c32-4b7d-41ef-8158-f31ff1469111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.714505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4c32-4b7d-41ef-8158-f31ff1469111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.715197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb4c32-4b7d-41ef-8158-f31ff1469111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:09.722685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb4c32-4b7d-41ef-8158-f31ff1469111 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:09.763998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2061/4133] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:09.766202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:09.782797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9d19-461a-49d6-9452-53ed7645f118 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:09.793234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:09.795175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.800916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.801224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] PATH_INFO: `/v3/projects/6b90eb2eef7c45398a821324472a6429/users/722940af11854f0687e7c99fae3650a2/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.849201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b90eb2eef7c45398a821324472a6429, user_id=722940af11854f0687e7c99fae3650a2, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:09.852840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:09.875539 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2073/4134] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:09 2022] PUT /identity/v3/projects/6b90eb2eef7c45398a821324472a6429/users/722940af11854f0687e7c99fae3650a2/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:09.880477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fa9e-24bb-4876-bbb9-70b153a941f5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:09.880912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fa9e-24bb-4876-bbb9-70b153a941f5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:09.881340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fa9e-24bb-4876-bbb9-70b153a941f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:09.909664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f487fa9e-24bb-4876-bbb9-70b153a941f5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:09.910974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f487fa9e-24bb-4876-bbb9-70b153a941f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:10.091268 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2062/4135] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:21:10.186322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:10.187823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:10.331894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072ab7-b2c6-4116-938f-5be5195cbb6f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:10.338407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:10.339719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:10.340587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:10.340899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:10.357170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:10.361906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:10.384738 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2074/4136] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:20.075682 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=3,keystone:SELECT=34 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:20.373542 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:21.479801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b006df8-375f-4b1b-9a0e-161f94d6b03d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:21.480965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b006df8-375f-4b1b-9a0e-161f94d6b03d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:21.482012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b006df8-375f-4b1b-9a0e-161f94d6b03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:21.549309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4b006df8-375f-4b1b-9a0e-161f94d6b03d None None] MFA Rules not processed for user `722940af11854f0687e7c99fae3650a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:21.550907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4b006df8-375f-4b1b-9a0e-161f94d6b03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:21.676368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:21.677589 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2063/4137] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:21.687830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef404d0-407c-423e-a673-8e0dfd776e1a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:21.693877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:21.694762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:21.695220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:21.695685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:21.696488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:21.698688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:21.750068 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2075/4138] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:21:21 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:21.753857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b006df8-375f-4b1b-9a0e-161f94d6b03d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:21.767887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b006df8-375f-4b1b-9a0e-161f94d6b03d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:21.901726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:21.902822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:21.903630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:21.903898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:21.905626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:21.909092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:21.954209 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2064/4139] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:21:21 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:21.958015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:21.978498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036c81-28a7-4b66-b55e-6a3fa5a632f6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:21.988274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:21.989315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:21.990010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:21.990517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:21.991641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:21.994355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:22.071022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2076/4140] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:21:22.073853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:22.097425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c14eb-804f-4330-bc38-1fcc8da7b452 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:22.117724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:22.122804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:22.141210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:22.141545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] PATH_INFO: `/v3/projects/9a941635dd0d4d70aa3e585d7960dd96/users/6951e96501e641d3bc0b0f51ebcd8825/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:22.179915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a941635dd0d4d70aa3e585d7960dd96, user_id=6951e96501e641d3bc0b0f51ebcd8825, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:22.187890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:22.222218 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2065/4141] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:22 2022] PUT /identity/v3/projects/9a941635dd0d4d70aa3e585d7960dd96/users/6951e96501e641d3bc0b0f51ebcd8825/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:22.227411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:22.252439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94960-9a10-4376-93ba-e900a99ec176 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:22.419026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e849de-1bda-4847-bc19-8593af66642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:22.419939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e849de-1bda-4847-bc19-8593af66642b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:22.425307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e849de-1bda-4847-bc19-8593af66642b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:22.426064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e849de-1bda-4847-bc19-8593af66642b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:22.428039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e849de-1bda-4847-bc19-8593af66642b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:22.430890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e849de-1bda-4847-bc19-8593af66642b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:22.491655 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2077/4142] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:22.496972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:22.536289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6c14-8c18-4de9-a71c-6dbc95e9455a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:22.548219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:22.548952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:22.549228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:22.549701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] PATH_INFO: `/v3/projects/9a941635dd0d4d70aa3e585d7960dd96/users/6951e96501e641d3bc0b0f51ebcd8825/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:22.554382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a941635dd0d4d70aa3e585d7960dd96, user_id=6951e96501e641d3bc0b0f51ebcd8825, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:22.557070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:22.581334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d083-261a-4e97-a1e3-bb786ab53701 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:22.581584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d083-261a-4e97-a1e3-bb786ab53701 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:22.581839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d083-261a-4e97-a1e3-bb786ab53701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:22.613650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2a55d083-261a-4e97-a1e3-bb786ab53701 None None] MFA Rules not processed for user `302454d9f56c4899895e341b0ddc6e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:22.614479 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2066/4143] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:22 2022] PUT /identity/v3/projects/9a941635dd0d4d70aa3e585d7960dd96/users/6951e96501e641d3bc0b0f51ebcd8825/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:22.616141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:22.616536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2a55d083-261a-4e97-a1e3-bb786ab53701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:22.618853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:22.704624 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:22.753495 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2078/4144] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:22.781050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abb070-d14c-4a16-bb8c-983f93e27895 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:22.794165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:22.795513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:22.796059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:22.796632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] PATH_INFO: `/v3/users/0c247647f8e34c638bec5e68826171e5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:22.819072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c247647f8e34c638bec5e68826171e5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:22.825708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:22.904753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c247647f8e34c638bec5e68826171e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:22.923795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c247647f8e34c638bec5e68826171e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:22.969121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c247647f8e34c638bec5e68826171e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:22.970162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c247647f8e34c638bec5e68826171e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:22.980631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d46b2a25-fa3d-4bce-8a41-be1af68a3f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c247647f8e34c638bec5e68826171e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:22.991049 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2067/4145] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:21:22 2022] DELETE /identity/v3/users/0c247647f8e34c638bec5e68826171e5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:23.330988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55d083-261a-4e97-a1e3-bb786ab53701 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:23.384578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55d083-261a-4e97-a1e3-bb786ab53701 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:23.541107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:23.542498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:23.543295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:23.543936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] PATH_INFO: `/v3/projects/30ccb279d8144dd39f613a6b57f42067` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:23.545625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ccb279d8144dd39f613a6b57f42067)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:23.547989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:23.562151 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:23.613242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ccb279d8144dd39f613a6b57f42067', 'request_id': 'req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:23.631579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ccb279d8144dd39f613a6b57f42067', 'request_id': 'req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:23.640277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ccb279d8144dd39f613a6b57f42067', 'request_id': 'req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:23.656161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] The token cache is being invalidate because project 30ccb279d8144dd39f613a6b57f42067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:21:23.657374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:23.658218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-01c3e9f2-d2ee-47c6-9cb8-cdd6bb973cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:23.660971 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2079/4146] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:21:23 2022] DELETE /identity/v3/projects/30ccb279d8144dd39f613a6b57f42067 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:23.666561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551f274-0fb6-48ed-b603-8e8d8917efaf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:23.667225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551f274-0fb6-48ed-b603-8e8d8917efaf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:23.667225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551f274-0fb6-48ed-b603-8e8d8917efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:23.703350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b551f274-0fb6-48ed-b603-8e8d8917efaf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:23.705358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b551f274-0fb6-48ed-b603-8e8d8917efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:23.788449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2068/4147] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:21:23.796838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3111a4-259b-4e5b-996e-c63c9de520fd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:23.798106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3111a4-259b-4e5b-996e-c63c9de520fd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:23.798559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3111a4-259b-4e5b-996e-c63c9de520fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:23.854192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2e3111a4-259b-4e5b-996e-c63c9de520fd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:23.866844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e3111a4-259b-4e5b-996e-c63c9de520fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:23.889900 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2080/4148] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:23.890329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551f274-0fb6-48ed-b603-8e8d8917efaf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:23.909325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551f274-0fb6-48ed-b603-8e8d8917efaf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:23.916272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:23.917960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:23.918393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:23.918781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:23.920381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:21:23.920924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:23.923746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:23.948406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3111a4-259b-4e5b-996e-c63c9de520fd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:23.955578 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2069/4149] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:21:23.961573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3111a4-259b-4e5b-996e-c63c9de520fd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:23.971167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:23.971798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:23.972218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:23.972581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:23.973512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:23.977053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:24.047220 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2081/4150] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:21:23 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:24.057909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:24.078135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dd342-8098-4d91-bd3a-890f1b2224eb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:24.183983 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:24.202645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:24.214803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:24.217129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:24.217468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:24.219441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:24.225290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:24.267441 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2070/4151] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:21:24 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:24.269239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:24.292844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369c931-7c94-4eba-af62-7eed3c8bf05b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:24.307362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:24.311859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:24.312363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:24.312910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:24.315097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:24.317303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:24.350675 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2082/4152] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:21:24.354774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:24.389807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bc813-861f-4d37-838c-e9381d23e859 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:24.405188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bd291-d9e8-4557-ad72-0d090db1bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:24.407650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd291-d9e8-4557-ad72-0d090db1bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:24.408110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd291-d9e8-4557-ad72-0d090db1bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:24.411299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd291-d9e8-4557-ad72-0d090db1bc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:24.411990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bd291-d9e8-4557-ad72-0d090db1bc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:24.413798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bd291-d9e8-4557-ad72-0d090db1bc49 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:24.448821 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2071/4153] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:24.450419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:24.473365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdc162-dcf4-4800-8072-27a85576ffa7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:24.502683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097231c7-5b48-4ff3-a8cf-2425f2f9d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:24.503365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097231c7-5b48-4ff3-a8cf-2425f2f9d4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:24.503643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097231c7-5b48-4ff3-a8cf-2425f2f9d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:24.503921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097231c7-5b48-4ff3-a8cf-2425f2f9d4f5 admin admin] PATH_INFO: `/v3/projects/641b7e2d0207464b97bbbbe212fb605b/users/8fc0387bfa7d476594a8e57da5340ef7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:24.565584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097231c7-5b48-4ff3-a8cf-2425f2f9d4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641b7e2d0207464b97bbbbe212fb605b, user_id=8fc0387bfa7d476594a8e57da5340ef7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:24.572926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097231c7-5b48-4ff3-a8cf-2425f2f9d4f5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:24.605413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2083/4154] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:24 2022] PUT /identity/v3/projects/641b7e2d0207464b97bbbbe212fb605b/users/8fc0387bfa7d476594a8e57da5340ef7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:24.623432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:24.626546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:24.627924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:24.717814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] MFA Rules not processed for user `8fc0387bfa7d476594a8e57da5340ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:24.719357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:24.867425 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2072/4155] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:24.873586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0984-ae12-4d36-9d23-5ad4414d3f34 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:24.874390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0984-ae12-4d36-9d23-5ad4414d3f34 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:24.874390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0984-ae12-4d36-9d23-5ad4414d3f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:24.907000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-602d0984-ae12-4d36-9d23-5ad4414d3f34 None None] MFA Rules not processed for user `8fc0387bfa7d476594a8e57da5340ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:24.908854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-602d0984-ae12-4d36-9d23-5ad4414d3f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:24.921375 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2084/4156] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:25.050268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:25.052584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:25.310684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8a4f-bacd-49e9-89c1-f120489209f1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:25.331210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:25.332003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:25.332357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:25.332660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:25.364634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:25.418855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:25.482724 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2073/4157] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:34.896478 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:35.455383 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:39.397459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:39.398324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:39.398782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:39.479094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] MFA Rules not processed for user `6951e96501e641d3bc0b0f51ebcd8825`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:39.481070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:39.606136 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2085/4158] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:39.618913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:39.620599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:39.772247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36284884-3072-4765-979a-ea232a3b3451 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:39.783079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:39.786739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:39.787187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:39.787565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:39.811604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:39.815311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:39.846799 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2074/4159] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:45.529730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:45.533417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:45.796146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270f6c7-4849-4fbc-8c31-9d13bf2595ab None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:45.807667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22f9d0-8635-4e58-a392-4ae19e0a7cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:45.808403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22f9d0-8635-4e58-a392-4ae19e0a7cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:45.808682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22f9d0-8635-4e58-a392-4ae19e0a7cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:45.808881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22f9d0-8635-4e58-a392-4ae19e0a7cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:45.816454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-da22f9d0-8635-4e58-a392-4ae19e0a7cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:45.859796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22f9d0-8635-4e58-a392-4ae19e0a7cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:45.862588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22f9d0-8635-4e58-a392-4ae19e0a7cf3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:45.880123 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2086/4160] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:46.379498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:46.508321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11426d-3bd1-4c10-a023-2c7d7fdac602 service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:46.515158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:46.516381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:46.516670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:46.518230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] PATH_INFO: `/v3/users/8fc0387bfa7d476594a8e57da5340ef7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:46.519550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc0387bfa7d476594a8e57da5340ef7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:46.521817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:46.655887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc0387bfa7d476594a8e57da5340ef7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:46.671270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc0387bfa7d476594a8e57da5340ef7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:46.708071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc0387bfa7d476594a8e57da5340ef7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:46.709079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc0387bfa7d476594a8e57da5340ef7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:46.724449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcd826b8-7dcb-40bf-9b90-ed98a482d264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc0387bfa7d476594a8e57da5340ef7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:46.742610 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2075/4161] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:21:46 2022] DELETE /identity/v3/users/8fc0387bfa7d476594a8e57da5340ef7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:46.745623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:46.746902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:46.747344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:46.793107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:46.799449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:46.905990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e65e8e-2261-4433-8bc6-2d8890f91512 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:46.907061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e65e8e-2261-4433-8bc6-2d8890f91512 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:46.907454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e65e8e-2261-4433-8bc6-2d8890f91512 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:46.909288 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2076/4162] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:21:46.921167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:46.921627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:46.922010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:46.961839 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2087/4163] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:46.964563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:46.966430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:47.009915 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:47.014754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:47.019614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:47.131982 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:47.156213 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2077/4164] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:47.232810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0974-06aa-4483-b529-821a0131dbf4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:47.238247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:47.239114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:47.239537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:47.240029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:47.252008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:47.253796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:47.282117 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2088/4165] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:47.292320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:47.297879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:47.323753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe2eab-5951-402c-9fb2-4b3e16516d6d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:47.335760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:47.337584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:47.339198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:47.341261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:47.378212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:47.380175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:47.414388 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2078/4166] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:47.760800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:47.773050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcadd5-ab72-4bbf-83fa-2da733eeeece service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:47.780271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e180f9-4295-4d26-893f-e08cccaeba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:47.781433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e180f9-4295-4d26-893f-e08cccaeba4f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:47.781863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e180f9-4295-4d26-893f-e08cccaeba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:47.782288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e180f9-4295-4d26-893f-e08cccaeba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:47.784349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-39e180f9-4295-4d26-893f-e08cccaeba4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:47.882906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e180f9-4295-4d26-893f-e08cccaeba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:47.884406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e180f9-4295-4d26-893f-e08cccaeba4f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:47.900323 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2089/4167] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:48.305558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:48.307451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:48.348974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42a31-899f-4144-a2e5-6a537ec9e373 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:48.355824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:48.356558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:48.356875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:48.357214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] PATH_INFO: `/v3/projects/641b7e2d0207464b97bbbbe212fb605b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:48.358765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641b7e2d0207464b97bbbbe212fb605b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:48.361093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:48.427664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641b7e2d0207464b97bbbbe212fb605b', 'request_id': 'req-8e193dc3-ddf1-4981-ab39-ea1014770f60'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:48.436844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641b7e2d0207464b97bbbbe212fb605b', 'request_id': 'req-8e193dc3-ddf1-4981-ab39-ea1014770f60'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:48.444260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641b7e2d0207464b97bbbbe212fb605b', 'request_id': 'req-8e193dc3-ddf1-4981-ab39-ea1014770f60'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:48.480064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] The token cache is being invalidate because project 641b7e2d0207464b97bbbbe212fb605b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:21:48.480064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:48.480064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e193dc3-ddf1-4981-ab39-ea1014770f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:21:48.480064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2079/4168] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:21:48 2022] DELETE /identity/v3/projects/641b7e2d0207464b97bbbbe212fb605b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:21:48.487610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5e04-acfa-4aa6-a73a-878673e314f4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:48.487610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5e04-acfa-4aa6-a73a-878673e314f4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:48.487610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5e04-acfa-4aa6-a73a-878673e314f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:48.514153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d3f5e04-acfa-4aa6-a73a-878673e314f4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:48.515543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d3f5e04-acfa-4aa6-a73a-878673e314f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:48.637264 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2090/4169] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:48.642610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8b50f-75f9-45d4-ba2d-b38ae87c88fa None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:48.642893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8b50f-75f9-45d4-ba2d-b38ae87c88fa None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:48.643165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8b50f-75f9-45d4-ba2d-b38ae87c88fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:48.708510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-74a8b50f-75f9-45d4-ba2d-b38ae87c88fa None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:48.717827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-74a8b50f-75f9-45d4-ba2d-b38ae87c88fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:48.743892 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2080/4170] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:48.745884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5e04-acfa-4aa6-a73a-878673e314f4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:48.761992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5e04-acfa-4aa6-a73a-878673e314f4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:48.774522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:48.775317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:48.776433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:48.776919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:48.777707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:21:48.778112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:48.779915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:48.841186 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2091/4171] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:21:48.849069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8b50f-75f9-45d4-ba2d-b38ae87c88fa None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:48.873806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8b50f-75f9-45d4-ba2d-b38ae87c88fa None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:48.890692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:48.891648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:48.892279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:48.893062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:48.901461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:48.905336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:48.966461 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2081/4172] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:21:48 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:48.972142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:48.992415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10307ec6-84bf-4a8a-ad41-720cf99f4468 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:49.069793 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:49.087387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:49.088094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:49.088380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:49.088655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:49.089334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:49.091291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:49.117084 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2092/4173] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:21:48 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:21:49.120967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:49.178978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e57907-2ed7-4677-8acb-95c885f8880d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:49.190131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:49.191026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:49.192588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:49.193249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:49.194218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:49.196090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:49.210667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2082/4174] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:21:49.214483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:49.227571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658307bc-67ea-4543-bfac-2d2ff1b8affd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:49.237615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5a5f-ea36-46f1-895f-0a0065de5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:49.238271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5a5f-ea36-46f1-895f-0a0065de5dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:49.238546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5a5f-ea36-46f1-895f-0a0065de5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:49.238816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5a5f-ea36-46f1-895f-0a0065de5dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:49.248746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5a5f-ea36-46f1-895f-0a0065de5dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:49.248746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5a5f-ea36-46f1-895f-0a0065de5dfb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:49.265666 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2093/4175] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:21:49.269950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:49.282082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf8aa0-1877-4c60-a4d3-3687e320ba3c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:49.287420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:49.288283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:49.288566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:49.288862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] PATH_INFO: `/v3/projects/7e6168828fb949408d66c24c38352a85/users/2c4c1382b0174bf3a4123806bef8d01e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:49.308112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6168828fb949408d66c24c38352a85, user_id=2c4c1382b0174bf3a4123806bef8d01e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:49.312226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:49.336140 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2083/4176] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:21:49 2022] PUT /identity/v3/projects/7e6168828fb949408d66c24c38352a85/users/2c4c1382b0174bf3a4123806bef8d01e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:21:49.341240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3451-6014-40ce-8393-b204f1f974be None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:49.341603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3451-6014-40ce-8393-b204f1f974be None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:49.355571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3451-6014-40ce-8393-b204f1f974be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:49.381166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bbce3451-6014-40ce-8393-b204f1f974be None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:49.386207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bbce3451-6014-40ce-8393-b204f1f974be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:49.541589 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2094/4177] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:49.542378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:49.544239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:49.610354 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:49.635063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82891d2-c7a5-4175-acbb-622699cd00d8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:49.641346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:49.642073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:49.642414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:49.642747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:49.658736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:49.660361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:49.672020 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2084/4178] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:21:53.397141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e3bc-f3e0-48c9-a2e7-25de5a846bd9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:53.397831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e3bc-f3e0-48c9-a2e7-25de5a846bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:53.397831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e3bc-f3e0-48c9-a2e7-25de5a846bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:53.444471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f5f1e3bc-f3e0-48c9-a2e7-25de5a846bd9 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:53.447789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f5f1e3bc-f3e0-48c9-a2e7-25de5a846bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:53.587986 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2095/4179] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:53.668509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:53.670167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:53.772009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5cd31-9586-43cc-91c5-81f6bc4817a8 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:53.785651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:53.786851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:53.789379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:53.789887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:53.804371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:53.818413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:53.857268 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2085/4180] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:21:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:21:58.852134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e331ee-3fcd-4263-952e-58d3c6473ae8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:58.852730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e331ee-3fcd-4263-952e-58d3c6473ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:58.852730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e331ee-3fcd-4263-952e-58d3c6473ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:59.001219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-67e331ee-3fcd-4263-952e-58d3c6473ae8 None None] MFA Rules not processed for user `2c4c1382b0174bf3a4123806bef8d01e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:21:59.006262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-67e331ee-3fcd-4263-952e-58d3c6473ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:59.200069 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:59.209853 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2096/4181] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:21:59.233320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:21:59.236319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:21:59.335501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff72edd-a8b6-4a9c-b07d-4919755108b5 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:21:59.342898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acc83d-fb21-42a0-b990-234e62552dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:21:59.344191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc83d-fb21-42a0-b990-234e62552dea service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:21:59.344627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc83d-fb21-42a0-b990-234e62552dea service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:21:59.345086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc83d-fb21-42a0-b990-234e62552dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:21:59.355160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acc83d-fb21-42a0-b990-234e62552dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:21:59.358481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acc83d-fb21-42a0-b990-234e62552dea service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:21:59.371100 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2086/4182] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:21:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:02.600252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e331ee-3fcd-4263-952e-58d3c6473ae8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:02.676501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e331ee-3fcd-4263-952e-58d3c6473ae8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:02.699812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:02.702469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:02.702940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:02.703388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:02.711980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:02.757112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:02.776969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:02.842849 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2097/4183] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:05.469106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:05.470491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:05.470970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:05.501298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:05.505383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:05.641631 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:05.663783 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2087/4184] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:06.475348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:06.497070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e36a-e16a-48bd-b0f6-4f4c62b7d6a3 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:06.501432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:06.502300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:06.509039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:06.509593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:06.512537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:06.532332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:06.534110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:06.547990 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2098/4185] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:07.060167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:07.062583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:07.295672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796a8e9-dd2d-4987-9989-de298dbdad63 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:07.312355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea0d0a-be84-4cb9-94f5-9b65f555174f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:07.316295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea0d0a-be84-4cb9-94f5-9b65f555174f service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:07.316848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea0d0a-be84-4cb9-94f5-9b65f555174f service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:07.318159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea0d0a-be84-4cb9-94f5-9b65f555174f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:07.322648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-73ea0d0a-be84-4cb9-94f5-9b65f555174f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:07.359447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea0d0a-be84-4cb9-94f5-9b65f555174f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:07.361455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea0d0a-be84-4cb9-94f5-9b65f555174f service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:07.402064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2088/4186] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:07.608300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:07.609896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:07.642414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b80c1-d53f-4081-9d81-5c7e5e2120ff service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:07.653924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:07.654404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:07.654672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:07.654951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:07.657235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:07.684516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:07.691982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:07.746292 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2099/4187] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:07.870312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f799-32a8-47c4-ba0d-ef93328f5a0c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:07.870991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f799-32a8-47c4-ba0d-ef93328f5a0c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:07.871803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f799-32a8-47c4-ba0d-ef93328f5a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:07.940087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b090f799-32a8-47c4-ba0d-ef93328f5a0c None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:07.941104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:07.944256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b090f799-32a8-47c4-ba0d-ef93328f5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:07.954898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe52d-86e0-4a85-8452-c444cc432fa2 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:07.962995 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2089/4188] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:07.989848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:07.990482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:07.999506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:07.999851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:08.007306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:08.055566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:08.057776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:08.107334 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2100/4189] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:09.713391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f799-32a8-47c4-ba0d-ef93328f5a0c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:09.730039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f799-32a8-47c4-ba0d-ef93328f5a0c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:09.749323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:09.750174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:09.750582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:09.750919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] PATH_INFO: `/v3/users/2c4c1382b0174bf3a4123806bef8d01e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:09.752558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4c1382b0174bf3a4123806bef8d01e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:09.757729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:09.854719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4c1382b0174bf3a4123806bef8d01e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:09.875684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4c1382b0174bf3a4123806bef8d01e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:09.899145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4c1382b0174bf3a4123806bef8d01e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:09.899931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4c1382b0174bf3a4123806bef8d01e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:09.932416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bade2547-2d49-4e8e-a3e9-e3dbdbebcd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4c1382b0174bf3a4123806bef8d01e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:09.946888 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2090/4190] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:09 2022] DELETE /identity/v3/users/2c4c1382b0174bf3a4123806bef8d01e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:10.492371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:10.508499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfbee-3af5-4af5-a29a-14cc15da4179 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:10.697029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:10.697979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:10.698424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:10.698949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] PATH_INFO: `/v3/projects/7e6168828fb949408d66c24c38352a85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:10.700275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6168828fb949408d66c24c38352a85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:10.702913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:10.834629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6168828fb949408d66c24c38352a85', 'request_id': 'req-b810307d-4d0c-4ada-884b-5358eb28e431'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:10.852676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6168828fb949408d66c24c38352a85', 'request_id': 'req-b810307d-4d0c-4ada-884b-5358eb28e431'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:10.859281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6168828fb949408d66c24c38352a85', 'request_id': 'req-b810307d-4d0c-4ada-884b-5358eb28e431'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:10.882907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] The token cache is being invalidate because project 7e6168828fb949408d66c24c38352a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:10.884293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:10.886589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b810307d-4d0c-4ada-884b-5358eb28e431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:10.897723 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2101/4191] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:10 2022] DELETE /identity/v3/projects/7e6168828fb949408d66c24c38352a85 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:10.899474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b6c64-87c0-411f-8624-c0142301ab64 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:10.899976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b6c64-87c0-411f-8624-c0142301ab64 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:10.900339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b6c64-87c0-411f-8624-c0142301ab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:10.972627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3c8b6c64-87c0-411f-8624-c0142301ab64 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:10.981330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3c8b6c64-87c0-411f-8624-c0142301ab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:11.171466 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:11.195121 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2091/4192] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:11.203760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352781-24b9-4f23-8014-2fbfbfa3d90b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.204262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352781-24b9-4f23-8014-2fbfbfa3d90b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.204724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352781-24b9-4f23-8014-2fbfbfa3d90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:11.251757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-47352781-24b9-4f23-8014-2fbfbfa3d90b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:11.253590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47352781-24b9-4f23-8014-2fbfbfa3d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:11.285773 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2102/4193] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:11.287830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b6c64-87c0-411f-8624-c0142301ab64 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:11.302592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b6c64-87c0-411f-8624-c0142301ab64 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:11.318904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:11.319470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.323515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.324029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:11.328796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:11.329547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:11.334178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:11.377968 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2092/4194] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:11.380219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47352781-24b9-4f23-8014-2fbfbfa3d90b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:11.395620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47352781-24b9-4f23-8014-2fbfbfa3d90b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:11.411864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:11.412610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.412996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.413471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:11.414360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:11.416565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:11.472716 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2103/4195] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:11 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:11.476935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:11.497628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9222a27-ab93-4c2d-a294-1f84e79e0a85 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:11.651886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:11.652993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.653379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.653790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:11.654488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:11.656490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:11.705999 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2093/4196] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:11 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:11.717191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:11.729177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb764e21-497d-4ad5-a0ea-47a9e89798c5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:11.737116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:11.738195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.738460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.738734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:11.739391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:11.741042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:11.742894 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:11.762601 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2104/4197] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:11.764500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:11.786141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8e0b-1013-4d8c-87bf-21a19a529086 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:11.798511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc8989-f943-494b-aae7-7844f67b381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:11.800795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8989-f943-494b-aae7-7844f67b381f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.801402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8989-f943-494b-aae7-7844f67b381f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.801691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8989-f943-494b-aae7-7844f67b381f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:11.804175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc8989-f943-494b-aae7-7844f67b381f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:11.818642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc8989-f943-494b-aae7-7844f67b381f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:11.840423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:11.844438 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2094/4198] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:22:11.855611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f9c2e-8e04-43e3-8482-b21ade61c884 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:11.868176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f275d4f-e37d-48e3-9192-91cc381e073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:11.868976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f275d4f-e37d-48e3-9192-91cc381e073b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.869258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f275d4f-e37d-48e3-9192-91cc381e073b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.869506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f275d4f-e37d-48e3-9192-91cc381e073b admin admin] PATH_INFO: `/v3/projects/1b9ebbd02c41420083631ba591536d53/users/6f1301aa097942a2a4309911a00bf511/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:11.898345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f275d4f-e37d-48e3-9192-91cc381e073b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9ebbd02c41420083631ba591536d53, user_id=6f1301aa097942a2a4309911a00bf511, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:11.905953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f275d4f-e37d-48e3-9192-91cc381e073b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:11.940790 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2105/4199] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:11 2022] PUT /identity/v3/projects/1b9ebbd02c41420083631ba591536d53/users/6f1301aa097942a2a4309911a00bf511/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:11.952380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:11.953007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:11.953007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:12.025911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] MFA Rules not processed for user `6f1301aa097942a2a4309911a00bf511`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:12.027295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:12.213190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2095/4200] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:12.215825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:12.216129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:12.216639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:12.268554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] MFA Rules not processed for user `6f1301aa097942a2a4309911a00bf511`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:12.283960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:12.307087 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2106/4201] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:12.318653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:12.320539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:12.450283 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:12.491446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117953d5-05f2-44eb-96de-5a57521b8f26 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:12.500164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:12.501326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:12.501326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:12.501817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:12.522692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:12.524980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:12.543521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2096/4202] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:15.473371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:15.478731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:15.611793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e44a68-5dd3-427e-8124-44cc804ef432 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:15.618296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:15.619299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:15.621935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:15.622578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] PATH_INFO: `/v3/users/302454d9f56c4899895e341b0ddc6e1a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:15.624485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302454d9f56c4899895e341b0ddc6e1a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:15.627172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:15.722907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302454d9f56c4899895e341b0ddc6e1a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:15.760118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302454d9f56c4899895e341b0ddc6e1a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:15.767897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302454d9f56c4899895e341b0ddc6e1a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:15.791193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302454d9f56c4899895e341b0ddc6e1a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:15.796961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c9dccd7b-f1e8-4858-bfd5-83a66aef86d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302454d9f56c4899895e341b0ddc6e1a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:15.847924 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2107/4203] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:15 2022] DELETE /identity/v3/users/302454d9f56c4899895e341b0ddc6e1a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:16.228078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:16.255579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b57b5-0745-43eb-8ad2-db599516b544 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:16.409459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:16.410213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:16.410490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:16.411597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] PATH_INFO: `/v3/projects/16542ba8c29e4ed0a5565945c0f87334` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:16.413380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16542ba8c29e4ed0a5565945c0f87334)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:16.416430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:16.500402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16542ba8c29e4ed0a5565945c0f87334', 'request_id': 'req-8f9c802b-32b7-49b4-9391-2a264b03d597'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:16.511782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16542ba8c29e4ed0a5565945c0f87334', 'request_id': 'req-8f9c802b-32b7-49b4-9391-2a264b03d597'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:16.519939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16542ba8c29e4ed0a5565945c0f87334', 'request_id': 'req-8f9c802b-32b7-49b4-9391-2a264b03d597'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:16.543376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] The token cache is being invalidate because project 16542ba8c29e4ed0a5565945c0f87334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:16.543687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:16.545103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f9c802b-32b7-49b4-9391-2a264b03d597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:16.551907 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2097/4204] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:16 2022] DELETE /identity/v3/projects/16542ba8c29e4ed0a5565945c0f87334 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:16.554550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbebb6a-58e1-4736-bbb0-2882d4643d6e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:16.555147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbebb6a-58e1-4736-bbb0-2882d4643d6e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:16.555147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbebb6a-58e1-4736-bbb0-2882d4643d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:16.592852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9bbebb6a-58e1-4736-bbb0-2882d4643d6e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:16.592852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9bbebb6a-58e1-4736-bbb0-2882d4643d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:16.662580 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:16.715081 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2108/4205] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:16.717641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8852f2-5b09-4f8f-9b75-973f08a650cb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:16.718139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8852f2-5b09-4f8f-9b75-973f08a650cb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:16.718635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8852f2-5b09-4f8f-9b75-973f08a650cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:16.740401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1d8852f2-5b09-4f8f-9b75-973f08a650cb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:16.742037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d8852f2-5b09-4f8f-9b75-973f08a650cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:16.757973 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2098/4206] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:16.761872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbebb6a-58e1-4736-bbb0-2882d4643d6e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:16.781722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbebb6a-58e1-4736-bbb0-2882d4643d6e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:16.788193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:16.789570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:16.790238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:16.790748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:16.791832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:16.792236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:16.794873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:16.812868 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2109/4207] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:16.815884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8852f2-5b09-4f8f-9b75-973f08a650cb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:16.835496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8852f2-5b09-4f8f-9b75-973f08a650cb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:16.841349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:16.842611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:16.843160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:16.843649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:16.844745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:16.847278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:16.930437 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2099/4208] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:16.935371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:16.948731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e704acf-8f68-44d0-a82c-2561665b81a1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:17.029801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:17.030547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:17.030892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:17.031235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:17.031931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:17.033968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:17.115867 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2110/4209] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:16 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:17.116121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:17.146058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664665-a20b-468c-b6bd-638c59933156 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:17.170362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:17.171166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:17.171549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:17.173064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:17.173847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:17.175617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:17.218783 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2100/4210] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:17.219552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:17.250507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236855a7-d629-416e-b15d-b4224ef9c6ce admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:17.266083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbe888-2a9d-4e49-83f0-99341da47eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:17.266790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe888-2a9d-4e49-83f0-99341da47eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:17.267075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe888-2a9d-4e49-83f0-99341da47eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:17.267349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe888-2a9d-4e49-83f0-99341da47eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:17.268010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbe888-2a9d-4e49-83f0-99341da47eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:17.269676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbe888-2a9d-4e49-83f0-99341da47eb7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:17.290222 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2111/4211] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:17.291505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:17.306551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c39cc-b422-402a-aa37-44efc4f26781 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:17.323215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74a3d5-f67c-49bf-b42e-7090a86fbb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:17.324011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74a3d5-f67c-49bf-b42e-7090a86fbb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:17.324393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74a3d5-f67c-49bf-b42e-7090a86fbb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:17.324864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74a3d5-f67c-49bf-b42e-7090a86fbb25 admin admin] PATH_INFO: `/v3/projects/f08ff6e2e16345dc9f733f6fc859aca1/users/78818dfe8e5b42dd84c49fc5bb2804b1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:17.359809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74a3d5-f67c-49bf-b42e-7090a86fbb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08ff6e2e16345dc9f733f6fc859aca1, user_id=78818dfe8e5b42dd84c49fc5bb2804b1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:17.362704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74a3d5-f67c-49bf-b42e-7090a86fbb25 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:17.399834 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2101/4212] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:17 2022] PUT /identity/v3/projects/f08ff6e2e16345dc9f733f6fc859aca1/users/78818dfe8e5b42dd84c49fc5bb2804b1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:17.410999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:17.411937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:17.412241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:17.479494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] MFA Rules not processed for user `78818dfe8e5b42dd84c49fc5bb2804b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:17.482185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:17.686587 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2112/4213] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:17.698465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195de0ed-f8f9-445f-b140-044ae79ad408 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:17.699060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195de0ed-f8f9-445f-b140-044ae79ad408 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:17.699393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195de0ed-f8f9-445f-b140-044ae79ad408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:17.710701 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:17.730776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-195de0ed-f8f9-445f-b140-044ae79ad408 None None] MFA Rules not processed for user `78818dfe8e5b42dd84c49fc5bb2804b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:17.732190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-195de0ed-f8f9-445f-b140-044ae79ad408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:17.744406 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2102/4214] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:17.751384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:17.752878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:17.839139 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:17.890134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fe9f-6c7a-47da-a27d-7a0090f72499 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:17.890134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefe197-35c9-4f8d-a78e-61e3b87d967c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:17.890134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefe197-35c9-4f8d-a78e-61e3b87d967c service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:17.890134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefe197-35c9-4f8d-a78e-61e3b87d967c service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:17.890712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefe197-35c9-4f8d-a78e-61e3b87d967c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:17.896596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefe197-35c9-4f8d-a78e-61e3b87d967c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:17.898655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefe197-35c9-4f8d-a78e-61e3b87d967c service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:17.921195 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2113/4215] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:18.120315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195de0ed-f8f9-445f-b140-044ae79ad408 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:18.157971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195de0ed-f8f9-445f-b140-044ae79ad408 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:18.179748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8816b4-1f73-40ea-8448-09caded19142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:18.182188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8816b4-1f73-40ea-8448-09caded19142 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:18.185278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8816b4-1f73-40ea-8448-09caded19142 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:18.186076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8816b4-1f73-40ea-8448-09caded19142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:18.192616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9e8816b4-1f73-40ea-8448-09caded19142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:18.358755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8816b4-1f73-40ea-8448-09caded19142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:18.360533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8816b4-1f73-40ea-8448-09caded19142 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:18.373175 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2103/4216] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:18.417698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:18.417978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:18.418252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:18.447227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] MFA Rules not processed for user `78818dfe8e5b42dd84c49fc5bb2804b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:18.450037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:18.479804 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2114/4217] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:21.735567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:21.736154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:21.736154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:21.758646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] MFA Rules not processed for user `722940af11854f0687e7c99fae3650a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:21.760093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:21.769418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2104/4218] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:22.816668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:22.818910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:22.922674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371f83-b1d4-454e-ba86-baa32849fe50 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:22.927292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7225971-5f56-46c4-b9a6-0c6b85bb6912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:22.928031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7225971-5f56-46c4-b9a6-0c6b85bb6912 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:22.928418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7225971-5f56-46c4-b9a6-0c6b85bb6912 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:22.928805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7225971-5f56-46c4-b9a6-0c6b85bb6912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:22.931522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e7225971-5f56-46c4-b9a6-0c6b85bb6912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:22.944910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7225971-5f56-46c4-b9a6-0c6b85bb6912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:22.946988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7225971-5f56-46c4-b9a6-0c6b85bb6912 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:22.958779 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2115/4219] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:23.265564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:23.270107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:23.345707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311aca8-a22e-4b29-926b-02de399c8865 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:23.350532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:23.351289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:23.351628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:23.351958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] PATH_INFO: `/v3/users/4d84c723d2d64286a6d9445ee2244af4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:23.353199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d84c723d2d64286a6d9445ee2244af4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:23.355189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:23.409334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d84c723d2d64286a6d9445ee2244af4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:23.418056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d84c723d2d64286a6d9445ee2244af4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:23.431315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d84c723d2d64286a6d9445ee2244af4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:23.432043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d84c723d2d64286a6d9445ee2244af4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:23.439607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d84c723d2d64286a6d9445ee2244af4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:23.445929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2105/4220] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:23 2022] DELETE /identity/v3/users/4d84c723d2d64286a6d9445ee2244af4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:23.450658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:23.450999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:23.451270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:23.469739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:23.470942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:23.540284 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2116/4221] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:23.551446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:23.553153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:23.566512 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:23.637296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e945-28dd-4c32-9815-e528703906fb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:23.642637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e612-f07a-46b8-aab2-44956e7070e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:23.644200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e612-f07a-46b8-aab2-44956e7070e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:23.644697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e612-f07a-46b8-aab2-44956e7070e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:23.645191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e612-f07a-46b8-aab2-44956e7070e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:23.664888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9e612-f07a-46b8-aab2-44956e7070e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:23.666197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9e612-f07a-46b8-aab2-44956e7070e3 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:23.679309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2106/4222] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:23.930428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:23.931910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:23.960651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad7fe-7c4e-4ac7-91d6-9a2b05839912 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:23.973241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075f66-16eb-4346-b510-83118094902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:23.974083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075f66-16eb-4346-b510-83118094902f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:23.974302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075f66-16eb-4346-b510-83118094902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:23.974785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075f66-16eb-4346-b510-83118094902f admin admin] PATH_INFO: `/v3/projects/096fe2e72b39403f8565d377cd7151ae` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:23.977070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075f66-16eb-4346-b510-83118094902f admin admin] RBAC: Authorizing `identity:delete_project(project_id=096fe2e72b39403f8565d377cd7151ae)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:23.979024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075f66-16eb-4346-b510-83118094902f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:23.998367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:23.998679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.000099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.040189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:24.041472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:24.065056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-94075f66-16eb-4346-b510-83118094902f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096fe2e72b39403f8565d377cd7151ae', 'request_id': 'req-94075f66-16eb-4346-b510-83118094902f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:24.077960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-94075f66-16eb-4346-b510-83118094902f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096fe2e72b39403f8565d377cd7151ae', 'request_id': 'req-94075f66-16eb-4346-b510-83118094902f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:24.081749 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:24.086703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-94075f66-16eb-4346-b510-83118094902f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096fe2e72b39403f8565d377cd7151ae', 'request_id': 'req-94075f66-16eb-4346-b510-83118094902f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:24.111663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-94075f66-16eb-4346-b510-83118094902f admin admin] The token cache is being invalidate because project 096fe2e72b39403f8565d377cd7151ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:24.112342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-94075f66-16eb-4346-b510-83118094902f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:24.113772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-94075f66-16eb-4346-b510-83118094902f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:24.118969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2117/4223] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:23 2022] DELETE /identity/v3/projects/096fe2e72b39403f8565d377cd7151ae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:24.121452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82b4da-d436-4838-9c07-757b57f03c7b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.121987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82b4da-d436-4838-9c07-757b57f03c7b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.122534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82b4da-d436-4838-9c07-757b57f03c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.124468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2107/4224] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:22:24.156687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:24.157436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-be82b4da-d436-4838-9c07-757b57f03c7b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:24.158702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-be82b4da-d436-4838-9c07-757b57f03c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:24.161327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:24.257515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c953-b59c-41e9-8bd1-deeae7028cb1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:24.264413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2118/4225] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:24.266375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61fd8-9981-40d2-80d1-48e86caf7965 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.266760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61fd8-9981-40d2-80d1-48e86caf7965 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.266911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61fd8-9981-40d2-80d1-48e86caf7965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.288371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-30a61fd8-9981-40d2-80d1-48e86caf7965 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:24.290496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30a61fd8-9981-40d2-80d1-48e86caf7965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:24.302102 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2119/4226] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:24.305376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a61fd8-9981-40d2-80d1-48e86caf7965 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:24.316157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a61fd8-9981-40d2-80d1-48e86caf7965 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:24.319997 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:24.321354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:24.321933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.322301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.323367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.323367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:24.323664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:24.325408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:24.332973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:24.333689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.334051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.334412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.337594 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2120/4227] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:22:24.343063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:24.354055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074461a-e925-4233-b54f-86fe08dca47e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:24.359229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:24.359837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.360113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.360383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.361099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:24.362994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:24.400798 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2121/4228] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:24 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:22:24.403619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:24.416090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:24.417883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:24.428109 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2108/4229] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:22:24.488933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab21b6-b601-4134-b359-0302ebdcde92 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:24.494372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:24.495122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.495411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.495743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.496503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:24.498634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:24.534043 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2122/4230] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:24 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:22:24.538174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:24.554560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dd8d-6928-44d0-8da3-95ee0e7b6fe5 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:24.566350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:24.567784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.568863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.569947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.571641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:24.573681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:24.600262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2109/4231] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:22:24.604631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:24.618727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94ab66-19e8-41be-ab0d-122eef598dee admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:24.633950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede850-97d4-4b23-a867-f5f6dea21e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:24.634754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede850-97d4-4b23-a867-f5f6dea21e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.635030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede850-97d4-4b23-a867-f5f6dea21e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.635987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede850-97d4-4b23-a867-f5f6dea21e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.638439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede850-97d4-4b23-a867-f5f6dea21e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:24.643321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede850-97d4-4b23-a867-f5f6dea21e72 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:24.668615 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2123/4232] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:24.673289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:24.687172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d431-565c-4182-9dde-13e2f8d39501 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:24.703432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:24.704137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.704424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.707020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] PATH_INFO: `/v3/projects/184c6923642c4850ba30b4d24f164e5b/users/b3abd4b022584de79d4e399fe4cbfc94/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.772244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184c6923642c4850ba30b4d24f164e5b, user_id=b3abd4b022584de79d4e399fe4cbfc94, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:24.781412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:24.828719 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2110/4233] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:24 2022] PUT /identity/v3/projects/184c6923642c4850ba30b4d24f164e5b/users/b3abd4b022584de79d4e399fe4cbfc94/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:22:24.842653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:24.844057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:24.844716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:24.916103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] MFA Rules not processed for user `b3abd4b022584de79d4e399fe4cbfc94`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:24.917828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:24.930362 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:25.045861 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2124/4234] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:25.059201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:25.061225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:25.253277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4295a-af04-42e0-93f1-b99775f91632 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:25.264067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:25.264956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:25.265328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:25.265727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:25.287818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:25.290269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:25.329392 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2111/4235] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:25.553928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:25.555473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:25.779293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745ab92-fd96-4000-94d4-1b91dc763e07 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:25.789464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2359a85-d589-4d47-9855-3df6fd29b1fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:25.790969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2359a85-d589-4d47-9855-3df6fd29b1fc service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:25.791494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2359a85-d589-4d47-9855-3df6fd29b1fc service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:25.792162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2359a85-d589-4d47-9855-3df6fd29b1fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:25.798868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d2359a85-d589-4d47-9855-3df6fd29b1fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:25.822372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2359a85-d589-4d47-9855-3df6fd29b1fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:25.825562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2359a85-d589-4d47-9855-3df6fd29b1fc service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:25.846568 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2125/4236] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:32.524208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:32.600891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c37b-086f-4747-bd13-36fc42ae50c5 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:32.605680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:32.606686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:32.607001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:32.607129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] PATH_INFO: `/v3/users/b3abd4b022584de79d4e399fe4cbfc94` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:32.608466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3abd4b022584de79d4e399fe4cbfc94)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:32.610580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:32.618248 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:32.670264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3abd4b022584de79d4e399fe4cbfc94'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:32.682346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3abd4b022584de79d4e399fe4cbfc94'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:32.697676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3abd4b022584de79d4e399fe4cbfc94'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:32.698587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3abd4b022584de79d4e399fe4cbfc94'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:32.711726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3abd4b022584de79d4e399fe4cbfc94'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:32.719393 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2112/4237] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:32 2022] DELETE /identity/v3/users/b3abd4b022584de79d4e399fe4cbfc94 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:32.723973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:32.724487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:32.724487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:32.747561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:32.748829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:32.814701 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2126/4238] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:32.824594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:32.826292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:32.887290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13e9cc-f8c6-44f4-98d8-82d4bc17102e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:32.891494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546f346-bb98-4c00-9520-1883b742acb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:32.892271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546f346-bb98-4c00-9520-1883b742acb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:32.892548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546f346-bb98-4c00-9520-1883b742acb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:32.894195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546f346-bb98-4c00-9520-1883b742acb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:32.902871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546f346-bb98-4c00-9520-1883b742acb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:32.904614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546f346-bb98-4c00-9520-1883b742acb6 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:32.915479 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2113/4239] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:33.127180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.129046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:33.142932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8ec3-f122-4d94-be87-517ea4650026 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:33.148408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:33.149111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.149389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.149660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] PATH_INFO: `/v3/projects/184c6923642c4850ba30b4d24f164e5b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.150916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] RBAC: Authorizing `identity:delete_project(project_id=184c6923642c4850ba30b4d24f164e5b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:33.152867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:33.193932 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:33.209113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184c6923642c4850ba30b4d24f164e5b', 'request_id': 'req-ab709174-1e25-40a9-a564-80551d14497b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:33.218203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184c6923642c4850ba30b4d24f164e5b', 'request_id': 'req-ab709174-1e25-40a9-a564-80551d14497b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:33.224538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184c6923642c4850ba30b4d24f164e5b', 'request_id': 'req-ab709174-1e25-40a9-a564-80551d14497b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:33.236376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] The token cache is being invalidate because project 184c6923642c4850ba30b4d24f164e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:33.236666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:33.237362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ab709174-1e25-40a9-a564-80551d14497b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:33.238901 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2127/4240] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:33 2022] DELETE /identity/v3/projects/184c6923642c4850ba30b4d24f164e5b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:33.243900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a7c28-4acf-4e9e-8587-e1d9ec840a04 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.244184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a7c28-4acf-4e9e-8587-e1d9ec840a04 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.244479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a7c28-4acf-4e9e-8587-e1d9ec840a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.267290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3a0a7c28-4acf-4e9e-8587-e1d9ec840a04 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:33.268505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3a0a7c28-4acf-4e9e-8587-e1d9ec840a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:33.330567 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2114/4241] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:33.338370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528736e-80d0-44dc-9c58-9b79cd7b5a88 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.338761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528736e-80d0-44dc-9c58-9b79cd7b5a88 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.338916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528736e-80d0-44dc-9c58-9b79cd7b5a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.363447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8528736e-80d0-44dc-9c58-9b79cd7b5a88 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:33.364996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8528736e-80d0-44dc-9c58-9b79cd7b5a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:33.374113 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2128/4242] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:33.378872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a7c28-4acf-4e9e-8587-e1d9ec840a04 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.390909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a7c28-4acf-4e9e-8587-e1d9ec840a04 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:33.396102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:33.396720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.397032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.397303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.397958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:33.398264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:33.399860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:33.415390 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2115/4243] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:33.418245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528736e-80d0-44dc-9c58-9b79cd7b5a88 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.428079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528736e-80d0-44dc-9c58-9b79cd7b5a88 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:33.433449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:33.434059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.434340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.434668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.435386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:33.437632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:33.475046 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2129/4244] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:33 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:33.480375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.495201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5db4d-0c2b-444b-8c9d-13d463c4d2c4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:33.511818 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:33.574568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:33.575360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.575486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.575704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.576331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:33.578335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:33.605134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2116/4245] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:33 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:33.610278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.624274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c629d2d-9a03-4aa6-936b-2afd04f39dbd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:33.630145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:33.631055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.631341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.631611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.632438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:33.634582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:33.653915 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2130/4246] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:33.656012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.667829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccff87-dd6a-4571-8f59-d228923ad9e1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:33.675901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de98cd-0259-4798-9c5f-dc1d29f9b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:33.677073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de98cd-0259-4798-9c5f-dc1d29f9b911 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.677598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de98cd-0259-4798-9c5f-dc1d29f9b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.677947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de98cd-0259-4798-9c5f-dc1d29f9b911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.678632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de98cd-0259-4798-9c5f-dc1d29f9b911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:33.681476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de98cd-0259-4798-9c5f-dc1d29f9b911 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:33.699755 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2117/4247] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:33.703932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.715877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c581d9-4a5d-432c-b9ca-081a300e1c9a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:33.721181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:33.721892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.722166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.722432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] PATH_INFO: `/v3/projects/65096e09f0424a9eb796cf2bc57f6de0/users/722db73c14ed4fee9762e3e1356fea62/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.744970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=65096e09f0424a9eb796cf2bc57f6de0, user_id=722db73c14ed4fee9762e3e1356fea62, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:33.749345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:33.767452 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2131/4248] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:33 2022] PUT /identity/v3/projects/65096e09f0424a9eb796cf2bc57f6de0/users/722db73c14ed4fee9762e3e1356fea62/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:33.780083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f823-03a8-4ecb-831e-1fc1e998b866 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:33.780688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f823-03a8-4ecb-831e-1fc1e998b866 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:33.780995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f823-03a8-4ecb-831e-1fc1e998b866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:33.816029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d980f823-03a8-4ecb-831e-1fc1e998b866 None None] MFA Rules not processed for user `722db73c14ed4fee9762e3e1356fea62`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:33.817282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d980f823-03a8-4ecb-831e-1fc1e998b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:33.899346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2118/4249] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:33.923283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:33.925347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:34.000369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3711-afeb-4497-9915-5385c006d1fb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:34.012460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25d322-fed2-4921-b0d4-f6a2be1ab75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:34.013503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25d322-fed2-4921-b0d4-f6a2be1ab75d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:34.013913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25d322-fed2-4921-b0d4-f6a2be1ab75d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:34.014223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25d322-fed2-4921-b0d4-f6a2be1ab75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:34.024746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25d322-fed2-4921-b0d4-f6a2be1ab75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:34.027351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25d322-fed2-4921-b0d4-f6a2be1ab75d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:34.045014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2132/4250] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:34.062612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f823-03a8-4ecb-831e-1fc1e998b866 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:34.154979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f823-03a8-4ecb-831e-1fc1e998b866 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:34.163437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:34.165437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:34.165852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:34.166135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] PATH_INFO: `/v3/users/722db73c14ed4fee9762e3e1356fea62` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:34.167387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722db73c14ed4fee9762e3e1356fea62)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:34.170339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:34.214516 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:34.243482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722db73c14ed4fee9762e3e1356fea62'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:34.254000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722db73c14ed4fee9762e3e1356fea62'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:34.283116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722db73c14ed4fee9762e3e1356fea62'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:34.284520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722db73c14ed4fee9762e3e1356fea62'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:34.297411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722db73c14ed4fee9762e3e1356fea62'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:34.306626 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2119/4251] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:34 2022] DELETE /identity/v3/users/722db73c14ed4fee9762e3e1356fea62 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:34.313024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:34.313322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:34.313583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:34.334832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:34.336072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:34.407516 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:34.420589 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2133/4252] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:22:34.431418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:34.433067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:34.516950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52c9d1-6380-4347-9bd4-d69219341f51 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:34.522145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b6a87-a263-44d9-a7de-972f62dfce5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:34.522762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6a87-a263-44d9-a7de-972f62dfce5c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:34.523045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6a87-a263-44d9-a7de-972f62dfce5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:34.523318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6a87-a263-44d9-a7de-972f62dfce5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:34.535221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b6a87-a263-44d9-a7de-972f62dfce5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:34.536689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b6a87-a263-44d9-a7de-972f62dfce5c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:34.548479 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2120/4253] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:34.959501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:34.961410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:34.977724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1495-6a80-4d4a-bff6-bfa16319d27b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:34.982882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:34.983561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:34.984526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:34.984881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] PATH_INFO: `/v3/projects/65096e09f0424a9eb796cf2bc57f6de0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:34.986481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65096e09f0424a9eb796cf2bc57f6de0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:34.988980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.042639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65096e09f0424a9eb796cf2bc57f6de0', 'request_id': 'req-e46c76b4-9031-4d78-81fc-106ced713494'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:35.051753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65096e09f0424a9eb796cf2bc57f6de0', 'request_id': 'req-e46c76b4-9031-4d78-81fc-106ced713494'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:35.058799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65096e09f0424a9eb796cf2bc57f6de0', 'request_id': 'req-e46c76b4-9031-4d78-81fc-106ced713494'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:35.072744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] The token cache is being invalidate because project 65096e09f0424a9eb796cf2bc57f6de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:35.073129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:35.073865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e46c76b4-9031-4d78-81fc-106ced713494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:35.075785 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2134/4254] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:34 2022] DELETE /identity/v3/projects/65096e09f0424a9eb796cf2bc57f6de0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:35.080972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d2b7-a531-4de0-bcb4-1e137ad4f243 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.081529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d2b7-a531-4de0-bcb4-1e137ad4f243 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.081723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d2b7-a531-4de0-bcb4-1e137ad4f243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.102938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0bf8d2b7-a531-4de0-bcb4-1e137ad4f243 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:35.104193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0bf8d2b7-a531-4de0-bcb4-1e137ad4f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:35.177731 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2121/4255] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:35.185736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fbef-72db-4e2a-9b35-bed26fba5389 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.186014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fbef-72db-4e2a-9b35-bed26fba5389 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.186286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fbef-72db-4e2a-9b35-bed26fba5389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.207687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5231fbef-72db-4e2a-9b35-bed26fba5389 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:35.208956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5231fbef-72db-4e2a-9b35-bed26fba5389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:35.217724 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2135/4256] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:35.222735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d2b7-a531-4de0-bcb4-1e137ad4f243 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.234187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d2b7-a531-4de0-bcb4-1e137ad4f243 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.241823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.242752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.243207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.243476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.244158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:35.244459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.246145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.259160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2122/4257] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:35.263807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231fbef-72db-4e2a-9b35-bed26fba5389 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.273539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231fbef-72db-4e2a-9b35-bed26fba5389 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.278541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.278912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.279196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.279476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.280131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.282082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.316081 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2136/4258] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:35 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:22:35.320621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.331152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276f92c-4900-48fc-aa64-851752efe802 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.360230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.362045 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:35.362356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:35.394253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.394860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.395141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.395442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.396198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.398243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.424524 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2123/4259] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:35 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:35.425698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.436257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80e83-a1bc-4abf-aeb1-56434ec5efb0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.436960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde6447-c8bc-4709-9ab7-9c486c42658a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.441232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6773167-d448-4e2b-8c31-e8d689e0e118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.442100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6773167-d448-4e2b-8c31-e8d689e0e118 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.442387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6773167-d448-4e2b-8c31-e8d689e0e118 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.442545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.442670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6773167-d448-4e2b-8c31-e8d689e0e118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.443137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.443417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.443711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.444379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.444666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c6773167-d448-4e2b-8c31-e8d689e0e118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:35.446134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.458648 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2124/4260] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:35.462701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.472651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0d84f-b914-4100-9f5e-98fdec2a44b1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.478659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.479706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.479706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.480121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.480853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.483171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.498122 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2125/4261] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:22:35.499783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.510339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64a77-4347-4cc8-813c-a3d219914b90 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.510585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6773167-d448-4e2b-8c31-e8d689e0e118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.512034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6773167-d448-4e2b-8c31-e8d689e0e118 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.516064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.516946 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:35.517644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.518137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.518368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] PATH_INFO: `/v3/projects/dac58bead76d48268dd8bad0f3589d9f/users/8d6d12777df649f58b9e2b9f31a18a24/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.534920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac58bead76d48268dd8bad0f3589d9f, user_id=8d6d12777df649f58b9e2b9f31a18a24, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.538228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.540573 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2137/4262] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:35.552651 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2126/4263] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:35 2022] PUT /identity/v3/projects/dac58bead76d48268dd8bad0f3589d9f/users/8d6d12777df649f58b9e2b9f31a18a24/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:35.563811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bba40-4a04-48f8-926b-b3d73b1dcb6b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.564113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bba40-4a04-48f8-926b-b3d73b1dcb6b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.564556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bba40-4a04-48f8-926b-b3d73b1dcb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.593586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8e6bba40-4a04-48f8-926b-b3d73b1dcb6b None None] MFA Rules not processed for user `8d6d12777df649f58b9e2b9f31a18a24`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:35.594811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8e6bba40-4a04-48f8-926b-b3d73b1dcb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:35.677207 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2138/4264] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:35.682010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.756264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759138e-248d-443e-8ca3-0bf6781a6b61 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.761867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.762493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.763695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.763695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.764120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.766095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.800677 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2127/4265] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:35 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:22:35.802506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bba40-4a04-48f8-926b-b3d73b1dcb6b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.816661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bba40-4a04-48f8-926b-b3d73b1dcb6b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.899901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.900927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.901352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.901624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.902279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.904820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.932555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2139/4266] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:35 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:35.933916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.945921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e264f61-56f9-4f57-9aa3-5ed96a47e317 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.951029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.951645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.951924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.952182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:35.952928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:35.954720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:35.966940 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2128/4267] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:35.971519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:35.982855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb923-1942-4872-a0f8-368e9398e033 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:35.989715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:35.990521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:35.990858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:35.991189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] PATH_INFO: `/v3/projects/4290f77cad36444eb40d78a29baf1283/users/1e26fa87f4274eaa8f867ec4fd951ad5/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:36.008475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4290f77cad36444eb40d78a29baf1283, user_id=1e26fa87f4274eaa8f867ec4fd951ad5, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:36.013069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:36.027940 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2140/4268] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:35 2022] PUT /identity/v3/projects/4290f77cad36444eb40d78a29baf1283/users/1e26fa87f4274eaa8f867ec4fd951ad5/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:36.032535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:36.043621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947617-0abc-4ef3-a2a5-cea8af43fa04 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:36.095155 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:36.106283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff649e6-9b7f-4531-b1da-18463373e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:36.107393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff649e6-9b7f-4531-b1da-18463373e67b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:36.107540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff649e6-9b7f-4531-b1da-18463373e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:36.107785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff649e6-9b7f-4531-b1da-18463373e67b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:36.108546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff649e6-9b7f-4531-b1da-18463373e67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:36.110082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff649e6-9b7f-4531-b1da-18463373e67b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:36.120445 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2129/4269] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:36.125244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:36.144542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3f1d-14f2-4c25-bce4-d77b934394e7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:36.151826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:36.152535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:36.152822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:36.153101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] PATH_INFO: `/v3/projects/4290f77cad36444eb40d78a29baf1283/users/1e26fa87f4274eaa8f867ec4fd951ad5/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:36.156211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4290f77cad36444eb40d78a29baf1283, user_id=1e26fa87f4274eaa8f867ec4fd951ad5, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:36.159095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:36.171002 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2141/4270] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:36 2022] PUT /identity/v3/projects/4290f77cad36444eb40d78a29baf1283/users/1e26fa87f4274eaa8f867ec4fd951ad5/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:36.183041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750f26-1f6d-4f04-bde9-38dd7a48c2d0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:36.183321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750f26-1f6d-4f04-bde9-38dd7a48c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:36.183587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750f26-1f6d-4f04-bde9-38dd7a48c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:36.212094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-81750f26-1f6d-4f04-bde9-38dd7a48c2d0 None None] MFA Rules not processed for user `1e26fa87f4274eaa8f867ec4fd951ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:36.213537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-81750f26-1f6d-4f04-bde9-38dd7a48c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:36.286646 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2130/4271] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:36.299032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:36.347347 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:36.374463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff2e09-093e-4648-a2a8-93e28884f618 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:36.378253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915e84a-dc7e-4659-968a-1142874146dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:36.378892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915e84a-dc7e-4659-968a-1142874146dd service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:36.379164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915e84a-dc7e-4659-968a-1142874146dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:36.379429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915e84a-dc7e-4659-968a-1142874146dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:36.395800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915e84a-dc7e-4659-968a-1142874146dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:36.397579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915e84a-dc7e-4659-968a-1142874146dd service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:36.409028 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2142/4272] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:36.918406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750f26-1f6d-4f04-bde9-38dd7a48c2d0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:36.998427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750f26-1f6d-4f04-bde9-38dd7a48c2d0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:37.003977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:37.004655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:37.004977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:37.005256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] PATH_INFO: `/v3/users/8d6d12777df649f58b9e2b9f31a18a24` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:37.006471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6d12777df649f58b9e2b9f31a18a24)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:37.008739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:37.068498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6d12777df649f58b9e2b9f31a18a24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.079405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6d12777df649f58b9e2b9f31a18a24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.096953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6d12777df649f58b9e2b9f31a18a24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.097787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6d12777df649f58b9e2b9f31a18a24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.100364 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:37.109862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6d12777df649f58b9e2b9f31a18a24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.118871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2131/4273] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:36 2022] DELETE /identity/v3/users/8d6d12777df649f58b9e2b9f31a18a24 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:37.123563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:37.124218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:37.124218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:37.145886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:37.147141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:37.215748 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2143/4274] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:22:37.233084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:37.235314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:37.304192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf653-3a30-4057-b2b4-82e4672129e8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:37.308442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:37.309147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:37.309585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:37.309990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:37.320705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:37.322298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:37.332869 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2132/4275] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:37.639283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:37.641127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:37.654170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fb59-3edb-4d5b-9b47-b8a6860a8190 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:37.660186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:37.660880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:37.661174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:37.661423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] PATH_INFO: `/v3/projects/dac58bead76d48268dd8bad0f3589d9f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:37.662724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac58bead76d48268dd8bad0f3589d9f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:37.664619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:37.718846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac58bead76d48268dd8bad0f3589d9f', 'request_id': 'req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.730531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac58bead76d48268dd8bad0f3589d9f', 'request_id': 'req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.737321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac58bead76d48268dd8bad0f3589d9f', 'request_id': 'req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.749589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] The token cache is being invalidate because project dac58bead76d48268dd8bad0f3589d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:37.749801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.750469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.752460 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2144/4276] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:37 2022] DELETE /identity/v3/projects/dac58bead76d48268dd8bad0f3589d9f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:22:37.756318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:37.776319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f947c3-f3ef-42f7-a727-c70f84639a77 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:37.851219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:37.852268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:37.852268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:37.852698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] PATH_INFO: `/v3/users/1e26fa87f4274eaa8f867ec4fd951ad5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:37.853973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e26fa87f4274eaa8f867ec4fd951ad5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:37.857227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:37.915878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e26fa87f4274eaa8f867ec4fd951ad5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.926209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e26fa87f4274eaa8f867ec4fd951ad5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.940536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e26fa87f4274eaa8f867ec4fd951ad5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.941701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e26fa87f4274eaa8f867ec4fd951ad5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.948441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-973debab-20dc-40d7-aff8-31235c5832dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e26fa87f4274eaa8f867ec4fd951ad5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:37.954722 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2133/4277] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:37 2022] DELETE /identity/v3/users/1e26fa87f4274eaa8f867ec4fd951ad5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:38.266418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:38.276750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:38.299965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbfe1f-a6e0-46ac-9fd0-56cd9a47ab01 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:38.380352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:38.381120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.381409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.381693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] PATH_INFO: `/v3/projects/4290f77cad36444eb40d78a29baf1283` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.382835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4290f77cad36444eb40d78a29baf1283)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:38.384745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:38.386567 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:38.454458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4290f77cad36444eb40d78a29baf1283', 'request_id': 'req-70b86ff1-817d-4937-a093-6105e17718b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:38.465404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4290f77cad36444eb40d78a29baf1283', 'request_id': 'req-70b86ff1-817d-4937-a093-6105e17718b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:38.483353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4290f77cad36444eb40d78a29baf1283', 'request_id': 'req-70b86ff1-817d-4937-a093-6105e17718b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:38.495526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] The token cache is being invalidate because project 4290f77cad36444eb40d78a29baf1283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:38.495799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:38.496484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-70b86ff1-817d-4937-a093-6105e17718b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:38.498480 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2145/4278] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:38 2022] DELETE /identity/v3/projects/4290f77cad36444eb40d78a29baf1283 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:38.503251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129e0a-21d6-40a2-9007-0dc156f43da9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.503749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129e0a-21d6-40a2-9007-0dc156f43da9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.503864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129e0a-21d6-40a2-9007-0dc156f43da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.523932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-00129e0a-21d6-40a2-9007-0dc156f43da9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:38.525273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00129e0a-21d6-40a2-9007-0dc156f43da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:38.535127 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:38.603709 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2134/4279] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:38.611919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243d53-5357-4181-af19-f6bd9810982e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.612230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243d53-5357-4181-af19-f6bd9810982e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.612506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243d53-5357-4181-af19-f6bd9810982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.635180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-17243d53-5357-4181-af19-f6bd9810982e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:38.636507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17243d53-5357-4181-af19-f6bd9810982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:38.645628 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2146/4280] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:38.649712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129e0a-21d6-40a2-9007-0dc156f43da9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:38.660131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129e0a-21d6-40a2-9007-0dc156f43da9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:38.668907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:38.669598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.669969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.670302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.671517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:38.671708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:38.673642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:38.686394 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2135/4281] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:38.690889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17243d53-5357-4181-af19-f6bd9810982e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:38.700220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17243d53-5357-4181-af19-f6bd9810982e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:38.704896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:38.705561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.705843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.706114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.706758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:38.708634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:38.744473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2147/4282] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:38 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:22:38.748870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:38.759327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23a38c-19a1-4200-bbb2-bf52d41ebacc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:38.821841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:38.822497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.822771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.823037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.823671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:38.825672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:38.848267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2136/4283] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:38 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:38.852728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:38.863919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef700d5-ba25-4ac6-83bb-3f1ebcf895b9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:38.869221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:38.869930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.870279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.870618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.871337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:38.873302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:38.883985 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2148/4284] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:38.888295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:38.900365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874dc08-61ac-4695-8922-70de14981be1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:38.906244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5fb7d-9e68-47a8-990f-5ea6d9bf2699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:38.907500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fb7d-9e68-47a8-990f-5ea6d9bf2699 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.907787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fb7d-9e68-47a8-990f-5ea6d9bf2699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.908065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fb7d-9e68-47a8-990f-5ea6d9bf2699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.908712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5fb7d-9e68-47a8-990f-5ea6d9bf2699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:38.910729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5fb7d-9e68-47a8-990f-5ea6d9bf2699 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:38.922653 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2137/4285] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:38.927402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:38.938784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fd4f1-f7e5-4d64-8a64-e1eec436a6a7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:38.944002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:38.944683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.945006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.945283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] PATH_INFO: `/v3/projects/d294a069ae2d4681b97ebaef49d6c11f/users/5632a7522dd04247b4ed54e6bd8880b2/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:38.964551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d294a069ae2d4681b97ebaef49d6c11f, user_id=5632a7522dd04247b4ed54e6bd8880b2, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:38.968953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:38.986457 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2149/4286] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:38 2022] PUT /identity/v3/projects/d294a069ae2d4681b97ebaef49d6c11f/users/5632a7522dd04247b4ed54e6bd8880b2/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:22:38.997455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423872-cb87-4af8-9463-ec8ce8ee057a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:38.998798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423872-cb87-4af8-9463-ec8ce8ee057a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:38.999085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423872-cb87-4af8-9463-ec8ce8ee057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:39.051931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c9423872-cb87-4af8-9463-ec8ce8ee057a None None] MFA Rules not processed for user `5632a7522dd04247b4ed54e6bd8880b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:39.053252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c9423872-cb87-4af8-9463-ec8ce8ee057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:39.166142 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2138/4287] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:39.170837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:39.304983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d65bb-1490-4e4a-9090-4682eb80ead1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:39.311457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:39.312037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:39.312622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:39.312925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:39.313647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:39.315703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:39.372086 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2150/4288] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:39 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:39.377060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9423872-cb87-4af8-9463-ec8ce8ee057a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:39.391046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9423872-cb87-4af8-9463-ec8ce8ee057a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:39.397563 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:39.467681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:39.468372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:39.468575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:39.468868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:39.469536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:39.471617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:39.497702 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2139/4289] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:39 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:39.501879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:39.518891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad5409-5104-4a02-8d8d-88c701ad2c21 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:39.529854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:39.530858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:39.531341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:39.531635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:39.532574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:39.534431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:39.542729 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:39.560341 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2151/4290] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:22:39.564693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:39.600693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daed72-164d-4737-b31a-ed7f3a24a46c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:39.609063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:39.610209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:39.610707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:39.611401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] PATH_INFO: `/v3/projects/3f7c40f2b2814d1b9686b8c58ddf690a/users/75d845ff69ba44f5a922fac2420783fe/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:39.634690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7c40f2b2814d1b9686b8c58ddf690a, user_id=75d845ff69ba44f5a922fac2420783fe, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:39.638286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:39.656265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2140/4291] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:39 2022] PUT /identity/v3/projects/3f7c40f2b2814d1b9686b8c58ddf690a/users/75d845ff69ba44f5a922fac2420783fe/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:39.660229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:39.672320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fa61-aeec-4521-be0a-125d67e2e7f4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:39.748487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bd7bf-b8a1-4611-9e49-e44e995feff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:39.749421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bd7bf-b8a1-4611-9e49-e44e995feff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:39.749984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bd7bf-b8a1-4611-9e49-e44e995feff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:39.750427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bd7bf-b8a1-4611-9e49-e44e995feff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:39.751415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bd7bf-b8a1-4611-9e49-e44e995feff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:39.753154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bd7bf-b8a1-4611-9e49-e44e995feff2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:39.778757 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2152/4292] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:39.782689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:39.799236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc5a6d-06b7-42dc-a0fe-91060e5b8b98 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:39.810386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65afcde-7696-47dd-9221-f37c62a00d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:39.811172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afcde-7696-47dd-9221-f37c62a00d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:39.811455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afcde-7696-47dd-9221-f37c62a00d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:39.811730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afcde-7696-47dd-9221-f37c62a00d54 admin admin] PATH_INFO: `/v3/projects/3f7c40f2b2814d1b9686b8c58ddf690a/users/75d845ff69ba44f5a922fac2420783fe/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:39.815157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65afcde-7696-47dd-9221-f37c62a00d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7c40f2b2814d1b9686b8c58ddf690a, user_id=75d845ff69ba44f5a922fac2420783fe, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:39.818790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65afcde-7696-47dd-9221-f37c62a00d54 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:39.850775 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2141/4293] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:39 2022] PUT /identity/v3/projects/3f7c40f2b2814d1b9686b8c58ddf690a/users/75d845ff69ba44f5a922fac2420783fe/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:39.969494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:39.969857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:39.970147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:40.023913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] MFA Rules not processed for user `75d845ff69ba44f5a922fac2420783fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:40.025533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:40.173722 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2153/4294] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:40.205978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519c60a-5cc7-4d99-8762-09829d4d96a3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:40.206270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519c60a-5cc7-4d99-8762-09829d4d96a3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:40.206804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519c60a-5cc7-4d99-8762-09829d4d96a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:40.206929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:40.208569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:40.231755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3519c60a-5cc7-4d99-8762-09829d4d96a3 None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:40.233175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3519c60a-5cc7-4d99-8762-09829d4d96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:40.283536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77203e-1637-429a-bd76-852293c30c6f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:40.287297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:40.287914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:40.288196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:40.288829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:40.313218 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2142/4295] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:40.347017 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:40.379352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:40.381186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:40.393193 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2154/4296] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:44.303909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:44.304430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:44.304430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:44.327963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] MFA Rules not processed for user `3338f52621ec4501b2f0b88ff5cb36fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:44.329603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:44.427173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2143/4297] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:45.520480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:45.527026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:45.528449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601a0ef-855e-402b-b18b-6511488f2a59 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:45.533084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1d690-f9f8-45ae-a3a9-d3217fdffaba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:45.533678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d690-f9f8-45ae-a3a9-d3217fdffaba service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:45.534009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d690-f9f8-45ae-a3a9-d3217fdffaba service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:45.534283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d690-f9f8-45ae-a3a9-d3217fdffaba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:45.534775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:45.549129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1d690-f9f8-45ae-a3a9-d3217fdffaba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:45.551412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1d690-f9f8-45ae-a3a9-d3217fdffaba service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:45.556163 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:45.566420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2155/4298] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:45.636088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfc09c-2ffc-4e5e-829f-6bc06bfcf1f8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:45.641849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:45.642632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:45.643004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:45.643517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:45.645843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:45.665298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:45.667161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:45.684210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2144/4299] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:49.179072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eced17-6b8f-45a5-84ff-4b8e48a16b25 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:49.179632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eced17-6b8f-45a5-84ff-4b8e48a16b25 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:49.179632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eced17-6b8f-45a5-84ff-4b8e48a16b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:49.241055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-00eced17-6b8f-45a5-84ff-4b8e48a16b25 None None] MFA Rules not processed for user `3fbef527355e40f3af441a57cd5807be`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:49.242415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-00eced17-6b8f-45a5-84ff-4b8e48a16b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:49.369657 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2156/4300] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:55.674582 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=29 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:55.984334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:55.986683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:56.061521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5afc8d-e421-4985-aec4-752c2df140f2 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:56.069819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:56.070505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:56.070783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:56.071057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] PATH_INFO: `/v3/users/6f1301aa097942a2a4309911a00bf511` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:56.072224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1301aa097942a2a4309911a00bf511)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:56.080179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:56.141709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1301aa097942a2a4309911a00bf511'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.155419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1301aa097942a2a4309911a00bf511'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.170184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1301aa097942a2a4309911a00bf511'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.171031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1301aa097942a2a4309911a00bf511'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.179054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1301aa097942a2a4309911a00bf511'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.185274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2145/4301] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:55 2022] DELETE /identity/v3/users/6f1301aa097942a2a4309911a00bf511 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:56.190433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:56.190932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:56.191192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:56.210537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:56.211767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:56.297899 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2157/4302] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:56.308248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:56.309782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:56.390225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334adce7-2c37-4459-ad43-4ad25c57490d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:56.399544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f0543-7a84-4b6d-9167-fe052167af94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:56.400463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0543-7a84-4b6d-9167-fe052167af94 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:56.400803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0543-7a84-4b6d-9167-fe052167af94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:56.401074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0543-7a84-4b6d-9167-fe052167af94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:56.413406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f0543-7a84-4b6d-9167-fe052167af94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:56.414876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f0543-7a84-4b6d-9167-fe052167af94 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:56.426580 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2146/4303] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:56.755321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:56.756987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:56.772946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652b46-9a76-451a-8355-cfa09470b5ac None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:56.779149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:56.780039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:56.780322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:56.780592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] PATH_INFO: `/v3/projects/1b9ebbd02c41420083631ba591536d53` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:56.781859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9ebbd02c41420083631ba591536d53)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:56.783805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:56.838712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9ebbd02c41420083631ba591536d53', 'request_id': 'req-db0237e7-56ec-4a73-be37-4afd18a91747'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.848800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9ebbd02c41420083631ba591536d53', 'request_id': 'req-db0237e7-56ec-4a73-be37-4afd18a91747'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.854311 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:56.855816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9ebbd02c41420083631ba591536d53', 'request_id': 'req-db0237e7-56ec-4a73-be37-4afd18a91747'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.871937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] The token cache is being invalidate because project 1b9ebbd02c41420083631ba591536d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:56.872515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.873431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db0237e7-56ec-4a73-be37-4afd18a91747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:56.875036 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2158/4304] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:56 2022] DELETE /identity/v3/projects/1b9ebbd02c41420083631ba591536d53 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:56.880610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ca295-bad0-4930-8938-186eddb2c6e4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:56.881176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ca295-bad0-4930-8938-186eddb2c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:56.881282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ca295-bad0-4930-8938-186eddb2c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:56.907411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1e5ca295-bad0-4930-8938-186eddb2c6e4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:56.908788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1e5ca295-bad0-4930-8938-186eddb2c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:56.990093 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:57.061357 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2147/4305] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:22:57.070846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351425-fe1f-4cfb-884f-93a16c958cd1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.070846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351425-fe1f-4cfb-884f-93a16c958cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.070846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351425-fe1f-4cfb-884f-93a16c958cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.091628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-24351425-fe1f-4cfb-884f-93a16c958cd1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:57.094135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-24351425-fe1f-4cfb-884f-93a16c958cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:57.104821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2159/4306] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:57.107197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ca295-bad0-4930-8938-186eddb2c6e4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.118585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ca295-bad0-4930-8938-186eddb2c6e4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.123285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.124594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.124918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.125199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.125908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:57.126438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.128310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.142882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2148/4307] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:22:57.147693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351425-fe1f-4cfb-884f-93a16c958cd1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.159814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351425-fe1f-4cfb-884f-93a16c958cd1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.165835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.166467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.166887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.167167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.167874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.170182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.207003 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2160/4308] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:57 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:22:57.211873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.225437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1269-fef7-43fe-8517-9879bf765f68 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.293831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.295122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.295458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.296235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.296373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.298450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.329312 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2149/4309] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:57 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:57.330962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.345573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e23d-3223-43c0-b1a5-e5278c1f3908 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.352574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.353251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.354144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.354144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.354509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.356278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.375996 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2161/4310] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:57.381344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.399376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc97f2-aaba-4d3e-ab64-0ce550ebee1f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.406471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d8dec-c72d-4b02-ae86-f3feb04076be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.407088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d8dec-c72d-4b02-ae86-f3feb04076be admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.407376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d8dec-c72d-4b02-ae86-f3feb04076be admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.407638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d8dec-c72d-4b02-ae86-f3feb04076be admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.408840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d8dec-c72d-4b02-ae86-f3feb04076be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.410632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d8dec-c72d-4b02-ae86-f3feb04076be admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.424802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2150/4311] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:57.428520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.440747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2cef-4c6d-4dbf-9c1d-b3ee78177851 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.452337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.453020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.453424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.453745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] PATH_INFO: `/v3/projects/01d13d94447a4903b680412bf56041af/users/b93ff1af776847d2ad9311618e50be24/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.469633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d13d94447a4903b680412bf56041af, user_id=b93ff1af776847d2ad9311618e50be24, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.472293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.487416 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2162/4312] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:57 2022] PUT /identity/v3/projects/01d13d94447a4903b680412bf56041af/users/b93ff1af776847d2ad9311618e50be24/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:57.500227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e17e-f99e-44f3-ae91-c3af387b628b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.500563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e17e-f99e-44f3-ae91-c3af387b628b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.500793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e17e-f99e-44f3-ae91-c3af387b628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.533550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9408e17e-f99e-44f3-ae91-c3af387b628b None None] MFA Rules not processed for user `b93ff1af776847d2ad9311618e50be24`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:57.534803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9408e17e-f99e-44f3-ae91-c3af387b628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:57.619328 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2151/4313] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:57.633078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.635026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:57.736055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773edaf-637e-4bbf-9580-cba63f1303e4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.749734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.749734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.749734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.749734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.762026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.764093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.778450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2163/4314] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:57.811195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19136a-b4f7-47f2-96ef-0e06dae707e2 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.811615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19136a-b4f7-47f2-96ef-0e06dae707e2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.812288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19136a-b4f7-47f2-96ef-0e06dae707e2 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.814173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2152/4315] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:22:57.823986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:22:57.840816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.857515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd21cb-8986-4d6c-9985-3b4e731f8fdc service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.862470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93ff1af776847d2ad9311618e50be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d13d94447a4903b680412bf56041af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.863581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.863581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.863839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] PATH_INFO: `/v3/projects/01d13d94447a4903b680412bf56041af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.864948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorizing `identity:get_project(project_id=01d13d94447a4903b680412bf56041af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.866928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.879898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2164/4316] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:22:57 2022] GET /identity/v3/projects/01d13d94447a4903b680412bf56041af => generated 365 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:57.902308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8b6-b7f6-4250-93de-ef6ed1cb49df None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.902926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8b6-b7f6-4250-93de-ef6ed1cb49df None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.902926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8b6-b7f6-4250-93de-ef6ed1cb49df None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.904586 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2153/4317] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:22:57.910131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:22:57.912071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:57.931599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:57.943641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bbdc9-2022-43f1-a9f8-43614b5e4c21 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:57.950354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93ff1af776847d2ad9311618e50be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d13d94447a4903b680412bf56041af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:57.951215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:57.951804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:57.952172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] PATH_INFO: `/v3/projects/01d13d94447a4903b680412bf56041af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:57.953524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorizing `identity:get_project(project_id=01d13d94447a4903b680412bf56041af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:57.955448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:57.958651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2165/4318] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:22:57 2022] GET /identity/v3/projects/01d13d94447a4903b680412bf56041af => generated 365 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:58.001284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896642b-6df0-41a4-8f7a-7ed6902af7a3 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.001624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896642b-6df0-41a4-8f7a-7ed6902af7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.001910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896642b-6df0-41a4-8f7a-7ed6902af7a3 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.003504 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2154/4319] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:22:58.008998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:22:58.026932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:58.038215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435860-d456-42e0-9aba-db33fbddf29c tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:58.045482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93ff1af776847d2ad9311618e50be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d13d94447a4903b680412bf56041af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:58.045987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.046352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.046715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] PATH_INFO: `/v3/projects/01d13d94447a4903b680412bf56041af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.048166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorizing `identity:get_project(project_id=01d13d94447a4903b680412bf56041af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:58.050512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:58.063328 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2166/4320] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:22:58 2022] GET /identity/v3/projects/01d13d94447a4903b680412bf56041af => generated 365 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:58.096670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a77b7-0a96-4265-9329-af65bedcdf23 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.097108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a77b7-0a96-4265-9329-af65bedcdf23 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.097392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a77b7-0a96-4265-9329-af65bedcdf23 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.098775 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2155/4321] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:22:58.105050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:22:58.124502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:58.141853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cf1fe-87a2-40f8-b3ea-f387c70c9328 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:58.148193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93ff1af776847d2ad9311618e50be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d13d94447a4903b680412bf56041af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:58.149018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.149401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.149795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] PATH_INFO: `/v3/projects/01d13d94447a4903b680412bf56041af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.151180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorizing `identity:get_project(project_id=01d13d94447a4903b680412bf56041af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:58.153162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:58.155161 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2167/4322] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:22:58 2022] GET /identity/v3/projects/01d13d94447a4903b680412bf56041af => generated 365 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:58.196560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac131-f3f5-4a24-b951-d0edbb58a689 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.196842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac131-f3f5-4a24-b951-d0edbb58a689 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.197361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac131-f3f5-4a24-b951-d0edbb58a689 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.198754 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2156/4323] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 01:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:22:58.206109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating service token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 01:22:58.223923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:58.234455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa7689-cdb4-4e43-9ef2-19a07d31e6d0 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:58.239431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131a193-2131-4d1d-a915-9eec736fef70 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93ff1af776847d2ad9311618e50be24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d13d94447a4903b680412bf56041af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:58.240079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a193-2131-4d1d-a915-9eec736fef70 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.240359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a193-2131-4d1d-a915-9eec736fef70 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.240630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a193-2131-4d1d-a915-9eec736fef70 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] PATH_INFO: `/v3/projects/01d13d94447a4903b680412bf56041af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.241848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131a193-2131-4d1d-a915-9eec736fef70 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorizing `identity:get_project(project_id=01d13d94447a4903b680412bf56041af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:58.243677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131a193-2131-4d1d-a915-9eec736fef70 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:58.245758 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2168/4324] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 01:22:58 2022] GET /identity/v3/projects/01d13d94447a4903b680412bf56041af => generated 365 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:58.281959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eac131-f3f5-4a24-b951-d0edbb58a689 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:58.305521 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:58.367727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eac131-f3f5-4a24-b951-d0edbb58a689 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:58.373429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:58.374073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.374348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.374615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] PATH_INFO: `/v3/users/b93ff1af776847d2ad9311618e50be24` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.376674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93ff1af776847d2ad9311618e50be24)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:58.378824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:58.441126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93ff1af776847d2ad9311618e50be24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:58.451444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93ff1af776847d2ad9311618e50be24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:58.469689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93ff1af776847d2ad9311618e50be24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:58.470817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93ff1af776847d2ad9311618e50be24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:58.487195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93ff1af776847d2ad9311618e50be24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:58.507305 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2157/4325] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:22:58 2022] DELETE /identity/v3/users/b93ff1af776847d2ad9311618e50be24 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:58.511020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.511020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.511020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.533859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:58.535368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:58.570022 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:58.624943 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2169/4326] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:58.633770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:58.636516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:58.718193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401b195-43f8-429d-a1d5-882874401791 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:58.722093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f866901-e539-4f15-9d27-31fc5258633d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:58.722749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866901-e539-4f15-9d27-31fc5258633d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:58.723022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866901-e539-4f15-9d27-31fc5258633d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:58.723438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866901-e539-4f15-9d27-31fc5258633d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:58.734189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866901-e539-4f15-9d27-31fc5258633d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:58.735641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866901-e539-4f15-9d27-31fc5258633d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:58.746399 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2158/4327] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:22:59.114002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:59.116041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:59.129509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33187b1c-10db-4db4-9b7e-fed44c33853f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:59.138110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:59.139079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.139404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.139584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] PATH_INFO: `/v3/projects/01d13d94447a4903b680412bf56041af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.141931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d13d94447a4903b680412bf56041af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:59.144059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:59.255569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d13d94447a4903b680412bf56041af', 'request_id': 'req-e7c7652a-3f8a-4ea6-90db-d7980333963f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:59.265057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d13d94447a4903b680412bf56041af', 'request_id': 'req-e7c7652a-3f8a-4ea6-90db-d7980333963f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:59.271521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d13d94447a4903b680412bf56041af', 'request_id': 'req-e7c7652a-3f8a-4ea6-90db-d7980333963f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:59.284543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] The token cache is being invalidate because project 01d13d94447a4903b680412bf56041af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:22:59.284834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:59.285730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e7c7652a-3f8a-4ea6-90db-d7980333963f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:22:59.287295 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2170/4328] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:22:59 2022] DELETE /identity/v3/projects/01d13d94447a4903b680412bf56041af => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:59.294629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b98b0-53ff-46d9-b1ea-63b1c00f596a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.297161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b98b0-53ff-46d9-b1ea-63b1c00f596a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.298549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b98b0-53ff-46d9-b1ea-63b1c00f596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.319965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f00b98b0-53ff-46d9-b1ea-63b1c00f596a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:59.321330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f00b98b0-53ff-46d9-b1ea-63b1c00f596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:59.360011 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:59.394347 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2159/4329] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:59.406228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569240-dcc6-40b0-a79d-6a14b70183ce None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.406707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569240-dcc6-40b0-a79d-6a14b70183ce None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.407087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569240-dcc6-40b0-a79d-6a14b70183ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.434664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9b569240-dcc6-40b0-a79d-6a14b70183ce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:59.437565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9b569240-dcc6-40b0-a79d-6a14b70183ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:22:59.447533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2171/4330] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:22:59.452840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b98b0-53ff-46d9-b1ea-63b1c00f596a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:59.466832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b98b0-53ff-46d9-b1ea-63b1c00f596a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:59.472063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:59.472687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.473169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.473672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.474136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:22:59.474423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:59.476788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:59.493467 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2160/4331] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:22:59.498143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569240-dcc6-40b0-a79d-6a14b70183ce None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:59.508843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569240-dcc6-40b0-a79d-6a14b70183ce None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:59.514548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:59.515435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.515724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.516022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.516838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:59.519295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:59.556221 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2172/4332] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:22:59 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:22:59.561119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:59.572453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3955-2654-4ea4-9b33-204c86547efe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:59.663786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:59.664850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.665203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.667619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.667619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:59.670172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:59.704989 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2161/4333] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:22:59 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:22:59.709318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:59.725003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa977-9d69-492b-bde8-f85e98d0252e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:59.745427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:59.746350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.746726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.747275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.748225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:59.750080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:59.766102 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2173/4334] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:22:59.770427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:59.782675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4419-b84d-45b5-b565-be7b74359f3c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:59.788096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e444-6c49-4ac6-a0c3-f3fd93b7fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:59.788706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e444-6c49-4ac6-a0c3-f3fd93b7fd7b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.789019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e444-6c49-4ac6-a0c3-f3fd93b7fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.789293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e444-6c49-4ac6-a0c3-f3fd93b7fd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.791294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051e444-6c49-4ac6-a0c3-f3fd93b7fd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:59.791772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051e444-6c49-4ac6-a0c3-f3fd93b7fd7b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:59.808453 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2162/4335] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:22:59.813533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:22:59.825318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4217a9-6500-48de-8f07-fcde913d11c3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:22:59.830274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:22:59.830976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.831234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.831509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] PATH_INFO: `/v3/projects/8d66a2b565324f54a16502cbdcdc8d53/users/a0b7df0540204c43948f6406d7f3caf0/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.848185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d66a2b565324f54a16502cbdcdc8d53, user_id=a0b7df0540204c43948f6406d7f3caf0, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:22:59.851104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:22:59.870788 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2174/4336] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:22:59 2022] PUT /identity/v3/projects/8d66a2b565324f54a16502cbdcdc8d53/users/a0b7df0540204c43948f6406d7f3caf0/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:22:59.876538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f52a0-8727-49c0-83cc-8346c7ed5fee None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:22:59.876927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f52a0-8727-49c0-83cc-8346c7ed5fee None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:22:59.877272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f52a0-8727-49c0-83cc-8346c7ed5fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:22:59.921713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-711f52a0-8727-49c0-83cc-8346c7ed5fee None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:22:59.923247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-711f52a0-8727-49c0-83cc-8346c7ed5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:00.006988 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2163/4337] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:00.018244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:00.020248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:00.111543 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:00.116650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cb71b-d26d-44fc-8445-df0798707a7d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:00.127227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f2ff1-5039-4d09-9240-81b0a3dcffa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:00.127889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2ff1-5039-4d09-9240-81b0a3dcffa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:00.128168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2ff1-5039-4d09-9240-81b0a3dcffa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:00.128453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2ff1-5039-4d09-9240-81b0a3dcffa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:00.142545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f2ff1-5039-4d09-9240-81b0a3dcffa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:00.144605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f2ff1-5039-4d09-9240-81b0a3dcffa0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:00.161655 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2175/4338] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:00.520132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:00.520754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:00.520914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:00.553155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] MFA Rules not processed for user `a0b7df0540204c43948f6406d7f3caf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:00.554504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:00.594163 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:00.632941 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2164/4339] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:00.643877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e3ec-3273-403f-a135-351a95804707 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:00.644469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e3ec-3273-403f-a135-351a95804707 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:00.644469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e3ec-3273-403f-a135-351a95804707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:00.664439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6fc4e3ec-3273-403f-a135-351a95804707 None None] MFA Rules not processed for user `a0b7df0540204c43948f6406d7f3caf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:00.665627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6fc4e3ec-3273-403f-a135-351a95804707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:00.680342 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2176/4340] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:00.688485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:00.690930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:00.790682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca46778-4c65-4474-be34-be0b96794da1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:00.801884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:00.802535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:00.802815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:00.803079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:00.813694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:00.815324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:00.827548 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2165/4341] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:02.145541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e3ec-3273-403f-a135-351a95804707 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:02.174069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e3ec-3273-403f-a135-351a95804707 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:02.182811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:02.183473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:02.183729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:02.183998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] PATH_INFO: `/v3/users/a0b7df0540204c43948f6406d7f3caf0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:02.186485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b7df0540204c43948f6406d7f3caf0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:02.188832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:02.301686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b7df0540204c43948f6406d7f3caf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.332966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b7df0540204c43948f6406d7f3caf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.334024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b7df0540204c43948f6406d7f3caf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.354573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b7df0540204c43948f6406d7f3caf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.362104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-73280de6-a7f5-4da6-923c-46f67e95c613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b7df0540204c43948f6406d7f3caf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.400819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2177/4342] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:02 2022] DELETE /identity/v3/users/a0b7df0540204c43948f6406d7f3caf0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:02.703924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:02.715774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c48e3-d888-4d90-8af5-d9370d9dc5f0 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:02.836480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:02.837278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:02.837585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:02.837862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] PATH_INFO: `/v3/projects/8d66a2b565324f54a16502cbdcdc8d53` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:02.839018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d66a2b565324f54a16502cbdcdc8d53)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:02.841320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:02.931503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d66a2b565324f54a16502cbdcdc8d53', 'request_id': 'req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.940844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d66a2b565324f54a16502cbdcdc8d53', 'request_id': 'req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.947283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d66a2b565324f54a16502cbdcdc8d53', 'request_id': 'req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.949173 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:02.967039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] The token cache is being invalidate because project 8d66a2b565324f54a16502cbdcdc8d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:02.967460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.968123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4758ddb9-00e6-4cef-9145-aaf8ad6591f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:02.970550 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2166/4343] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:02 2022] DELETE /identity/v3/projects/8d66a2b565324f54a16502cbdcdc8d53 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:02.975423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd427bd5-7ffd-48ef-b4cb-6251fee3315b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:02.975709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd427bd5-7ffd-48ef-b4cb-6251fee3315b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:02.976184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd427bd5-7ffd-48ef-b4cb-6251fee3315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:02.996596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dd427bd5-7ffd-48ef-b4cb-6251fee3315b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:02.998108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dd427bd5-7ffd-48ef-b4cb-6251fee3315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:03.088194 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2178/4344] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:03.089982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9057975-89c4-49c9-80ef-a045d221853b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.091404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9057975-89c4-49c9-80ef-a045d221853b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.091777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9057975-89c4-49c9-80ef-a045d221853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.113791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c9057975-89c4-49c9-80ef-a045d221853b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:03.115172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c9057975-89c4-49c9-80ef-a045d221853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:03.126979 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2167/4345] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:03.129371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd427bd5-7ffd-48ef-b4cb-6251fee3315b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.143051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd427bd5-7ffd-48ef-b4cb-6251fee3315b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.148475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.149290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.149568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.149844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.150533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:03.151165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.152848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.167231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2179/4346] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:03.172483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9057975-89c4-49c9-80ef-a045d221853b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.184289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9057975-89c4-49c9-80ef-a045d221853b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.191094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.191811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.192183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.192446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.193150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.195116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.226936 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2168/4347] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:03 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:03.231237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.241721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430637cf-449e-45a6-b54d-5bcded43e28f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.294292 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:03.319539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.320529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.321015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.321504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.322514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.324991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.358410 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2180/4348] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:03 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:03.362564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.377125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04beeb-94df-4b81-abc0-c210f77b0b49 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.382542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.383151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.383415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.383693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.384342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.387641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.401450 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2169/4349] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:03.406387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.419931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22d3d-ce77-4c9e-beec-781608de9a35 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.425085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eed060-7eed-47a5-84ed-d46a97af52cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.426054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eed060-7eed-47a5-84ed-d46a97af52cd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.426332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eed060-7eed-47a5-84ed-d46a97af52cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.426606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eed060-7eed-47a5-84ed-d46a97af52cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.427501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eed060-7eed-47a5-84ed-d46a97af52cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.429315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eed060-7eed-47a5-84ed-d46a97af52cd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.443400 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2181/4350] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:03.451693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.463176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f24ca-946a-47a5-aa92-2727c6e6e821 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.469632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.470218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.470505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.470781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] PATH_INFO: `/v3/projects/99f7eae440db43e98f0198f9a5c26a13/users/b87d684e357f4f918e1f424ae0881a63/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.496524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f7eae440db43e98f0198f9a5c26a13, user_id=b87d684e357f4f918e1f424ae0881a63, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.501102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.527392 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2170/4351] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:03 2022] PUT /identity/v3/projects/99f7eae440db43e98f0198f9a5c26a13/users/b87d684e357f4f918e1f424ae0881a63/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:03.540427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a996-3164-49f1-a241-3a2c14b24417 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.540834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a996-3164-49f1-a241-3a2c14b24417 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.541177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a996-3164-49f1-a241-3a2c14b24417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.580258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f1d1a996-3164-49f1-a241-3a2c14b24417 None None] MFA Rules not processed for user `b87d684e357f4f918e1f424ae0881a63`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:03.582140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f1d1a996-3164-49f1-a241-3a2c14b24417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:03.693748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.694000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2182/4352] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:03.770684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5869c-225e-4064-abda-31fc6faccebc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.776012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.777213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.777591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.778118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.779401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.781206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.823597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a996-3164-49f1-a241-3a2c14b24417 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:03.830855 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2171/4353] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:03 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:03.838900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a996-3164-49f1-a241-3a2c14b24417 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:03.952247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:03.953340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:03.953855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:03.954300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:03.955239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:03.957627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:03.992314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2183/4354] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:03 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:04.001132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.067408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf281f60-9a96-44c0-8135-c391a6a1f7f3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:04.088995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:04.090160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.092733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.093060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.093744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:04.095929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:04.122836 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2172/4355] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:04.128517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.141273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc12f1-5573-4ffb-9020-c5af4a74bd8d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:04.147232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:04.147959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.148239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.148570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] PATH_INFO: `/v3/projects/0fc8262c64af48f5ba471fc50a52a34e/users/65cec6796dc14a02accb3e4c83797d65/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.168489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc8262c64af48f5ba471fc50a52a34e, user_id=65cec6796dc14a02accb3e4c83797d65, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:04.171429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:04.192253 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2184/4356] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:04 2022] PUT /identity/v3/projects/0fc8262c64af48f5ba471fc50a52a34e/users/65cec6796dc14a02accb3e4c83797d65/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:04.193595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.215499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b60407-4e4a-494b-8be0-3e033d058a64 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:04.310304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f530d6-f7d7-4ab1-90ae-87613b790d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:04.313027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f530d6-f7d7-4ab1-90ae-87613b790d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.314614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f530d6-f7d7-4ab1-90ae-87613b790d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.315153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f530d6-f7d7-4ab1-90ae-87613b790d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.318601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f530d6-f7d7-4ab1-90ae-87613b790d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:04.322167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f530d6-f7d7-4ab1-90ae-87613b790d8e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:04.325767 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:04.343902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.356632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb327-d34f-4cf9-8f0e-ec7b31b256ae admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:04.359013 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2173/4357] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:04.363955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:04.365081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.365585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.366147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] PATH_INFO: `/v3/projects/0fc8262c64af48f5ba471fc50a52a34e/users/65cec6796dc14a02accb3e4c83797d65/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.368863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc8262c64af48f5ba471fc50a52a34e, user_id=65cec6796dc14a02accb3e4c83797d65, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:04.372520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:04.385671 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2185/4358] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:04 2022] PUT /identity/v3/projects/0fc8262c64af48f5ba471fc50a52a34e/users/65cec6796dc14a02accb3e4c83797d65/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:04.401365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90ee7-eb4a-446a-a97e-e561ea8dc67d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.401838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90ee7-eb4a-446a-a97e-e561ea8dc67d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.402117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90ee7-eb4a-446a-a97e-e561ea8dc67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.437261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9ee90ee7-eb4a-446a-a97e-e561ea8dc67d None None] MFA Rules not processed for user `65cec6796dc14a02accb3e4c83797d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:04.438534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ee90ee7-eb4a-446a-a97e-e561ea8dc67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:04.523739 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2174/4359] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:04.528261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.535666 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:04.540881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7879-dede-415a-a997-fb2a62372500 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:04.547434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:04.548073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.548351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.548636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.549345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:04.551237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:04.588829 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2186/4360] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:23:04 2022] POST /identity/v3/projects => generated 349 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:04.592800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee90ee7-eb4a-446a-a97e-e561ea8dc67d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.605537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee90ee7-eb4a-446a-a97e-e561ea8dc67d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:04.695654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:04.696389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.696729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.697742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.697896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:04.701731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:04.780939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2175/4361] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:04 2022] POST /identity/v3/projects => generated 351 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:04.784948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.801285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8395a-d5d1-42f7-89c2-f37dbe0a0d16 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:04.952002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:04.953098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:04.953384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:04.953776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/users/b87d684e357f4f918e1f424ae0881a63` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:04.955012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:get_user(user_id=b87d684e357f4f918e1f424ae0881a63)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:04.957467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:04.959723 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2187/4362] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:23:04 2022] GET /identity/v3/users/b87d684e357f4f918e1f424ae0881a63 => generated 287 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:04.965794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:04.981362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dd984-92f2-4d7b-84ad-6aa5dc70f964 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.001549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.002578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.003146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.003612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.008348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.010754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.085218 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2176/4363] 10.222.0.46 () {60 vars in 1162 bytes} [Sun Aug 21 01:23:04 2022] POST /identity/v3/credentials => generated 430 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:05.088466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.101717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e438e1-1d35-4929-8dce-8a5a335bda26 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.107721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.108504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.108938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.109462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials/72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.112726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.114672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.118082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.119962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.179354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2188/4364] 10.222.0.46 () {60 vars in 1358 bytes} [Sun Aug 21 01:23:05 2022] PATCH /identity/v3/credentials/72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4 => generated 437 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:05.184554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.206075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434615a5-7276-488d-8635-2f23d6bed9a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.212812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.216229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.216942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.218043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials/72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.223246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.226750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.231692 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2177/4365] 10.222.0.46 () {58 vars in 1335 bytes} [Sun Aug 21 01:23:05 2022] GET /identity/v3/credentials/72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4 => generated 437 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:05.236038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.249589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984aeb2-9767-4375-be61-6f85d073b309 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.262401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.263220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.263504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.263791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials/72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.266110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.268110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.296066 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2189/4366] 10.222.0.46 () {58 vars in 1338 bytes} [Sun Aug 21 01:23:05 2022] DELETE /identity/v3/credentials/72c951f443c9fa61954edc26234f1dee07ee922f33d7a02bc78067eab534b9e4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:05.309409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.322468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab3bc-90ea-4625-9085-14161ab75fb5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.339083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.339946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.340227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.341117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.342086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.343991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.373281 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2178/4367] 10.222.0.46 () {60 vars in 1162 bytes} [Sun Aug 21 01:23:05 2022] POST /identity/v3/credentials => generated 429 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:05.377899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.390486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59def0-81b7-4337-8b5b-14a213a93de5 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.400503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.402063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.402672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.403336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.404975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.407368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.433130 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2190/4368] 10.222.0.46 () {60 vars in 1162 bytes} [Sun Aug 21 01:23:05 2022] POST /identity/v3/credentials => generated 430 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:05.437876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.454594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20b54-adc7-4139-88a1-f22e17fa8443 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.465496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.466206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.466559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.466953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.467621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.469744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.486627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.488405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.490369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.491966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.498657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2179/4369] 10.222.0.46 () {58 vars in 1140 bytes} [Sun Aug 21 01:23:05 2022] GET /identity/v3/credentials => generated 944 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:05.499067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.511075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf394f5-c6f6-4395-84c1-26bb9e2b494b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.519183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.519930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.520365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.520510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials/d4feaa96efe4c503a0f3e9ab32bc5d5795acccbbc6b815996e716c89bcbc65c3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.523741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=d4feaa96efe4c503a0f3e9ab32bc5d5795acccbbc6b815996e716c89bcbc65c3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.526329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.557043 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2191/4370] 10.222.0.46 () {58 vars in 1338 bytes} [Sun Aug 21 01:23:05 2022] DELETE /identity/v3/credentials/d4feaa96efe4c503a0f3e9ab32bc5d5795acccbbc6b815996e716c89bcbc65c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:05.558743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.569977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9856-bb0b-488b-8744-977acbc2c35a tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.574964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.575672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.575974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.576363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/credentials/491f1a43d6dacf593a74f6241c41fbccb034051d14894ce1e9a87104a8999aa9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.578551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=491f1a43d6dacf593a74f6241c41fbccb034051d14894ce1e9a87104a8999aa9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.580365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.618438 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2180/4371] 10.222.0.46 () {58 vars in 1338 bytes} [Sun Aug 21 01:23:05 2022] DELETE /identity/v3/credentials/491f1a43d6dacf593a74f6241c41fbccb034051d14894ce1e9a87104a8999aa9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:05.619476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.631719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e935d-7a3c-4746-beeb-4593ea844014 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.637259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.638212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.638815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.639101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/projects/0ba267bd310949c3ba39525541265455` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.640612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ba267bd310949c3ba39525541265455)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.642915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.702313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba267bd310949c3ba39525541265455', 'request_id': 'req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.712341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba267bd310949c3ba39525541265455', 'request_id': 'req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.720248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba267bd310949c3ba39525541265455', 'request_id': 'req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.734043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] The token cache is being invalidate because project 0ba267bd310949c3ba39525541265455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:05.734588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.735542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.737592 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2192/4372] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:05 2022] DELETE /identity/v3/projects/0ba267bd310949c3ba39525541265455 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:05.741974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.743945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:05.758886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096fa69-451f-458b-8913-d4e96e24cb8b tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:05.773249 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:05.826987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cec6796dc14a02accb3e4c83797d65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc8262c64af48f5ba471fc50a52a34e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:05.828282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.828790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.829250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] PATH_INFO: `/v3/projects/67e5544f030e4291912981d10338b1ac` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.830672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorizing `identity:delete_project(project_id=67e5544f030e4291912981d10338b1ac)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:05.832952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:05.887271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e5544f030e4291912981d10338b1ac', 'request_id': 'req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.895625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e5544f030e4291912981d10338b1ac', 'request_id': 'req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.921092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e5544f030e4291912981d10338b1ac', 'request_id': 'req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.956125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] The token cache is being invalidate because project 67e5544f030e4291912981d10338b1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:05.956706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.957712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86ca85aa-cc30-4559-90e5-c47f5cebe3a9 tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:05.964186 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2181/4373] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:05 2022] DELETE /identity/v3/projects/67e5544f030e4291912981d10338b1ac => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:05.965672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:05.967699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:05.986255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f393f3-817d-4fed-a89d-70db972d2f27 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:05.986554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f393f3-817d-4fed-a89d-70db972d2f27 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:05.986838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f393f3-817d-4fed-a89d-70db972d2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:05.989636 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:06.015273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a3f393f3-817d-4fed-a89d-70db972d2f27 None None] MFA Rules not processed for user `3fbef527355e40f3af441a57cd5807be`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:06.020912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a3f393f3-817d-4fed-a89d-70db972d2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:06.065105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac590bb-53cc-45ec-9e0d-3f4008e6fe2d tempest-CredentialsTestJSON-781663586 tempest-CredentialsTestJSON-781663586-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:06.111386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2182/4374] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:06.195529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:06.196535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:06.197038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:06.197475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] PATH_INFO: `/v3/users/b87d684e357f4f918e1f424ae0881a63` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:06.199320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87d684e357f4f918e1f424ae0881a63)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:06.204566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:06.294971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87d684e357f4f918e1f424ae0881a63'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:06.306874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87d684e357f4f918e1f424ae0881a63'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:06.308010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87d684e357f4f918e1f424ae0881a63'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:06.318386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87d684e357f4f918e1f424ae0881a63'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:06.319513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87d684e357f4f918e1f424ae0881a63'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:06.342376 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2193/4375] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:05 2022] DELETE /identity/v3/users/b87d684e357f4f918e1f424ae0881a63 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:06.347581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:06.348565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:06.349105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:06.372830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:06.374570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:06.442278 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:06.472176 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2183/4376] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:06.478937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:06.481184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:06.544042 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:06.568026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c8369-8e71-4d58-bb74-0a8061587192 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:06.572628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:06.573576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:06.574039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:06.574469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:06.587210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:06.589694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:06.602623 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2194/4377] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:07.393281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:07.395318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:07.413267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaa8d5-f4f7-423a-affb-eb1a29a60e8e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:07.428335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:07.429035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:07.429311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:07.429584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] PATH_INFO: `/v3/projects/99f7eae440db43e98f0198f9a5c26a13` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:07.431453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f7eae440db43e98f0198f9a5c26a13)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:07.434903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:07.509913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f7eae440db43e98f0198f9a5c26a13', 'request_id': 'req-1d045359-7e30-4cd3-8985-77f53903aa78'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.517190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f7eae440db43e98f0198f9a5c26a13', 'request_id': 'req-1d045359-7e30-4cd3-8985-77f53903aa78'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.523294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f7eae440db43e98f0198f9a5c26a13', 'request_id': 'req-1d045359-7e30-4cd3-8985-77f53903aa78'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.537783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] The token cache is being invalidate because project 99f7eae440db43e98f0198f9a5c26a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:07.538082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.538857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.541020 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2184/4378] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:07 2022] DELETE /identity/v3/projects/99f7eae440db43e98f0198f9a5c26a13 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:07.545216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:07.557810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050985f0-bd57-400e-b01f-9523dcd4e875 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:07.627471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:07.628269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:07.628597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:07.628883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] PATH_INFO: `/v3/users/65cec6796dc14a02accb3e4c83797d65` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:07.629995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cec6796dc14a02accb3e4c83797d65)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:07.631918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:07.696994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cec6796dc14a02accb3e4c83797d65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.709093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cec6796dc14a02accb3e4c83797d65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.709880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cec6796dc14a02accb3e4c83797d65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.720415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cec6796dc14a02accb3e4c83797d65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.721360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4618627d-3b45-4ed4-b892-b4a01cdf8c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cec6796dc14a02accb3e4c83797d65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:07.763051 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2195/4379] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:07 2022] DELETE /identity/v3/users/65cec6796dc14a02accb3e4c83797d65 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:08.135803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:08.139812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:08.165167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045359-7e30-4cd3-8985-77f53903aa78 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:08.249643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:08.250310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.250589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.250860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] PATH_INFO: `/v3/projects/0fc8262c64af48f5ba471fc50a52a34e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.252088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc8262c64af48f5ba471fc50a52a34e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:08.254081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:08.308136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc8262c64af48f5ba471fc50a52a34e', 'request_id': 'req-f11d9d54-ad44-44cf-adbf-ba0beafb3655'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:08.315344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc8262c64af48f5ba471fc50a52a34e', 'request_id': 'req-f11d9d54-ad44-44cf-adbf-ba0beafb3655'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:08.320882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc8262c64af48f5ba471fc50a52a34e', 'request_id': 'req-f11d9d54-ad44-44cf-adbf-ba0beafb3655'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:08.335843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] The token cache is being invalidate because project 0fc8262c64af48f5ba471fc50a52a34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:08.336128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:08.336837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f11d9d54-ad44-44cf-adbf-ba0beafb3655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:08.338572 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2185/4380] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:08 2022] DELETE /identity/v3/projects/0fc8262c64af48f5ba471fc50a52a34e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:08.344111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41d0a-0c82-4f37-89b8-024ff5c3bdeb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.344507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41d0a-0c82-4f37-89b8-024ff5c3bdeb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.344757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41d0a-0c82-4f37-89b8-024ff5c3bdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.367515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2bc41d0a-0c82-4f37-89b8-024ff5c3bdeb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:08.368794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2bc41d0a-0c82-4f37-89b8-024ff5c3bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:08.433381 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2196/4381] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:08.441921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1c20e-2c56-4df3-a9cd-5007555397ce None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.442517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1c20e-2c56-4df3-a9cd-5007555397ce None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.442517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1c20e-2c56-4df3-a9cd-5007555397ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.458002 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:08.476832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-36a1c20e-2c56-4df3-a9cd-5007555397ce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:08.477930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-36a1c20e-2c56-4df3-a9cd-5007555397ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:08.492877 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2186/4382] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:08.494210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc41d0a-0c82-4f37-89b8-024ff5c3bdeb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:08.499487 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:08.507924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc41d0a-0c82-4f37-89b8-024ff5c3bdeb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:08.514829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:08.515977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.516475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.517038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.519437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:08.519750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:08.521667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:08.540683 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2197/4383] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:08.542179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1c20e-2c56-4df3-a9cd-5007555397ce None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:08.562480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1c20e-2c56-4df3-a9cd-5007555397ce None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:08.576299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:08.576971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.577298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.577570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.578337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:08.581950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:08.636810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2187/4384] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:08 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:08.642120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:08.658297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46837d8-7821-439d-84c8-f1275bcb0bdb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:08.740399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:08.741653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.742250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.742692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.743503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:08.745782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:08.803329 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2198/4385] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:08 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:08.809048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:08.837370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5839c0-7248-4981-97f8-b96e966d7633 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:08.843575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:08.844235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.844499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.844932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.845619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:08.847285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:08.860295 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2188/4386] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:08.864250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:08.877117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65b07-3a69-4776-abdd-101629782e23 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:08.882602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea6b0-3469-4a97-80f9-3d8ae5d7d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:08.883370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea6b0-3469-4a97-80f9-3d8ae5d7d709 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.883747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea6b0-3469-4a97-80f9-3d8ae5d7d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.884113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea6b0-3469-4a97-80f9-3d8ae5d7d709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.884912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ea6b0-3469-4a97-80f9-3d8ae5d7d709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:08.886812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ea6b0-3469-4a97-80f9-3d8ae5d7d709 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:08.906339 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2199/4387] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:08.910274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:08.921785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a62f-236a-4364-994c-0b0d724aebbe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:08.926718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:08.927486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.927827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.928164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] PATH_INFO: `/v3/projects/95df0518942c48279ba4beb74661ffac/users/68ce0a750c30462895e3ee7d077e0c96/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:08.948233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95df0518942c48279ba4beb74661ffac, user_id=68ce0a750c30462895e3ee7d077e0c96, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:08.951938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:08.970458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2189/4388] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:08 2022] PUT /identity/v3/projects/95df0518942c48279ba4beb74661ffac/users/68ce0a750c30462895e3ee7d077e0c96/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:08.981407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e99d5-6e2f-4165-a40d-27854c209db9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:08.981892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e99d5-6e2f-4165-a40d-27854c209db9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:08.982174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e99d5-6e2f-4165-a40d-27854c209db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.011298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6f8e99d5-6e2f-4165-a40d-27854c209db9 None None] MFA Rules not processed for user `68ce0a750c30462895e3ee7d077e0c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:09.012587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6f8e99d5-6e2f-4165-a40d-27854c209db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:09.121664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2200/4389] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:09.126443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.220910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e8b72-236c-42a7-891e-19f942494b1c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:09.226885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:09.227738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.228150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.228549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.229663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:09.232434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:09.285457 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2190/4390] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:09 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:09.286493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e99d5-6e2f-4165-a40d-27854c209db9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.303199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e99d5-6e2f-4165-a40d-27854c209db9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:09.366623 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:09.387323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:09.388007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.388368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.388758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.389563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:09.392813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:09.425709 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2201/4391] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:09 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:09.428068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.439699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce48c6-5524-4ac5-8ccf-7bbb101e9548 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:09.447249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:09.448049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.448380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.448654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.449358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:09.451059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:09.469334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2191/4392] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:09.469717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.481595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f46b-1cd9-4f29-a808-c6d0adb4ef07 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:09.487148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:09.487866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.488146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.488426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] PATH_INFO: `/v3/projects/064a463925464814b50e6a64be38d0de/users/56bf15b2b3ae486883ca227202958221/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.506664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=064a463925464814b50e6a64be38d0de, user_id=56bf15b2b3ae486883ca227202958221, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:09.510165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:09.545887 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2202/4393] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:09 2022] PUT /identity/v3/projects/064a463925464814b50e6a64be38d0de/users/56bf15b2b3ae486883ca227202958221/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:09.550035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.565819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937057b-8ce6-49d2-8385-d7a270e25470 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:09.654293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103443c2-4a47-4598-b38e-02efdb4fe9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:09.655628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103443c2-4a47-4598-b38e-02efdb4fe9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.656183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103443c2-4a47-4598-b38e-02efdb4fe9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.656453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103443c2-4a47-4598-b38e-02efdb4fe9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.657520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103443c2-4a47-4598-b38e-02efdb4fe9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:09.659481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103443c2-4a47-4598-b38e-02efdb4fe9bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:09.672833 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2192/4394] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:09.676444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.696667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c512ad4-2c2e-4e02-9141-591cf616c7ce admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:09.704822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:09.705527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.705807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.706079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] PATH_INFO: `/v3/projects/064a463925464814b50e6a64be38d0de/users/56bf15b2b3ae486883ca227202958221/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.708206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064a463925464814b50e6a64be38d0de, user_id=56bf15b2b3ae486883ca227202958221, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:09.710986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:09.723091 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2203/4395] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:09 2022] PUT /identity/v3/projects/064a463925464814b50e6a64be38d0de/users/56bf15b2b3ae486883ca227202958221/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:09.734712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5e1f4-bdfb-4cc6-8733-882b8174a4a3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.734996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5e1f4-bdfb-4cc6-8733-882b8174a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.735273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5e1f4-bdfb-4cc6-8733-882b8174a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.757763 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:09.770865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-64c5e1f4-bdfb-4cc6-8733-882b8174a4a3 None None] MFA Rules not processed for user `56bf15b2b3ae486883ca227202958221`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:09.771866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-64c5e1f4-bdfb-4cc6-8733-882b8174a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:09.887787 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2193/4396] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:09.889587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.910207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef7ae-0dfe-49d4-80b8-c81d144e7db7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:09.917751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:09.920726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:09.921661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:09.923562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:09.925355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:09.927217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:09.956366 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2204/4397] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:23:09 2022] POST /identity/v3/domains => generated 276 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:09.959719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5e1f4-bdfb-4cc6-8733-882b8174a4a3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:09.970636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5e1f4-bdfb-4cc6-8733-882b8174a4a3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.035931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.036591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.036921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.037201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.037884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=65eacc47c5db416f9f287ba2a6abbbbb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.039959 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:10.039959 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:10.039959 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:10.041319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.108249 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2194/4398] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:23:09 2022] PUT /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config => generated 138 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:10.113137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.129030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2646d-7126-4666-be05-ca06e43738bb tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.142144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.143227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.143687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.144076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.145947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=65eacc47c5db416f9f287ba2a6abbbbb, group=identity)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.149217 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:10.149217 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:10.149217 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:10.151026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.161860 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2205/4399] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:23:10 2022] GET /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/identity => generated 45 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:10.166151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.183594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c93a-9bba-4aff-b9ea-33e2f52056f6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.191440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.192338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.192955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.193393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/identity/driver` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.195104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=65eacc47c5db416f9f287ba2a6abbbbb, group=identity, option=driver)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.197183 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:10.197183 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:10.197183 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:10.199224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.209435 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2195/4400] 10.222.0.46 () {58 vars in 1296 bytes} [Sun Aug 21 01:23:10 2022] GET /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/identity/driver => generated 31 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:10.213771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.230838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e50b4-4633-4706-a401-e19ecd1ca8f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.237680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.238861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.239843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.240221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/ldap` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.241654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=65eacc47c5db416f9f287ba2a6abbbbb, group=ldap)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.244072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.252947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2206/4401] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:23:10 2022] GET /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/ldap => generated 106 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:10.257828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.273260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8413a3-ece3-4bf4-917b-0ced74edc634 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.280808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.280808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.280808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.281490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/ldap/url` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.282972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=65eacc47c5db416f9f287ba2a6abbbbb, group=ldap, option=url)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.284746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.291578 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2196/4402] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:23:10 2022] GET /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/ldap/url => generated 46 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:10.295523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.308517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639563b0-f6e3-40cc-b1c6-123f0e43da96 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.324976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.326416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.326905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.327347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/ldap/user_tree_dn` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.328954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=65eacc47c5db416f9f287ba2a6abbbbb, group=ldap, option=user_tree_dn)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.332304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.343574 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2207/4403] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:23:10 2022] GET /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config/ldap/user_tree_dn => generated 63 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:10.344623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.357616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8fd24-830f-4422-b93f-9bad4f1bba05 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.365043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.365908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.366284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.366656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.369247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=65eacc47c5db416f9f287ba2a6abbbbb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.370700 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:10.370700 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:10.370700 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:10.373061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.386495 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2197/4404] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:23:10 2022] DELETE /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb/config => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:10.390636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.407580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6398af-12bf-4bcf-9fbe-3116eba58dbd tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.414347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.415359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.415830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.416174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.418056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=65eacc47c5db416f9f287ba2a6abbbbb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.420209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.446939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.447982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.477797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.478552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.481672 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2208/4405] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:10 2022] PATCH /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb => generated 277 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:10.485593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.487739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:10.502096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf4a0-d782-43dc-a293-5ce3e66c47b2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.542777 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:10.573270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.574016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.574361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.574701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.589729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=65eacc47c5db416f9f287ba2a6abbbbb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.591643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.617774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.622135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.676785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb', 'request_id': 'req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.686328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb', 'request_id': 'req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.694408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb', 'request_id': 'req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.717071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] The token cache is being invalidate because project 65eacc47c5db416f9f287ba2a6abbbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:10.717523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.718363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.730229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb', 'request_id': 'req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.731459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb', 'request_id': 'req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.732785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '65eacc47c5db416f9f287ba2a6abbbbb', 'request_id': 'req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:10.753351 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2198/4406] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:10 2022] DELETE /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:10.755260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.769997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625091d-86c9-4838-a181-716f10b4d07b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.865992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.866662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.866943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.867217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.867908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.869673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.893981 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2209/4407] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:23:10 2022] POST /identity/v3/domains => generated 277 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:10.895294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.897398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:10.914684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ab55f-e582-4e1e-b4e6-1bbbd21b40af tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.947089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.951036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:11.008246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.008972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.009257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.009533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.010251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.012576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.014245 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:11.049795 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:11.072500 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2199/4408] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:23:10 2022] PUT /identity/v3/domains/cff90610892a48d9b13340a84b82c541/config => generated 138 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:11.079309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.097087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be9621-433e-466a-84ed-761342716ad2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.100455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89f88-339f-4758-9556-1419c745639f tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.104832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.105914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.106599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.107083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] PATH_INFO: `/v3/users/5632a7522dd04247b4ed54e6bd8880b2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.109233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5632a7522dd04247b4ed54e6bd8880b2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.114366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.114838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.115088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.115369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.115646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.116380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.119783 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:11.119783 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:11.119783 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:11.120760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.199539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5632a7522dd04247b4ed54e6bd8880b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.202521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2200/4409] 10.222.0.46 () {60 vars in 1271 bytes} [Sun Aug 21 01:23:11 2022] PATCH /identity/v3/domains/cff90610892a48d9b13340a84b82c541/config => generated 142 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:11.208312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.216453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5632a7522dd04247b4ed54e6bd8880b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.217380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5632a7522dd04247b4ed54e6bd8880b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.224657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6996ae-9892-44ef-a93c-fd724cc788b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.226745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5632a7522dd04247b4ed54e6bd8880b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.227597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1c8e0d55-e58b-4e1e-8dce-a2d859e961f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5632a7522dd04247b4ed54e6bd8880b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.232832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.233745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.234228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.234835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.238091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.240669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.252932 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2201/4410] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:11 2022] GET /identity/v3/domains/cff90610892a48d9b13340a84b82c541/config => generated 142 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:11.254172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.255971 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2210/4411] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:10 2022] DELETE /identity/v3/users/5632a7522dd04247b4ed54e6bd8880b2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:11.256575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:11.261723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.262166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.262800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.273510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45a432-c66d-43a7-aed7-af8770165407 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.292562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:11.294374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:11.346789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.347753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.348345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.348842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.349839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.352238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.367354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2202/4412] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:23:11 2022] DELETE /identity/v3/domains/cff90610892a48d9b13340a84b82c541/config => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:11.371996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.386437 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2211/4413] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:11.395281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4abdc-4766-4192-817d-c658002d0a4a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.398328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.399992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:11.401571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.402775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.403166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.403560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.405567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.407327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Could not find any options in domain configuration for domain cff90610892a48d9b13340a84b82c541.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain cff90610892a48d9b13340a84b82c541. Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:23:11.420980 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain cff90610892a48d9b13340a84b82c541. Aug 21 01:23:11.422196 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:11.425994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2203/4414] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:11 2022] GET /identity/v3/domains/cff90610892a48d9b13340a84b82c541/config => generated 151 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:23:11.430511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.449342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329e20-3e0a-44a3-bfa8-71662058492b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.456903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.457730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.458082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.458431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541/config` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.459684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.461894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.473104 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2204/4415] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:23:11 2022] DELETE /identity/v3/domains/cff90610892a48d9b13340a84b82c541/config => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:11.478885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.490137 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:11.495058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7775c6-0a40-46a4-9cb8-30860972f436 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.501942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.503544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.503853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.504322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.507920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.510208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.512984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c980-0bd1-4e34-b326-5819b71124b2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.519271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.520258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.520852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.521315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.538473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.541354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cff90610892a48d9b13340a84b82c541'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.542225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cff90610892a48d9b13340a84b82c541'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.543011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.560408 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2212/4416] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:11.575561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cff90610892a48d9b13340a84b82c541'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.576614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cff90610892a48d9b13340a84b82c541'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.579895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2205/4417] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:11 2022] PATCH /identity/v3/domains/cff90610892a48d9b13340a84b82c541 => generated 278 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:11.584033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.596548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3192e1-ba30-4ba4-8033-6ac6fd08205a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:11.675648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:11.677647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:11.678494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:11.679047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:11.728601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cff90610892a48d9b13340a84b82c541)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:11.730673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:11.778924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cff90610892a48d9b13340a84b82c541'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.783324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cff90610892a48d9b13340a84b82c541'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.850353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff90610892a48d9b13340a84b82c541', 'request_id': 'req-2e054be4-3e83-4b38-9448-d97758fa912a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.863674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff90610892a48d9b13340a84b82c541', 'request_id': 'req-2e054be4-3e83-4b38-9448-d97758fa912a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.872574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff90610892a48d9b13340a84b82c541', 'request_id': 'req-2e054be4-3e83-4b38-9448-d97758fa912a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.889650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] The token cache is being invalidate because project cff90610892a48d9b13340a84b82c541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:11.890565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.892102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.912403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cff90610892a48d9b13340a84b82c541', 'request_id': 'req-2e054be4-3e83-4b38-9448-d97758fa912a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.917363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cff90610892a48d9b13340a84b82c541', 'request_id': 'req-2e054be4-3e83-4b38-9448-d97758fa912a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.918494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cff90610892a48d9b13340a84b82c541', 'request_id': 'req-2e054be4-3e83-4b38-9448-d97758fa912a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:11.929096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.934624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:11.937711 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2213/4418] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:11 2022] DELETE /identity/v3/domains/cff90610892a48d9b13340a84b82c541 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:11.951360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:11.953169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:11.995880 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:12.023570 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:12.048149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd83aa2-ce46-49cd-9373-1ed5f7bb64d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.049684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e054be4-3e83-4b38-9448-d97758fa912a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.055230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.055924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.056207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.056478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.058502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.062763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.108182 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2214/4419] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:23:11 2022] POST /identity/v3/domains => generated 276 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:12.112178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.151611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.152164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.152543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.152958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] PATH_INFO: `/v3/projects/d294a069ae2d4681b97ebaef49d6c11f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.155250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d294a069ae2d4681b97ebaef49d6c11f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.159356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.242046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd294a069ae2d4681b97ebaef49d6c11f', 'request_id': 'req-0a761ea5-cbed-44ef-b350-df6a9df71b05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.252250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd294a069ae2d4681b97ebaef49d6c11f', 'request_id': 'req-0a761ea5-cbed-44ef-b350-df6a9df71b05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.261323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd294a069ae2d4681b97ebaef49d6c11f', 'request_id': 'req-0a761ea5-cbed-44ef-b350-df6a9df71b05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.291379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a0588-2892-4af5-b46d-1240f5ff7f90 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.296499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] The token cache is being invalidate because project d294a069ae2d4681b97ebaef49d6c11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:12.298291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.309501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.322267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2206/4420] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:11 2022] DELETE /identity/v3/projects/d294a069ae2d4681b97ebaef49d6c11f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:12.323448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.325767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:12.368223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.368938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.369215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.369484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.370504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.371242 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:12.371242 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:12.371242 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:12.372569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.416921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a761ea5-cbed-44ef-b350-df6a9df71b05 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.420611 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2215/4421] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:23:12 2022] PUT /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config => generated 138 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:12.424839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.426614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.427329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:12.427470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.427819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.428159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] PATH_INFO: `/v3/users/75d845ff69ba44f5a922fac2420783fe` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.429463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d845ff69ba44f5a922fac2420783fe)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.431613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.443521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4ea98-fdbe-4c6a-8894-33aed973d26d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.449610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.451088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.451088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.451364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.452012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41, group=identity)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.453102 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:12.453102 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:12.453102 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:12.454011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.457957 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:12.488758 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2216/4422] 10.222.0.46 () {60 vars in 1297 bytes} [Sun Aug 21 01:23:12 2022] PATCH /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity => generated 174 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:12.493025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.500276 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:12.500529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d845ff69ba44f5a922fac2420783fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.504440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c464b1f-ac68-465d-93ff-b5130e93d05d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.510317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.511109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.511405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.511568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d845ff69ba44f5a922fac2420783fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.511709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity/driver` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.512433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41, group=identity, option=driver)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.514466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.526584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d845ff69ba44f5a922fac2420783fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.527320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d845ff69ba44f5a922fac2420783fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.536123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d845ff69ba44f5a922fac2420783fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.542227 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2217/4423] 10.222.0.46 () {60 vars in 1318 bytes} [Sun Aug 21 01:23:12 2022] PATCH /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity/driver => generated 176 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:12.544350 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2207/4424] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:12 2022] DELETE /identity/v3/users/75d845ff69ba44f5a922fac2420783fe => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:12.548053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.549963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:12.564417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196ce2e-d18d-4ca0-909d-44dce7d68937 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.629928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.630610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.630881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.631155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity/driver` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.631757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41, group=identity, option=driver)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.633022 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:12.633022 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:12.633022 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:12.633758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.655971 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2218/4425] 10.222.0.46 () {58 vars in 1299 bytes} [Sun Aug 21 01:23:12 2022] DELETE /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity/driver => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:12.657269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.668545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b431ba-d581-4306-991d-007ac4a733a6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.673769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.674501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.674785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.675057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity/driver` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.676226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41, group=identity, option=driver)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.677941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Could not find option driver in group identity in domain configuration for domain 6027f8f9fc89495cb6d53d0eca556b41.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 6027f8f9fc89495cb6d53d0eca556b41. Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:23:12.687873 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 6027f8f9fc89495cb6d53d0eca556b41. Aug 21 01:23:12.689030 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:12.689679 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2208/4426] 10.222.0.46 () {58 vars in 1296 bytes} [Sun Aug 21 01:23:12 2022] GET /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity/driver => generated 171 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:23:12.693289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.704035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4031ec4-e6da-4e82-a909-1407ee51f53c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.709352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.710016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.710302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.711119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.711284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41, group=identity)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.713078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.735975 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2219/4427] 10.222.0.46 () {58 vars in 1278 bytes} [Sun Aug 21 01:23:12 2022] DELETE /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:12.740138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.751711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6189f-ba43-4cfd-92dd-fca882997776 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.756526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.757213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.757494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.757772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.759069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41, group=identity)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.760698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Could not find group identity in domain configuration for domain 6027f8f9fc89495cb6d53d0eca556b41.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 6027f8f9fc89495cb6d53d0eca556b41. Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:23:12.771902 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 6027f8f9fc89495cb6d53d0eca556b41. Aug 21 01:23:12.773092 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:12.773787 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2209/4428] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:23:12 2022] GET /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config/identity => generated 154 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:23:12.777791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.788488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013ff4-bb03-49f1-8b61-c808c6e4a7d2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.793552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.794383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.795013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.795329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.796054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=6027f8f9fc89495cb6d53d0eca556b41)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.798244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.808898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2220/4429] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:23:12 2022] DELETE /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41/config => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:12.814119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.824696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe25955-d0d7-4a39-8e6a-25ccfe051b7c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.830002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.830674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.830995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.831278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:12.832631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6027f8f9fc89495cb6d53d0eca556b41)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:12.834330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:12.861002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.861806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.871456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.873663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:12.891978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.892729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:12.896051 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2210/4430] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:12 2022] PATCH /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41 => generated 277 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:12.900283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:12.902087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:12.973296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5aea1-e319-4e69-9e08-3d259239ba3e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.985237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec6225-604f-40cb-9686-ae9870c8ef23 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:12.990778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:12.991886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:12.992084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:12.992319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.008896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6027f8f9fc89495cb6d53d0eca556b41)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.010752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.021685 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:13.040876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.044733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.050816 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:13.057575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.058321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.058564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.058795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] PATH_INFO: `/v3/projects/3f7c40f2b2814d1b9686b8c58ddf690a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.060217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7c40f2b2814d1b9686b8c58ddf690a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.062546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.110112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41', 'request_id': 'req-b19155a2-bd92-45eb-bd4a-cd29de052be2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.116163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7c40f2b2814d1b9686b8c58ddf690a', 'request_id': 'req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.117489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41', 'request_id': 'req-b19155a2-bd92-45eb-bd4a-cd29de052be2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.125405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41', 'request_id': 'req-b19155a2-bd92-45eb-bd4a-cd29de052be2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.126981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7c40f2b2814d1b9686b8c58ddf690a', 'request_id': 'req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.138347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7c40f2b2814d1b9686b8c58ddf690a', 'request_id': 'req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.153472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] The token cache is being invalidate because project 3f7c40f2b2814d1b9686b8c58ddf690a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:13.153838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.154553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6eb8ea1-a72e-491d-87f3-1c58433e90e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.156558 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2221/4431] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:12 2022] DELETE /identity/v3/projects/3f7c40f2b2814d1b9686b8c58ddf690a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:13.159988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] The token cache is being invalidate because project 6027f8f9fc89495cb6d53d0eca556b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:13.160380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.161342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b5c0-c921-47ec-b534-6a5ac171537a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.161625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b5c0-c921-47ec-b534-6a5ac171537a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.161864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.162005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b5c0-c921-47ec-b534-6a5ac171537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.173790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41', 'request_id': 'req-b19155a2-bd92-45eb-bd4a-cd29de052be2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.174530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41', 'request_id': 'req-b19155a2-bd92-45eb-bd4a-cd29de052be2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.175454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6027f8f9fc89495cb6d53d0eca556b41', 'request_id': 'req-b19155a2-bd92-45eb-bd4a-cd29de052be2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:13.182374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-28b3b5c0-c921-47ec-b534-6a5ac171537a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:13.183622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-28b3b5c0-c921-47ec-b534-6a5ac171537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:13.194035 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2211/4432] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:12 2022] DELETE /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:13.199971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.201945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:13.265785 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2222/4433] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:13.274762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b19fc8-5d19-45f8-9721-5cca26f6fb23 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.275343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b19fc8-5d19-45f8-9721-5cca26f6fb23 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.276998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b19fc8-5d19-45f8-9721-5cca26f6fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.300936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-62b19fc8-5d19-45f8-9721-5cca26f6fb23 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:13.302183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-62b19fc8-5d19-45f8-9721-5cca26f6fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:13.307960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19155a2-bd92-45eb-bd4a-cd29de052be2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.311033 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2223/4434] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:13.315670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b19fc8-5d19-45f8-9721-5cca26f6fb23 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.325133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b19fc8-5d19-45f8-9721-5cca26f6fb23 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.330015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.330673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.331148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.331148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.331807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:13.332102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.333709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.348978 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2224/4435] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:13.351234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.363582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829181d-0549-4d00-8be3-44ebdb47b520 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.369448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.369978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.370301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.370612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.370732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.370891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.371169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.371305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.371802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.372197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.373240 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:13.373240 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:13.373240 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:13.374142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.374571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.378794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2212/4436] 10.222.0.46 () {58 vars in 1173 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:13.382971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.395672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c975-8ba1-4732-aefb-65819f3493ac tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.401719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.402449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.402805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.403689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.404875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.406524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.411202 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2213/4437] 10.222.0.46 () {58 vars in 1200 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.411988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.416304 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2225/4438] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:13 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:13.417958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.425343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5b11b-fdaa-40a0-bf04-81a72853a3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.451845 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:13.459691 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:13.505713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e2df6-3fb5-4194-b434-a52215199f18 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.508624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.509925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.510445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.511063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.511353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.511488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.511684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.512191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.512316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.514458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.515075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.516876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.522347 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2214/4439] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:13.523842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.539587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b66db-acd4-4b3f-93c8-2f58523828e3 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.546978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.548002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.548002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.548527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.549216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.553060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.553969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2226/4440] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:13 2022] POST /identity/v3/users => generated 284 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:13.556283 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2215/4441] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.556678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.557276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.569410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e917738-a35b-4e95-a0e2-c27305187904 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.572725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716e2e-a026-472b-acf3-b50f143643b7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.577860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.578526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.578807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.580229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.582955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.584123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.584279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.585194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.585476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.586177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.587842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.595969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.606363 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2216/4442] 10.222.0.46 () {58 vars in 1188 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:13.608093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.616530 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2227/4443] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:13.621605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.634556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5d2e-a94c-45de-a8ca-3c418c5be3e2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.641726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.642745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.643129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.643483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.644266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.646071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.658559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440fea8-4cff-408b-9a32-22b8921a8162 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.672522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2228/4444] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:13.672796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.672796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.672796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.673101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.674055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.674771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.678799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.681718 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2217/4445] 10.222.0.46 () {58 vars in 1200 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.686064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.693380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5e19a-15ae-4aa5-b08f-9b37fe700c22 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.698918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158431-e342-49b9-af6e-82de19dd179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.699753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158431-e342-49b9-af6e-82de19dd179d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.700759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158431-e342-49b9-af6e-82de19dd179d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.701676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158431-e342-49b9-af6e-82de19dd179d admin admin] PATH_INFO: `/v3/projects/1cb973b5fd7843e687b710c172571f14/users/1fadae4facc940408cf2d56150b3e644/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.709100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808f730-7b7e-4039-82b1-2ee776b1a4b6 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.718562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.721320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.721785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158431-e342-49b9-af6e-82de19dd179d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb973b5fd7843e687b710c172571f14, user_id=1fadae4facc940408cf2d56150b3e644, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.722053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.722708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.723679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.725454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158431-e342-49b9-af6e-82de19dd179d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.729814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.732025 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2218/4446] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.738901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.748813 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2229/4447] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:13 2022] PUT /identity/v3/projects/1cb973b5fd7843e687b710c172571f14/users/1fadae4facc940408cf2d56150b3e644/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:13.757260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39de8c-b48c-4793-a30e-0dc2665c777c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.759814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f51d-3dc8-4488-8303-07912ec5a758 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.760343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f51d-3dc8-4488-8303-07912ec5a758 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.760975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f51d-3dc8-4488-8303-07912ec5a758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.804569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-70a2f51d-3dc8-4488-8303-07912ec5a758 None None] MFA Rules not processed for user `1fadae4facc940408cf2d56150b3e644`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:13.806163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-70a2f51d-3dc8-4488-8303-07912ec5a758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:13.831500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.832445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.832740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.833061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.835145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.837181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.842428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2219/4448] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.844242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.858648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2b1d-3c17-43a8-b9ec-274a9303e715 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.864283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.865042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.866223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.866627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.867714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.870290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.871689 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2220/4449] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.875759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.880081 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2230/4450] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:13.884457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f51d-3dc8-4488-8303-07912ec5a758 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.890583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0816097-5ecb-4be5-84eb-6dd9c6b44e73 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.896496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.897405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.897869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.898148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.898762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.900370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.906769 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2221/4451] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.907641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.918195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdad97-93bc-4d95-ab25-9da048c13898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.924124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.924969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.925252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.925524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.926131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.927750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.929050 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2222/4452] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:13.932749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.944029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf786-01f6-43f2-a9d8-61e60aa66bb2 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.949334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.950171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.950772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.951054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.951645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.953382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.957906 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2223/4453] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:13.958926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.963900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f51d-3dc8-4488-8303-07912ec5a758 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.970326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.970958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.971234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.971427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ff27-da52-4215-9efb-03a3161e13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:13.971554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.972134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.974106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.976251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:13.976936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:13.977219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:13.977496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:13.978098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:13.979731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:13.980203 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:13.981572 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2224/4454] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:13.985838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:13.998010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214670-7fee-4421-a527-46022764e3db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.004336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.005144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.005486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.005862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.007111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.008934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.010359 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2225/4455] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:13 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:14.014498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.017992 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2231/4456] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:13 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:14.021848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.040322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa3867-f0f6-4c3b-8570-a69b4630bd1d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.101358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3267fa-ea91-43a9-843c-386a6cf710be admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.106864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.107962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.107962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.108502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.109342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.111410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.141547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.142262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.142537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.147451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2232/4457] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:14 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:14.147629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.147629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.149010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.149546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.153998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2226/4458] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:14.155758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.161930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a98f36-fd74-4ec2-9c32-d6c021ab1de9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.169339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b940-6456-4858-9874-906dd921992e tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.170430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.171434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.171949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.172697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.173627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.175606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.176718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.177683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.177959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.178616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.179330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.181734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.183261 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2227/4459] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:14.188212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.190155 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2233/4460] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:14.197134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.205313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e9bc-67c8-4961-9436-503ad823756c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.211855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.213329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.213713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.214131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.214506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b100-8c4f-4b66-a875-931716fbe15e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.214845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.217265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.221961 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2228/4461] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.222492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.223072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.223423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.223744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.224024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] PATH_INFO: `/v3/projects/e4d5d71d253f4768b5ad54fb2fada71b/users/a2c1af7786734470a135ba0db98ed72a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.236828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91473f-54eb-453b-bf87-ab7559281b08 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.244211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.245603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.246093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.246485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5d71d253f4768b5ad54fb2fada71b, user_id=a2c1af7786734470a135ba0db98ed72a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.246891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.247712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.249843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.250981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.254611 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2229/4462] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.262894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.277568 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2234/4463] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:14 2022] PUT /identity/v3/projects/e4d5d71d253f4768b5ad54fb2fada71b/users/a2c1af7786734470a135ba0db98ed72a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:14.278030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331087cb-2e9c-47ca-b915-8e91bc294777 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.281685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.292790 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:14.360823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.361819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.362302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.362723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.362910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7ed92-5dd3-4c56-b7b1-47613be10275 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.363316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.364971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.366341 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2230/4464] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.367057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.368695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.370854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.371507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.371854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.372190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.372884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.374519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.385930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8d00-d8a8-43ea-af34-0cdd5e51a4d0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.386729 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2235/4465] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:14.387839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.394379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.395131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.396026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.396026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] PATH_INFO: `/v3/users/78818dfe8e5b42dd84c49fc5bb2804b1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.397056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78818dfe8e5b42dd84c49fc5bb2804b1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.399403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.400370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e3e4-a7e1-48e9-ba7b-72b27dc14b77 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.405516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.406663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.406663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.406940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.407316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.408360 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:14.408360 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:14.408360 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:14.409286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.410704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2236/4466] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.414615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.426570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817e13-abc5-4b5e-aa37-9083bb7494fe tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.431682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.432330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.432605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.432915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] PATH_INFO: `/v3/projects/e4d5d71d253f4768b5ad54fb2fada71b/users/a2c1af7786734470a135ba0db98ed72a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.434934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5d71d253f4768b5ad54fb2fada71b, user_id=a2c1af7786734470a135ba0db98ed72a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.437950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.450263 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2237/4467] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:14 2022] PUT /identity/v3/projects/e4d5d71d253f4768b5ad54fb2fada71b/users/a2c1af7786734470a135ba0db98ed72a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:14.451095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.466189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78818dfe8e5b42dd84c49fc5bb2804b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:14.476475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78818dfe8e5b42dd84c49fc5bb2804b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:14.479142 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:14.494387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78818dfe8e5b42dd84c49fc5bb2804b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:14.495437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78818dfe8e5b42dd84c49fc5bb2804b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:14.503648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5f20dea-e398-4631-9a22-3aeb73ff2e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78818dfe8e5b42dd84c49fc5bb2804b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:14.511564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2231/4468] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:14 2022] DELETE /identity/v3/users/78818dfe8e5b42dd84c49fc5bb2804b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:14.513812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.514200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.514542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.534590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99325c-1ed8-4c04-ac25-4bba7f02802f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.551866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] MFA Rules not processed for user `a2c1af7786734470a135ba0db98ed72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:14.553394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.606278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379931f1-0cf4-4cf2-9baa-0e71ca55236c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.607169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379931f1-0cf4-4cf2-9baa-0e71ca55236c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.607454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379931f1-0cf4-4cf2-9baa-0e71ca55236c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.607737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379931f1-0cf4-4cf2-9baa-0e71ca55236c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.608331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379931f1-0cf4-4cf2-9baa-0e71ca55236c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.609981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379931f1-0cf4-4cf2-9baa-0e71ca55236c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.611403 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2238/4469] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.614935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac750-cdd5-4819-8b80-1209c1d45934 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.615741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac750-cdd5-4819-8b80-1209c1d45934 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.616937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac750-cdd5-4819-8b80-1209c1d45934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.643541 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2232/4470] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:14.643541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.643541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.645293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-736ac750-cdd5-4819-8b80-1209c1d45934 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:14.647194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-736ac750-cdd5-4819-8b80-1209c1d45934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.659090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa725d9-fa2f-49df-b22d-bfbe9e1f4856 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.665716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.666416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.666702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.666977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.667599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.670143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.672804 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2233/4471] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.672804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.674465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.690572 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:14.734928 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2239/4472] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:14.734928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac750-cdd5-4819-8b80-1209c1d45934 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.753726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac750-cdd5-4819-8b80-1209c1d45934 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.760057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.760732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.761156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.761283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.761900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.764400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.768646 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2240/4473] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.768646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.768999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.778365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0ba0d-685a-4f65-bd0a-fbaacc11782c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.783469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.784376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.784723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.784976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.797484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.798959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.812396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2234/4474] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:14.813310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.826769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16287b-8223-4039-a372-c03a8fd617b5 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.837596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.838398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.838613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.838867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.839468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.843246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.848136 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2235/4475] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.851857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.872485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feeb3db-bace-4460-bf30-69e529383960 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.878138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.878822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.879105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.879388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.879983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.881689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.883301 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2236/4476] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:14.891683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b84d2-6deb-46a7-8597-c69458d6b09a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.893207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.899960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.900619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.900984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.901259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.905357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828aab2-393b-4d17-bfe7-eb845198c0f8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.911519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.912202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.912808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.913093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.913337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.913709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.915062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.915322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.916598 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2237/4477] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:14.920674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.922499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.929998 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2241/4478] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:14.931443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.945900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9890-f909-45bf-9b24-bf7e3c863353 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.948099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b6cd4-0de6-4e0f-b996-785adc20d007 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.951870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.952722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.953125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.953482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.953807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.954283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.955003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.955450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.955888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.956904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.958514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:14.961616 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2242/4479] 10.222.0.46 () {58 vars in 1290 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.963026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:14.971007 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:14.977637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2c0a5-32bf-4bf3-a914-198cf3b76f13 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:14.985142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:14.986012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:14.986312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:14.986584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:14.987266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:14.989049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:14.990785 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2243/4480] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:14.994459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.006942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c5440-7dae-4cc4-b331-24a263076009 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.015287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.017368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.020999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.021499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.022183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.024500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.030707 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2244/4481] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:15.031594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.045311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb16641-9d3d-4806-b1e9-43ffbce0ad06 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.053961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.054863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.055023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.055207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.056198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.059064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.068811 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2245/4482] 10.222.0.46 () {58 vars in 1308 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.074248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.095551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88349f95-a500-445f-b46b-982b33058259 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.096731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.099029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.118405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.118405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.118405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.118825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.118825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.119041 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2238/4483] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:15.119140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.119632 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2246/4484] 10.222.0.46 () {58 vars in 1290 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:15.123842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.156378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7210-f796-4d90-98a8-a451211b521d service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.162570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.163102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.163383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.163656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.164271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.165940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.167458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2239/4485] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:15.171834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.184692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1872f01-35a9-46fd-a8f2-09532d21a18d tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.190961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.192239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.192735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.193405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.194377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.196192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.197903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2247/4486] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.201990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.228987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00364b6-1428-47e6-95e0-507a284d2843 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.243853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.245257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.245795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.246935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.247657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.249842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.252039 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2240/4487] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:15.255226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.269414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79b792-65ca-4c19-8130-168fd3f2abd1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.274747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.275503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.276066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.276423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.277091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.278793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.280530 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2248/4488] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.284407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.296865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd3a0-b9ca-4151-9a44-965d97d9fb57 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.302834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.303934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.304484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.304958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.305717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.308780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.311182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:15.315107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.318094 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2241/4489] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.323976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.330748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509edbd-d2ee-4438-8a2b-9de2a7047f3c tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.335958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.336642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.336956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.337232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] PATH_INFO: `/v3/projects/f08ff6e2e16345dc9f733f6fc859aca1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.338487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08ff6e2e16345dc9f733f6fc859aca1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.340655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.347293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f84cb-6de6-490c-95ec-6211c0bd59b8 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.353604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.354681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.355070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.355532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.356365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.361033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.372457 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2242/4490] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.373523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.386781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb0e8-d2a9-4f87-b7a9-88a11b31f7f9 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.393395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.393738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.393964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.394526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.394859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.396555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.401088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2243/4491] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.401983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.414250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08ff6e2e16345dc9f733f6fc859aca1', 'request_id': 'req-8ed396cc-d867-445c-bffb-9be9a302e8d0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:15.414404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b7066-b3f7-4fcf-a417-5b9b38de9a7b tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.423489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08ff6e2e16345dc9f733f6fc859aca1', 'request_id': 'req-8ed396cc-d867-445c-bffb-9be9a302e8d0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:15.431699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08ff6e2e16345dc9f733f6fc859aca1', 'request_id': 'req-8ed396cc-d867-445c-bffb-9be9a302e8d0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:15.447828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] The token cache is being invalidate because project f08ff6e2e16345dc9f733f6fc859aca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:15.448107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:15.449005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ed396cc-d867-445c-bffb-9be9a302e8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:15.451496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2249/4492] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:15 2022] DELETE /identity/v3/projects/f08ff6e2e16345dc9f733f6fc859aca1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:15.457020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7d4e-df2b-406a-88a9-386d977d25da None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.457131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7d4e-df2b-406a-88a9-386d977d25da None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.457358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7d4e-df2b-406a-88a9-386d977d25da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.479026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-289f7d4e-df2b-406a-88a9-386d977d25da None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:15.480391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-289f7d4e-df2b-406a-88a9-386d977d25da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:15.499631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.501124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.501525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.501872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.502433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.504215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.506209 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2244/4493] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.510836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.513000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:15.528591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5ae7-8191-4e58-8e7b-093fbefe431a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.535214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.535889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.536169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.536442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.537066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.538842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.539971 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2245/4494] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:15.544540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.552717 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:15.571197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc105ea6-3d0c-4272-b4a8-e46bc5698e00 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.575366 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2250/4495] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:15.579171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.580906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.581622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.582773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.585537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.588058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a630-55f8-4b68-b3b0-17498f412a45 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.588564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a630-55f8-4b68-b3b0-17498f412a45 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.589220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a630-55f8-4b68-b3b0-17498f412a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.591582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.597285 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2246/4496] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.598505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.628136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2235a630-55f8-4b68-b3b0-17498f412a45 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:15.629753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2235a630-55f8-4b68-b3b0-17498f412a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:15.631093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c325c-b8a1-40c6-8c71-51f8b5ca20c5 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.642267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.642969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.643296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.643582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.644334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.645134 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2251/4497] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:15.645470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a630-55f8-4b68-b3b0-17498f412a45 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.646200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.647909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2247/4498] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.652181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.657147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a630-55f8-4b68-b3b0-17498f412a45 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.664966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.666119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.666777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.666923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca3715-103f-44a6-93a5-604836ded144 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.667477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.668321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:15.669131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.671342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.675427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.676422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.676802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.677021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.677819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.679675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.681259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2248/4499] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:15.686037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.693669 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2252/4500] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:15.698614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.698743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb3f24-cd55-4353-91af-5f656cab1907 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.703904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.704573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.704885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.705213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.705745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.707517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.708827 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2249/4501] 10.222.0.46 () {58 vars in 1212 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.714115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.714667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afee9d4-400b-457d-b1ea-393bb9ce6268 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.721563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.722538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.723050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.723573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.724474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.726955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.730264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db54d-326a-4731-8022-5d6bf188d18a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.738146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.739053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.739402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.740408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.741348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.742836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.747495 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2250/4502] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.748338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.760044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ee62-52bc-47b4-a50b-769f8ad7aab0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.764533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2253/4503] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:15 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:15.769038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.769182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.769877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.770233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.770855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.771294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.773100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.777309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2251/4504] 10.222.0.46 () {58 vars in 1215 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.778494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.791802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755066-77c3-46dc-b155-29a3a853e8ab tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.793161 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:15.846586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f3414-e40e-4e87-8975-d28f8b590abe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.851720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.852345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.852623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.852925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.853569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.855847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.883048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2254/4505] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:15 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:15.887764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.888593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.888906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.890686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.890686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.891899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.893213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.897388 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2252/4506] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:15.900613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.907940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d1fbe-e00c-4e8e-a710-ad7d41b370f9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.913173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.913991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.914323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.914694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.915564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.917474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfde52-c590-448a-bd4d-089edc780b21 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.917878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.930512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2255/4507] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:15.933542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.934359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.934639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.934781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.934932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.935543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.937633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.941679 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2253/4508] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.944117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.946348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64e1b-d23f-49a7-b6b3-d5c2b02cef18 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.951693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.952312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.952586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.952967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.953535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.955150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.955431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479ab8-543e-4fce-90c1-8795bac395db tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.960688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.962059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.962764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.962764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.963306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.965293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.966691 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2254/4509] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:15.967906 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2256/4510] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:15.970614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.973788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:15.987885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef083-c5f7-453c-a617-47bec5bd1225 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.992696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e82d7-a61a-4788-9fac-0c085c6dccdf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:15.994001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.994754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.995046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:15.995326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:15.995934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:15.997923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:15.998927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e2da-2f35-4919-b44c-dc638495f84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:15.999633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e2da-2f35-4919-b44c-dc638495f84a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:15.999911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e2da-2f35-4919-b44c-dc638495f84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.000933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e2da-2f35-4919-b44c-dc638495f84a admin admin] PATH_INFO: `/v3/projects/6d9f6cf1c2694e7099cff8757420b421/users/fe0e970187b548d0878f3cbfc89f25fc/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.001430 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2255/4511] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:23:15 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:16.005518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.019249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792a825-b6f1-49a7-86ec-034435a81794 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.019687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e2da-2f35-4919-b44c-dc638495f84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9f6cf1c2694e7099cff8757420b421, user_id=fe0e970187b548d0878f3cbfc89f25fc, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.022324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e2da-2f35-4919-b44c-dc638495f84a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.026245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.027126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.027513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.027872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.029034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.031422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.035629 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2256/4512] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:23:16 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:16.036721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.042684 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2257/4513] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:15 2022] PUT /identity/v3/projects/6d9f6cf1c2694e7099cff8757420b421/users/fe0e970187b548d0878f3cbfc89f25fc/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:16.048013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.048386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.048728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.051006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796359e-6991-4b32-b2e0-422f88b206b0 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.069523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:16.070749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:16.118832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.121376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.121376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.121376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.121376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.122562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.126734 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2257/4514] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:16 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:16.127795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.143813 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2258/4515] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:16.147796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f870e5-e759-47a3-9af8-7b95a69e9898 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.157590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.158979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:16.174238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.174992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.175282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.175571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.176178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.178362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.187636 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2258/4516] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:16 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:23:16.188714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.216875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cd31e-cfce-4c7a-a866-f72da669165a tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.236257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.237092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.237260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.238518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.238932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.243359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.244531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e35a21-9210-438a-865b-b5a3c5aa8b79 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.248101 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2259/4517] 10.222.0.46 () {58 vars in 1278 bytes} [Sun Aug 21 01:23:16 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 21 01:23:16.255304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.255304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.256236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.256515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.265274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.277805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.281309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.296033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92417208-de5f-4e6f-a15d-6d0f98219fc7 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.307015 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2259/4518] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:16.307259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.308038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.308414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.308842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/6027f8f9fc89495cb6d53d0eca556b41` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.321913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Could not find domain: 6027f8f9fc89495cb6d53d0eca556b41.: keystone.exception.DomainNotFound: Could not find domain: 6027f8f9fc89495cb6d53d0eca556b41. Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6027f8f9fc89495cb6d53d0eca556b41. Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:23:16.329666 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:23:16.331171 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:23:16.332599 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6027f8f9fc89495cb6d53d0eca556b41. Aug 21 01:23:16.333871 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:16.333871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2260/4519] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:16 2022] PATCH /identity/v3/domains/6027f8f9fc89495cb6d53d0eca556b41 => generated 112 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:23:16.336508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.348515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54f3a-f0ff-4e8d-9545-75f52fab9c45 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.356376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.357186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.357705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.358280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/cff90610892a48d9b13340a84b82c541` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.360713 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:16.369930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Could not find domain: cff90610892a48d9b13340a84b82c541.: keystone.exception.DomainNotFound: Could not find domain: cff90610892a48d9b13340a84b82c541. Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cff90610892a48d9b13340a84b82c541. Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:23:16.379407 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:23:16.380882 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:23:16.385402 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cff90610892a48d9b13340a84b82c541. Aug 21 01:23:16.386633 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:23:16.386633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2260/4520] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:16 2022] PATCH /identity/v3/domains/cff90610892a48d9b13340a84b82c541 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:23:16.386796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.397605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0fa8-7b15-44be-a049-4d645c43f442 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.403193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1cef7-577d-49f0-881a-fd6d522b13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56bf15b2b3ae486883ca227202958221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '064a463925464814b50e6a64be38d0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.403935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1cef7-577d-49f0-881a-fd6d522b13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.404284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1cef7-577d-49f0-881a-fd6d522b13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.404673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1cef7-577d-49f0-881a-fd6d522b13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] PATH_INFO: `/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.414191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1cef7-577d-49f0-881a-fd6d522b13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-acc1cef7-577d-49f0-881a-fd6d522b13d1 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Could not find domain: 65eacc47c5db416f9f287ba2a6abbbbb.: keystone.exception.DomainNotFound: Could not find domain: 65eacc47c5db416f9f287ba2a6abbbbb. Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 65eacc47c5db416f9f287ba2a6abbbbb. Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:23:16.419407 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:23:16.420686 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:23:16.422149 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 65eacc47c5db416f9f287ba2a6abbbbb. Aug 21 01:23:16.423536 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:23:16.423536 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2261/4521] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:16 2022] PATCH /identity/v3/domains/65eacc47c5db416f9f287ba2a6abbbbb => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:23:16.424916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.427604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:16.442426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8fec4-fb23-436a-bacc-57b3e4ec8f71 tempest-DomainConfigurationTestJSON-2009634562 tempest-DomainConfigurationTestJSON-2009634562-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.447375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.448045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.448388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.448619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] PATH_INFO: `/v3/users/68ce0a750c30462895e3ee7d077e0c96` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.450260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ce0a750c30462895e3ee7d077e0c96)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.452266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.508095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ce0a750c30462895e3ee7d077e0c96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:16.516986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ce0a750c30462895e3ee7d077e0c96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:16.517779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ce0a750c30462895e3ee7d077e0c96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:16.525659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ce0a750c30462895e3ee7d077e0c96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:16.526419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ce0a750c30462895e3ee7d077e0c96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:16.546112 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2261/4522] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:16 2022] DELETE /identity/v3/users/68ce0a750c30462895e3ee7d077e0c96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:16.551632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.552510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.552848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.573312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:16.574506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:16.617340 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:16.704583 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2262/4523] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:16.719106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:16.722695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:16.814671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcb59a-f118-49e6-8d44-4ca004676efc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:16.820224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:16.821136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:16.821461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:16.821727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:16.832837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:16.834355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:16.845768 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2262/4524] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:17.336482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:17.338789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:17.366850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db7ce-a5bf-4fbb-a227-1e8a83c008c6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:17.372694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:17.374597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:17.375049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:17.375507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] PATH_INFO: `/v3/projects/95df0518942c48279ba4beb74661ffac` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:17.377373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95df0518942c48279ba4beb74661ffac)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:17.379933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:17.487120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95df0518942c48279ba4beb74661ffac', 'request_id': 'req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.500537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95df0518942c48279ba4beb74661ffac', 'request_id': 'req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.513159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95df0518942c48279ba4beb74661ffac', 'request_id': 'req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.533609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] The token cache is being invalidate because project 95df0518942c48279ba4beb74661ffac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:17.534548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.534802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.537494 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2263/4525] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:17 2022] DELETE /identity/v3/projects/95df0518942c48279ba4beb74661ffac => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:17.541926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:17.564207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b15f2-bb14-4b8b-ae87-b8a8fabd6b11 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:17.635941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:17.636709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:17.637078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:17.637444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] PATH_INFO: `/v3/users/56bf15b2b3ae486883ca227202958221` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:17.638731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bf15b2b3ae486883ca227202958221)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:17.640789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:17.660615 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:17.721041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bf15b2b3ae486883ca227202958221'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.732732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bf15b2b3ae486883ca227202958221'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.733387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bf15b2b3ae486883ca227202958221'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.743816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bf15b2b3ae486883ca227202958221'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.744566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4151993a-3da2-47ee-9d40-8918c68fa603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bf15b2b3ae486883ca227202958221'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:17.770133 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2263/4526] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:17 2022] DELETE /identity/v3/users/56bf15b2b3ae486883ca227202958221 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:18.160565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:18.162142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:18.189606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9ece6-2bdc-4abe-a887-41a87ef8cd39 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:18.337958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:18.338755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:18.339099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:18.339530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] PATH_INFO: `/v3/projects/064a463925464814b50e6a64be38d0de` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:18.340883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064a463925464814b50e6a64be38d0de)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:18.352127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:18.447933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064a463925464814b50e6a64be38d0de', 'request_id': 'req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:18.457900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064a463925464814b50e6a64be38d0de', 'request_id': 'req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:18.469196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064a463925464814b50e6a64be38d0de', 'request_id': 'req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:18.473317 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:18.517350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] The token cache is being invalidate because project 064a463925464814b50e6a64be38d0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:18.520324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:18.521547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fcda8560-9f56-4d24-9e9d-c74b8c8b3033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:18.524569 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2264/4527] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:18 2022] DELETE /identity/v3/projects/064a463925464814b50e6a64be38d0de => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:18.530438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a26f-188f-4224-b181-435f2e0089bf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:18.530837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a26f-188f-4224-b181-435f2e0089bf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:18.531202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a26f-188f-4224-b181-435f2e0089bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:18.556313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c7d5a26f-188f-4224-b181-435f2e0089bf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:18.558485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c7d5a26f-188f-4224-b181-435f2e0089bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:18.692648 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2264/4528] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:18.693906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9543-9c33-444b-bfe0-7232c3a1b628 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:18.694216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9543-9c33-444b-bfe0-7232c3a1b628 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:18.694471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9543-9c33-444b-bfe0-7232c3a1b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:18.733998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-45ea9543-9c33-444b-bfe0-7232c3a1b628 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:18.737320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-45ea9543-9c33-444b-bfe0-7232c3a1b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:18.751386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2265/4529] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:18.752686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a26f-188f-4224-b181-435f2e0089bf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:18.766953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a26f-188f-4224-b181-435f2e0089bf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:18.789502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:18.791075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:18.791849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:18.793413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:18.795575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:18.796192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:18.799753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:18.818115 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2265/4530] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:18.823769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9543-9c33-444b-bfe0-7232c3a1b628 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:18.834637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9543-9c33-444b-bfe0-7232c3a1b628 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:18.840669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:18.841518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:18.841798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:18.842099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:18.845087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:18.847236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:18.884814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2266/4531] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:18 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:18.886564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:18.897164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5250d-8dfe-4bab-9c00-2f0661c8f9ea admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:18.972567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:18.972974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:18.973258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:18.973581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:18.974485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:18.989269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.019229 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2266/4532] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:18 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:19.020113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.046830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86129df-c034-4c3c-8748-98404f80adea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.063953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.064593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.066753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.067051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.067724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.069681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.089243 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2267/4533] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:19.093564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.104987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6cd2a-a225-4d44-a70a-a9b7fe6da7b9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.114801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.115743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.116190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.116636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.117517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.119490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.123987 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:19.140562 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2267/4534] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:19.140809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.157605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907179-6be7-4df5-a6bb-05ace491fb47 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.163801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ddcb-903a-467b-b5c3-c93dc56dcbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.165371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ddcb-903a-467b-b5c3-c93dc56dcbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.165874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ddcb-903a-467b-b5c3-c93dc56dcbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.166380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ddcb-903a-467b-b5c3-c93dc56dcbbb admin admin] PATH_INFO: `/v3/projects/a8716c178dfc432dbb0e26270cdad276/users/9797b4fcb6b54381b74bb2b5472a2a96/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.174233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.177839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:19.202021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd4071-adb0-49ae-86e3-82ca8029a4d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.206702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ddcb-903a-467b-b5c3-c93dc56dcbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8716c178dfc432dbb0e26270cdad276, user_id=9797b4fcb6b54381b74bb2b5472a2a96, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.209543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.210241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.210524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.210801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] PATH_INFO: `/v3/users/1fadae4facc940408cf2d56150b3e644` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.212149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fadae4facc940408cf2d56150b3e644)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.212279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ddcb-903a-467b-b5c3-c93dc56dcbbb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.215011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.262498 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2268/4535] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:19 2022] PUT /identity/v3/projects/a8716c178dfc432dbb0e26270cdad276/users/9797b4fcb6b54381b74bb2b5472a2a96/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:19.265325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.265683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.266101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.305785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] MFA Rules not processed for user `9797b4fcb6b54381b74bb2b5472a2a96`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:19.307706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:19.310552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fadae4facc940408cf2d56150b3e644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:19.326904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fadae4facc940408cf2d56150b3e644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:19.327535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fadae4facc940408cf2d56150b3e644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:19.340140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fadae4facc940408cf2d56150b3e644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:19.341348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fb28097b-b988-4f57-8efb-94007868ff4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fadae4facc940408cf2d56150b3e644'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:19.383445 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2268/4536] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:19 2022] DELETE /identity/v3/users/1fadae4facc940408cf2d56150b3e644 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:19.388509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.388872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.389148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.431930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:19.433684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:19.471777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2269/4537] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:19.473021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.474804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:19.524257 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2269/4538] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:19.535753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.537306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:19.618438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2e964-2983-4d13-bc08-9ed29285f01b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.624436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.625583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.626176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.626748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.635125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da7bce-1ded-4d6b-92af-a2fbfa2e85c6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.642415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.644348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.655771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.657281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.657793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.658289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.659444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.661124 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2270/4539] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:19.665994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.722948 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2270/4540] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:19 2022] POST /identity/v3/projects => generated 369 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:19.725670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.742405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c3777-359a-407f-83d8-4fa3126a4fb4 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.765777 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:19.858950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.859852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.860305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.861571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.862342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.864600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.907575 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2271/4541] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:19 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:19.908578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.914757 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:19.924116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ca2b-58e7-40ce-89f3-341deefec698 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:19.946493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:19.947139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:19.947372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:19.947617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:19.948466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:19.953166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:19.971387 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2271/4542] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:19.976117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:19.997658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091e2ce-d79e-465f-8025-6406829829c3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.003997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.004804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.005818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.006173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] PATH_INFO: `/v3/projects/5e95dd9d87af4fdcb0ad32a6643b150f/users/3aaa01a73b1a44759c91ce66c82d3a55/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.029447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e95dd9d87af4fdcb0ad32a6643b150f, user_id=3aaa01a73b1a44759c91ce66c82d3a55, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.032503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.060292 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2272/4543] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:19 2022] PUT /identity/v3/projects/5e95dd9d87af4fdcb0ad32a6643b150f/users/3aaa01a73b1a44759c91ce66c82d3a55/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:20.064648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.077502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681ad-284f-4b24-9376-e251dc9d9172 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.212142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.214984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:20.218387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.220452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.221092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.221546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.222386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.227165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.233201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb47d4-031a-41a3-8dae-dafc36a56186 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.238900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.239982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.240464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.241133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] PATH_INFO: `/v3/projects/1cb973b5fd7843e687b710c172571f14` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.242726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb973b5fd7843e687b710c172571f14)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.245888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.258354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2272/4544] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:20.262324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.288723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef4b2f-1f2c-4a38-93d0-2f19018fe95a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.299064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98586-b329-47c3-ad18-2257bbd71f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.299771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98586-b329-47c3-ad18-2257bbd71f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.300050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98586-b329-47c3-ad18-2257bbd71f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.300325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98586-b329-47c3-ad18-2257bbd71f7a admin admin] PATH_INFO: `/v3/projects/5e95dd9d87af4fdcb0ad32a6643b150f/users/3aaa01a73b1a44759c91ce66c82d3a55/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.305581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f98586-b329-47c3-ad18-2257bbd71f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e95dd9d87af4fdcb0ad32a6643b150f, user_id=3aaa01a73b1a44759c91ce66c82d3a55, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.308302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f98586-b329-47c3-ad18-2257bbd71f7a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.329022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb973b5fd7843e687b710c172571f14', 'request_id': 'req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.337990 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2273/4545] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:20 2022] PUT /identity/v3/projects/5e95dd9d87af4fdcb0ad32a6643b150f/users/3aaa01a73b1a44759c91ce66c82d3a55/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:20.349286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f766-5d4b-40a2-ab5d-ad86b1e6cc0a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.350349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f766-5d4b-40a2-ab5d-ad86b1e6cc0a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.351012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f766-5d4b-40a2-ab5d-ad86b1e6cc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.362430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb973b5fd7843e687b710c172571f14', 'request_id': 'req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.372328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb973b5fd7843e687b710c172571f14', 'request_id': 'req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.394407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] The token cache is being invalidate because project 1cb973b5fd7843e687b710c172571f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:20.397591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.398784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.406678 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2273/4546] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:20 2022] DELETE /identity/v3/projects/1cb973b5fd7843e687b710c172571f14 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:20.407924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.412821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:20.427799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1919f766-5d4b-40a2-ab5d-ad86b1e6cc0a None None] MFA Rules not processed for user `3aaa01a73b1a44759c91ce66c82d3a55`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:20.429492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1919f766-5d4b-40a2-ab5d-ad86b1e6cc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:20.549497 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2274/4547] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:20.553234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f766-5d4b-40a2-ab5d-ad86b1e6cc0a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.567047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f766-5d4b-40a2-ab5d-ad86b1e6cc0a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.568453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcf27-3a9e-4c70-8579-a4b5e1ca3947 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.572917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.573547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.573829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.574095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.574835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.576922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.579119 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:20.607529 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2275/4548] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:23:20 2022] POST /identity/v3/domains => generated 277 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:20.608541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.680586 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:20.697356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.698182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.698555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.698929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] PATH_INFO: `/v3/users/a2c1af7786734470a135ba0db98ed72a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.700254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c1af7786734470a135ba0db98ed72a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.702790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.703251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9913b5-12c8-4f7c-b90c-c1aa1c14dcc9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.710664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.712296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.712725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.713048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.713706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.716229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.786870 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2276/4549] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:20 2022] POST /identity/v3/groups => generated 279 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:20.792638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.812495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb3f6-eebc-4c2a-91a0-752f2bff6696 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.820393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.821397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.821928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.822580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/c1863162287d4248aff1ad10560aa2d9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.829785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:update_group(group_id=c1863162287d4248aff1ad10560aa2d9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.831422 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:20.831422 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:20.831422 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:20.833311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.837832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c1af7786734470a135ba0db98ed72a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.860348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c1af7786734470a135ba0db98ed72a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.861198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c1af7786734470a135ba0db98ed72a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.874478 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2277/4550] 10.222.0.46 () {60 vars in 1247 bytes} [Sun Aug 21 01:23:20 2022] PATCH /identity/v3/groups/c1863162287d4248aff1ad10560aa2d9 => generated 291 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:20.875717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:20.879187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:20.885763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c1af7786734470a135ba0db98ed72a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.889179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c1af7786734470a135ba0db98ed72a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:20.899704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16057b50-6f19-454c-8123-fbcee799b93a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:20.912303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:20.913086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:20.913571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:20.914461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/c1863162287d4248aff1ad10560aa2d9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:20.915526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2274/4551] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:20 2022] DELETE /identity/v3/users/a2c1af7786734470a135ba0db98ed72a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:20.927690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:get_group(group_id=c1863162287d4248aff1ad10560aa2d9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:20.929936 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:20.929936 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:20.929936 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:20.931754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:20.937450 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2278/4552] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:20 2022] GET /identity/v3/groups/c1863162287d4248aff1ad10560aa2d9 => generated 291 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:20.938525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:21.032497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62746877-bee5-47e6-b0ec-1375be14e545 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:21.038229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:21.038964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:21.039259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:21.039528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/c1863162287d4248aff1ad10560aa2d9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:21.040876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:update_group(group_id=c1863162287d4248aff1ad10560aa2d9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:21.045998 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:21.045998 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:21.045998 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:21.047451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:21.079883 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2275/4553] 10.222.0.46 () {60 vars in 1246 bytes} [Sun Aug 21 01:23:20 2022] PATCH /identity/v3/groups/c1863162287d4248aff1ad10560aa2d9 => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:21.081035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:21.096652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41a2d0-dc11-4277-ba2a-f1bc60a7e462 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:21.108421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:21.109142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:21.109413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:21.109734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/c1863162287d4248aff1ad10560aa2d9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:21.122412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c1863162287d4248aff1ad10560aa2d9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:21.139811 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:21.139811 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:21.139811 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:21.149436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:21.242122 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2279/4554] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:21 2022] DELETE /identity/v3/groups/c1863162287d4248aff1ad10560aa2d9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:21.244089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:21.265283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c914e-a425-4b83-9c10-39ca710a4576 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:21.320905 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:21.462828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:21.463793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:21.464292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:21.464755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:21.465711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:21.467036 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:21.467036 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:21.467036 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:21.469171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:21.504121 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2276/4555] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:21 2022] POST /identity/v3/groups => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:21.505394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:21.527128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3bea2-2a91-452b-aac8-06b0d8b59632 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:21.539494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:21.540163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:21.540445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:21.540717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:21.541402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:21.543323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:21.588508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:21.590754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:21.604783 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2280/4556] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:21 2022] POST /identity/v3/users => generated 323 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:21.607506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:21.628789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32158fc-b9d7-4d7d-9ff1-8d44eba65f67 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:21.640390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:21.641292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:21.642755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:21.643029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/72551aa07e6a43099f4eac41671600ab` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:21.736043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=72551aa07e6a43099f4eac41671600ab)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:21.737516 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:21.737516 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:21.737516 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:21.738948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:21.770202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20187-93d9-44f2-b078-bc92d678114a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:21.776641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:21.778218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:21.779034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:21.779463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] PATH_INFO: `/v3/projects/e4d5d71d253f4768b5ad54fb2fada71b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:21.781416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d5d71d253f4768b5ad54fb2fada71b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:21.784447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:21.814533 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2281/4557] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:23:21 2022] PUT /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/72551aa07e6a43099f4eac41671600ab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:21.815623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:21.878309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d5d71d253f4768b5ad54fb2fada71b', 'request_id': 'req-167f1967-6ef5-4129-9506-f9fd72768990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:21.893900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d5d71d253f4768b5ad54fb2fada71b', 'request_id': 'req-167f1967-6ef5-4129-9506-f9fd72768990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:21.903212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d5d71d253f4768b5ad54fb2fada71b', 'request_id': 'req-167f1967-6ef5-4129-9506-f9fd72768990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:21.918211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] The token cache is being invalidate because project e4d5d71d253f4768b5ad54fb2fada71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:21.918666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:21.919868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-167f1967-6ef5-4129-9506-f9fd72768990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:21.924814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2277/4558] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:21 2022] DELETE /identity/v3/projects/e4d5d71d253f4768b5ad54fb2fada71b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:21.930093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556caa-28dc-48ab-86d0-c0ffadeaf38b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:21.931392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556caa-28dc-48ab-86d0-c0ffadeaf38b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:21.931723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556caa-28dc-48ab-86d0-c0ffadeaf38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:21.957168 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:21.972967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb24ef-a2ee-44c0-aaf4-eaaf7240c2d6 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:21.979089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2a556caa-28dc-48ab-86d0-c0ffadeaf38b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:21.981822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2a556caa-28dc-48ab-86d0-c0ffadeaf38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:22.052502 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:22.100691 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2278/4559] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:22.102866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4e87-3892-4aa5-b006-fcde9dc3f813 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.103059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.103240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4e87-3892-4aa5-b006-fcde9dc3f813 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.104191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4e87-3892-4aa5-b006-fcde9dc3f813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.104567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.104985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.105354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.106405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.109357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.150795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8dbd4e87-3892-4aa5-b006-fcde9dc3f813 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:22.162166 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2282/4560] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:21 2022] POST /identity/v3/users => generated 321 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:22.163641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8dbd4e87-3892-4aa5-b006-fcde9dc3f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:22.169909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.173312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:22.177230 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2279/4561] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:22.181514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4e87-3892-4aa5-b006-fcde9dc3f813 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.192595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde1f8-dcb5-4042-a714-841751364e54 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.197416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4e87-3892-4aa5-b006-fcde9dc3f813 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.198216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.199301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.199810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.200285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/495a403751c948288e31bea17c42dcc6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.203928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.205549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.206209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.206483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.207479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:22.207793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.209457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.222126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=495a403751c948288e31bea17c42dcc6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.224537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.233229 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2280/4562] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:22.239952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.265277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa37f2-fb28-4ae6-83e7-17755ac7a489 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.269733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2283/4563] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:23:22 2022] PUT /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/495a403751c948288e31bea17c42dcc6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:22.273651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.353560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.355141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.355527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.355910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.356699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.361052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.405215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16168d-2bd3-406f-994d-5cf6f136a194 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.411668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.413236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.413582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.413868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.414629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.417309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.433385 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2281/4564] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:22 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:22.438754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.462136 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2284/4565] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:22 2022] POST /identity/v3/users => generated 323 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:22.464127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.490738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db41a01-b62d-4ae2-a601-ccdfdb7a95a9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.583268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981027b-bd4a-4e2f-bea6-4cdaf0582d58 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.589677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.590521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.590841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.591640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.592476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.595217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.625435 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2282/4566] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:22 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:22.630328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.638367 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:22.699742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f329c-aab5-44ab-be58-3a83f4194759 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.730568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.735350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.736321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.736705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.737049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/6f996b6679d743978a42e9fcc1bafdbe` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.743393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.743683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.743951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.744630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.773494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.797931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=6f996b6679d743978a42e9fcc1bafdbe)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.800131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.815014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2283/4567] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:22.818999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.844529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7508a-0132-4574-9731-87f57b998a07 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:22.859965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:22.861114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:22.861818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:22.862363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:22.863724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:22.868210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:22.886349 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2285/4568] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:23:22 2022] PUT /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/6f996b6679d743978a42e9fcc1bafdbe => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:22.890561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.903770 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2284/4569] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:22.905810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:22.964337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3c97-3de2-47c7-9f34-a560c4ec82ee admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.017659 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:23.150970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b609aef-7698-44ad-8d29-5a20ab70b451 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.173641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.174367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a43aad-94ab-4678-bbf6-75c2e57e1b87 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.174521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.174730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.175011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] PATH_INFO: `/v3/projects/e8ad782c1a4343329ea378b63dedb1d6/users/591397e2fb574365b6d6cd26479024d5/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.175508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43aad-94ab-4678-bbf6-75c2e57e1b87 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.177908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43aad-94ab-4678-bbf6-75c2e57e1b87 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.179034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43aad-94ab-4678-bbf6-75c2e57e1b87 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.186414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43aad-94ab-4678-bbf6-75c2e57e1b87 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=fe78339d98a2457fb69b498f31e508ab)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.189692 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-f2a43aad-94ab-4678-bbf6-75c2e57e1b87 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:23.189692 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:23.189692 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:23.193704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43aad-94ab-4678-bbf6-75c2e57e1b87 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.232851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ad782c1a4343329ea378b63dedb1d6, user_id=591397e2fb574365b6d6cd26479024d5, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.238143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.280927 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2285/4570] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:22 2022] PUT /identity/v3/projects/e8ad782c1a4343329ea378b63dedb1d6/users/591397e2fb574365b6d6cd26479024d5/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:23.282880 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2286/4571] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:23:22 2022] GET /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users => generated 1083 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:23.290652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:23.291450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dae32-2689-4968-853c-7221f1aa1abf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.291815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dae32-2689-4968-853c-7221f1aa1abf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.308023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dae32-2689-4968-853c-7221f1aa1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.372097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5e8dae32-2689-4968-853c-7221f1aa1abf None None] MFA Rules not processed for user `591397e2fb574365b6d6cd26479024d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:23.374273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5e8dae32-2689-4968-853c-7221f1aa1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:23.412713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf588a5-1f84-4378-ace2-f5d30567e56f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.423200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.423800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.424089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.424364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/72551aa07e6a43099f4eac41671600ab` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.426093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=72551aa07e6a43099f4eac41671600ab)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.427134 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:23.427134 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:23.427134 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:23.428337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.447308 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2286/4572] 10.222.0.46 () {58 vars in 1342 bytes} [Sun Aug 21 01:23:23 2022] HEAD /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/72551aa07e6a43099f4eac41671600ab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:23.453308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:23.474948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8785-20d3-4c75-aca2-4d5f77c84bfd tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.494812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.498656 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2287/4573] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:23.498976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.498976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.498976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/72551aa07e6a43099f4eac41671600ab` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.500744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=72551aa07e6a43099f4eac41671600ab)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.501427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dae32-2689-4968-853c-7221f1aa1abf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:23.501955 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:23.501955 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:23.501955 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:23.503586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.523002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-20462152-d13b-43c9-aa80-0b42479048d1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '72551aa07e6a43099f4eac41671600ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:23.570434 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2287/4574] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:23:23 2022] DELETE /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/72551aa07e6a43099f4eac41671600ab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:23.572342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48391-97bd-4e59-8cb9-8636d8eb5459 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.573051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48391-97bd-4e59-8cb9-8636d8eb5459 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.573296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48391-97bd-4e59-8cb9-8636d8eb5459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.604971 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:23.608446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8cd48391-97bd-4e59-8cb9-8636d8eb5459 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:23.609887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8cd48391-97bd-4e59-8cb9-8636d8eb5459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:23.622483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dae32-2689-4968-853c-7221f1aa1abf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.685218 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:23.690486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260cf29-6fbe-4f3d-9e7a-e4651664d691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.691149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260cf29-6fbe-4f3d-9e7a-e4651664d691 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.691427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260cf29-6fbe-4f3d-9e7a-e4651664d691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.691781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260cf29-6fbe-4f3d-9e7a-e4651664d691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.692436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260cf29-6fbe-4f3d-9e7a-e4651664d691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.693023 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2288/4575] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:23.694209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48391-97bd-4e59-8cb9-8636d8eb5459 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:23.694618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260cf29-6fbe-4f3d-9e7a-e4651664d691 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.726868 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2288/4576] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:23 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:23.731391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87060d7-8ee9-45ed-9a92-b38b37a6c7d3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.731688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87060d7-8ee9-45ed-9a92-b38b37a6c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.732181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87060d7-8ee9-45ed-9a92-b38b37a6c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.754227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e87060d7-8ee9-45ed-9a92-b38b37a6c7d3 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:23.755538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e87060d7-8ee9-45ed-9a92-b38b37a6c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:23.799723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48391-97bd-4e59-8cb9-8636d8eb5459 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.833162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2289/4577] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:23.835804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87060d7-8ee9-45ed-9a92-b38b37a6c7d3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:23.871933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.872492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.872785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.873071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/495a403751c948288e31bea17c42dcc6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.875008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=495a403751c948288e31bea17c42dcc6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.877156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.893910 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2289/4578] 10.222.0.46 () {58 vars in 1342 bytes} [Sun Aug 21 01:23:23 2022] HEAD /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/495a403751c948288e31bea17c42dcc6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:23.895209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:23.899588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:23.902686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87060d7-8ee9-45ed-9a92-b38b37a6c7d3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.909174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.909819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.910098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.910377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.911019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.913244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.942742 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2290/4579] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:23 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:23.944570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:23.961965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47487c5-4ae8-44e8-864c-ae819afc7b3e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:23.969577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:23.970266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:23.970597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:23.970814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/495a403751c948288e31bea17c42dcc6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:23.972506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=495a403751c948288e31bea17c42dcc6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:23.973628 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:23.973628 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:23.973628 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:23.974833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:23.986855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '495a403751c948288e31bea17c42dcc6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:23.992167 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:23.998877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c60580-2eaf-41f5-9853-e726c4d5433e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.008809 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2291/4580] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:23:23 2022] DELETE /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/495a403751c948288e31bea17c42dcc6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:24.010052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.055658 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:24.095635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19438-dd0f-486c-af84-2c501a9aee17 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.099906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.100496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.100824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.101123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.101787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.102369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.102648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.102916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.103568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.105272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.120819 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2292/4581] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:24.122748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.183472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.186091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.196978 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2290/4582] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:24.197971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.210889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c2b14-ff2d-4ec0-8682-c447278cc191 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.213922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e5c3-8fec-4ad9-92d4-425993f96a17 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.217293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.218196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.218485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.218763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] PATH_INFO: `/v3/projects/3d9825f0099f4351978dc666420618b2/users/eb752460a42944c188057a61f38a62df/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.230425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.231365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.231670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.232251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/6f996b6679d743978a42e9fcc1bafdbe` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.235217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=6f996b6679d743978a42e9fcc1bafdbe)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.236283 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:24.236283 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:24.236283 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:24.239399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.249400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9825f0099f4351978dc666420618b2, user_id=eb752460a42944c188057a61f38a62df, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.258900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.267815 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2293/4583] 10.222.0.46 () {58 vars in 1342 bytes} [Sun Aug 21 01:23:24 2022] HEAD /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/6f996b6679d743978a42e9fcc1bafdbe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:24.272059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.289454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21cdb9-3fc6-4269-9978-97f0962f96bc tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.307275 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2291/4584] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:24 2022] PUT /identity/v3/projects/3d9825f0099f4351978dc666420618b2/users/eb752460a42944c188057a61f38a62df/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:24.310032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.433439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.434560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.434991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.435353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/6f996b6679d743978a42e9fcc1bafdbe` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.437927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fe78339d98a2457fb69b498f31e508ab, user_id=6f996b6679d743978a42e9fcc1bafdbe)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.440031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.446604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c51da-984f-423d-afa9-5e42f0fd9c28 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.454380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.455243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.455724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.457127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6f996b6679d743978a42e9fcc1bafdbe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:24.457880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.468794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.470760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.486722 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2292/4586] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:24.486930 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2294/4586] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:23:24 2022] DELETE /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users/6f996b6679d743978a42e9fcc1bafdbe => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:24.492008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.493035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.500627 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:24.525109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee559b-c802-4ece-bdd3-de29ea3685fe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.616426 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:24.642249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdffc87-8ac5-4480-b1de-b9c34cea4104 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.647728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.648395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.648975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.649258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.651319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=fe78339d98a2457fb69b498f31e508ab)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.652353 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:24.652353 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:24.652353 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:24.653649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.654735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac05b8-90d0-4df4-a9c5-0da4386231d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.655674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac05b8-90d0-4df4-a9c5-0da4386231d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.655960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac05b8-90d0-4df4-a9c5-0da4386231d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.656229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac05b8-90d0-4df4-a9c5-0da4386231d2 admin admin] PATH_INFO: `/v3/projects/3d9825f0099f4351978dc666420618b2/users/eb752460a42944c188057a61f38a62df/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.658592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac05b8-90d0-4df4-a9c5-0da4386231d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9825f0099f4351978dc666420618b2, user_id=eb752460a42944c188057a61f38a62df, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.661800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac05b8-90d0-4df4-a9c5-0da4386231d2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.676264 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2295/4587] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:24 2022] PUT /identity/v3/projects/3d9825f0099f4351978dc666420618b2/users/eb752460a42944c188057a61f38a62df/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:24.688126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.688385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.688662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.696563 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2293/4588] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:23:24 2022] GET /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab/users => generated 145 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:24.700643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.722880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] MFA Rules not processed for user `eb752460a42944c188057a61f38a62df`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:24.724121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:24.728004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5be4c5-2c96-48af-89f8-af66d9be87b9 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:24.821610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:24.822289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:24.822556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:24.822975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users/6f996b6679d743978a42e9fcc1bafdbe` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:24.825451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6f996b6679d743978a42e9fcc1bafdbe)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:24.830961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:24.900146 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2296/4589] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:24.913472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f996b6679d743978a42e9fcc1bafdbe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:24.914739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:24.916544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:24.931194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f996b6679d743978a42e9fcc1bafdbe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:24.931965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f996b6679d743978a42e9fcc1bafdbe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:24.950901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f996b6679d743978a42e9fcc1bafdbe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:24.951966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f996b6679d743978a42e9fcc1bafdbe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:24.991907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2294/4590] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:24 2022] DELETE /identity/v3/users/6f996b6679d743978a42e9fcc1bafdbe => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:25.008585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:25.011441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:25.084199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899208d-d568-420f-99d2-d96c6a6c4ab3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:25.114351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee67d0-56bf-4e45-a383-97b68195478c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:25.124997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:25.125682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:25.125964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:25.126237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users/495a403751c948288e31bea17c42dcc6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:25.127547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_user(user_id=495a403751c948288e31bea17c42dcc6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:25.130409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:25.134766 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:25.151335 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:25.166593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:25.167440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:25.167799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:25.168759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:25.173694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:25.223011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495a403751c948288e31bea17c42dcc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.250847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495a403751c948288e31bea17c42dcc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.251548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495a403751c948288e31bea17c42dcc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.272882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495a403751c948288e31bea17c42dcc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.273641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495a403751c948288e31bea17c42dcc6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.312694 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2295/4591] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:24 2022] DELETE /identity/v3/users/495a403751c948288e31bea17c42dcc6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:25.316874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:25.320356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:25.363833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:25.365910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:25.398921 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2297/4592] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:25.490538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1541-7cda-4f06-8eea-35c060b2085a tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:25.505884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:25.510927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:25.512912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:25.513518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users/72551aa07e6a43099f4eac41671600ab` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:25.521792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_user(user_id=72551aa07e6a43099f4eac41671600ab)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:25.530755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:25.650934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72551aa07e6a43099f4eac41671600ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.669509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72551aa07e6a43099f4eac41671600ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.670437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72551aa07e6a43099f4eac41671600ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.687194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72551aa07e6a43099f4eac41671600ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.688367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72551aa07e6a43099f4eac41671600ab'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:25.708668 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:25.714637 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2296/4593] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:25 2022] DELETE /identity/v3/users/72551aa07e6a43099f4eac41671600ab => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:25.719718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:25.741561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2c83-8058-48e0-8c97-e083ce42ab75 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:25.950703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:25.951478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:25.952485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:25.952818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe78339d98a2457fb69b498f31e508ab` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:25.955702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fe78339d98a2457fb69b498f31e508ab)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:25.958104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.104259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2298/4594] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:25 2022] DELETE /identity/v3/groups/fe78339d98a2457fb69b498f31e508ab => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:26.105204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.106754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:26.143810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebc974-500e-4a1d-95b5-a75e528bd0c8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.352529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.353246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.353529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.353650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.353907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.355989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:26.357567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:26.359573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.430807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2297/4595] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:26 2022] POST /identity/v3/groups => generated 326 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:26.437400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.475547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669f8d-a6ba-4d0a-9525-a71c457206f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.493295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.493973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.494338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.494634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.495579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:26.499451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.504126 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:26.541997 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2298/4596] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:26 2022] POST /identity/v3/groups => generated 326 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:26.547212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.547420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72482-442c-4687-8367-b410128df5c1 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.561139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c25a98-13f9-419e-b135-c3775778e485 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.562905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c28a36-cfff-4842-ac73-c63db0ef243c tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb752460a42944c188057a61f38a62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d9825f0099f4351978dc666420618b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.563737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28a36-cfff-4842-ac73-c63db0ef243c tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.564019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28a36-cfff-4842-ac73-c63db0ef243c tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.564295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28a36-cfff-4842-ac73-c63db0ef243c tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.565017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c28a36-cfff-4842-ac73-c63db0ef243c tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:26.565320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c28a36-cfff-4842-ac73-c63db0ef243c tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:26.566969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c28a36-cfff-4842-ac73-c63db0ef243c tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.567853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.568530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.569177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.569483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.570124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:26.572246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.616359 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2299/4597] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:26.616605 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2299/4598] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:26 2022] POST /identity/v3/groups => generated 327 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:26.617533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc233a-6db0-443b-8805-8484574079a8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.617848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc233a-6db0-443b-8805-8484574079a8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.618307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc233a-6db0-443b-8805-8484574079a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.627250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.651007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c740d4-3208-48b9-8b1b-37d54b3e758c tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.663318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e8dc233a-6db0-443b-8805-8484574079a8 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:26.664590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e8dc233a-6db0-443b-8805-8484574079a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:26.665979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb752460a42944c188057a61f38a62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d9825f0099f4351978dc666420618b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.669975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.671044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.672182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.673219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:26.678435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.768784 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2300/4599] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:26 2022] POST /identity/v3/projects => generated 352 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:26.771760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.791382 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2300/4600] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:26.792483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc233a-6db0-443b-8805-8484574079a8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.841154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc233a-6db0-443b-8805-8484574079a8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.894806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e260de-f19a-4806-a811-b55d009e90e9 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.902057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.903245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.903891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.903891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.904385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:26.905451 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:26.905451 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:26.905451 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:26.906929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.916812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2301/4601] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:23:26 2022] GET /identity/v3/groups => generated 1489 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:26.916812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.920716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:26.928025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb752460a42944c188057a61f38a62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d9825f0099f4351978dc666420618b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.928893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.929397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.929750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.931000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:26.931397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:26.933512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:26.952952 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2301/4602] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:26.954341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:26.971506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e495aca-ae9d-4de5-97c4-9b8d71d05261 tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:26.979711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:26.980895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:26.981601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:26.982299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/dc767446d2c445529d09c00564f2bd83` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:26.988634 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:26.998393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dc767446d2c445529d09c00564f2bd83)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:27.004055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:27.062759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26b61-55c7-44ec-8c52-a6ef73950440 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:27.077528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:27.078178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:27.078462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:27.078738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:27.092472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2302/4603] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:26 2022] DELETE /identity/v3/groups/dc767446d2c445529d09c00564f2bd83 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:27.094235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:27.161580 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:27.206830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c841fb-516b-4697-8f52-f364aee5746e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:27.213961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:27.215060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb752460a42944c188057a61f38a62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d9825f0099f4351978dc666420618b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:27.215882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:27.216214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:27.216479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:27.216614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] PATH_INFO: `/v3/projects/9c630fcfad1d491c84bf288dc8aacf27` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:27.218374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c630fcfad1d491c84bf288dc8aacf27)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:27.220207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:27.248413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2302/4604] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:23:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:23:27.249679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:27.272875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7a2da-1e4e-4d3f-9b2d-77cd07269da5 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:27.404902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c630fcfad1d491c84bf288dc8aacf27', 'request_id': 'req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:27.412278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:27.414775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:27.416880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:27.417448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/174c346ee93b4f2cafe41508530ad06f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:27.430963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c630fcfad1d491c84bf288dc8aacf27', 'request_id': 'req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:27.444162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=174c346ee93b4f2cafe41508530ad06f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:27.445583 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:27.445583 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:27.445583 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:27.450638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c630fcfad1d491c84bf288dc8aacf27', 'request_id': 'req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:27.456398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:27.476259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] The token cache is being invalidate because project 9c630fcfad1d491c84bf288dc8aacf27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:27.476534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:27.480704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:27.483710 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2303/4605] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:27 2022] DELETE /identity/v3/projects/9c630fcfad1d491c84bf288dc8aacf27 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:27.687136 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2303/4606] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:27 2022] DELETE /identity/v3/groups/174c346ee93b4f2cafe41508530ad06f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:27.691704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:27.693537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:27.925135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ce9e-fb98-47c3-b6bd-31a7b2c91e0d tempest-VolumeQuotaClassesTest-1265929935 tempest-VolumeQuotaClassesTest-1265929935-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:28.155630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:28.157196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:28.157484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:28.157766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/70dc967deadf46ae8f25af59a4a3273d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:28.161083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:28.163046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:28.183657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=70dc967deadf46ae8f25af59a4a3273d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:28.187269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:28.194380 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:28.299106 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:28.303664 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2304/4607] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:27 2022] DELETE /identity/v3/groups/70dc967deadf46ae8f25af59a4a3273d => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:28.310623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:28.347680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d609-9f4f-4d34-8920-39185229f0cb tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:28.483638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:28.484467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:28.485922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:28.486315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] PATH_INFO: `/v3/users/591397e2fb574365b6d6cd26479024d5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:28.489651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] RBAC: Authorizing `identity:delete_user(user_id=591397e2fb574365b6d6cd26479024d5)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:28.499918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:28.508967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767b84-dfe6-4ef3-b2df-5b5d26657303 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:28.530655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:28.531490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:28.531881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:28.532252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:28.533114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:28.537172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:28.637242 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2305/4608] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:28 2022] POST /identity/v3/users => generated 319 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:28.639617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591397e2fb574365b6d6cd26479024d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:28.644700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:28.655948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591397e2fb574365b6d6cd26479024d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:28.656518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591397e2fb574365b6d6cd26479024d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:28.672041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591397e2fb574365b6d6cd26479024d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:28.674253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f82c00a5-aabd-4b0a-9057-69666eca217e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591397e2fb574365b6d6cd26479024d5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:28.696528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f415-047a-4c8d-b70f-cfbd0147dd94 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:28.719093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:28.719749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:28.720029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:28.720299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:28.720962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:28.722655 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2304/4609] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:28 2022] DELETE /identity/v3/users/591397e2fb574365b6d6cd26479024d5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:28.723134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:28.724093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:28.724379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:28.724656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:28.761823 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2306/4610] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:28 2022] POST /identity/v3/groups => generated 327 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:28.770607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:28.772835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:28.775938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:28.778638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:28.816154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9c01-a059-4dec-a3bb-45ef8c28d2b8 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:28.922973 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2305/4611] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:28.941077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:28.942701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:28.957551 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:29.087696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99fd50-aae7-4d75-adff-9daf83072dd9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:29.099181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:29.101030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:29.101933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:29.102217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:29.126353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:29.127864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:29.160532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:29.162662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:29.162952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:29.163236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe8c4fa9383e42328b4afcfe382c2931/users/d4b74ab5f7034fd782f08e140dfc966d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:29.170810 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2306/4612] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:23:29.236404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fe8c4fa9383e42328b4afcfe382c2931, user_id=d4b74ab5f7034fd782f08e140dfc966d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:29.238477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:29.284530 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2307/4613] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:23:28 2022] PUT /identity/v3/groups/fe8c4fa9383e42328b4afcfe382c2931/users/d4b74ab5f7034fd782f08e140dfc966d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:29.288267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:29.305198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300c57-3be8-484c-9790-7d0d99cf496f service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:29.479109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:29.480419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:29.480419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:29.480419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:29.481834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:29.489448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:29.523159 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2307/4614] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:29 2022] POST /identity/v3/groups => generated 326 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:29.524906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:29.557122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30f63-9c83-4bf8-88ca-1db4b0467f52 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:29.590333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:29.591034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:29.591317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:29.591592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/8da97472d20c4b808121e68357c13331/users/d4b74ab5f7034fd782f08e140dfc966d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:29.594241 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:29.600934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8da97472d20c4b808121e68357c13331, user_id=d4b74ab5f7034fd782f08e140dfc966d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:29.609105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:29.684139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2308/4615] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:23:29 2022] PUT /identity/v3/groups/8da97472d20c4b808121e68357c13331/users/d4b74ab5f7034fd782f08e140dfc966d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:29.688361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:29.703435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1d1c0-9704-4644-86cd-bdbe1ba50a74 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:29.989476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:29.992167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:30.052743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c929667-2100-4395-90db-475080174299 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:30.053475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c929667-2100-4395-90db-475080174299 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:30.053860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c929667-2100-4395-90db-475080174299 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:30.054030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c929667-2100-4395-90db-475080174299 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users/d4b74ab5f7034fd782f08e140dfc966d/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:30.065952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c929667-2100-4395-90db-475080174299 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=d4b74ab5f7034fd782f08e140dfc966d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:30.078522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c929667-2100-4395-90db-475080174299 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:30.181239 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2308/4616] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:23:29 2022] GET /identity/v3/users/d4b74ab5f7034fd782f08e140dfc966d/groups => generated 839 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:30.182756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2b97a-66e3-44d2-a147-22641a35e9ab None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:30.183043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2b97a-66e3-44d2-a147-22641a35e9ab None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:30.183320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2b97a-66e3-44d2-a147-22641a35e9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:30.330503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c9e2b97a-66e3-44d2-a147-22641a35e9ab None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:30.332128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c9e2b97a-66e3-44d2-a147-22641a35e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:30.417725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3c79-b1d4-4599-b731-97bcb1a52aa5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:30.432938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:30.433668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:30.434004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:30.434294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] PATH_INFO: `/v3/projects/e8ad782c1a4343329ea378b63dedb1d6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:30.437306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ad782c1a4343329ea378b63dedb1d6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:30.442626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:30.525671 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:30.547883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ad782c1a4343329ea378b63dedb1d6', 'request_id': 'req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:30.561226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ad782c1a4343329ea378b63dedb1d6', 'request_id': 'req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:30.571334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ad782c1a4343329ea378b63dedb1d6', 'request_id': 'req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:30.604401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] The token cache is being invalidate because project e8ad782c1a4343329ea378b63dedb1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:30.606235 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2309/4617] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:30.606968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:30.607171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2b97a-66e3-44d2-a147-22641a35e9ab None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:30.613334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:30.634730 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2309/4618] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:29 2022] DELETE /identity/v3/projects/e8ad782c1a4343329ea378b63dedb1d6 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:30.635954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:30.639958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:30.655357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2b97a-66e3-44d2-a147-22641a35e9ab None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:30.830356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c2a3-9056-4c4e-a387-b6efdb5561df admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:30.843401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:30.845947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:30.846996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:30.847434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:30.847729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:30.847982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:30.848115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/8da97472d20c4b808121e68357c13331` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:30.848593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:30.850865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:30.853396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8da97472d20c4b808121e68357c13331)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:30.859412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:30.876688 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:30.990377 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2310/4619] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:30 2022] DELETE /identity/v3/groups/8da97472d20c4b808121e68357c13331 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:30.993942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:30.997272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:30.998346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:30.998715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:31.027505 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2310/4620] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:23:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:23:31.028534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:31.030108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:31.060934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4647a-504a-4549-9c9c-4f5aa1d649fa service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:31.219506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17467fe5-adf5-427c-8920-cee2a228f050 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:31.226148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:31.227128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:31.227735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:31.228410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] PATH_INFO: `/v3/users/eb752460a42944c188057a61f38a62df` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:31.232547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb752460a42944c188057a61f38a62df)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:31.235331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:31.320233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:31.320984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:31.321268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:31.321546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/groups/fe8c4fa9383e42328b4afcfe382c2931` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:31.329089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fe8c4fa9383e42328b4afcfe382c2931)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:31.331111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:31.401883 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:31.415009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb752460a42944c188057a61f38a62df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:31.425211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb752460a42944c188057a61f38a62df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:31.426224 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2311/4621] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:31 2022] DELETE /identity/v3/groups/fe8c4fa9383e42328b4afcfe382c2931 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:31.426709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb752460a42944c188057a61f38a62df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:31.430699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:31.432574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:31.440592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb752460a42944c188057a61f38a62df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:31.441488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb752460a42944c188057a61f38a62df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:31.484859 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2311/4622] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:30 2022] DELETE /identity/v3/users/eb752460a42944c188057a61f38a62df => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:31.606581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03477981-744d-443a-9559-331e5a1783f5 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:31.642055 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:31.798390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:31.798971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:31.799253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:31.799580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/users/d4b74ab5f7034fd782f08e140dfc966d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:31.803979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d4b74ab5f7034fd782f08e140dfc966d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:31.806771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:31.922029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b74ab5f7034fd782f08e140dfc966d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:31.955023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b74ab5f7034fd782f08e140dfc966d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.012048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b74ab5f7034fd782f08e140dfc966d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.013572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b74ab5f7034fd782f08e140dfc966d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.038912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b74ab5f7034fd782f08e140dfc966d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.073449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2312/4623] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:31 2022] DELETE /identity/v3/users/d4b74ab5f7034fd782f08e140dfc966d => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:32.075709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:32.099621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdfdde-60d2-4f39-ac99-0414d1b75917 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:32.284917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:32.285623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:32.285926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:32.286212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/domains/612798e59122445fa8a05b0e5472bcaa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:32.287594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=612798e59122445fa8a05b0e5472bcaa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:32.289704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:32.391491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:32.410625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:32.445922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '612798e59122445fa8a05b0e5472bcaa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.449844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '612798e59122445fa8a05b0e5472bcaa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.548623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '612798e59122445fa8a05b0e5472bcaa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.553319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '612798e59122445fa8a05b0e5472bcaa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.562769 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2312/4624] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:32 2022] PATCH /identity/v3/domains/612798e59122445fa8a05b0e5472bcaa => generated 278 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:32.566997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:32.576402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:32.692796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004d42-8f23-4b9b-ac95-b7f95d371556 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:32.787859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e33834-e53d-441b-a551-6f2d5bb7ccf2 tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:32.801553 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:32.817611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aaa01a73b1a44759c91ce66c82d3a55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e95dd9d87af4fdcb0ad32a6643b150f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:32.821816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:32.822623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:32.823662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] PATH_INFO: `/v3/domains/612798e59122445fa8a05b0e5472bcaa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:32.863317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=612798e59122445fa8a05b0e5472bcaa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:32.866318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:32.868109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:32.870307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:32.870598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:32.870881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] PATH_INFO: `/v3/projects/3d9825f0099f4351978dc666420618b2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:32.878129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9825f0099f4351978dc666420618b2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:32.880809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:32.928294 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:32.933852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '612798e59122445fa8a05b0e5472bcaa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:32.939370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '612798e59122445fa8a05b0e5472bcaa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.054127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612798e59122445fa8a05b0e5472bcaa', 'request_id': 'req-aa15715b-a2b8-442c-9429-0be7684f4f8e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.070896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612798e59122445fa8a05b0e5472bcaa', 'request_id': 'req-aa15715b-a2b8-442c-9429-0be7684f4f8e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.079089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612798e59122445fa8a05b0e5472bcaa', 'request_id': 'req-aa15715b-a2b8-442c-9429-0be7684f4f8e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.106584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] The token cache is being invalidate because project 612798e59122445fa8a05b0e5472bcaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:33.106889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.113265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.119470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9825f0099f4351978dc666420618b2', 'request_id': 'req-76831c91-dbe8-4c69-9e10-5ca3e370f932'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.140814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '612798e59122445fa8a05b0e5472bcaa', 'request_id': 'req-aa15715b-a2b8-442c-9429-0be7684f4f8e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.140814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '612798e59122445fa8a05b0e5472bcaa', 'request_id': 'req-aa15715b-a2b8-442c-9429-0be7684f4f8e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.140814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '612798e59122445fa8a05b0e5472bcaa', 'request_id': 'req-aa15715b-a2b8-442c-9429-0be7684f4f8e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.141280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9825f0099f4351978dc666420618b2', 'request_id': 'req-76831c91-dbe8-4c69-9e10-5ca3e370f932'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.152789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9825f0099f4351978dc666420618b2', 'request_id': 'req-76831c91-dbe8-4c69-9e10-5ca3e370f932'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.157595 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2313/4625] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:32 2022] DELETE /identity/v3/domains/612798e59122445fa8a05b0e5472bcaa => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:33.158723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:33.166012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:33.175243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] The token cache is being invalidate because project 3d9825f0099f4351978dc666420618b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:33.175552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.176717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-76831c91-dbe8-4c69-9e10-5ca3e370f932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.182039 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2313/4626] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:32 2022] DELETE /identity/v3/projects/3d9825f0099f4351978dc666420618b2 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:33.192739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4f2d-dc6c-4a19-8036-50b60813c8e8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:33.193348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4f2d-dc6c-4a19-8036-50b60813c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:33.193784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4f2d-dc6c-4a19-8036-50b60813c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:33.233871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1c2b4f2d-dc6c-4a19-8036-50b60813c8e8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:33.235428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1c2b4f2d-dc6c-4a19-8036-50b60813c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:33.310163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15715b-a2b8-442c-9429-0be7684f4f8e tempest-GroupsV3TestJSON-1936388569 tempest-GroupsV3TestJSON-1936388569-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:33.484439 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2314/4627] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:33.487001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d375e8-b7ea-40d6-a028-a0f243783566 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:33.487358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d375e8-b7ea-40d6-a028-a0f243783566 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:33.487696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d375e8-b7ea-40d6-a028-a0f243783566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:33.504225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:33.505734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:33.506393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:33.506884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] PATH_INFO: `/v3/users/9797b4fcb6b54381b74bb2b5472a2a96` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:33.508657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9797b4fcb6b54381b74bb2b5472a2a96)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:33.511209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:33.524480 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:33.559832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-35d375e8-b7ea-40d6-a028-a0f243783566 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:33.561165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-35d375e8-b7ea-40d6-a028-a0f243783566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:33.574556 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2315/4628] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:33.579258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d375e8-b7ea-40d6-a028-a0f243783566 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:33.598561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d375e8-b7ea-40d6-a028-a0f243783566 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:33.624599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:33.625499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:33.625984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:33.626424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:33.627206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:33.627615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:33.629667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:33.649945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9797b4fcb6b54381b74bb2b5472a2a96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.666151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9797b4fcb6b54381b74bb2b5472a2a96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.667280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9797b4fcb6b54381b74bb2b5472a2a96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.677065 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2316/4629] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:33.678266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:33.681498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:33.688656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9797b4fcb6b54381b74bb2b5472a2a96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.691795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a19e455-558a-4f11-b275-2a69d5c38eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9797b4fcb6b54381b74bb2b5472a2a96'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:33.728005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7562ce9-fdc8-4e59-89c2-44a4d9dcee24 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:33.748761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:33.749764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:33.750080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:33.750467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:33.751237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:33.753370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:33.804363 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2314/4630] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:33 2022] DELETE /identity/v3/users/9797b4fcb6b54381b74bb2b5472a2a96 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:33.814352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:33.816980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:33.817512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:33.855373 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2317/4631] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:33 2022] POST /identity/v3/projects => generated 401 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:33.856725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:33.893524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:33.895153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:33.934873 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:33.988002 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2315/4632] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:34.002525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:34.004733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:34.023213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2cc8-d47c-4ad2-bd69-7809c210eb60 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:34.051344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:34.052162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:34.052576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:34.052980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:34.053727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:34.056828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:34.087067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0995-844e-4de4-87be-99f6faaad379 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:34.093628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:34.094934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:34.095410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:34.096568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:34.111287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:34.113573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:34.140305 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2318/4633] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:33 2022] POST /identity/v3/users => generated 301 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:34.144469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:34.145243 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2316/4634] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:34.172648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70f6f4-2f51-4df4-96b3-d71ed756393d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:34.191840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:34.192659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:34.193062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:34.193435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:34.194196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:34.196452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:34.217737 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2319/4635] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:34.221718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:34.236893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67757a-3c78-4156-88f6-f97bbaa1d418 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:34.251016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe24a70-4f2e-40e2-9c00-f6e95a52af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:34.251681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe24a70-4f2e-40e2-9c00-f6e95a52af9d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:34.251966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe24a70-4f2e-40e2-9c00-f6e95a52af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:34.252273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe24a70-4f2e-40e2-9c00-f6e95a52af9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:34.253211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe24a70-4f2e-40e2-9c00-f6e95a52af9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:34.254889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe24a70-4f2e-40e2-9c00-f6e95a52af9d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:34.285917 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2317/4636] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:34.290536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:34.309524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d129e-5406-406a-a272-8cf178953160 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:34.329980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:34.330891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:34.331243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:34.331621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] PATH_INFO: `/v3/projects/457f9479db2a4f03a49d0f7278d12844/users/222e6734a439444cbdd42e8754328990/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:34.372836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=457f9479db2a4f03a49d0f7278d12844, user_id=222e6734a439444cbdd42e8754328990, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:34.379261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:34.424293 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2320/4637] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:34 2022] PUT /identity/v3/projects/457f9479db2a4f03a49d0f7278d12844/users/222e6734a439444cbdd42e8754328990/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:34.428019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfd82-ba62-4bd9-a18d-3e39cfdbaea0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:34.428591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfd82-ba62-4bd9-a18d-3e39cfdbaea0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:34.429128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfd82-ba62-4bd9-a18d-3e39cfdbaea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:34.518295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9b6cfd82-ba62-4bd9-a18d-3e39cfdbaea0 None None] MFA Rules not processed for user `222e6734a439444cbdd42e8754328990`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:34.529579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9b6cfd82-ba62-4bd9-a18d-3e39cfdbaea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:34.557015 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:34.755181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:34.755893 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2318/4638] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:34.943445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60d786-ca6c-4c20-b8c5-6e06bda9c82d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:34.972630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:34.976381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:34.976879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:34.977262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:34.978080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:34.980404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:35.043852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cfd82-ba62-4bd9-a18d-3e39cfdbaea0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:35.056867 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2321/4639] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:34 2022] POST /identity/v3/projects => generated 401 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:35.064313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cfd82-ba62-4bd9-a18d-3e39cfdbaea0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:35.296810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:35.297635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:35.297635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:35.297635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:35.298319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:35.300371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:35.386089 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2319/4640] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:35 2022] POST /identity/v3/users => generated 307 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:35.389084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:35.390585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:35.393332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:35.407652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa3564-a794-4482-9643-e1c71e900eb3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:35.410104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89263-382d-4ace-bee7-182cba1da2f5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:35.415559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:35.416499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:35.417005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:35.417432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] PATH_INFO: `/v3/projects/a8716c178dfc432dbb0e26270cdad276` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:35.419385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8716c178dfc432dbb0e26270cdad276)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:35.419873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:35.420954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:35.421450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:35.421918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:35.423741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:35.426068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:35.427730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:35.448806 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2322/4641] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:35.455754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:35.495098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c25e3-b678-495d-b39b-a8f7877180d7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:35.513076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8716c178dfc432dbb0e26270cdad276', 'request_id': 'req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:35.529566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8716c178dfc432dbb0e26270cdad276', 'request_id': 'req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:35.538328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8716c178dfc432dbb0e26270cdad276', 'request_id': 'req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:35.559800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] The token cache is being invalidate because project a8716c178dfc432dbb0e26270cdad276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:35.560407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:35.561704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:35.564085 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2320/4642] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:35 2022] DELETE /identity/v3/projects/a8716c178dfc432dbb0e26270cdad276 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:35.568035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:35.570010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:35.596015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:35.598190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:35.599097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:35.600653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] PATH_INFO: `/v3/projects/db8bac2f12cc4e2bb89737307bcdbb51/users/daea06e102c14683b1263af4f275c817/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:35.604739 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:35.612859 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:35.658493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8bac2f12cc4e2bb89737307bcdbb51, user_id=daea06e102c14683b1263af4f275c817, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:35.676674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:35.740386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2323/4643] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:35 2022] PUT /identity/v3/projects/db8bac2f12cc4e2bb89737307bcdbb51/users/daea06e102c14683b1263af4f275c817/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:35.747770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:35.754997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:35.802197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0cdc-f0f3-4b17-bb45-df5f8cf09091 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:36.033482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd408-bd7a-48c6-a726-5412388d8d71 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:36.048658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:36.049782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:36.050073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:36.050476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:36.051260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:36.052973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:36.053579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:36.054611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:36.060028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:36.061044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] PATH_INFO: `/v3/users/3aaa01a73b1a44759c91ce66c82d3a55` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:36.067377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aaa01a73b1a44759c91ce66c82d3a55)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:36.088291 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2324/4644] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:36.089621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:36.090148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:36.111706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945189f6-79db-48ed-9d12-8fa463355e7d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:36.131782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613c38-3893-4c25-9278-66836f2cac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:36.132617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613c38-3893-4c25-9278-66836f2cac11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:36.132943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613c38-3893-4c25-9278-66836f2cac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:36.134140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613c38-3893-4c25-9278-66836f2cac11 admin admin] PATH_INFO: `/v3/projects/db8bac2f12cc4e2bb89737307bcdbb51/users/daea06e102c14683b1263af4f275c817/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:36.145351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf613c38-3893-4c25-9278-66836f2cac11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8bac2f12cc4e2bb89737307bcdbb51, user_id=daea06e102c14683b1263af4f275c817, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:36.149395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf613c38-3893-4c25-9278-66836f2cac11 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:36.198495 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2325/4645] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:36 2022] PUT /identity/v3/projects/db8bac2f12cc4e2bb89737307bcdbb51/users/daea06e102c14683b1263af4f275c817/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:36.216826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b586-90af-4a56-bf7e-9791f51f80b2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:36.217755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b586-90af-4a56-bf7e-9791f51f80b2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:36.218303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b586-90af-4a56-bf7e-9791f51f80b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:36.274313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aaa01a73b1a44759c91ce66c82d3a55'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:36.293745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aaa01a73b1a44759c91ce66c82d3a55'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:36.294668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aaa01a73b1a44759c91ce66c82d3a55'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:36.315174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3da8b586-90af-4a56-bf7e-9791f51f80b2 None None] MFA Rules not processed for user `daea06e102c14683b1263af4f275c817`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:36.316168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aaa01a73b1a44759c91ce66c82d3a55'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:36.317132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aaa01a73b1a44759c91ce66c82d3a55'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:36.318658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3da8b586-90af-4a56-bf7e-9791f51f80b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:36.390881 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2321/4646] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:35 2022] DELETE /identity/v3/users/3aaa01a73b1a44759c91ce66c82d3a55 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:36.603360 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2326/4647] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:36.620348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:36.622064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:36.777445 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:36.803683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de5990-4164-44d3-8b62-90b5f923d5b3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:36.815678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:36.820370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:36.820811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:36.821184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:36.997765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:37.001221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:37.028317 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2322/4648] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:36 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:37.202595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8b586-90af-4a56-bf7e-9791f51f80b2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:37.270819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:37.272149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:37.413507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8b586-90af-4a56-bf7e-9791f51f80b2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:37.424180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e28b75-443b-4751-95ef-a4ddb837b577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:37.425461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28b75-443b-4751-95ef-a4ddb837b577 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:37.429337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28b75-443b-4751-95ef-a4ddb837b577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:37.429783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28b75-443b-4751-95ef-a4ddb837b577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:37.435322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d8e28b75-443b-4751-95ef-a4ddb837b577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:37.445889 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:37.485802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9ffb-7d16-4a73-864a-191659fac140 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:37.506285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:37.506911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:37.507233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:37.507506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] PATH_INFO: `/v3/projects/5e95dd9d87af4fdcb0ad32a6643b150f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:37.509062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e95dd9d87af4fdcb0ad32a6643b150f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:37.510797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:37.581491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28b75-443b-4751-95ef-a4ddb837b577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:37.583126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28b75-443b-4751-95ef-a4ddb837b577 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:37.596424 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2327/4649] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:37.674145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e95dd9d87af4fdcb0ad32a6643b150f', 'request_id': 'req-f4be82b2-a683-46cc-8ad8-5d8c99131906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:37.695198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e95dd9d87af4fdcb0ad32a6643b150f', 'request_id': 'req-f4be82b2-a683-46cc-8ad8-5d8c99131906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:37.703269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e95dd9d87af4fdcb0ad32a6643b150f', 'request_id': 'req-f4be82b2-a683-46cc-8ad8-5d8c99131906'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:37.744811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] The token cache is being invalidate because project 5e95dd9d87af4fdcb0ad32a6643b150f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:37.745400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:37.748315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f4be82b2-a683-46cc-8ad8-5d8c99131906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:37.754589 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2323/4650] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:37 2022] DELETE /identity/v3/projects/5e95dd9d87af4fdcb0ad32a6643b150f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:37.759733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d78c-c555-4455-99f6-cd0e299fd8fd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:37.760253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d78c-c555-4455-99f6-cd0e299fd8fd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:37.760381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d78c-c555-4455-99f6-cd0e299fd8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:37.827500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-edb7d78c-c555-4455-99f6-cd0e299fd8fd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:37.828598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-edb7d78c-c555-4455-99f6-cd0e299fd8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:38.043878 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2328/4651] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:38.045621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92f2b-6d8b-4f0e-9166-bea2eb80b2ff None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:38.045912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92f2b-6d8b-4f0e-9166-bea2eb80b2ff None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:38.046188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92f2b-6d8b-4f0e-9166-bea2eb80b2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:38.125846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-45f92f2b-6d8b-4f0e-9166-bea2eb80b2ff None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:38.130256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-45f92f2b-6d8b-4f0e-9166-bea2eb80b2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:38.174166 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2324/4652] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:38.175534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7d78c-c555-4455-99f6-cd0e299fd8fd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:38.204189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7d78c-c555-4455-99f6-cd0e299fd8fd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:38.214043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:38.227998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:38.228373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:38.228662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:38.229392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:38.229700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:38.238208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:38.281418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2329/4653] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:38.285873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f92f2b-6d8b-4f0e-9166-bea2eb80b2ff None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:38.301481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f92f2b-6d8b-4f0e-9166-bea2eb80b2ff None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:38.312457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:38.313565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:38.314948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:38.325758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:38.326725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:38.333813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:38.386119 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:38.421611 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2325/4654] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:38 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:38.422134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:38.446727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abb0e9-3251-4b69-80ae-572b63397974 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:38.663736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:38.664411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:38.664691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:38.664990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:38.669560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:38.671721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:38.727791 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2330/4655] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:38 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:38.729444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:38.746169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b893-344e-4c6b-8d60-d2fa40addded admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:38.771998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:38.775515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:38.775864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:38.776076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:38.776953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:38.784831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:38.833801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2326/4656] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:38.838041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:38.855378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013818-c432-4567-a242-a34a25054c1f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:38.873670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f198d-c29c-4811-80fc-89e143cc99e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:38.874933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f198d-c29c-4811-80fc-89e143cc99e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:38.875425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f198d-c29c-4811-80fc-89e143cc99e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:38.876009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f198d-c29c-4811-80fc-89e143cc99e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:38.877752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f198d-c29c-4811-80fc-89e143cc99e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:38.879781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f198d-c29c-4811-80fc-89e143cc99e9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:38.914733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2331/4657] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:38.921422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:38.938599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19883c-dfb8-4c0c-bb95-b98a5f6f40a5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:38.953214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:38.954270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:38.954752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:38.955496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] PATH_INFO: `/v3/projects/dd109cd8283e4d07a79f1828efa96eb8/users/1d9ca12b6c1d46f8bd43df0b2e41e85d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:39.006645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd109cd8283e4d07a79f1828efa96eb8, user_id=1d9ca12b6c1d46f8bd43df0b2e41e85d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:39.013343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:39.056810 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2327/4658] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:38 2022] PUT /identity/v3/projects/dd109cd8283e4d07a79f1828efa96eb8/users/1d9ca12b6c1d46f8bd43df0b2e41e85d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:39.172277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6054-de13-44f5-a4fd-342371c11b6a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:39.173019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6054-de13-44f5-a4fd-342371c11b6a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:39.173533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6054-de13-44f5-a4fd-342371c11b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:39.243251 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:39.271236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-94fe6054-de13-44f5-a4fd-342371c11b6a None None] MFA Rules not processed for user `1d9ca12b6c1d46f8bd43df0b2e41e85d`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:39.272645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-94fe6054-de13-44f5-a4fd-342371c11b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:39.489172 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2332/4659] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:39.493416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:39.663035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab84db-4265-46c7-bd67-72aadb59771d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:39.676199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:39.677143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:39.677613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:39.678060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:39.678884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:39.681040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:39.784299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6054-de13-44f5-a4fd-342371c11b6a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:39.785287 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2328/4660] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:39 2022] POST /identity/v3/projects => generated 371 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:39.805751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6054-de13-44f5-a4fd-342371c11b6a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:39.931880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:39.932743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:39.932959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:39.933310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:39.934214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:39.937109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:39.994473 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2333/4661] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:39 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:39.998543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:40.015691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9668a8-8f32-4286-804b-b2915a3ab862 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:40.025443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:40.026089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:40.026373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:40.026647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:40.027334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:40.036667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:40.081363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:40.081901 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2329/4662] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:40.101371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec968c6-37c1-41ad-8b6b-af01cc554ee6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:40.115083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:40.116551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:40.116905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:40.118700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] PATH_INFO: `/v3/projects/eeda5a6dd6224645936afaa1958dd8fb/users/30e03e8a84db40a9baaa84aa40d13acd/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:40.191065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeda5a6dd6224645936afaa1958dd8fb, user_id=30e03e8a84db40a9baaa84aa40d13acd, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:40.193905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:40.227667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2334/4663] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:40 2022] PUT /identity/v3/projects/eeda5a6dd6224645936afaa1958dd8fb/users/30e03e8a84db40a9baaa84aa40d13acd/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:40.235653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:40.257056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2d5f-0944-4f45-8a6f-468d81a7477d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:40.478446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b1cd-c55b-4f25-852f-bae780e1306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:40.479540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b1cd-c55b-4f25-852f-bae780e1306b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:40.480787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b1cd-c55b-4f25-852f-bae780e1306b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:40.481199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b1cd-c55b-4f25-852f-bae780e1306b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:40.482668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b1cd-c55b-4f25-852f-bae780e1306b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:40.484681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b1cd-c55b-4f25-852f-bae780e1306b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:40.505258 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2330/4664] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:40.510496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:40.527657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee87a95-e020-4016-bde0-1861484de722 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:40.538638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:40.541412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:40.541999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:40.542409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] PATH_INFO: `/v3/projects/eeda5a6dd6224645936afaa1958dd8fb/users/30e03e8a84db40a9baaa84aa40d13acd/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:40.547264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeda5a6dd6224645936afaa1958dd8fb, user_id=30e03e8a84db40a9baaa84aa40d13acd, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:40.556308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:40.594429 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2335/4665] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:40 2022] PUT /identity/v3/projects/eeda5a6dd6224645936afaa1958dd8fb/users/30e03e8a84db40a9baaa84aa40d13acd/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:40.605022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393239-0819-4396-865a-98b2d60ecf85 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:40.605605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393239-0819-4396-865a-98b2d60ecf85 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:40.606134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393239-0819-4396-865a-98b2d60ecf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:40.679223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6c393239-0819-4396-865a-98b2d60ecf85 None None] MFA Rules not processed for user `30e03e8a84db40a9baaa84aa40d13acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:40.680517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6c393239-0819-4396-865a-98b2d60ecf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:40.752180 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:40.879021 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2331/4666] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:40.883902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:40.913633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051c5a-b41b-4f95-a163-20c5bdbbb556 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:40.932012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:40.932012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:40.932858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:40.932858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:40.933296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:40.939994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:40.983630 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2336/4667] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:23:40 2022] POST /identity/v3/domains => generated 275 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:40.987698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393239-0819-4396-865a-98b2d60ecf85 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:41.007381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393239-0819-4396-865a-98b2d60ecf85 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:41.262062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:41.263666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:41.264196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:41.264708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:41.266062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:41.269907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:41.337004 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2332/4668] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:40 2022] POST /identity/v3/projects => generated 401 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:41.341899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:41.357148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a290-7d69-4af7-a008-0d944432e6e2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:41.424621 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:41.464466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:41.465204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:41.465531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:41.465776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/groups` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:41.466466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:41.468509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:41.501247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:41.502135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2337/4669] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:41 2022] POST /identity/v3/groups => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:41.516830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d7c61-3f1a-444d-9ca1-10840ed3e506 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:41.528068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:41.528885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:41.529171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:41.529442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:41.530606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:41.532565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:41.601083 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2333/4670] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:41 2022] POST /identity/v3/users => generated 445 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:41.601887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:41.618347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488333-9299-4db4-9a00-dee79c390d0e tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:41.624691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:41.626311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:41.626698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:41.627094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:41.627869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:41.629821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:41.661542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:41.672893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2338/4671] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:23:41 2022] POST /identity/v3/roles => generated 239 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:41.678436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22fd20-e13d-4771-ac3c-bd45b434d931 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:41.684420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:41.698733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:41.698733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:41.698733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/groups/25d32352a247446bb5cbb0954abf40ca/roles/ac9b2cd7595c45518c63f95771e7353d/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:41.698733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, group_id=25d32352a247446bb5cbb0954abf40ca, role_id=ac9b2cd7595c45518c63f95771e7353d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:41.701380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:41.729725 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2334/4672] 10.222.0.46 () {60 vars in 1585 bytes} [Sun Aug 21 01:23:41 2022] PUT /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/groups/25d32352a247446bb5cbb0954abf40ca/roles/ac9b2cd7595c45518c63f95771e7353d/inherited_to_projects => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:41.735123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:41.765600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01496b-7e06-40d3-a2ba-fccdc3129ec7 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:41.879308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:41.880340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:41.880993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:41.881608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/groups/25d32352a247446bb5cbb0954abf40ca/roles/ac9b2cd7595c45518c63f95771e7353d/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:41.884497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, group_id=25d32352a247446bb5cbb0954abf40ca, role_id=ac9b2cd7595c45518c63f95771e7353d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:41.885997 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:41.885997 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:41.885997 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:41.889059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:41.903944 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2339/4673] 10.222.0.46 () {58 vars in 1567 bytes} [Sun Aug 21 01:23:41 2022] HEAD /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/groups/25d32352a247446bb5cbb0954abf40ca/roles/ac9b2cd7595c45518c63f95771e7353d/inherited_to_projects => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:41.904644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:41.928984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e829d3-e1ef-4188-bda9-a607e6538b35 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:41.948689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:41.949520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:41.949831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:41.950083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/groups/25d32352a247446bb5cbb0954abf40ca/roles/ac9b2cd7595c45518c63f95771e7353d/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:41.952384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, group_id=25d32352a247446bb5cbb0954abf40ca, role_id=ac9b2cd7595c45518c63f95771e7353d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:41.953479 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:41.953479 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:41.953479 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:41.955933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:41.980691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role ac9b2cd7595c45518c63f95771e7353d was removed from group 25d32352a247446bb5cbb0954abf40ca on project 8ac8dc5c5c504a0f9865defced29d073. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:41.981194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:41.984895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:42.015381 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2335/4674] 10.222.0.46 () {58 vars in 1569 bytes} [Sun Aug 21 01:23:41 2022] DELETE /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/groups/25d32352a247446bb5cbb0954abf40ca/roles/ac9b2cd7595c45518c63f95771e7353d/inherited_to_projects => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:42.020212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:42.022919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:42.044117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c4bb1-7165-4c87-801f-f8dc09fb7757 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:42.192311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:42.194455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:42.195676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:42.197071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles/ac9b2cd7595c45518c63f95771e7353d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:42.198989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ac9b2cd7595c45518c63f95771e7353d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:42.205981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:42.334438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role ac9b2cd7595c45518c63f95771e7353d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:42.335128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:42.336221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:42.360036 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2340/4675] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:42 2022] DELETE /identity/v3/roles/ac9b2cd7595c45518c63f95771e7353d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:42.365059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:42.411797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e11ea0-e05c-45b1-b251-205ef6feeaf2 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:42.588004 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:42.644414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:42.647266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:42.647558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:42.655625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:42.656381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:42.670080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:42.722880 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2336/4676] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:23:42 2022] POST /identity/v3/roles => generated 239 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:42.724509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:42.726436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:42.752598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524731f-58ca-496e-80d7-2e2bffda8746 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:42.773713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:42.774903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:42.776359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:42.777143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/2344231f43434789927de3ec9aeaf403/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:42.824780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=2344231f43434789927de3ec9aeaf403)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:42.828519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:42.845578 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:42.872503 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2341/4677] 10.222.0.46 () {60 vars in 1582 bytes} [Sun Aug 21 01:23:42 2022] PUT /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/2344231f43434789927de3ec9aeaf403/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:42.873758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:42.906925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1ab6b-4998-469e-a4e7-0ac60099dc01 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:43.068104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:43.069401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:43.069995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:43.070512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/2344231f43434789927de3ec9aeaf403/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:43.074014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=2344231f43434789927de3ec9aeaf403)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:43.075936 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:43.075936 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:43.075936 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:43.079394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:43.088889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2337/4678] 10.222.0.46 () {58 vars in 1564 bytes} [Sun Aug 21 01:23:42 2022] HEAD /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/2344231f43434789927de3ec9aeaf403/inherited_to_projects => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:43.093142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:43.108016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905798ac-c676-46c2-8779-cf4215769610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:43.131665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:43.131665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:43.131665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:43.132170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/2344231f43434789927de3ec9aeaf403/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:43.132170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=2344231f43434789927de3ec9aeaf403)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:43.132558 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:43.132558 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:43.132558 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:43.140840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:43.161264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 2344231f43434789927de3ec9aeaf403 was removed from user a1a26fc71f514e72aec2deb10abd4683 on project 8ac8dc5c5c504a0f9865defced29d073. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:43.161795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:43.162622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:43.206510 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2342/4679] 10.222.0.46 () {58 vars in 1566 bytes} [Sun Aug 21 01:23:43 2022] DELETE /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/2344231f43434789927de3ec9aeaf403/inherited_to_projects => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:43.211413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:43.214315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:43.259115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaca78-8ba6-434a-8695-4737626b4c05 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:43.520500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:43.521220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:43.521512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:43.521975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles/2344231f43434789927de3ec9aeaf403` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:43.530053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2344231f43434789927de3ec9aeaf403)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:43.539438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:43.603041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 2344231f43434789927de3ec9aeaf403 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:43.603677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:43.604670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:43.609030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2338/4680] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:43 2022] DELETE /identity/v3/roles/2344231f43434789927de3ec9aeaf403 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:43.614170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:43.629973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26bf0-ff6c-4862-a37e-3a6068bebab0 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:43.768612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c94d-e042-4539-9d81-25561cdf0ab8 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:43.769615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c94d-e042-4539-9d81-25561cdf0ab8 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:43.769902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c94d-e042-4539-9d81-25561cdf0ab8 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:43.770181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c94d-e042-4539-9d81-25561cdf0ab8 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:43.770886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c94d-e042-4539-9d81-25561cdf0ab8 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:43.775465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c94d-e042-4539-9d81-25561cdf0ab8 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:43.821171 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2343/4681] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:23:43 2022] POST /identity/v3/roles => generated 239 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:43.822761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:43.830812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:43.840039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63535-8152-4dcb-afbc-06e0b304b9fa None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:43.840277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63535-8152-4dcb-afbc-06e0b304b9fa None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:43.843357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63535-8152-4dcb-afbc-06e0b304b9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:43.864025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc537-e10b-4999-9464-c3042ab2f779 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:43.907193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:43.907918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:43.908219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:43.908973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/c57a22d3dd104789bc2ba251833edf2f/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:43.912885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, group_id=25d32352a247446bb5cbb0954abf40ca, role_id=c57a22d3dd104789bc2ba251833edf2f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:43.916787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:43.923693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-14b63535-8152-4dcb-afbc-06e0b304b9fa None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:43.925021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-14b63535-8152-4dcb-afbc-06e0b304b9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:43.960187 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2339/4682] 10.222.0.46 () {60 vars in 1582 bytes} [Sun Aug 21 01:23:43 2022] PUT /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/c57a22d3dd104789bc2ba251833edf2f/inherited_to_projects => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:43.961967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:44.071561 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:44.110514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2344/4683] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:44.169964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c082563-e699-4f50-97ee-0da678488aaf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:44.200955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:44.205106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:44.205501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:44.208175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:44.213156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, group_id=25d32352a247446bb5cbb0954abf40ca)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:44.239397 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:44.239397 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:44.239397 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:44.241689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:44.342784 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2340/4684] 10.222.0.46 () {58 vars in 1464 bytes} [Sun Aug 21 01:23:43 2022] GET /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/inherited_to_projects => generated 447 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:23:44.350225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63535-8152-4dcb-afbc-06e0b304b9fa None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:44.383026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63535-8152-4dcb-afbc-06e0b304b9fa None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:44.398950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:44.399688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:44.399972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:44.400299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/c57a22d3dd104789bc2ba251833edf2f/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:44.411288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, group_id=25d32352a247446bb5cbb0954abf40ca, role_id=c57a22d3dd104789bc2ba251833edf2f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:44.414922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:44.442852 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2345/4685] 10.222.0.46 () {58 vars in 1564 bytes} [Sun Aug 21 01:23:44 2022] HEAD /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/c57a22d3dd104789bc2ba251833edf2f/inherited_to_projects => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:44.446925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:44.467028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0c89-864f-4c0d-b8d9-195da98b6b64 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:44.494457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:44.495365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:44.495662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:44.495904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/c57a22d3dd104789bc2ba251833edf2f/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:44.505816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, group_id=25d32352a247446bb5cbb0954abf40ca, role_id=c57a22d3dd104789bc2ba251833edf2f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:44.510964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:44.540313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role c57a22d3dd104789bc2ba251833edf2f was removed from group 25d32352a247446bb5cbb0954abf40ca on domain 1e83a784d0e04c7fb1078f90a32bfac7. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:44.540619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:44.545479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:44.606181 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2341/4686] 10.222.0.46 () {58 vars in 1566 bytes} [Sun Aug 21 01:23:44 2022] DELETE /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/groups/25d32352a247446bb5cbb0954abf40ca/roles/c57a22d3dd104789bc2ba251833edf2f/inherited_to_projects => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:44.613008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:44.614862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:44.651883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97e75-989f-4961-a100-90819d02e94f tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:44.845875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:44.847373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:44.847683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:44.847946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles/c57a22d3dd104789bc2ba251833edf2f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:44.849467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c57a22d3dd104789bc2ba251833edf2f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:44.851130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:44.873840 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:44.909252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role c57a22d3dd104789bc2ba251833edf2f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:44.909586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:44.910249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:44.912820 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2346/4687] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:44 2022] DELETE /identity/v3/roles/c57a22d3dd104789bc2ba251833edf2f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:44.917470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:44.930923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c03be-8cb4-4174-9ebc-3f668642e879 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:45.080566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:45.090065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:45.090725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:45.096885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:45.097931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:45.100011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:45.156718 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2342/4688] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:23:44 2022] POST /identity/v3/roles => generated 239 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:45.166139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:45.170274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:45.210315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651c20f-fd4c-40c9-b703-c42a974be298 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:45.242248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:45.247921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:45.250148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:45.250547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/31a93a7b7ee346d4badf474f2ce9bb60/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:45.261715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=31a93a7b7ee346d4badf474f2ce9bb60)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:45.279779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:45.370598 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2347/4689] 10.222.0.46 () {60 vars in 1579 bytes} [Sun Aug 21 01:23:45 2022] PUT /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/31a93a7b7ee346d4badf474f2ce9bb60/inherited_to_projects => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:45.376885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:45.399306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc4da9-c8fc-495b-b277-5d7ca24de5c9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:45.568530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:45.569344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:45.570262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:45.570768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:45.575514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, user_id=a1a26fc71f514e72aec2deb10abd4683)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:45.580853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:45.602839 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2343/4690] 10.222.0.46 () {58 vars in 1461 bytes} [Sun Aug 21 01:23:45 2022] GET /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/inherited_to_projects => generated 446 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:45.606934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:45.660699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242be2-68fa-487f-8476-be83ed8ef59a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:45.680190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:45.680828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:45.681176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:45.689834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/31a93a7b7ee346d4badf474f2ce9bb60/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:45.692501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=31a93a7b7ee346d4badf474f2ce9bb60)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:45.695240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:45.741238 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2348/4691] 10.222.0.46 () {58 vars in 1561 bytes} [Sun Aug 21 01:23:45 2022] HEAD /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/31a93a7b7ee346d4badf474f2ce9bb60/inherited_to_projects => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:45.748005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:45.774511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb13be-774e-40df-a055-1e40b4d2fe23 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:45.807395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:45.808136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:45.808409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:45.808724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/31a93a7b7ee346d4badf474f2ce9bb60/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:45.825872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=31a93a7b7ee346d4badf474f2ce9bb60)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:45.841629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:45.856219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 31a93a7b7ee346d4badf474f2ce9bb60 was removed from user a1a26fc71f514e72aec2deb10abd4683 on domain 1e83a784d0e04c7fb1078f90a32bfac7. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:45.856515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:45.857499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:45.892965 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2344/4692] 10.222.0.46 () {58 vars in 1563 bytes} [Sun Aug 21 01:23:45 2022] DELETE /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/31a93a7b7ee346d4badf474f2ce9bb60/inherited_to_projects => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:45.897220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:45.899253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:45.939089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cb35a-ad5e-4512-aa4f-3614577ab04c tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:46.160532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:46.161701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:46.162239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:46.163230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles/31a93a7b7ee346d4badf474f2ce9bb60` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:46.165916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_role(role_id=31a93a7b7ee346d4badf474f2ce9bb60)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:46.168416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:46.259041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 31a93a7b7ee346d4badf474f2ce9bb60 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:46.259753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:46.262358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:46.266397 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2349/4693] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:45 2022] DELETE /identity/v3/roles/31a93a7b7ee346d4badf474f2ce9bb60 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:46.272399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:46.301421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da54896-19b8-490e-abc2-09d8ecdaf018 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:46.326405 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:46.513227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:46.513773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:46.514121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:46.514329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:46.515009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:46.516839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:46.556175 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2345/4694] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:23:46 2022] POST /identity/v3/roles => generated 240 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:46.559807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:46.562328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:46.589018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f2e86-203b-4161-80ae-7700983aa822 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:46.619284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:46.620240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:46.620694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:46.621226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:46.626580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:46.629052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:46.751724 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2350/4695] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:46 2022] POST /identity/v3/projects => generated 408 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:46.755417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:46.768025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc7e9-a7fe-4fa2-8d50-8458cf4ed610 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:46.859981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:46.860680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:46.861054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:46.861576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/33f6b72d446845049900cd05f23a5c14/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:46.869507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=33f6b72d446845049900cd05f23a5c14)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:46.873278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:46.891734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2346/4696] 10.222.0.46 () {60 vars in 1579 bytes} [Sun Aug 21 01:23:46 2022] PUT /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/33f6b72d446845049900cd05f23a5c14/inherited_to_projects => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:46.896290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:46.922558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b26283-0408-48e7-abf5-5443b221bc15 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:47.114131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:47.166407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:47.170393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:47.171054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:47.171199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:47.172175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Adding query filter params (scope.project.id=8ac8dc5c5c504a0f9865defced29d073, user.id=a1a26fc71f514e72aec2deb10abd4683) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:47.172592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:47.173851 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:47.173851 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:47.173851 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:47.177323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:47.304825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2351/4697] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:23:46 2022] GET /identity/v3/role_assignments?scope.project.id=8ac8dc5c5c504a0f9865defced29d073&user.id=a1a26fc71f514e72aec2deb10abd4683&effective => generated 648 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:47.314402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:47.351058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d36f4-8fc7-47d5-ae71-08b3fd98e7ce tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:47.365621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:47.366491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:47.366949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:47.367386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:47.368309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Adding query filter params (scope.project.id=a573d79b620c42e9952fbc530bfde3ab, user.id=a1a26fc71f514e72aec2deb10abd4683) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:47.368914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:47.370112 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:47.370112 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:23:47.370112 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:23:47.371779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:47.484420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2347/4698] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:23:47 2022] GET /identity/v3/role_assignments?scope.project.id=a573d79b620c42e9952fbc530bfde3ab&user.id=a1a26fc71f514e72aec2deb10abd4683&effective => generated 648 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:47.488808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:47.511190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812226f-28f2-463a-867a-deecea0fadc5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:47.535360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:47.536054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:47.536319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:47.536602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/33f6b72d446845049900cd05f23a5c14/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:47.538806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1e83a784d0e04c7fb1078f90a32bfac7, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=33f6b72d446845049900cd05f23a5c14)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:47.541486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:47.555183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 33f6b72d446845049900cd05f23a5c14 was removed from user a1a26fc71f514e72aec2deb10abd4683 on domain 1e83a784d0e04c7fb1078f90a32bfac7. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:47.555428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:47.556133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:47.581591 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2352/4699] 10.222.0.46 () {58 vars in 1563 bytes} [Sun Aug 21 01:23:47 2022] DELETE /identity/v3/OS-INHERIT/domains/1e83a784d0e04c7fb1078f90a32bfac7/users/a1a26fc71f514e72aec2deb10abd4683/roles/33f6b72d446845049900cd05f23a5c14/inherited_to_projects => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:47.585932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:47.588401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:47.620351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251ad4-c40a-48f4-84b2-4ae253afe664 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:47.753660 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:47.806229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:47.806983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:47.808110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:47.808710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:47.811401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Adding query filter params (scope.project.id=8ac8dc5c5c504a0f9865defced29d073, user.id=a1a26fc71f514e72aec2deb10abd4683) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:47.813104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:47.820361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:47.995268 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2348/4700] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:23:47 2022] GET /identity/v3/role_assignments?scope.project.id=8ac8dc5c5c504a0f9865defced29d073&user.id=a1a26fc71f514e72aec2deb10abd4683&effective => generated 228 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:47.996568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:48.066877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5045ef3-a685-4bde-b692-995b2a73159b tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:48.097042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:48.097866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:48.098251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:48.098630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:48.099482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Adding query filter params (scope.project.id=a573d79b620c42e9952fbc530bfde3ab, user.id=a1a26fc71f514e72aec2deb10abd4683) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:48.101996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:48.104453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:48.269729 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2353/4701] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:23:47 2022] GET /identity/v3/role_assignments?scope.project.id=a573d79b620c42e9952fbc530bfde3ab&user.id=a1a26fc71f514e72aec2deb10abd4683&effective => generated 228 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:48.270697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:48.310497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72403-d6ac-40f2-b189-9009dc2b58bf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:48.333071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:48.333735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:48.334014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:48.334286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/projects/a573d79b620c42e9952fbc530bfde3ab` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:48.335493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a573d79b620c42e9952fbc530bfde3ab)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:48.337458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:48.425972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a573d79b620c42e9952fbc530bfde3ab', 'request_id': 'req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:48.439945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a573d79b620c42e9952fbc530bfde3ab', 'request_id': 'req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:48.466443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a573d79b620c42e9952fbc530bfde3ab', 'request_id': 'req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:48.508073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] The token cache is being invalidate because project a573d79b620c42e9952fbc530bfde3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:48.508451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:48.512293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:48.519887 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2349/4702] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:48 2022] DELETE /identity/v3/projects/a573d79b620c42e9952fbc530bfde3ab => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:48.524313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:48.526148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:48.555180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e4bc9-4447-4a34-8110-8b9a7a3e1ee9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:48.689555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:48.690219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:48.690501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:48.690771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles/33f6b72d446845049900cd05f23a5c14` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:48.692232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_role(role_id=33f6b72d446845049900cd05f23a5c14)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:48.693872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:48.780107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 33f6b72d446845049900cd05f23a5c14 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:48.780644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:48.781635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:48.788885 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2354/4703] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:48 2022] DELETE /identity/v3/roles/33f6b72d446845049900cd05f23a5c14 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:48.789657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:48.806256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743d58-bff3-4fc6-8573-50fbbd0cf0cf tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:49.028095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:49.028747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:49.029051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:49.029331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:49.030069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:49.031945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:49.039632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:49.041759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:49.064413 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:49.108502 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2350/4704] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:23:48 2022] POST /identity/v3/roles => generated 239 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:49.109893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:49.112239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:49.137758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f88e8-85ba-4818-a729-47b092dfe9a9 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:49.151054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:49.152546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:49.153263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:49.153854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:49.154754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:49.157792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:49.199074 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:49.213109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446d78d-c5b6-4633-b3ea-bdb91f8892ee tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:49.228862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2351/4705] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:49 2022] POST /identity/v3/projects => generated 410 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:49.233800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:49.235225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:49.237057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:49.238154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:49.239152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:49.244186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:49.262407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:49.264460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:49.279010 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2355/4706] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:49.353136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d6107-ff78-40a1-980e-d9d95d0e4476 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:49.362442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:49.363495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:49.364000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:49.364494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/39dc595b94b74a70a6665a05d3425b6d/inherited_to_projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:49.373272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=39dc595b94b74a70a6665a05d3425b6d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:49.377292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:49.405651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2352/4707] 10.222.0.46 () {60 vars in 1582 bytes} [Sun Aug 21 01:23:49 2022] PUT /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/39dc595b94b74a70a6665a05d3425b6d/inherited_to_projects => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:49.410193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:49.461126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87c329-71a6-41ca-bc7e-8e346fa992b2 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:49.613700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:49.615542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:49.685651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:49.686522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:49.686805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:49.687083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:49.688164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Adding query filter params (scope.project.id=092915d4a5164e7a9126735fc4b0dda6, user.id=a1a26fc71f514e72aec2deb10abd4683) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:49.688164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:49.690011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:49.794415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151325-d621-4b11-be95-09a1f59a7652 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:49.810700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:49.811845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:49.812221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:49.812591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:49.817369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:49.868936 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2356/4708] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:23:49 2022] GET /identity/v3/role_assignments?scope.project.id=092915d4a5164e7a9126735fc4b0dda6&user.id=a1a26fc71f514e72aec2deb10abd4683&effective => generated 649 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:49.878208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:49.894004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa966d61-01b1-4fd0-973a-d31749484497 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:49.905346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:49.906560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:49.907003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:49.907466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/39dc595b94b74a70a6665a05d3425b6d/inherited_to_projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:49.914609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ac8dc5c5c504a0f9865defced29d073, user_id=a1a26fc71f514e72aec2deb10abd4683, role_id=39dc595b94b74a70a6665a05d3425b6d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:49.917975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:49.939564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 39dc595b94b74a70a6665a05d3425b6d was removed from user a1a26fc71f514e72aec2deb10abd4683 on project 8ac8dc5c5c504a0f9865defced29d073. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:49.939844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:49.941340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:49.970652 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2357/4709] 10.222.0.46 () {58 vars in 1566 bytes} [Sun Aug 21 01:23:49 2022] DELETE /identity/v3/OS-INHERIT/projects/8ac8dc5c5c504a0f9865defced29d073/users/a1a26fc71f514e72aec2deb10abd4683/roles/39dc595b94b74a70a6665a05d3425b6d/inherited_to_projects => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:49.975055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:49.976532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:49.992238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:49.996692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:50.047756 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2353/4710] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:50.117138 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:50.192194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8bd7e-f5ff-4aaa-87aa-0cdfce2ed69a tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:50.212483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:50.214235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:50.218805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:50.219171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:50.219959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Adding query filter params (scope.project.id=092915d4a5164e7a9126735fc4b0dda6, user.id=a1a26fc71f514e72aec2deb10abd4683) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:50.220270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:50.226618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:50.401407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:50.403144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:50.442139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2358/4711] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:23:49 2022] GET /identity/v3/role_assignments?scope.project.id=092915d4a5164e7a9126735fc4b0dda6&user.id=a1a26fc71f514e72aec2deb10abd4683&effective => generated 228 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:50.446386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:50.457950 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:50.491940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8630d26-1a0e-4595-ae93-67811c08ca47 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:50.509487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:50.510744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:50.512939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:50.516619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/projects/092915d4a5164e7a9126735fc4b0dda6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:50.519009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_project(project_id=092915d4a5164e7a9126735fc4b0dda6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:50.523443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:50.618212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ee3d1-a04a-4b89-9489-6e0afc055892 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:50.661632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092915d4a5164e7a9126735fc4b0dda6', 'request_id': 'req-04cd3b7f-e5e5-4e89-9da5-13976568a613'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.672274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092915d4a5164e7a9126735fc4b0dda6', 'request_id': 'req-04cd3b7f-e5e5-4e89-9da5-13976568a613'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.679289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092915d4a5164e7a9126735fc4b0dda6', 'request_id': 'req-04cd3b7f-e5e5-4e89-9da5-13976568a613'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.709749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] The token cache is being invalidate because project 092915d4a5164e7a9126735fc4b0dda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:50.710049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.711339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.713203 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2359/4712] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:50 2022] DELETE /identity/v3/projects/092915d4a5164e7a9126735fc4b0dda6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:50.733218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:50.734658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:50.788213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:50.788213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:50.788213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:50.788213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] PATH_INFO: `/v3/users/222e6734a439444cbdd42e8754328990` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:50.788638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=222e6734a439444cbdd42e8754328990)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:50.788638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:50.897919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3b7f-e5e5-4e89-9da5-13976568a613 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:50.904214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222e6734a439444cbdd42e8754328990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.910765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:50.911427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:50.911765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:50.911972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/roles/39dc595b94b74a70a6665a05d3425b6d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:50.916187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_role(role_id=39dc595b94b74a70a6665a05d3425b6d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:50.919491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:50.924436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222e6734a439444cbdd42e8754328990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.926066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222e6734a439444cbdd42e8754328990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.941900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222e6734a439444cbdd42e8754328990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.944259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4761c630-6eb2-4188-ac1d-c301b3f7c57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222e6734a439444cbdd42e8754328990'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:50.975918 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:50.995236 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2354/4713] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:50 2022] DELETE /identity/v3/users/222e6734a439444cbdd42e8754328990 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:51.001521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:51.001809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:51.002082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:51.009469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invalidating the token cache because role 39dc595b94b74a70a6665a05d3425b6d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:51.009763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:51.013255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:51.019427 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2360/4714] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:50 2022] DELETE /identity/v3/roles/39dc595b94b74a70a6665a05d3425b6d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:51.020556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:51.022079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:51.053678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:51.054914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:51.136694 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:51.165012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352b547-59c7-44c2-ac08-3b70bb0204dd tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:51.183473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:51.184211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:51.184582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:51.185182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/users/a1a26fc71f514e72aec2deb10abd4683` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:51.187758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a1a26fc71f514e72aec2deb10abd4683)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:51.194254 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2355/4715] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:51.202890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:51.204401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:51.204541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:51.293258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a26fc71f514e72aec2deb10abd4683'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:51.316899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a26fc71f514e72aec2deb10abd4683'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:51.339282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a26fc71f514e72aec2deb10abd4683'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:51.341021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a26fc71f514e72aec2deb10abd4683'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:51.355663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a26fc71f514e72aec2deb10abd4683'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:51.362552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a735713-96d1-4a3c-975b-c6d4d421ffd8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:51.366524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:51.367151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:51.367448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:51.367710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:51.370981 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2361/4716] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:51 2022] DELETE /identity/v3/users/a1a26fc71f514e72aec2deb10abd4683 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:51.373029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:51.375790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:51.378330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:51.444840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:51.446331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:51.485500 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2356/4717] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:23:51.552199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174a9e-ee66-49cc-aaa9-5c78a8fe9401 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:51.566417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:51.567277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:51.567557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:51.567828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/groups/25d32352a247446bb5cbb0954abf40ca` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:51.569364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_group(group_id=25d32352a247446bb5cbb0954abf40ca)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:51.571293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:51.609757 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:51.733663 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2362/4718] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:23:51 2022] DELETE /identity/v3/groups/25d32352a247446bb5cbb0954abf40ca => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:51.738570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:51.756624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4646-1db8-4965-9372-1d55a677bedf service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:52.046173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:52.046872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:52.047159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:52.047481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/projects/8ac8dc5c5c504a0f9865defced29d073` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:52.050256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ac8dc5c5c504a0f9865defced29d073)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:52.052949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:52.257077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac8dc5c5c504a0f9865defced29d073', 'request_id': 'req-1b8599a9-8425-4b7d-b3de-7905f99a24ad'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.261078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:52.263906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:52.273618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac8dc5c5c504a0f9865defced29d073', 'request_id': 'req-1b8599a9-8425-4b7d-b3de-7905f99a24ad'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.299924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac8dc5c5c504a0f9865defced29d073', 'request_id': 'req-1b8599a9-8425-4b7d-b3de-7905f99a24ad'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.322085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] The token cache is being invalidate because project 8ac8dc5c5c504a0f9865defced29d073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:52.324470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.326458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.332339 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2357/4719] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:51 2022] DELETE /identity/v3/projects/8ac8dc5c5c504a0f9865defced29d073 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:52.333461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:52.336036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:52.361392 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:52.425647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae760c-fa36-445d-ada8-a4cc46671042 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:52.466277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8599a9-8425-4b7d-b3de-7905f99a24ad tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:52.478333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:52.479619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:52.480011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:52.480412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/domains/1e83a784d0e04c7fb1078f90a32bfac7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:52.483413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1e83a784d0e04c7fb1078f90a32bfac7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:52.485333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:52.536648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:52.537635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:52.538109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:52.538555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] PATH_INFO: `/v3/projects/457f9479db2a4f03a49d0f7278d12844` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:52.539968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457f9479db2a4f03a49d0f7278d12844)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:52.542295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:52.545592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.550341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.587430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.588228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.596785 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2358/4720] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:23:52 2022] PATCH /identity/v3/domains/1e83a784d0e04c7fb1078f90a32bfac7 => generated 276 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:52.598084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:52.599807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:52.654781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457f9479db2a4f03a49d0f7278d12844', 'request_id': 'req-7ea6e9e5-f13e-4549-9a0c-923232d401a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.663140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457f9479db2a4f03a49d0f7278d12844', 'request_id': 'req-7ea6e9e5-f13e-4549-9a0c-923232d401a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.669993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457f9479db2a4f03a49d0f7278d12844', 'request_id': 'req-7ea6e9e5-f13e-4549-9a0c-923232d401a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.692526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dd4f9-f48f-4fdc-a141-7471666ef364 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:52.701526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] The token cache is being invalidate because project 457f9479db2a4f03a49d0f7278d12844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:52.701526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.704452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.708046 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2363/4721] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:52 2022] DELETE /identity/v3/projects/457f9479db2a4f03a49d0f7278d12844 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:52.712715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:52.714434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:52.729254 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:52.783867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e03e8a84db40a9baaa84aa40d13acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeda5a6dd6224645936afaa1958dd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:52.784886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:52.785520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:52.786439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] PATH_INFO: `/v3/domains/1e83a784d0e04c7fb1078f90a32bfac7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:52.805909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1e83a784d0e04c7fb1078f90a32bfac7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:52.808853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:52.843164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:52.844698 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:52.848627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.000225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e9e5-f13e-4549-9a0c-923232d401a6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:53.019256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7', 'request_id': 'req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.034356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7', 'request_id': 'req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.053898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7', 'request_id': 'req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.093404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] The token cache is being invalidate because project 1e83a784d0e04c7fb1078f90a32bfac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:53.093777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.097248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.128380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7', 'request_id': 'req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.137374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7', 'request_id': 'req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.138888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1e83a784d0e04c7fb1078f90a32bfac7', 'request_id': 'req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.159929 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2359/4722] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:52 2022] DELETE /identity/v3/domains/1e83a784d0e04c7fb1078f90a32bfac7 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:53.191892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:53.192991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:53.193492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:53.193931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] PATH_INFO: `/v3/users/daea06e102c14683b1263af4f275c817` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:53.197249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:53.198968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:53.201387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=daea06e102c14683b1263af4f275c817)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:53.215223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:53.230172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219b013-beaf-4ccc-8b2f-4cd326d3b0f5 tempest-InheritsV3TestJSON-136433561 tempest-InheritsV3TestJSON-136433561-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:53.278340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:53.279066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:53.279351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:53.279652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] PATH_INFO: `/v3/users/1d9ca12b6c1d46f8bd43df0b2e41e85d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:53.281628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9ca12b6c1d46f8bd43df0b2e41e85d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:53.284367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:53.352617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daea06e102c14683b1263af4f275c817'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.359998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9ca12b6c1d46f8bd43df0b2e41e85d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.364404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daea06e102c14683b1263af4f275c817'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.372667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9ca12b6c1d46f8bd43df0b2e41e85d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.373572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9ca12b6c1d46f8bd43df0b2e41e85d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.390077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9ca12b6c1d46f8bd43df0b2e41e85d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.390972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9c54eae-afb9-4cd7-8c7c-6e5d7585a3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9ca12b6c1d46f8bd43df0b2e41e85d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.391268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daea06e102c14683b1263af4f275c817'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.392535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daea06e102c14683b1263af4f275c817'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.413154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daea06e102c14683b1263af4f275c817'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:53.424441 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2360/4723] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:53 2022] DELETE /identity/v3/users/1d9ca12b6c1d46f8bd43df0b2e41e85d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:53.431231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:53.432045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:53.432242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:53.443233 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2364/4724] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:52 2022] DELETE /identity/v3/users/daea06e102c14683b1263af4f275c817 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:53.458849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:53.461060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:53.555191 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:53.608935 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2361/4725] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:53.630296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:53.632345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:53.700697 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:53.732110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546af39-3b99-46a4-b834-4c36bbd9d64c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:53.741605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:53.742875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:53.744220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:53.744736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:53.770217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:53.771877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:53.789999 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2365/4726] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:54.541888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:54.546325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:54.567610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820a037-e617-4ac8-8d8e-d97ccb6da31f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:54.596310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:54.597012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:54.597887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:54.598167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] PATH_INFO: `/v3/projects/dd109cd8283e4d07a79f1828efa96eb8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:54.599990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd109cd8283e4d07a79f1828efa96eb8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:54.602442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:54.709249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd109cd8283e4d07a79f1828efa96eb8', 'request_id': 'req-0af3191a-1758-4869-99c2-a578a94d0304'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.724447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd109cd8283e4d07a79f1828efa96eb8', 'request_id': 'req-0af3191a-1758-4869-99c2-a578a94d0304'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.737828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd109cd8283e4d07a79f1828efa96eb8', 'request_id': 'req-0af3191a-1758-4869-99c2-a578a94d0304'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.761077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] The token cache is being invalidate because project dd109cd8283e4d07a79f1828efa96eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:54.761444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.762757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.765236 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2362/4727] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:54 2022] DELETE /identity/v3/projects/dd109cd8283e4d07a79f1828efa96eb8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:54.769056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:54.779785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad9f77-5432-4beb-9e91-35ef6517ec96 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:54.796249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:54.798089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:54.846476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:54.847674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:54.848176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:54.848805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] PATH_INFO: `/v3/users/30e03e8a84db40a9baaa84aa40d13acd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:54.850343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e03e8a84db40a9baaa84aa40d13acd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:54.853653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:54.927784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3191a-1758-4869-99c2-a578a94d0304 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:54.935148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:54.935797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e03e8a84db40a9baaa84aa40d13acd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.936283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:54.936527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:54.936834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] PATH_INFO: `/v3/projects/db8bac2f12cc4e2bb89737307bcdbb51` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:54.938055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8bac2f12cc4e2bb89737307bcdbb51)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:54.940537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:54.962665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e03e8a84db40a9baaa84aa40d13acd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.976879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e03e8a84db40a9baaa84aa40d13acd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.977865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e03e8a84db40a9baaa84aa40d13acd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.986869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-09306f00-1413-4567-aca6-464de025bd2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e03e8a84db40a9baaa84aa40d13acd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:54.993372 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2366/4728] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:54 2022] DELETE /identity/v3/users/30e03e8a84db40a9baaa84aa40d13acd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:55.000600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8bac2f12cc4e2bb89737307bcdbb51', 'request_id': 'req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.011811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8bac2f12cc4e2bb89737307bcdbb51', 'request_id': 'req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.018050 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:55.019474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8bac2f12cc4e2bb89737307bcdbb51', 'request_id': 'req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.036483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] The token cache is being invalidate because project db8bac2f12cc4e2bb89737307bcdbb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:55.037206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.038243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2aa2eba-39ae-44f3-bf32-f95c9a3c6b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.039834 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2363/4729] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:54 2022] DELETE /identity/v3/projects/db8bac2f12cc4e2bb89737307bcdbb51 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:55.045355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902a02-5a3c-4d41-a3aa-2b6c2aaec33e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.045791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902a02-5a3c-4d41-a3aa-2b6c2aaec33e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.046186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902a02-5a3c-4d41-a3aa-2b6c2aaec33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.068547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6e902a02-5a3c-4d41-a3aa-2b6c2aaec33e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:55.070244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e902a02-5a3c-4d41-a3aa-2b6c2aaec33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:55.172830 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:55.196846 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2367/4730] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:55.205064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501c78-d3c1-461e-b3a3-7cc3320955f9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.205064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501c78-d3c1-461e-b3a3-7cc3320955f9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.205064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501c78-d3c1-461e-b3a3-7cc3320955f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.242451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4a501c78-d3c1-461e-b3a3-7cc3320955f9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:55.243978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a501c78-d3c1-461e-b3a3-7cc3320955f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:55.263408 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2364/4731] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:55.269391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902a02-5a3c-4d41-a3aa-2b6c2aaec33e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:55.281011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902a02-5a3c-4d41-a3aa-2b6c2aaec33e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:55.291419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:55.293697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.293697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.295168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.296715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:55.297008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:55.302061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:55.330735 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2368/4732] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:55.335023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501c78-d3c1-461e-b3a3-7cc3320955f9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:55.360585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501c78-d3c1-461e-b3a3-7cc3320955f9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:55.366133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:55.366813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.367099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.367374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.368008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:55.373492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:55.427405 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2365/4733] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:55 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:55.431541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:55.455107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095f470-e8f7-45fa-bc60-025372144c0c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:55.504938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:55.509106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:55.605496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:55.606829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.607112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.607387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.608032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:55.610211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:55.636383 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2369/4734] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:55 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:55.640538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:55.660240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9811-d499-40e0-97fe-11949dc1c7e7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:55.665328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:55.666793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.667417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.667705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.668655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:55.670419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:55.682712 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2370/4735] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:55.687468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:55.700999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7900887-4821-47d8-a7de-a994f45de2be admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:55.704572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b3f82-f5eb-4d12-8e5d-b92ffec5769d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:55.716236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:55.716941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.717221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.717489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] PATH_INFO: `/v3/projects/eeda5a6dd6224645936afaa1958dd8fb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.718793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:55.718962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeda5a6dd6224645936afaa1958dd8fb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:55.721447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:55.722854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.724329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.724898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.726749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:55.728481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:55.760840 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2371/4736] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:55.764512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:55.781544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f10d0-3316-4a7c-8e56-96a1454bc8a9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:55.789819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7164d8-624c-45b4-b8b5-0d6f62f44c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:55.791072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7164d8-624c-45b4-b8b5-0d6f62f44c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.791507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7164d8-624c-45b4-b8b5-0d6f62f44c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.791882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7164d8-624c-45b4-b8b5-0d6f62f44c54 admin admin] PATH_INFO: `/v3/projects/0c4e661ea64b42e88db213f553f1419e/users/f46938ddc67c46e28add868c7c51423c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.821771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7164d8-624c-45b4-b8b5-0d6f62f44c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4e661ea64b42e88db213f553f1419e, user_id=f46938ddc67c46e28add868c7c51423c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:55.824740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7164d8-624c-45b4-b8b5-0d6f62f44c54 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:55.839077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeda5a6dd6224645936afaa1958dd8fb', 'request_id': 'req-76d57b71-d677-4d10-bd77-81258f949b21'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.862669 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2372/4737] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:55 2022] PUT /identity/v3/projects/0c4e661ea64b42e88db213f553f1419e/users/f46938ddc67c46e28add868c7c51423c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:55.864341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.864617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.865001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.866391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeda5a6dd6224645936afaa1958dd8fb', 'request_id': 'req-76d57b71-d677-4d10-bd77-81258f949b21'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.884371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeda5a6dd6224645936afaa1958dd8fb', 'request_id': 'req-76d57b71-d677-4d10-bd77-81258f949b21'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.900397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] The token cache is being invalidate because project eeda5a6dd6224645936afaa1958dd8fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:55.901462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.903705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76d57b71-d677-4d10-bd77-81258f949b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:55.905510 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2366/4738] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:55 2022] DELETE /identity/v3/projects/eeda5a6dd6224645936afaa1958dd8fb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:55.913604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] MFA Rules not processed for user `f46938ddc67c46e28add868c7c51423c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:55.914737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921540aa-a772-4467-a5e6-afffe6f3ae50 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:55.915032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921540aa-a772-4467-a5e6-afffe6f3ae50 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:55.915309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921540aa-a772-4467-a5e6-afffe6f3ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:55.919948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:55.959674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-921540aa-a772-4467-a5e6-afffe6f3ae50 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:55.961738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-921540aa-a772-4467-a5e6-afffe6f3ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:56.054783 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:56.062919 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2373/4739] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:56.067755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.071371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:56.092986 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2367/4740] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:56.094532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90bbc3-1eb8-4762-ba6a-2b5a89589955 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.094916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775734ff-5950-4005-bc15-f5afcd1113bd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.095298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775734ff-5950-4005-bc15-f5afcd1113bd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.095666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775734ff-5950-4005-bc15-f5afcd1113bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.100082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.100707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.101014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.101284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.101993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.104125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.124004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-775734ff-5950-4005-bc15-f5afcd1113bd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:56.128587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-775734ff-5950-4005-bc15-f5afcd1113bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:56.129726 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:56.148050 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2368/4741] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:56.148228 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2374/4742] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:56.153046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.153271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775734ff-5950-4005-bc15-f5afcd1113bd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.169166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775734ff-5950-4005-bc15-f5afcd1113bd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.264958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.266529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.266916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.267328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.268175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:23:56.268934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.271677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.273062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3a18e-ffb7-44a9-8b3e-a3d289571574 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.282948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.283591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.284061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.284337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.285423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.288586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.306807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2369/4743] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:56.314608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.320628 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2375/4744] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:56.327255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.330521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c966-32df-4189-b337-b2b90b84baf2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.336151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.336861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.337245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.338023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.338684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.341562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.345174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bb202-0868-46f5-9442-84544e8a23d7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.352090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.352886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.353234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.353680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.354342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.357739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.375164 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2376/4745] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:56.385388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.400866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83e0b3-6f6f-43af-910a-3be7c2ba9701 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.410891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.411671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.412047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.412448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.413617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2370/4746] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:56.414216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.414550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.416051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.433024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2377/4747] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:56.438626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.460150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa98f9-840a-40bb-b458-a2a75bea3b71 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.560594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f6e3d-f244-4cd6-8b04-18fdad88f27a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.567856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.569683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.569963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.570230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.571093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.573100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.591227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1909cbe-45e9-4395-976a-4f6c08f164ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.592000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909cbe-45e9-4395-976a-4f6c08f164ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.592212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909cbe-45e9-4395-976a-4f6c08f164ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.592488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909cbe-45e9-4395-976a-4f6c08f164ca admin admin] PATH_INFO: `/v3/projects/8f5306d15d4c48fe887b0a6680167a94/users/70c073900bd74198b8633361852d19a4/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.602071 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2371/4748] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:56.607273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.620287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f5cf-327f-475b-bc51-8c0efe484949 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.626937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.627985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.628113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1909cbe-45e9-4395-976a-4f6c08f164ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5306d15d4c48fe887b0a6680167a94, user_id=70c073900bd74198b8633361852d19a4, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.628571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.629067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.630480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.631705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1909cbe-45e9-4395-976a-4f6c08f164ca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.632674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.650247 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2372/4749] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:56.654545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.671754 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2378/4750] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:56 2022] PUT /identity/v3/projects/8f5306d15d4c48fe887b0a6680167a94/users/70c073900bd74198b8633361852d19a4/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:56.680874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27cb0f-16d5-416a-ac0e-153d71fa1997 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.688536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425248-5d16-4821-83d7-a1d9d3cc5894 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.689000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425248-5d16-4821-83d7-a1d9d3cc5894 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.689310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425248-5d16-4821-83d7-a1d9d3cc5894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.722201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1e425248-5d16-4821-83d7-a1d9d3cc5894 None None] MFA Rules not processed for user `70c073900bd74198b8633361852d19a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:56.723528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1e425248-5d16-4821-83d7-a1d9d3cc5894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:56.755932 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:56.780552 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:56.807346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.808261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.808869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.809497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.809907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.812196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.841748 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2379/4751] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:56.843544 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2373/4752] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:23:56.847555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425248-5d16-4821-83d7-a1d9d3cc5894 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.848811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.860579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372b6fd-52f8-44b8-92c4-b7da9c4418f3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.862177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425248-5d16-4821-83d7-a1d9d3cc5894 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:56.865972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.866772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.867211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.867641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.868440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.869223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52efff1-79ac-430c-945d-4c2483f368b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:56.870129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efff1-79ac-430c-945d-4c2483f368b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.870569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efff1-79ac-430c-945d-4c2483f368b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.871015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efff1-79ac-430c-945d-4c2483f368b4 admin admin] PATH_INFO: `/v3/projects/e803740b6c14451d9edc194ecf85fe99/users/497cfcebbd654308aabae14db9c74b00/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:56.871588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.893799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52efff1-79ac-430c-945d-4c2483f368b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e803740b6c14451d9edc194ecf85fe99, user_id=497cfcebbd654308aabae14db9c74b00, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:56.897017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52efff1-79ac-430c-945d-4c2483f368b4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:56.910769 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2374/4753] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:56.915243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:56.962088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2380/4754] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:56 2022] PUT /identity/v3/projects/e803740b6c14451d9edc194ecf85fe99/users/497cfcebbd654308aabae14db9c74b00/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:56.967667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe68eed-7edc-48f4-91db-84e67a2a38f8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:56.968060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe68eed-7edc-48f4-91db-84e67a2a38f8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:56.968514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe68eed-7edc-48f4-91db-84e67a2a38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.035078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fbe68eed-7edc-48f4-91db-84e67a2a38f8 None None] MFA Rules not processed for user `497cfcebbd654308aabae14db9c74b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:57.036353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fbe68eed-7edc-48f4-91db-84e67a2a38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:57.041991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50553a39-52d9-48f6-a031-e35b12683d67 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.162184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.164246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.164953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.170594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.172602 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2381/4755] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:23:57.173648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe68eed-7edc-48f4-91db-84e67a2a38f8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.175088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.178350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.185780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe68eed-7edc-48f4-91db-84e67a2a38f8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.192241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.192912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.193192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.193465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.194473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.196521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.232478 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2375/4756] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:56 2022] POST /identity/v3/users => generated 296 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:57.237036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.243866 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2382/4757] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:57 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:57.247202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.252103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68750cd0-e8da-4436-8307-efe35803a0c7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.338486 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:57.360321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.361915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.362198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.362748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.363503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.365002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1cfa-1bc8-4e78-92be-306f9bea5188 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.365291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.371440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.372176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.372522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.372948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.373653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.375877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.384070 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2376/4758] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:57.389028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.408939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2383/4759] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:57 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:57.410914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d415-8d15-4b79-85a5-5b3c5424b020 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.413018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.417260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.418079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.418441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.418920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] PATH_INFO: `/v3/projects/64e1be8f79ee43bf900808c4c0557eb4/users/a37c7737f05742c7997b617d81aabe77/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.427854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0f27-9c77-41b4-b56f-7ac434060822 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.441808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.442055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e1be8f79ee43bf900808c4c0557eb4, user_id=a37c7737f05742c7997b617d81aabe77, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.442709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.443086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.443457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.444224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.445382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.446171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.448100 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:57.463736 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2384/4760] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:57.464496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2377/4761] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:57 2022] PUT /identity/v3/projects/64e1be8f79ee43bf900808c4c0557eb4/users/a37c7737f05742c7997b617d81aabe77/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:57.471832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.472317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.486507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af22e-003d-44f0-9748-999977476d7e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.559375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858693f-4144-4d8f-ab7f-e8a54e930ac8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.564897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.565760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.566044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.566320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] PATH_INFO: `/v3/projects/bbd6967dadaa4f36917542d73c2dee3b/users/6b002ffa125e4c9486004cfd468b2849/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.595629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd6967dadaa4f36917542d73c2dee3b, user_id=6b002ffa125e4c9486004cfd468b2849, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.597936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.598787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.599129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.599446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.599664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.600185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.601943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.626642 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2385/4762] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:57.634648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.644704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2378/4763] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:57 2022] PUT /identity/v3/projects/bbd6967dadaa4f36917542d73c2dee3b/users/6b002ffa125e4c9486004cfd468b2849/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:57.650997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.653596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3b58a-ffc6-4717-89ad-c3f3c88434af admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.759666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4a598-3ded-46c5-9dfc-83ceeffaf3fe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.767770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.768412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.768690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.769094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.769804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.771585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.780554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fec1f-29d7-4696-a96d-f8ba9eaabcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.782532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fec1f-29d7-4696-a96d-f8ba9eaabcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.785491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fec1f-29d7-4696-a96d-f8ba9eaabcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.786009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fec1f-29d7-4696-a96d-f8ba9eaabcdd admin admin] PATH_INFO: `/v3/projects/64e1be8f79ee43bf900808c4c0557eb4/users/a37c7737f05742c7997b617d81aabe77/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.786402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2379/4764] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:23:57.790755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:57.794571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fec1f-29d7-4696-a96d-f8ba9eaabcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e1be8f79ee43bf900808c4c0557eb4, user_id=a37c7737f05742c7997b617d81aabe77, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.800864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fec1f-29d7-4696-a96d-f8ba9eaabcdd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.804956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137c98-2cf9-49b4-82e3-b94f73915a10 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:57.811656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaa95e-2461-407b-aa70-afb17ba510da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:57.812754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa95e-2461-407b-aa70-afb17ba510da admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.813240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa95e-2461-407b-aa70-afb17ba510da admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.813831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa95e-2461-407b-aa70-afb17ba510da admin admin] PATH_INFO: `/v3/projects/bbd6967dadaa4f36917542d73c2dee3b/users/6b002ffa125e4c9486004cfd468b2849/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.816829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaa95e-2461-407b-aa70-afb17ba510da admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd6967dadaa4f36917542d73c2dee3b, user_id=6b002ffa125e4c9486004cfd468b2849, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:57.820407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaa95e-2461-407b-aa70-afb17ba510da admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:57.834047 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2380/4765] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:57 2022] PUT /identity/v3/projects/bbd6967dadaa4f36917542d73c2dee3b/users/6b002ffa125e4c9486004cfd468b2849/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:57.841380 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2386/4766] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:57 2022] PUT /identity/v3/projects/64e1be8f79ee43bf900808c4c0557eb4/users/a37c7737f05742c7997b617d81aabe77/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:57.859942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed1960-21f4-4d5b-b7fe-f1d1908896d8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.860647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:57.860647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.860867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed1960-21f4-4d5b-b7fe-f1d1908896d8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:57.860867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed1960-21f4-4d5b-b7fe-f1d1908896d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.861059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:57.893613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6bed1960-21f4-4d5b-b7fe-f1d1908896d8 None None] MFA Rules not processed for user `6b002ffa125e4c9486004cfd468b2849`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:57.900208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6bed1960-21f4-4d5b-b7fe-f1d1908896d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:57.901487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] MFA Rules not processed for user `a37c7737f05742c7997b617d81aabe77`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:23:57.906080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:57.931587 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:58.031740 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2387/4767] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:58.032642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed1960-21f4-4d5b-b7fe-f1d1908896d8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.047675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed1960-21f4-4d5b-b7fe-f1d1908896d8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.064788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.065500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.065732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.065970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.066618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.068535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.079200 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2381/4768] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:23:58.086910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.088962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:58.098447 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:58.158399 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2388/4769] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:58 2022] POST /identity/v3/projects => generated 359 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:58.173216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc54e3-3994-47ff-8324-176fbe0865f5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.174509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.248990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.249727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.249948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.250165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.285266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e633276-e88c-4930-b34d-a852683a71cb tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.293958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.295252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.295810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.296249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.297832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.301101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.351573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.354959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.357616 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2389/4770] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:58 2022] POST /identity/v3/users => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:58.362530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.379379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee37c66-5d4c-40f3-a0bc-fa3ebeb57c2a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.388206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.388614 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2382/4771] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:23:58.389362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.389645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.389923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/5c7bee7053934896a3bdf7344017f786` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.426285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:get_user(user_id=5c7bee7053934896a3bdf7344017f786)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.428644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.433117 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2390/4772] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:23:58 2022] GET /identity/v3/users/5c7bee7053934896a3bdf7344017f786 => generated 373 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:58.437755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.441847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.444670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:58.451651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200039c5-1c80-4430-8d80-18f508669efb service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.456605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.457662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.458204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.458486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/5c7bee7053934896a3bdf7344017f786` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.459680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5c7bee7053934896a3bdf7344017f786)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.462139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.463709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf2695-7335-4ccb-80f8-5445ce9bfa17 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.473289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.474707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.475180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.475609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.479581 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:58.521005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7bee7053934896a3bdf7344017f786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.531668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7bee7053934896a3bdf7344017f786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.532703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7bee7053934896a3bdf7344017f786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.551823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7bee7053934896a3bdf7344017f786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.553150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7bee7053934896a3bdf7344017f786'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.582974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2383/4773] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:23:58 2022] DELETE /identity/v3/users/5c7bee7053934896a3bdf7344017f786 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:58.584268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.585756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:58.595065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.596671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.618805 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2391/4774] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:23:58.664516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24ec1f-c02b-4986-b5ae-f15f51dbf6a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.671100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.671633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.671929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.672235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/e03e00b4f76f48f5b9e683c0b81cab44` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.674000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e03e00b4f76f48f5b9e683c0b81cab44)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.676030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.741785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03e00b4f76f48f5b9e683c0b81cab44', 'request_id': 'req-3921afef-a959-4c03-b5cb-c146448aa9a5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.751782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03e00b4f76f48f5b9e683c0b81cab44', 'request_id': 'req-3921afef-a959-4c03-b5cb-c146448aa9a5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.758648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03e00b4f76f48f5b9e683c0b81cab44', 'request_id': 'req-3921afef-a959-4c03-b5cb-c146448aa9a5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.775815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] The token cache is being invalidate because project e03e00b4f76f48f5b9e683c0b81cab44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:23:58.776533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.777711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:23:58.779650 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2384/4775] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:23:58 2022] DELETE /identity/v3/projects/e03e00b4f76f48f5b9e683c0b81cab44 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:58.786286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.798823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362bf26-5efd-440a-b782-d84a49d60586 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.884038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:58.884981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:58.885409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:58.885908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:58.886800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:58.889592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:58.903982 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:58.943323 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2392/4776] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:58 2022] POST /identity/v3/projects => generated 358 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:58.947695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:58.949455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:58.967582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921afef-a959-4c03-b5cb-c146448aa9a5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:58.987029 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:59.087646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.088544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.089120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.089462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.090643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.092841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.136992 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2385/4777] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:23:58 2022] POST /identity/v3/users => generated 414 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:59.140920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.174681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7f5a-52fa-4b39-a3ea-04c89cbe9c5e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.197057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.198867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.199310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.200560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.203214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.205286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.237733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2393/4778] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:23:59 2022] POST /identity/v3/roles => generated 239 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:23:59.239469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.253332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5445a-c45f-418a-a525-a07e8dfc3ec0 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.263513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.264994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.265293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.265623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/c6c374875157469db9508ad3a70bcc4b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.285931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:get_user(user_id=c6c374875157469db9508ad3a70bcc4b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.288395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.290794 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2386/4779] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:23:59 2022] GET /identity/v3/users/c6c374875157469db9508ad3a70bcc4b => generated 414 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:59.295096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.306894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ac3e-e0c2-42bf-97de-b2ec32a07036 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.311385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.312038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.312485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.312799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/roles/454cda61f34f422fbb0e37d978fd7ec2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.314218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:get_role(role_id=454cda61f34f422fbb0e37d978fd7ec2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.315249 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:23:59.315249 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:23:59.315249 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:23:59.316219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.317812 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2394/4780] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:23:59 2022] GET /identity/v3/roles/454cda61f34f422fbb0e37d978fd7ec2 => generated 239 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:59.321903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.333898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5ce22-74f9-410b-8512-ec4fa2e8997e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.341605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.342379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.342766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.343338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.344199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.346367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.388192 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2387/4781] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:59 2022] POST /identity/v3/projects => generated 358 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:59.395611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.419332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e5283-d71a-4288-ad34-6129844ffd29 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.517934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.518925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.519058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.519403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/ea5df9679a0d462887a8f867e5cdfc31` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.520572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:get_project(project_id=ea5df9679a0d462887a8f867e5cdfc31)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.522731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.527750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2395/4782] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:59 2022] GET /identity/v3/projects/ea5df9679a0d462887a8f867e5cdfc31 => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:59.529370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.545608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28178032-03db-458e-a551-fdc57693e19d tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.551094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.551842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.552206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.552540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/ea5df9679a0d462887a8f867e5cdfc31/users/c6c374875157469db9508ad3a70bcc4b/roles/454cda61f34f422fbb0e37d978fd7ec2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.555073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ea5df9679a0d462887a8f867e5cdfc31, user_id=c6c374875157469db9508ad3a70bcc4b, role_id=454cda61f34f422fbb0e37d978fd7ec2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.559804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.580879 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2388/4783] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:59 2022] PUT /identity/v3/projects/ea5df9679a0d462887a8f867e5cdfc31/users/c6c374875157469db9508ad3a70bcc4b/roles/454cda61f34f422fbb0e37d978fd7ec2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:23:59.582562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.597440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f36d-9a34-4715-a716-772f52d8cb5c tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.710431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.711594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.711879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.712155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.712832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.717428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.765505 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2396/4784] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:23:59 2022] POST /identity/v3/projects => generated 359 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:23:59.767828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.785008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd988f5a-86bc-4d08-9cf1-8581b63b72fd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.906906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.907762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.908181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.908563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/b6c7eafc92764e769367c6585a78d63d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.909904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:get_project(project_id=b6c7eafc92764e769367c6585a78d63d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.912113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.917224 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2389/4785] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:23:59 2022] GET /identity/v3/projects/b6c7eafc92764e769367c6585a78d63d => generated 359 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:23:59.919043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.932502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda54a-6a29-407e-b451-6e75155fcddc tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:59.943930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:59.947643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:59.948195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:59.948570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/b6c7eafc92764e769367c6585a78d63d/users/c6c374875157469db9508ad3a70bcc4b/roles/454cda61f34f422fbb0e37d978fd7ec2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:59.951842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b6c7eafc92764e769367c6585a78d63d, user_id=c6c374875157469db9508ad3a70bcc4b, role_id=454cda61f34f422fbb0e37d978fd7ec2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:59.955057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:59.978441 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2397/4786] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:23:59 2022] PUT /identity/v3/projects/b6c7eafc92764e769367c6585a78d63d/users/c6c374875157469db9508ad3a70bcc4b/roles/454cda61f34f422fbb0e37d978fd7ec2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:23:59.983986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:59.998433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4b6ef-dc77-4aa8-a7af-97b98745e934 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:00.079983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:00.081163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:00.081443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:00.081907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/c6c374875157469db9508ad3a70bcc4b/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:00.091072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=c6c374875157469db9508ad3a70bcc4b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:00.094043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:00.100817 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:00.285306 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2390/4787] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:23:59 2022] GET /identity/v3/users/c6c374875157469db9508ad3a70bcc4b/projects => generated 841 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:00.285413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:00.297478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790766e-86d4-4ad0-9dad-36a8788a64bd tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:00.309629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:00.310359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:00.310847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:00.311489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/b6c7eafc92764e769367c6585a78d63d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:00.313443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6c7eafc92764e769367c6585a78d63d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:00.315423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:00.446419 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:00.459447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c7eafc92764e769367c6585a78d63d', 'request_id': 'req-4306164f-a97c-431a-8be9-b8372ffb53f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.469412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c7eafc92764e769367c6585a78d63d', 'request_id': 'req-4306164f-a97c-431a-8be9-b8372ffb53f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.476003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c7eafc92764e769367c6585a78d63d', 'request_id': 'req-4306164f-a97c-431a-8be9-b8372ffb53f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.499301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] The token cache is being invalidate because project b6c7eafc92764e769367c6585a78d63d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:00.499536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.500310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.506822 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2398/4788] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:00 2022] DELETE /identity/v3/projects/b6c7eafc92764e769367c6585a78d63d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:00.507073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:00.509376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:00.533650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4bbcf-4776-4260-855b-9900fdf7c646 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:00.609372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:00.610111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:00.610379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:00.610675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/ea5df9679a0d462887a8f867e5cdfc31` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:00.611900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ea5df9679a0d462887a8f867e5cdfc31)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:00.613937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:00.666599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5df9679a0d462887a8f867e5cdfc31', 'request_id': 'req-eda667c8-e512-4529-82c2-028da37a14d7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.674905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5df9679a0d462887a8f867e5cdfc31', 'request_id': 'req-eda667c8-e512-4529-82c2-028da37a14d7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.680834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5df9679a0d462887a8f867e5cdfc31', 'request_id': 'req-eda667c8-e512-4529-82c2-028da37a14d7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.692689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] The token cache is being invalidate because project ea5df9679a0d462887a8f867e5cdfc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:00.693004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.693750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.695518 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2391/4789] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:00 2022] DELETE /identity/v3/projects/ea5df9679a0d462887a8f867e5cdfc31 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:00.699879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:00.710797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306164f-a97c-431a-8be9-b8372ffb53f7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:00.784796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:00.786770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:00.787449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:00.787795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/roles/454cda61f34f422fbb0e37d978fd7ec2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:00.789401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_role(role_id=454cda61f34f422fbb0e37d978fd7ec2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:00.791207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:00.848983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invalidating the token cache because role 454cda61f34f422fbb0e37d978fd7ec2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:00.849391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.850234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:00.856740 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2399/4790] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:00 2022] DELETE /identity/v3/roles/454cda61f34f422fbb0e37d978fd7ec2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:00.857061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:00.858353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:00.876086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda667c8-e512-4529-82c2-028da37a14d7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:00.948569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:00.949466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:00.949810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:00.950139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/c6c374875157469db9508ad3a70bcc4b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:00.951393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c6c374875157469db9508ad3a70bcc4b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:00.953435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:00.962569 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:01.038930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c374875157469db9508ad3a70bcc4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.051019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c374875157469db9508ad3a70bcc4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.051791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c374875157469db9508ad3a70bcc4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.067570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c374875157469db9508ad3a70bcc4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.068335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2e59240b-eef2-4166-8ff2-f3a182aa21c3 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c374875157469db9508ad3a70bcc4b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.101457 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2392/4791] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:00 2022] DELETE /identity/v3/users/c6c374875157469db9508ad3a70bcc4b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:01.102394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:01.104159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:01.133656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c0574-1ec3-4183-bc23-7029c4830d8e tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:01.261542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:01.263215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:01.263496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:01.263769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/37bc2c4109b94eb1b068a253ed68fcf3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:01.268819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37bc2c4109b94eb1b068a253ed68fcf3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:01.270770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:01.375770 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:01.386761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:01.387066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:01.387315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:01.394639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37bc2c4109b94eb1b068a253ed68fcf3', 'request_id': 'req-41505507-30c5-485f-b7db-fa55c1380fa2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.407401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37bc2c4109b94eb1b068a253ed68fcf3', 'request_id': 'req-41505507-30c5-485f-b7db-fa55c1380fa2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.421365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:01.422597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:01.433039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37bc2c4109b94eb1b068a253ed68fcf3', 'request_id': 'req-41505507-30c5-485f-b7db-fa55c1380fa2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.458912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] The token cache is being invalidate because project 37bc2c4109b94eb1b068a253ed68fcf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:01.462329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.463749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.466222 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2400/4792] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:01 2022] DELETE /identity/v3/projects/37bc2c4109b94eb1b068a253ed68fcf3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:01.473152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:01.475975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:01.556944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2393/4793] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:01.575735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:01.578188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:01.653385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41505507-30c5-485f-b7db-fa55c1380fa2 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:01.662704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:01.663774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:01.663774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:01.664005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/497cfcebbd654308aabae14db9c74b00` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:01.668538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:update_user(user_id=497cfcebbd654308aabae14db9c74b00)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:01.670183 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:24:01.670183 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:24:01.670183 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:24:01.671158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:01.738469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.756544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invalidating the token cache because user 497cfcebbd654308aabae14db9c74b00 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:01.761433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.765257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d5b841e-4786-4c37-af65-8f6564778759 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:01.773781 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2401/4794] 10.222.0.46 () {60 vars in 1243 bytes} [Sun Aug 21 01:24:01 2022] PATCH /identity/v3/users/497cfcebbd654308aabae14db9c74b00 => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:01.776930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f8ce7-36c6-44de-95e1-dfe66d23fb8d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:01.777218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f8ce7-36c6-44de-95e1-dfe66d23fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:01.782885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f8ce7-36c6-44de-95e1-dfe66d23fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:01.826622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256aa09-4d9f-4a25-a13b-8620165952e5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:01.842006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:01.842650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:01.842925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:01.843196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:01.847650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:01.874048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:01.875120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:01.903589 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2394/4795] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:01.916548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-571f8ce7-36c6-44de-95e1-dfe66d23fb8d None None] MFA Rules not processed for user `497cfcebbd654308aabae14db9c74b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:01.918112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-571f8ce7-36c6-44de-95e1-dfe66d23fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:01.923919 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2402/4796] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:01 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:01.927889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:01.930109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:01.958800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fad6c8-6c4e-41bf-b149-b43020b41b3d service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:01.970079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:01.970739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:01.971049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:01.971344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/497cfcebbd654308aabae14db9c74b00` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:01.974584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:update_user(user_id=497cfcebbd654308aabae14db9c74b00)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:01.975617 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:24:01.975617 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:24:01.975617 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:24:01.977798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:02.035102 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:02.058699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.084078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invalidating the token cache because user 497cfcebbd654308aabae14db9c74b00 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:02.084497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.085217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-da096c19-9d76-41ff-ae79-3510d16371ce tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.089386 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2395/4797] 10.222.0.46 () {60 vars in 1243 bytes} [Sun Aug 21 01:24:01 2022] PATCH /identity/v3/users/497cfcebbd654308aabae14db9c74b00 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:02.093311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f8ce7-36c6-44de-95e1-dfe66d23fb8d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:02.120093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f8ce7-36c6-44de-95e1-dfe66d23fb8d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:02.135070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:02.137035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:02.137345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:02.137633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/497cfcebbd654308aabae14db9c74b00` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:02.180802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:update_user(user_id=497cfcebbd654308aabae14db9c74b00)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:02.195380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:02.274174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.289106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invalidating the token cache because user 497cfcebbd654308aabae14db9c74b00 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:02.289407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.290051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.295547 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2403/4798] 10.222.0.46 () {60 vars in 1243 bytes} [Sun Aug 21 01:24:02 2022] PATCH /identity/v3/users/497cfcebbd654308aabae14db9c74b00 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:02.297240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cf4c-450d-434c-9058-4e3de759a11e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:02.297551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cf4c-450d-434c-9058-4e3de759a11e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:02.297912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cf4c-450d-434c-9058-4e3de759a11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:02.394733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-31f9cf4c-450d-434c-9058-4e3de759a11e None None] MFA Rules not processed for user `497cfcebbd654308aabae14db9c74b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:02.396201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-31f9cf4c-450d-434c-9058-4e3de759a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:02.411525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2396/4799] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:02 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 01:24:02.415550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:02.417260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:02.443685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8fb9-4622-4bf6-a57d-775d8816d7f5 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:02.457830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:02.459470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:02.460023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:02.460571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/497cfcebbd654308aabae14db9c74b00` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:02.462737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:update_user(user_id=497cfcebbd654308aabae14db9c74b00)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:02.470420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:02.549642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.562130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invalidating the token cache because user 497cfcebbd654308aabae14db9c74b00 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:02.562714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.564150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.567467 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2404/4800] 10.222.0.46 () {60 vars in 1243 bytes} [Sun Aug 21 01:24:02 2022] PATCH /identity/v3/users/497cfcebbd654308aabae14db9c74b00 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:02.572253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cf4c-450d-434c-9058-4e3de759a11e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:02.591348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cf4c-450d-434c-9058-4e3de759a11e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:02.605611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ea31-89af-485b-82cd-6eda2eb051ea tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:02.606446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ea31-89af-485b-82cd-6eda2eb051ea tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:02.606857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ea31-89af-485b-82cd-6eda2eb051ea tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:02.607489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ea31-89af-485b-82cd-6eda2eb051ea tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:02.608271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065ea31-89af-485b-82cd-6eda2eb051ea tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:02.610831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065ea31-89af-485b-82cd-6eda2eb051ea tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:02.668578 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2397/4801] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:24:02 2022] POST /identity/v3/users => generated 264 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:02.672899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:02.674424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:02.690106 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=10,keystone:SELECT=80,keystone:INSERT=7,keystone:UPDATE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:02.707938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24b67-366a-4e46-9502-85587bba5335 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:02.715339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438422a-cc07-40fe-ba56-8386f9d9d40a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:02.716000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438422a-cc07-40fe-ba56-8386f9d9d40a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:02.716274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438422a-cc07-40fe-ba56-8386f9d9d40a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:02.716542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438422a-cc07-40fe-ba56-8386f9d9d40a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/3c08bf2411044a3a8f43b47f4249c3f7/password` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:02.865225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9438422a-cc07-40fe-ba56-8386f9d9d40a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3c08bf2411044a3a8f43b47f4249c3f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:02.891434 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2405/4802] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:24:02 2022] POST /identity/v3/users/3c08bf2411044a3a8f43b47f4249c3f7/password => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:03.893521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1942b-e165-4712-b092-7a8d010d328f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:03.893997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1942b-e165-4712-b092-7a8d010d328f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:03.894099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1942b-e165-4712-b092-7a8d010d328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:03.938041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0ef1942b-e165-4712-b092-7a8d010d328f None None] MFA Rules not processed for user `3c08bf2411044a3a8f43b47f4249c3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:03.939672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0ef1942b-e165-4712-b092-7a8d010d328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:03.943911 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2398/4803] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:03 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:03.948323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438422a-cc07-40fe-ba56-8386f9d9d40a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:03.963557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438422a-cc07-40fe-ba56-8386f9d9d40a tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:03.982186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:03.982950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:03.983426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:03.983862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:03.996972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:03.999279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:04.027450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1942b-e165-4712-b092-7a8d010d328f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:04.028376 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2406/4804] 10.222.0.46 () {56 vars in 1263 bytes} [Sun Aug 21 01:24:03 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:04.050088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1942b-e165-4712-b092-7a8d010d328f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:04.063797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:04.064487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:04.064791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:04.065281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/3c08bf2411044a3a8f43b47f4249c3f7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:04.068034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3c08bf2411044a3a8f43b47f4249c3f7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:04.076981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:04.203335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c08bf2411044a3a8f43b47f4249c3f7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:04.216221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c08bf2411044a3a8f43b47f4249c3f7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:04.216523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c08bf2411044a3a8f43b47f4249c3f7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:04.226645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c08bf2411044a3a8f43b47f4249c3f7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:04.227699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c08bf2411044a3a8f43b47f4249c3f7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:04.252191 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2399/4805] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:04 2022] DELETE /identity/v3/users/3c08bf2411044a3a8f43b47f4249c3f7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:04.257266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:04.272077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d24e-6265-4636-819d-f11eedd20775 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:04.393376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:04.394629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:04.395709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:04.396216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:04.397072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:04.400819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:04.441090 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2407/4806] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:04 2022] POST /identity/v3/users => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:04.446020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:04.451418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:04.466466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dd54c-2d37-4840-b86d-c6c68ed9259f tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:04.472109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:04.473061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:04.473523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:04.473975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:04.474786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:04.477526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:04.530664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2400/4807] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:04 2022] POST /identity/v3/projects => generated 359 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:04.536566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:04.551918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c25c51-d4b8-43aa-89d9-6783a25fca93 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:04.662156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe773a-1653-4f6b-92bf-58decc6a7480 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:04.662827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe773a-1653-4f6b-92bf-58decc6a7480 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:04.663139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe773a-1653-4f6b-92bf-58decc6a7480 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:04.663770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe773a-1653-4f6b-92bf-58decc6a7480 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/74b0753947a042c2b230c9826d8fa4aa` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:04.683102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe773a-1653-4f6b-92bf-58decc6a7480 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:update_user(user_id=74b0753947a042c2b230c9826d8fa4aa)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:04.686533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe773a-1653-4f6b-92bf-58decc6a7480 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:04.744222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:04.754750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2408/4808] 10.222.0.46 () {60 vars in 1244 bytes} [Sun Aug 21 01:24:04 2022] PATCH /identity/v3/users/74b0753947a042c2b230c9826d8fa4aa => generated 521 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:04.763034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f5001-5511-4947-8563-9755128cdfe1 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:04.765333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c704f-1342-40a4-b6e4-f53aef5c6061 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:04.765709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c704f-1342-40a4-b6e4-f53aef5c6061 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:04.766090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c704f-1342-40a4-b6e4-f53aef5c6061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:04.776862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:04.777730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:04.778114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:04.779242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/74b0753947a042c2b230c9826d8fa4aa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:04.780967 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:04.822743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0c4c704f-1342-40a4-b6e4-f53aef5c6061 None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:04.826345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c4c704f-1342-40a4-b6e4-f53aef5c6061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:04.833559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:get_user(user_id=74b0753947a042c2b230c9826d8fa4aa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:04.837028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:04.839180 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2401/4809] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:24:04 2022] GET /identity/v3/users/74b0753947a042c2b230c9826d8fa4aa => generated 388 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:04.843570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:04.862466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0e3c-ecaf-4180-91bf-d250038f9bf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:04.877041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:04.877705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:04.877973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:04.878244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/projects/fb50657c053b44e1a668b336670c2cdd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:04.881268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fb50657c053b44e1a668b336670c2cdd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:04.883627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:04.909783 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2409/4810] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:04.965372 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=81,keystone:INSERT=6,keystone:DELETE=13 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:04.981471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb50657c053b44e1a668b336670c2cdd', 'request_id': 'req-fe95f383-9c95-40ea-95c1-986045a9dcf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:04.992794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb50657c053b44e1a668b336670c2cdd', 'request_id': 'req-fe95f383-9c95-40ea-95c1-986045a9dcf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.007096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb50657c053b44e1a668b336670c2cdd', 'request_id': 'req-fe95f383-9c95-40ea-95c1-986045a9dcf7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.020901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] The token cache is being invalidate because project fb50657c053b44e1a668b336670c2cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:05.021194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.021972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.029005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c704f-1342-40a4-b6e4-f53aef5c6061 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:05.030703 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2402/4811] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:04 2022] DELETE /identity/v3/projects/fb50657c053b44e1a668b336670c2cdd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:05.042074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c704f-1342-40a4-b6e4-f53aef5c6061 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:05.170753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b002ffa125e4c9486004cfd468b2849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd6967dadaa4f36917542d73c2dee3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:05.171321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:05.171602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:05.171873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] PATH_INFO: `/v3/users/74b0753947a042c2b230c9826d8fa4aa` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:05.173763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorizing `identity:delete_user(user_id=74b0753947a042c2b230c9826d8fa4aa)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:05.176422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:05.246266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b0753947a042c2b230c9826d8fa4aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.276629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b0753947a042c2b230c9826d8fa4aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.278452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:05.280032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:05.293441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b0753947a042c2b230c9826d8fa4aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.295419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b0753947a042c2b230c9826d8fa4aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.314221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b0753947a042c2b230c9826d8fa4aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.329211 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2410/4812] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:05 2022] DELETE /identity/v3/users/74b0753947a042c2b230c9826d8fa4aa => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:05.334942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:05.340985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:05.405867 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:05.410699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f383-9c95-40ea-95c1-986045a9dcf7 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:05.493154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8825b-9457-4a2a-8cc1-7318c3cfd290 tempest-UsersV3TestJSON-1540492519 tempest-UsersV3TestJSON-1540492519-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:05.509623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:05.510341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:05.510618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:05.510888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] PATH_INFO: `/v3/users/497cfcebbd654308aabae14db9c74b00` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:05.524589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc40e5d-d1e8-4e9b-aa57-e07349f49b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:05.525519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc40e5d-d1e8-4e9b-aa57-e07349f49b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:05.529600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc40e5d-d1e8-4e9b-aa57-e07349f49b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:05.530103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc40e5d-d1e8-4e9b-aa57-e07349f49b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:05.536335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fcc40e5d-d1e8-4e9b-aa57-e07349f49b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:05.551172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc40e5d-d1e8-4e9b-aa57-e07349f49b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:05.553644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc40e5d-d1e8-4e9b-aa57-e07349f49b65 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:05.558758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=497cfcebbd654308aabae14db9c74b00)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:05.560732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:05.566417 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2403/4813] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:05.673843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:05.674331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:05.674705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:05.676477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.688117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.704827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.705967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.716027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-67c59abb-75b2-452a-93d1-01a052ff2eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497cfcebbd654308aabae14db9c74b00'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:05.716234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:05.723275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:05.727656 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2411/4814] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:05 2022] DELETE /identity/v3/users/497cfcebbd654308aabae14db9c74b00 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:05.729436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:05.730094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:05.730973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:05.753834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:05.755849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:05.853929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2412/4815] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:05.871909 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2404/4816] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:05.887302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:05.891499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:05.900006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:05.906414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:05.966609 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:05.978893 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:06.019650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41383b-addb-4197-8a6a-6793abcccc6d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:06.027256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:06.028474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:06.029065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:06.029998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:06.041276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:06.043401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:06.049388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baf024-a22c-41cf-b022-08a05db12d47 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:06.054082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f082892-05b8-42fd-be85-3d916788f494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:06.054680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f082892-05b8-42fd-be85-3d916788f494 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:06.054950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f082892-05b8-42fd-be85-3d916788f494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:06.055220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f082892-05b8-42fd-be85-3d916788f494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:06.057074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2413/4817] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:06.076027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f082892-05b8-42fd-be85-3d916788f494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:06.078174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f082892-05b8-42fd-be85-3d916788f494 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:06.098233 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2405/4818] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:06.746307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:06.748315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:06.767290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ef571-e321-4c1c-a6a5-9254b4787512 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:06.775024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:06.778933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:06.779503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:06.780716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] PATH_INFO: `/v3/users/f46938ddc67c46e28add868c7c51423c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:06.783609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46938ddc67c46e28add868c7c51423c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:06.788331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:06.935716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46938ddc67c46e28add868c7c51423c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:06.959272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46938ddc67c46e28add868c7c51423c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:06.990339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46938ddc67c46e28add868c7c51423c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:06.991230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46938ddc67c46e28add868c7c51423c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:07.001509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46938ddc67c46e28add868c7c51423c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:07.016799 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2414/4819] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:06 2022] DELETE /identity/v3/users/f46938ddc67c46e28add868c7c51423c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:07.021620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:07.022197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:07.022197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:07.066693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:07.070702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:07.199578 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2406/4820] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:07.212811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:07.215387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:07.336618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f90fb-1912-4915-94da-cb45a625bc99 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:07.342218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:07.343138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:07.343629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:07.344075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:07.359693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:07.363207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:07.380846 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2415/4821] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:07.993197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:07.994947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:08.009029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dbb5-a660-4582-9c34-014fde1f4823 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:08.020714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:08.021520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:08.021983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:08.022571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] PATH_INFO: `/v3/projects/0c4e661ea64b42e88db213f553f1419e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:08.023906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4e661ea64b42e88db213f553f1419e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:08.026007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:08.087356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4e661ea64b42e88db213f553f1419e', 'request_id': 'req-6ee5f245-3164-4584-b20e-6ce993e9f298'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.096905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4e661ea64b42e88db213f553f1419e', 'request_id': 'req-6ee5f245-3164-4584-b20e-6ce993e9f298'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.107068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4e661ea64b42e88db213f553f1419e', 'request_id': 'req-6ee5f245-3164-4584-b20e-6ce993e9f298'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.121993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] The token cache is being invalidate because project 0c4e661ea64b42e88db213f553f1419e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:08.122528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.123457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.125692 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2407/4822] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:07 2022] DELETE /identity/v3/projects/0c4e661ea64b42e88db213f553f1419e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:08.129952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:08.144299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76f9bb-a187-4ac2-bbe6-e616a505c3d7 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:08.237504 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:08.279718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:08.281981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:08.282696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:08.283283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] PATH_INFO: `/v3/users/70c073900bd74198b8633361852d19a4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:08.285117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c073900bd74198b8633361852d19a4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:08.289204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:08.376756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c073900bd74198b8633361852d19a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.387392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c073900bd74198b8633361852d19a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.403565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c073900bd74198b8633361852d19a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.404498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c073900bd74198b8633361852d19a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.415705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c073900bd74198b8633361852d19a4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:08.429535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2416/4823] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:08 2022] DELETE /identity/v3/users/70c073900bd74198b8633361852d19a4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:09.076616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:09.078654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:09.106199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f245-3164-4584-b20e-6ce993e9f298 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:09.128702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:09.130332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:09.176432 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:09.193340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:09.196025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:09.196400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:09.196740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] PATH_INFO: `/v3/projects/e803740b6c14451d9edc194ecf85fe99` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:09.198148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e803740b6c14451d9edc194ecf85fe99)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:09.201253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:09.284023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e803740b6c14451d9edc194ecf85fe99', 'request_id': 'req-d9ff4339-69bd-473a-ac70-369f126d2150'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.313466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e803740b6c14451d9edc194ecf85fe99', 'request_id': 'req-d9ff4339-69bd-473a-ac70-369f126d2150'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.321911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9ef4c-f8c0-4eca-a759-c8cb15613e82 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:09.339351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e803740b6c14451d9edc194ecf85fe99', 'request_id': 'req-d9ff4339-69bd-473a-ac70-369f126d2150'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.374190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] The token cache is being invalidate because project e803740b6c14451d9edc194ecf85fe99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:09.375968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.381298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.390074 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2408/4824] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:09 2022] DELETE /identity/v3/projects/e803740b6c14451d9edc194ecf85fe99 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:09.392895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:09.394558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:09.454513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:09.455182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:09.455462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:09.455735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] PATH_INFO: `/v3/projects/8f5306d15d4c48fe887b0a6680167a94` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:09.459455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5306d15d4c48fe887b0a6680167a94)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:09.464243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:09.478790 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:09.546913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4339-69bd-473a-ac70-369f126d2150 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:09.565935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5306d15d4c48fe887b0a6680167a94', 'request_id': 'req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.585643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5306d15d4c48fe887b0a6680167a94', 'request_id': 'req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.606550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5306d15d4c48fe887b0a6680167a94', 'request_id': 'req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.637170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] The token cache is being invalidate because project 8f5306d15d4c48fe887b0a6680167a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:09.637505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.638719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.645732 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2417/4825] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:09 2022] DELETE /identity/v3/projects/8f5306d15d4c48fe887b0a6680167a94 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:09.649519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:09.653874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:09.694460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:09.695156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:09.695441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:09.695714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] PATH_INFO: `/v3/users/6b002ffa125e4c9486004cfd468b2849` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:09.697367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b002ffa125e4c9486004cfd468b2849)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:09.701981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:09.814386 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:09.834121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bfbec-8bbf-439c-b1ab-84941c5c763a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:09.839789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b002ffa125e4c9486004cfd468b2849'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.845193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:09.845870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:09.846148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:09.846466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] PATH_INFO: `/v3/users/a37c7737f05742c7997b617d81aabe77` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:09.848260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37c7737f05742c7997b617d81aabe77)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:09.852167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:09.859432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b002ffa125e4c9486004cfd468b2849'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.860109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b002ffa125e4c9486004cfd468b2849'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.875192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b002ffa125e4c9486004cfd468b2849'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.878903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b002ffa125e4c9486004cfd468b2849'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.926941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2409/4826] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:09 2022] DELETE /identity/v3/users/6b002ffa125e4c9486004cfd468b2849 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:09.967520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37c7737f05742c7997b617d81aabe77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:09.985992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37c7737f05742c7997b617d81aabe77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:10.019479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37c7737f05742c7997b617d81aabe77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:10.020580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37c7737f05742c7997b617d81aabe77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:10.031835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37c7737f05742c7997b617d81aabe77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:10.047142 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2418/4827] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:09 2022] DELETE /identity/v3/users/a37c7737f05742c7997b617d81aabe77 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:11.203811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:11.205086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:11.248960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:11.250473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:11.287451 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:11.416323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d516dc-94a2-484e-a406-32bf7a56a6ad admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:11.422112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:11.423181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.423525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.424501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] PATH_INFO: `/v3/projects/bbd6967dadaa4f36917542d73c2dee3b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.426052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd6967dadaa4f36917542d73c2dee3b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:11.431474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:11.432995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a2a4-7d54-41de-9b76-62ef2c275595 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:11.446700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:11.453088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.453740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.454147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] PATH_INFO: `/v3/projects/64e1be8f79ee43bf900808c4c0557eb4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.457847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e1be8f79ee43bf900808c4c0557eb4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:11.461208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:11.532654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd6967dadaa4f36917542d73c2dee3b', 'request_id': 'req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.557491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd6967dadaa4f36917542d73c2dee3b', 'request_id': 'req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.573335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd6967dadaa4f36917542d73c2dee3b', 'request_id': 'req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.580381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e1be8f79ee43bf900808c4c0557eb4', 'request_id': 'req-1eeedfb2-8752-429b-b46b-f0f0adafac39'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.599732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e1be8f79ee43bf900808c4c0557eb4', 'request_id': 'req-1eeedfb2-8752-429b-b46b-f0f0adafac39'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.608338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] The token cache is being invalidate because project bbd6967dadaa4f36917542d73c2dee3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:11.608654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.609643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04f1ac47-becc-41f7-a4cf-d6b19d2d359c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.614126 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2419/4828] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:11 2022] DELETE /identity/v3/projects/bbd6967dadaa4f36917542d73c2dee3b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:11.620315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4752bc-abe1-4b65-b570-5a09d897536f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.621216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4752bc-abe1-4b65-b570-5a09d897536f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.621787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4752bc-abe1-4b65-b570-5a09d897536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.622581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e1be8f79ee43bf900808c4c0557eb4', 'request_id': 'req-1eeedfb2-8752-429b-b46b-f0f0adafac39'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.641411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] The token cache is being invalidate because project 64e1be8f79ee43bf900808c4c0557eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:11.641842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.642585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1eeedfb2-8752-429b-b46b-f0f0adafac39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:11.649053 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2410/4829] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:11 2022] DELETE /identity/v3/projects/64e1be8f79ee43bf900808c4c0557eb4 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:11.650682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c4f1d-0104-4572-b8d9-5f01ef7186e4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.651030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c4f1d-0104-4572-b8d9-5f01ef7186e4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.651429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c4f1d-0104-4572-b8d9-5f01ef7186e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.660244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3e4752bc-abe1-4b65-b570-5a09d897536f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:11.661867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3e4752bc-abe1-4b65-b570-5a09d897536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:11.677118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-713c4f1d-0104-4572-b8d9-5f01ef7186e4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:11.678840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-713c4f1d-0104-4572-b8d9-5f01ef7186e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:11.727910 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:11.776818 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2420/4830] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:11.785552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a22a-4737-487c-8938-e585b30547ba None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.785811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a22a-4737-487c-8938-e585b30547ba None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.786091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a22a-4737-487c-8938-e585b30547ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.790135 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2411/4831] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:11.799882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f95f-0126-4151-b7f3-31cf8f80bcd9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.801137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f95f-0126-4151-b7f3-31cf8f80bcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.801728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f95f-0126-4151-b7f3-31cf8f80bcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.819401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-04a8a22a-4737-487c-8938-e585b30547ba None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:11.821363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-04a8a22a-4737-487c-8938-e585b30547ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:11.833668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2421/4832] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:11.837393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8a22a-4737-487c-8938-e585b30547ba None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:11.848970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4f52f95f-0126-4151-b7f3-31cf8f80bcd9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:11.850041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8a22a-4737-487c-8938-e585b30547ba None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:11.851449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4f52f95f-0126-4151-b7f3-31cf8f80bcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:11.856131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:11.856923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.857437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.858067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.858926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:11.859367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:11.861216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:11.874204 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2412/4833] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:11.877608 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2422/4834] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:24:11.881771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:11.882846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f95f-0126-4151-b7f3-31cf8f80bcd9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:11.902894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66e7a-8a60-4aad-b3da-dd238a66d8c8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:11.905095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f95f-0126-4151-b7f3-31cf8f80bcd9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:11.914486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:11.915114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:11.915935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.916858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.917302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.917796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.918137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.918427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.919190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:11.919477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:11.919954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:11.921766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:11.924592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:11.941273 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2423/4835] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:11.942575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:11.954492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f2cb-d416-4f95-a15d-a0cc6f4fd668 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:11.960429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:11.961563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:11.962012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:11.962449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:11.963277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:11.969450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:11.983517 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:11.991450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2413/4836] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:11 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:11.993625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.038308 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2424/4837] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:11 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:12.039553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.118109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ffa7a-c0e8-484e-b162-cc63a69c5f6f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.229482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646521-bd60-4934-8058-f14389fdf1f8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.244067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.245510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.246065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.246438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.247142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.253563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.256391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.257561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.258019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.258780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.259584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.262101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.304960 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2425/4838] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:12 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:12.305234 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2414/4839] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:11 2022] POST /identity/v3/users => generated 299 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:12.306410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.309451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.359305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7962-f9f2-42c0-8948-2630f4401f05 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.375105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.375985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.376567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.377032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.377857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.379706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.389934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a976490-c0a8-48e2-88a6-df27f6bbdbdb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.409058 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2415/4840] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:12.412888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.413614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.413880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.414298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.414654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.415830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.419877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.442802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe6ab-479b-455b-bc81-0be521fcdc53 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.444958 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2426/4841] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:24:12.448690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.452797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.461333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.461837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.462824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3cb6-ca7f-43c9-a12d-b8920bc96629 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.463336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.464247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.469746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.471352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.472522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.472835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.473118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] PATH_INFO: `/v3/projects/643f997dac744f0abc9cd4977bcee151/users/cc85bd9fae4a45f0884c2bc721fe66f7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.499777 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2416/4842] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:12.500650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] RBAC: Authorizing `identity:create_grant(project_id=643f997dac744f0abc9cd4977bcee151, user_id=cc85bd9fae4a45f0884c2bc721fe66f7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.503893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.504480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.523192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ddf8-999f-4280-973d-a1d360af3e3a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.529827 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2427/4843] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:12 2022] PUT /identity/v3/projects/643f997dac744f0abc9cd4977bcee151/users/cc85bd9fae4a45f0884c2bc721fe66f7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:12.534248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.577742 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:12.654532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b79d-3a74-4342-916a-7d3a5cc1678c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.661012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.663870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.664228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.664599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.665465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.669337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.669498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50551a46-f024-4427-a084-3b27cd84d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.670074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551a46-f024-4427-a084-3b27cd84d74c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.670366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551a46-f024-4427-a084-3b27cd84d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.670646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551a46-f024-4427-a084-3b27cd84d74c admin admin] PATH_INFO: `/v3/projects/daa4332e29cc48169862dbf6dd5a221a/users/e465092cdf0e452d9a06f9f36fee5f26/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.687739 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2428/4844] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:12.689802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:12.707680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50551a46-f024-4427-a084-3b27cd84d74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa4332e29cc48169862dbf6dd5a221a, user_id=e465092cdf0e452d9a06f9f36fee5f26, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.710410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50551a46-f024-4427-a084-3b27cd84d74c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.711869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0708-31cb-40b9-8561-807b797a31fe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:12.724330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a82b9-c929-47cb-87bc-4c99e355677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:12.725207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a82b9-c929-47cb-87bc-4c99e355677b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.727895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a82b9-c929-47cb-87bc-4c99e355677b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.728217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a82b9-c929-47cb-87bc-4c99e355677b admin admin] PATH_INFO: `/v3/projects/643f997dac744f0abc9cd4977bcee151/users/cc85bd9fae4a45f0884c2bc721fe66f7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.734869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a82b9-c929-47cb-87bc-4c99e355677b admin admin] RBAC: Authorizing `identity:create_grant(project_id=643f997dac744f0abc9cd4977bcee151, user_id=cc85bd9fae4a45f0884c2bc721fe66f7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:12.739880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a82b9-c929-47cb-87bc-4c99e355677b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:12.742388 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2417/4845] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:12 2022] PUT /identity/v3/projects/daa4332e29cc48169862dbf6dd5a221a/users/e465092cdf0e452d9a06f9f36fee5f26/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:12.755066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35865ba-debf-4c6f-9c94-5b33c27fe491 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.755353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35865ba-debf-4c6f-9c94-5b33c27fe491 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.755621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35865ba-debf-4c6f-9c94-5b33c27fe491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.775382 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2429/4846] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:12 2022] PUT /identity/v3/projects/643f997dac744f0abc9cd4977bcee151/users/cc85bd9fae4a45f0884c2bc721fe66f7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:12.777217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376af429-144f-4194-9844-ffe95c16ffa8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:12.777502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376af429-144f-4194-9844-ffe95c16ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:12.777777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376af429-144f-4194-9844-ffe95c16ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:12.811066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f35865ba-debf-4c6f-9c94-5b33c27fe491 None None] MFA Rules not processed for user `e465092cdf0e452d9a06f9f36fee5f26`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:12.812363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f35865ba-debf-4c6f-9c94-5b33c27fe491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:12.826099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-376af429-144f-4194-9844-ffe95c16ffa8 None None] MFA Rules not processed for user `cc85bd9fae4a45f0884c2bc721fe66f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:12.829306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-376af429-144f-4194-9844-ffe95c16ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:12.879148 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:12.920268 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2418/4847] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:12.921804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35865ba-debf-4c6f-9c94-5b33c27fe491 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.029369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35865ba-debf-4c6f-9c94-5b33c27fe491 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.046186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.046429 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2430/4848] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:13.046533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.046533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.046533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.046533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.047465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376af429-144f-4194-9844-ffe95c16ffa8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.048850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.068207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376af429-144f-4194-9844-ffe95c16ffa8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.093002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.093670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.095300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.095580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.096239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.109726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.123548 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2419/4849] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:12 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:13.124709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.180041 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2431/4850] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:13 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:13.187646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.187885 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:13.300872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428a301-6e4b-43cd-9bdf-eb78d56d63ee admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.404017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec674-4dc4-435a-ab84-3133cf7907f1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.427520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.428256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.428532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.428820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.429462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.431489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.485511 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2432/4851] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:13 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:13.486722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.487508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.488148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.488430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.488704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.489397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.493386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.507065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4874-2d14-4204-be8c-119dc8e1fcbe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.521145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.522264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.522483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.522730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.524972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.530298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.559509 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2433/4852] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:13.561274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.564617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2420/4853] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:13 2022] POST /identity/v3/users => generated 299 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:13.565733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.581333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f2960-2eeb-47b7-b662-e1900e289611 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.585836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6b63-46f1-4994-919f-4b74d15de0cc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.586262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.587051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.587336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.587773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.589211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.591691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.596557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.597204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.597477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.597748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.598489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.600094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.604817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2421/4854] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:13.608526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.617372 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2434/4855] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:13.621671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.631885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c3ff4-1f7d-43b7-8272-61c8c73cf4ad admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.655252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215c61-8627-480b-8060-47dc057e6447 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.656212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.659407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.659796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.660145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] PATH_INFO: `/v3/projects/4fbf955c40d84ca9b832f0f233e6da9d/users/a818a5f1d2b64a558793fe1587430335/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.667099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfef35-d26e-4bcd-9f6f-c51230de1eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.668269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfef35-d26e-4bcd-9f6f-c51230de1eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.668831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfef35-d26e-4bcd-9f6f-c51230de1eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.669454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfef35-d26e-4bcd-9f6f-c51230de1eb2 admin admin] PATH_INFO: `/v3/projects/b025bc3ca302496e86a658cedb33b245/users/2e4a24b6196945e4bae4a21695da7a2c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.690620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfef35-d26e-4bcd-9f6f-c51230de1eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b025bc3ca302496e86a658cedb33b245, user_id=2e4a24b6196945e4bae4a21695da7a2c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.693968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfef35-d26e-4bcd-9f6f-c51230de1eb2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.705100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbf955c40d84ca9b832f0f233e6da9d, user_id=a818a5f1d2b64a558793fe1587430335, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.708132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.717029 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2435/4856] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:13 2022] PUT /identity/v3/projects/b025bc3ca302496e86a658cedb33b245/users/2e4a24b6196945e4bae4a21695da7a2c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:13.727380 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2422/4857] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:13 2022] PUT /identity/v3/projects/4fbf955c40d84ca9b832f0f233e6da9d/users/a818a5f1d2b64a558793fe1587430335/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:13.729525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.731863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.732501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.733120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.797444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] MFA Rules not processed for user `2e4a24b6196945e4bae4a21695da7a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:13.799598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:13.861427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097826b-4477-46d0-99f5-f8e28340facb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.873764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.874363 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:13.874526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.874636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.874903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.875552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.890324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:13.916543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2423/4858] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:13.919848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:13.958117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3e62-83b6-4954-acb9-84781c568036 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:13.976312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c49878-4dc1-457a-ad47-eea63046e385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:13.977022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49878-4dc1-457a-ad47-eea63046e385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:13.977302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49878-4dc1-457a-ad47-eea63046e385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:13.977575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49878-4dc1-457a-ad47-eea63046e385 admin admin] PATH_INFO: `/v3/projects/4fbf955c40d84ca9b832f0f233e6da9d/users/a818a5f1d2b64a558793fe1587430335/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:13.986581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c49878-4dc1-457a-ad47-eea63046e385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbf955c40d84ca9b832f0f233e6da9d, user_id=a818a5f1d2b64a558793fe1587430335, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:13.988119 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2436/4859] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:13.989634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c49878-4dc1-457a-ad47-eea63046e385 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:14.000411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:14.002725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:14.031647 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2424/4860] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:13 2022] PUT /identity/v3/projects/4fbf955c40d84ca9b832f0f233e6da9d/users/a818a5f1d2b64a558793fe1587430335/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:14.037278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:14.037278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:14.037278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:14.070805 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:14.094564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] MFA Rules not processed for user `a818a5f1d2b64a558793fe1587430335`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:14.095717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:14.181168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57963bd5-1865-464d-9f4f-ee86c42256c0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:14.268629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:14.269384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:14.269667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:14.269937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:14.274045 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2425/4861] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:14.287691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:14.290351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:14.444167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f41e-3dc6-4bac-aa98-d541fcc6b6dc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:14.455676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de65226-4920-46aa-941e-7cf85b2d8911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:14.456869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65226-4920-46aa-941e-7cf85b2d8911 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:14.459003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65226-4920-46aa-941e-7cf85b2d8911 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:14.459395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65226-4920-46aa-941e-7cf85b2d8911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:14.476319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:14.479141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:14.499002 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2437/4862] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:24:14.561753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de65226-4920-46aa-941e-7cf85b2d8911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:14.563346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de65226-4920-46aa-941e-7cf85b2d8911 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:14.593897 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2426/4863] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:15.807594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:15.879894 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:15.927111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08639e-d204-450c-ad1b-e8278e6c903e service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:15.942379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:15.943425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:15.943938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:15.944444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] PATH_INFO: `/v3/users/cc85bd9fae4a45f0884c2bc721fe66f7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:15.948398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc85bd9fae4a45f0884c2bc721fe66f7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:15.951358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:16.057749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc85bd9fae4a45f0884c2bc721fe66f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:16.076114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc85bd9fae4a45f0884c2bc721fe66f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:16.100925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc85bd9fae4a45f0884c2bc721fe66f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:16.102009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc85bd9fae4a45f0884c2bc721fe66f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:16.130810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc85bd9fae4a45f0884c2bc721fe66f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:16.145842 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2438/4864] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:15 2022] DELETE /identity/v3/users/cc85bd9fae4a45f0884c2bc721fe66f7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:16.151218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:16.151708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:16.152171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:16.213445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:16.215895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:16.306814 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:16.375103 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2427/4865] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:16.406641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:16.408034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:16.510478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871947b-70dd-48de-aaee-e2d086ef8327 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:16.522343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47510aa-72b6-4a96-83ef-ce3b47886275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:16.522988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47510aa-72b6-4a96-83ef-ce3b47886275 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:16.523269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47510aa-72b6-4a96-83ef-ce3b47886275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:16.523550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47510aa-72b6-4a96-83ef-ce3b47886275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:16.546924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47510aa-72b6-4a96-83ef-ce3b47886275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:16.548441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47510aa-72b6-4a96-83ef-ce3b47886275 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:16.573902 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2439/4866] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:24:17.238073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:17.243638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:17.278004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3d46d-b81a-4828-85cb-02e9371e0d97 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:17.292328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:17.293395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:17.293784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:17.294265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] PATH_INFO: `/v3/projects/643f997dac744f0abc9cd4977bcee151` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:17.299551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=643f997dac744f0abc9cd4977bcee151)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:17.301880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:17.463742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea03199-59c9-499e-a5a7-541c7f750ddb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:17.464311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea03199-59c9-499e-a5a7-541c7f750ddb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:17.465166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea03199-59c9-499e-a5a7-541c7f750ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:17.476750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643f997dac744f0abc9cd4977bcee151', 'request_id': 'req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:17.505791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643f997dac744f0abc9cd4977bcee151', 'request_id': 'req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:17.518790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643f997dac744f0abc9cd4977bcee151', 'request_id': 'req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:17.524146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dea03199-59c9-499e-a5a7-541c7f750ddb None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:17.525913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dea03199-59c9-499e-a5a7-541c7f750ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:17.536258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] The token cache is being invalidate because project 643f997dac744f0abc9cd4977bcee151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:17.540980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:17.540980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:17.543997 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2428/4867] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:17 2022] DELETE /identity/v3/projects/643f997dac744f0abc9cd4977bcee151 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:17.548113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:17.549895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:17.663457 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:17.689099 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2440/4868] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:17.836896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9579bf2-7bc1-4e0e-97f2-f9407adb1e57 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:17.860166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:17.860884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:17.861170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:17.861447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] PATH_INFO: `/v3/users/2e4a24b6196945e4bae4a21695da7a2c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:17.865348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4a24b6196945e4bae4a21695da7a2c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:17.872200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:17.984620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4a24b6196945e4bae4a21695da7a2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:18.007799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4a24b6196945e4bae4a21695da7a2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:18.009231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4a24b6196945e4bae4a21695da7a2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:18.023192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4a24b6196945e4bae4a21695da7a2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:18.024242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c50a9b7-7d08-40ea-8302-1b5d1df74bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4a24b6196945e4bae4a21695da7a2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:18.044922 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:18.083704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2429/4869] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:17 2022] DELETE /identity/v3/users/2e4a24b6196945e4bae4a21695da7a2c => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:19.650249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea03199-59c9-499e-a5a7-541c7f750ddb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:19.668256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea03199-59c9-499e-a5a7-541c7f750ddb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:19.846167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:19.847154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:19.847598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:19.848056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] PATH_INFO: `/v3/projects/b025bc3ca302496e86a658cedb33b245` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:19.853911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b025bc3ca302496e86a658cedb33b245)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:19.856519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:19.961325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b025bc3ca302496e86a658cedb33b245', 'request_id': 'req-85904fe5-dd56-443b-8474-ea7e85f7d57c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:19.974746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b025bc3ca302496e86a658cedb33b245', 'request_id': 'req-85904fe5-dd56-443b-8474-ea7e85f7d57c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:19.995821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b025bc3ca302496e86a658cedb33b245', 'request_id': 'req-85904fe5-dd56-443b-8474-ea7e85f7d57c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:20.015244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] The token cache is being invalidate because project b025bc3ca302496e86a658cedb33b245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:20.015828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:20.016838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-85904fe5-dd56-443b-8474-ea7e85f7d57c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:20.019545 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2441/4870] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:19 2022] DELETE /identity/v3/projects/b025bc3ca302496e86a658cedb33b245 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:20.024572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeac16c-635d-440a-a4ce-e193dff96a1b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:20.025154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeac16c-635d-440a-a4ce-e193dff96a1b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:20.025273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeac16c-635d-440a-a4ce-e193dff96a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:20.151493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3eeac16c-635d-440a-a4ce-e193dff96a1b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:20.162422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3eeac16c-635d-440a-a4ce-e193dff96a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:20.360255 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2430/4871] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:20.381512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aee68-d94a-440d-83ea-e49aed4f35db None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:20.382063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aee68-d94a-440d-83ea-e49aed4f35db None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:20.382500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aee68-d94a-440d-83ea-e49aed4f35db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:20.433959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-778aee68-d94a-440d-83ea-e49aed4f35db None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:20.436421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-778aee68-d94a-440d-83ea-e49aed4f35db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:20.460004 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2442/4872] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:20.464626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeac16c-635d-440a-a4ce-e193dff96a1b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:20.479559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeac16c-635d-440a-a4ce-e193dff96a1b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:20.490767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:20.492001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:20.495489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:20.497103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:20.498073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:20.498548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:20.500650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:20.517741 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2431/4873] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:20.522471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aee68-d94a-440d-83ea-e49aed4f35db None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:20.538615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aee68-d94a-440d-83ea-e49aed4f35db None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:20.552422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:20.553115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:20.553501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:20.553632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:20.556294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:20.562950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:20.635401 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2443/4874] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:20 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:20.639622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:20.654002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e5b8-cf9c-4b61-b955-0543e0dfe004 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:20.778981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:20.779845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:20.782874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:20.784072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:20.785191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:20.791978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:20.840176 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2432/4875] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:20 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:20.840749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:20.863010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e52db-1a2c-4d96-8869-ab34eb3d96a0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:20.877142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:20.878343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:20.880456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:20.881077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:20.882946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:20.889907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:20.909212 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2444/4876] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:20.913405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:20.926106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f9c11-9461-4964-af12-df5bacaaa498 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:20.931875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f6306-4df8-470a-a7a4-7f4c8506ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:20.932265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6306-4df8-470a-a7a4-7f4c8506ffbf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:20.936822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6306-4df8-470a-a7a4-7f4c8506ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:20.937186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6306-4df8-470a-a7a4-7f4c8506ffbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:20.937995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f6306-4df8-470a-a7a4-7f4c8506ffbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:20.939903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f6306-4df8-470a-a7a4-7f4c8506ffbf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:20.991304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:20.991971 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2433/4877] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:21.004952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7ebb-1f95-46d9-9df4-46049d9fe60d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:21.014507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:21.015294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:21.015891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:21.016361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] PATH_INFO: `/v3/projects/181e0d8bd12e4552a7b0bb666cee622d/users/6dc85a6323d64f25a572eade33c74b03/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:21.070836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181e0d8bd12e4552a7b0bb666cee622d, user_id=6dc85a6323d64f25a572eade33c74b03, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:21.074164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:21.113424 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2445/4878] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:20 2022] PUT /identity/v3/projects/181e0d8bd12e4552a7b0bb666cee622d/users/6dc85a6323d64f25a572eade33c74b03/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:21.129499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65526c2-8146-4042-aec2-0d2596aa871d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:21.129499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65526c2-8146-4042-aec2-0d2596aa871d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:21.129499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65526c2-8146-4042-aec2-0d2596aa871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:21.272803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f65526c2-8146-4042-aec2-0d2596aa871d None None] MFA Rules not processed for user `6dc85a6323d64f25a572eade33c74b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:21.274496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f65526c2-8146-4042-aec2-0d2596aa871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:21.353637 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:21.407429 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2434/4879] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:21.409758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:21.464304 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:21.539920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a806dcb-f13a-46a4-90e2-25c628c03106 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:21.547031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:21.547677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:21.550535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:21.550959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:21.552367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:21.558773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:21.648958 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2446/4880] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:21 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:21.649668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65526c2-8146-4042-aec2-0d2596aa871d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:21.667289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65526c2-8146-4042-aec2-0d2596aa871d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:21.861674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:21.862275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:21.862556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:21.862828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:21.865663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:21.870545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:21.939653 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2435/4881] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:21 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:21.941339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:21.975622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfd31-4df3-49ca-ac69-4c2fc6ae8150 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:21.993758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:21.996624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:21.996942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:21.997214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:21.997877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:21.999576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:22.027769 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2447/4882] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:22.033280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:22.059874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48dae7-cc11-441c-9256-10a617460cb7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:22.069521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873946-783d-4c65-a12b-be6362b7201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:22.070154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873946-783d-4c65-a12b-be6362b7201a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:22.070436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873946-783d-4c65-a12b-be6362b7201a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:22.070712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873946-783d-4c65-a12b-be6362b7201a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:22.071367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873946-783d-4c65-a12b-be6362b7201a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:22.081322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873946-783d-4c65-a12b-be6362b7201a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:22.104239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:22.111512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2436/4883] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:22.117055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c1ee-0ea3-47f1-98b1-707139ca4e60 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:22.124130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:22.128914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:22.128914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:22.128914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] PATH_INFO: `/v3/projects/d5122bfbbbe14cba8f6086ef0ce402a9/users/856296bddaae488182f69463e10eb537/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:22.159125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5122bfbbbe14cba8f6086ef0ce402a9, user_id=856296bddaae488182f69463e10eb537, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:22.162282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:22.211302 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2448/4884] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:22 2022] PUT /identity/v3/projects/d5122bfbbbe14cba8f6086ef0ce402a9/users/856296bddaae488182f69463e10eb537/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:22.226819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199ac7f-4835-4b52-b162-543c650dec72 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:22.227397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199ac7f-4835-4b52-b162-543c650dec72 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:22.227397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199ac7f-4835-4b52-b162-543c650dec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:22.325958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0199ac7f-4835-4b52-b162-543c650dec72 None None] MFA Rules not processed for user `856296bddaae488182f69463e10eb537`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:22.327217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0199ac7f-4835-4b52-b162-543c650dec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:22.484818 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2437/4885] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:22.497825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:22.499865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:22.616026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844947-ccb4-48e3-9dc5-7a8a8c37d6b1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:22.635890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:22.639584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:22.640291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:22.641871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:22.787931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:22.789809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:22.803858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2449/4886] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:23.078355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:23.078641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:23.079000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:23.112025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:23.114973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:23.243681 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:23.281302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:23.282826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:23.292014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2438/4887] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:23.382025 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:23.430095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef182-8d91-4aa3-9cc2-372e9650e6f4 service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:23.436677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5053-7a91-4c83-b8df-cf25620c6241 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:23.437566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5053-7a91-4c83-b8df-cf25620c6241 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:23.438042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5053-7a91-4c83-b8df-cf25620c6241 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:23.438609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5053-7a91-4c83-b8df-cf25620c6241 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:23.449126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5053-7a91-4c83-b8df-cf25620c6241 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:23.451173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5053-7a91-4c83-b8df-cf25620c6241 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:23.463190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2450/4888] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:23.750188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:23.752200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:23.777025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7718-fb65-4c1f-a946-f07a8baa0e3d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:23.782966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:23.783854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:23.784294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:23.785340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:23.796162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:23.798057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:23.809617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2439/4889] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:23.883324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9e07-ae03-4085-8222-c3613d35c5da None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:23.883570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9e07-ae03-4085-8222-c3613d35c5da None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:23.883848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9e07-ae03-4085-8222-c3613d35c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:23.924530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-088d9e07-ae03-4085-8222-c3613d35c5da None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:23.928212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-088d9e07-ae03-4085-8222-c3613d35c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:23.955338 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2451/4890] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:23.972559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:23.989311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35eec-44be-47e5-9653-d2e9b2bfca5c service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:23.998539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e541a4-88b6-421e-97b9-d1c345a2b02e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:23.999768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e541a4-88b6-421e-97b9-d1c345a2b02e service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:24.000560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e541a4-88b6-421e-97b9-d1c345a2b02e service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:24.001075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e541a4-88b6-421e-97b9-d1c345a2b02e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:24.012506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e541a4-88b6-421e-97b9-d1c345a2b02e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:24.014626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e541a4-88b6-421e-97b9-d1c345a2b02e service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:24.045258 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2440/4891] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:24.194023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d9e07-ae03-4085-8222-c3613d35c5da None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:24.360530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d9e07-ae03-4085-8222-c3613d35c5da None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:24.367994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:24.368907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:24.369388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:24.369818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] PATH_INFO: `/v3/users/6dc85a6323d64f25a572eade33c74b03` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:24.371182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc85a6323d64f25a572eade33c74b03)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:24.373604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:24.470771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc85a6323d64f25a572eade33c74b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:24.483337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc85a6323d64f25a572eade33c74b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:24.521754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc85a6323d64f25a572eade33c74b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:24.522510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc85a6323d64f25a572eade33c74b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:24.540557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc85a6323d64f25a572eade33c74b03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:24.549945 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2452/4892] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:24 2022] DELETE /identity/v3/users/6dc85a6323d64f25a572eade33c74b03 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:24.554243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88419dea-9752-4d68-a4c6-2ed8cf60045a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:24.554734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88419dea-9752-4d68-a4c6-2ed8cf60045a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:24.554961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88419dea-9752-4d68-a4c6-2ed8cf60045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:24.602845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-88419dea-9752-4d68-a4c6-2ed8cf60045a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:24.604223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-88419dea-9752-4d68-a4c6-2ed8cf60045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:24.696919 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2441/4893] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:24.706925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:24.708398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:24.748455 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:24.781666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951e57f-f57a-4d46-8d05-acd1ea613e2b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:24.785742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:24.786472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:24.786749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:24.787017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:24.798525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:24.799898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:24.821116 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2453/4894] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:25.063508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:25.064066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:25.064541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:25.091148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:25.092823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:25.204441 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2442/4895] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:25.220573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:25.223161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:25.413713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdc3c7-8c14-4d75-a447-927baad62197 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:25.429926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:25.431177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:25.431699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:25.432214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:25.443346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:25.445724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:25.478287 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2454/4896] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:24:25.664554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:25.670576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:25.725130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba905bd-bc73-4ed9-9c09-f72a83a6bd93 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:25.759490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:25.760603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:25.761613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:25.762310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] PATH_INFO: `/v3/projects/181e0d8bd12e4552a7b0bb666cee622d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:25.763971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=181e0d8bd12e4552a7b0bb666cee622d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:25.767019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:25.854297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181e0d8bd12e4552a7b0bb666cee622d', 'request_id': 'req-5e3ed7df-cae2-490c-86dd-8d192630d3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:25.866211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181e0d8bd12e4552a7b0bb666cee622d', 'request_id': 'req-5e3ed7df-cae2-490c-86dd-8d192630d3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:25.876041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181e0d8bd12e4552a7b0bb666cee622d', 'request_id': 'req-5e3ed7df-cae2-490c-86dd-8d192630d3e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:25.885131 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:25.891360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] The token cache is being invalidate because project 181e0d8bd12e4552a7b0bb666cee622d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:25.891999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:25.893223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:25.898650 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2443/4897] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:25 2022] DELETE /identity/v3/projects/181e0d8bd12e4552a7b0bb666cee622d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:25.899448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:25.925355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35000e83-859e-4d92-a8d6-0d916be52d8e service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:26.026186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:26.028025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:26.028564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:26.029124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] PATH_INFO: `/v3/users/856296bddaae488182f69463e10eb537` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:26.033159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856296bddaae488182f69463e10eb537)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:26.036254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:26.148974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856296bddaae488182f69463e10eb537'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:26.162476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856296bddaae488182f69463e10eb537'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:26.177931 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:26.199623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856296bddaae488182f69463e10eb537'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:26.200821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856296bddaae488182f69463e10eb537'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:26.213418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856296bddaae488182f69463e10eb537'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:26.227122 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2455/4898] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:25 2022] DELETE /identity/v3/users/856296bddaae488182f69463e10eb537 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:27.053820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:27.055458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:27.078557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ed7df-cae2-490c-86dd-8d192630d3e8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:27.189285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:27.191947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:27.252434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:27.253159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:27.253622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:27.254098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] PATH_INFO: `/v3/projects/d5122bfbbbe14cba8f6086ef0ce402a9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:27.256657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5122bfbbbe14cba8f6086ef0ce402a9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:27.264466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:27.376301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f894e-8338-4d33-b6be-fdc00a8998f5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:27.386500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5122bfbbbe14cba8f6086ef0ce402a9', 'request_id': 'req-8da2564e-b9ae-40d3-ac6a-37d97636dfda'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:27.405825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5122bfbbbe14cba8f6086ef0ce402a9', 'request_id': 'req-8da2564e-b9ae-40d3-ac6a-37d97636dfda'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:27.418368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5122bfbbbe14cba8f6086ef0ce402a9', 'request_id': 'req-8da2564e-b9ae-40d3-ac6a-37d97636dfda'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:27.443906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] The token cache is being invalidate because project d5122bfbbbe14cba8f6086ef0ce402a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:27.444106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:27.444737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8da2564e-b9ae-40d3-ac6a-37d97636dfda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:27.448841 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2444/4899] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:27 2022] DELETE /identity/v3/projects/d5122bfbbbe14cba8f6086ef0ce402a9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:27.452332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1a49-125d-4fb2-af4e-0c7c98b87765 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:27.457289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1a49-125d-4fb2-af4e-0c7c98b87765 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:27.457673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1a49-125d-4fb2-af4e-0c7c98b87765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:27.485089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-acda1a49-125d-4fb2-af4e-0c7c98b87765 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:27.486555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-acda1a49-125d-4fb2-af4e-0c7c98b87765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:27.519193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:27.519832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:27.520106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:27.520369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:27.522214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:27.564232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:27.565858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:27.573243 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2445/4900] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:27.586744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422ddc-d975-47d0-84f0-514b888df287 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:27.588792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422ddc-d975-47d0-84f0-514b888df287 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:27.589182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422ddc-d975-47d0-84f0-514b888df287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:27.592013 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2456/4901] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:27.636802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d422ddc-d975-47d0-84f0-514b888df287 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:27.638124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d422ddc-d975-47d0-84f0-514b888df287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:27.648167 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2446/4902] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:27.654997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:27.668021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45074e76-f3ba-4ef8-a0e1-d5b256d12b95 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:27.674184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:27.674954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:27.675295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:27.675631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:27.677382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:27.677756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:27.679544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:27.699891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2457/4903] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:27.701007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d422ddc-d975-47d0-84f0-514b888df287 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:27.714207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d422ddc-d975-47d0-84f0-514b888df287 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:27.724852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:27.725633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:27.726053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:27.726704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:27.729028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:27.739584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:27.803092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2447/4904] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:27 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:27.808231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:27.822728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee89db9-1704-4072-9922-ef4247da9e02 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:27.855775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:27.858458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:27.883982 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:27.966154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:27.966952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:27.967334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:27.967740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:27.968489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:27.970595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:27.991004 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:28.014838 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2458/4905] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:27 2022] POST /identity/v3/users => generated 282 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:28.016089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:28.018330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:28.035927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647d9d5-df21-418a-a6cf-1a270f4121b9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.037697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201861a-119b-4429-aa72-614f16364878 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.040793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.041445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.041724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.041998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] PATH_INFO: `/v3/users/722940af11854f0687e7c99fae3650a2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.043504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=722940af11854f0687e7c99fae3650a2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.044194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.045018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.045235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.045567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.045689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.047562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:28.067304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.069045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.086335 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2448/4906] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:24:28.087675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:28.110264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793640d-f17f-4d36-ae89-064030104c7b service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.118705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722940af11854f0687e7c99fae3650a2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.121717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.122680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.123884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.123884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.124335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.131354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722940af11854f0687e7c99fae3650a2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.143470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.175041 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2449/4907] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:28.176098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:28.176748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722940af11854f0687e7c99fae3650a2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.177781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722940af11854f0687e7c99fae3650a2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.188743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ace20-1769-4c7a-8d1b-badab2e49994 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.193166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ba957-52f9-4530-8541-6eb5008e7c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.193838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba957-52f9-4530-8541-6eb5008e7c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.194338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba957-52f9-4530-8541-6eb5008e7c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.194679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba957-52f9-4530-8541-6eb5008e7c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.195652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ba957-52f9-4530-8541-6eb5008e7c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.196346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722940af11854f0687e7c99fae3650a2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.197443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ba957-52f9-4530-8541-6eb5008e7c8b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.204468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2459/4908] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:28 2022] DELETE /identity/v3/users/722940af11854f0687e7c99fae3650a2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:28.231156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2450/4909] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:28.232417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:28.233729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:28.317606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39319031-e24f-45e7-a7f9-bb6af9546e3d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.322968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.323998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.324274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.324675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] PATH_INFO: `/v3/projects/cc038745a37a478cae7e47b30c86a171/users/7e7ace02b48143068a00bb004bbcfd05/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.342198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc038745a37a478cae7e47b30c86a171, user_id=7e7ace02b48143068a00bb004bbcfd05, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.344898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.361248 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2460/4910] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:28 2022] PUT /identity/v3/projects/cc038745a37a478cae7e47b30c86a171/users/7e7ace02b48143068a00bb004bbcfd05/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:28.372636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.372956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.373240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.405590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] MFA Rules not processed for user `7e7ace02b48143068a00bb004bbcfd05`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:28.408479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:28.514804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:28.517611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:28.527658 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2451/4911] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:28.540577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:28.542337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:28.600816 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:28.621693 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:28.635251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3a77-b43b-4ace-b43c-43d2b7df8ccb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.646721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.647560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.647961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.648328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] PATH_INFO: `/v3/projects/6b90eb2eef7c45398a821324472a6429` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.650698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b90eb2eef7c45398a821324472a6429)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.652433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b4af-5b4d-49c0-9794-c7055cb72ed8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.653631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.657846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.658647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.659097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.659542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.672570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.674218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.701444 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2452/4912] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:28.714624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b90eb2eef7c45398a821324472a6429', 'request_id': 'req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.722114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b90eb2eef7c45398a821324472a6429', 'request_id': 'req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.727839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b90eb2eef7c45398a821324472a6429', 'request_id': 'req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.742269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] The token cache is being invalidate because project 6b90eb2eef7c45398a821324472a6429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:28.742642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.743346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.745600 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2461/4913] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:28 2022] DELETE /identity/v3/projects/6b90eb2eef7c45398a821324472a6429 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:28.749717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:28.766199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69866f7-940a-42f8-9cac-0f70eb38cfbe service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:28.837237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:28.838071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:28.838365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:28.838631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] PATH_INFO: `/v3/users/6951e96501e641d3bc0b0f51ebcd8825` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:28.840055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6951e96501e641d3bc0b0f51ebcd8825)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:28.842077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:28.906683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6951e96501e641d3bc0b0f51ebcd8825'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.916097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6951e96501e641d3bc0b0f51ebcd8825'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.916830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6951e96501e641d3bc0b0f51ebcd8825'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.925472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6951e96501e641d3bc0b0f51ebcd8825'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.926199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6951e96501e641d3bc0b0f51ebcd8825'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:28.945316 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2453/4914] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:28 2022] DELETE /identity/v3/users/6951e96501e641d3bc0b0f51ebcd8825 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:29.086971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.088652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:29.145320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae42a31-f9c6-4bef-90e0-3dd22e66ba9e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.150276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.152266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:29.216603 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:29.242740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d187-2cc3-4f40-992a-15ad7642622b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.249291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.249854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.250218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.250412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.250621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.250916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.251072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] PATH_INFO: `/v3/users/7e7ace02b48143068a00bb004bbcfd05` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.251215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] PATH_INFO: `/v3/projects/9a941635dd0d4d70aa3e585d7960dd96` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.252377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7ace02b48143068a00bb004bbcfd05)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.253009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a941635dd0d4d70aa3e585d7960dd96)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.254606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.255611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.309286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7ace02b48143068a00bb004bbcfd05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.311876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a941635dd0d4d70aa3e585d7960dd96', 'request_id': 'req-1192e781-7a91-4ee4-af68-9dd3696c16fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.322795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7ace02b48143068a00bb004bbcfd05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.328697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a941635dd0d4d70aa3e585d7960dd96', 'request_id': 'req-1192e781-7a91-4ee4-af68-9dd3696c16fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.336076 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:29.342001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a941635dd0d4d70aa3e585d7960dd96', 'request_id': 'req-1192e781-7a91-4ee4-af68-9dd3696c16fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.349323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7ace02b48143068a00bb004bbcfd05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.350504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7ace02b48143068a00bb004bbcfd05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.356164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] The token cache is being invalidate because project 9a941635dd0d4d70aa3e585d7960dd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:29.356460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.357199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1192e781-7a91-4ee4-af68-9dd3696c16fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.362174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2454/4915] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:29 2022] DELETE /identity/v3/projects/9a941635dd0d4d70aa3e585d7960dd96 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:29.364098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a1a08-b6f8-4ff1-b97a-2c80dce4f97b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.364386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a1a08-b6f8-4ff1-b97a-2c80dce4f97b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.364654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a1a08-b6f8-4ff1-b97a-2c80dce4f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.365014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f0c8ed10-dea6-4b1a-9e7b-d3ea0fbdf8aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7ace02b48143068a00bb004bbcfd05'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:29.380601 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2462/4916] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:29 2022] DELETE /identity/v3/users/7e7ace02b48143068a00bb004bbcfd05 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:29.386615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.387133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.387249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.395163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-422a1a08-b6f8-4ff1-b97a-2c80dce4f97b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:29.396496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-422a1a08-b6f8-4ff1-b97a-2c80dce4f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:29.409228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:29.410501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:29.492020 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2455/4917] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:29.495942 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2463/4918] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:29.500890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2bcb-ba92-438d-a7d2-d08034f7b2c8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.501538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2bcb-ba92-438d-a7d2-d08034f7b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.502013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2bcb-ba92-438d-a7d2-d08034f7b2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.502586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.504017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:29.528616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f1dc2bcb-ba92-438d-a7d2-d08034f7b2c8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:29.530148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f1dc2bcb-ba92-438d-a7d2-d08034f7b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:29.538697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2456/4919] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:29.544963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2bcb-ba92-438d-a7d2-d08034f7b2c8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.558966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2bcb-ba92-438d-a7d2-d08034f7b2c8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.564496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.565081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.565360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.565631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.566282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:29.566579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.568189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.590251 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2457/4920] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:29.590729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3032db-5b5d-4051-82b0-e22a0a439b9d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.591176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.594687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.595301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.595575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.595843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.602145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368085c-d633-4e31-b9e4-951e764212f1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.606455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.607155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.607769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.608047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.608200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.608307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.609009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.611306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.619167 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2464/4921] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:29.648497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2458/4922] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:29 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:29.652493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.667523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd8f2-0a56-4295-9e2f-9e7559e86ceb service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.752277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.753716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.754378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.754662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.755620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.757793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.798710 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2465/4923] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:29 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:29.802571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.817629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a443-6257-4143-b2f0-07e8b7380fb8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.825615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.826325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.826684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.827072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.827834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.830410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.847888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2459/4924] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:24:29.851981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.865210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1523d9-aa89-410f-aa28-a3e5e1cde5e3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.870779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7695f-07c3-47c0-8ad8-22146f1c30b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.871419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7695f-07c3-47c0-8ad8-22146f1c30b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.871748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7695f-07c3-47c0-8ad8-22146f1c30b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.872029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7695f-07c3-47c0-8ad8-22146f1c30b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.872683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7695f-07c3-47c0-8ad8-22146f1c30b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.874590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7695f-07c3-47c0-8ad8-22146f1c30b3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.884678 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:29.912668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2466/4925] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:29.916592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:29.931836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84098e86-21f7-45b4-9b80-dd69c70c0500 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:29.938366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:29.939438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:29.939722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:29.939996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] PATH_INFO: `/v3/projects/6d5b8f7e13fd479a9095de1f12047697/users/ab1181975f074a1ebf2022256e0d38c8/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:29.968558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5b8f7e13fd479a9095de1f12047697, user_id=ab1181975f074a1ebf2022256e0d38c8, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:29.974033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:29.981702 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:29.999427 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2460/4926] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:29 2022] PUT /identity/v3/projects/6d5b8f7e13fd479a9095de1f12047697/users/ab1181975f074a1ebf2022256e0d38c8/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:30.009931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.010206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.010484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.046848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] MFA Rules not processed for user `ab1181975f074a1ebf2022256e0d38c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:30.048553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:30.115604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:30.117457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:30.202253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2467/4927] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:30.210020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:30.211484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:30.317120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909d3f-065b-45c3-bb11-6e8c9640686e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:30.321978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:30.322636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.322921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.323194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] PATH_INFO: `/v3/projects/cc038745a37a478cae7e47b30c86a171` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.325527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc038745a37a478cae7e47b30c86a171)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:30.327626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:30.346478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac45ac9-f140-4271-94a6-6aecbd64c786 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:30.355705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25308e2c-6028-47bf-81c3-60d93d021e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:30.356542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308e2c-6028-47bf-81c3-60d93d021e70 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.356928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308e2c-6028-47bf-81c3-60d93d021e70 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.357319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308e2c-6028-47bf-81c3-60d93d021e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.369978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25308e2c-6028-47bf-81c3-60d93d021e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:30.372340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25308e2c-6028-47bf-81c3-60d93d021e70 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:30.387641 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2468/4928] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:24:30.395162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc038745a37a478cae7e47b30c86a171', 'request_id': 'req-bd15174d-751b-42c3-837c-28b9e36d505c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:30.409892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc038745a37a478cae7e47b30c86a171', 'request_id': 'req-bd15174d-751b-42c3-837c-28b9e36d505c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:30.418313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc038745a37a478cae7e47b30c86a171', 'request_id': 'req-bd15174d-751b-42c3-837c-28b9e36d505c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:30.442666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] The token cache is being invalidate because project cc038745a37a478cae7e47b30c86a171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:30.443013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:30.443638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bd15174d-751b-42c3-837c-28b9e36d505c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:30.445542 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2461/4929] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:30 2022] DELETE /identity/v3/projects/cc038745a37a478cae7e47b30c86a171 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:30.450506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e9890-f446-4837-924d-4a7030caa3d3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.450810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e9890-f446-4837-924d-4a7030caa3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.451063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e9890-f446-4837-924d-4a7030caa3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.479492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f24e9890-f446-4837-924d-4a7030caa3d3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:30.481215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f24e9890-f446-4837-924d-4a7030caa3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:30.579537 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2469/4930] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:30.581243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4634f7e-035c-4816-a246-4c48669c312b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.581537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4634f7e-035c-4816-a246-4c48669c312b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.581816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4634f7e-035c-4816-a246-4c48669c312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.602823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a4634f7e-035c-4816-a246-4c48669c312b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:30.604060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4634f7e-035c-4816-a246-4c48669c312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:30.616745 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2462/4931] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:30.617604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e9890-f446-4837-924d-4a7030caa3d3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:30.642386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e9890-f446-4837-924d-4a7030caa3d3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:30.647044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:30.647689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.647965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.648236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.648936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:30.649236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:30.650851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:30.654064 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:30.664586 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2470/4932] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:24:30.668854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4634f7e-035c-4816-a246-4c48669c312b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:30.679649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4634f7e-035c-4816-a246-4c48669c312b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:30.692904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:30.693931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.694274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.694652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.696410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:30.698920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:30.751619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2463/4933] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:30 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:30.755561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:30.777485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed53b-ba90-47bf-9d56-f1f4cebb6d6b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:30.872663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:30.873405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.873670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.873958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.874790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:30.877128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:30.907777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2471/4934] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:30 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:30.911250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:30.941601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62505b51-989c-445b-8026-74a45aed8486 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:30.947033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:30.947663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.947941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.948207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.949137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:30.950935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:30.963871 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2464/4935] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:30.968059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:30.987997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32530a4-424d-4ef3-a37f-9adaa63b4b9d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:30.994599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173ef54-1832-4e37-8748-53beed39a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:30.995582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ef54-1832-4e37-8748-53beed39a7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:30.996168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ef54-1832-4e37-8748-53beed39a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:30.996666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ef54-1832-4e37-8748-53beed39a7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:30.998071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173ef54-1832-4e37-8748-53beed39a7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.002469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173ef54-1832-4e37-8748-53beed39a7e5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.015764 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2472/4936] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:31.020236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.032252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f53584-16a9-4fac-be5a-71ec52e36996 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.038376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.039140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.039419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.039689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] PATH_INFO: `/v3/projects/399fcaf2e79f49acbc4d85ec3f3daa96/users/f2d075ced76c4b6faf058e8bdef9b20e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.065054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399fcaf2e79f49acbc4d85ec3f3daa96, user_id=f2d075ced76c4b6faf058e8bdef9b20e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.067724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.084250 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2465/4937] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:31 2022] PUT /identity/v3/projects/399fcaf2e79f49acbc4d85ec3f3daa96/users/f2d075ced76c4b6faf058e8bdef9b20e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:31.096810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.097301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.097570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.142969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] MFA Rules not processed for user `f2d075ced76c4b6faf058e8bdef9b20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:31.145484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:31.216482 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2473/4938] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:31.220657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.234972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.236620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:31.248526 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:31.301294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8b2ad-0c37-424d-bdc7-acc0f422c646 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.306027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.306705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.306985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.307256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.307932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.308898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810467-31df-474d-a8b5-b33ee080f397 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.309954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.313988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.314856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.315200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.315551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] PATH_INFO: `/v3/users/ab1181975f074a1ebf2022256e0d38c8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.317081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1181975f074a1ebf2022256e0d38c8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.319040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.324790 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:31.340716 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2466/4939] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:31 2022] POST /identity/v3/projects => generated 361 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:31.344719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.382649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1181975f074a1ebf2022256e0d38c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:31.393114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1181975f074a1ebf2022256e0d38c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:31.408006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1181975f074a1ebf2022256e0d38c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:31.408694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1181975f074a1ebf2022256e0d38c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:31.415264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5de2c-4ddd-4b8b-ad60-da6c7d8dba27 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.416033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef38714c-6384-4a54-bd95-cac6dae13306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1181975f074a1ebf2022256e0d38c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:31.422287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.423041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.423324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.423601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.424236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.428437 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2474/4940] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:31 2022] DELETE /identity/v3/users/ab1181975f074a1ebf2022256e0d38c8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:31.428631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.429778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.430221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.430600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.453650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:31.454844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:31.456345 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2467/4941] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:31 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:31.460054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.462319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:31.474902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec17da9-02c9-4466-9c90-52c30473b941 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.521036 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2475/4942] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:31.531553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.533009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:31.540615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.541295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.541572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.541840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.542662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.544332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.555787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2468/4943] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:24:31.559834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.569918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2710fe-83fe-4e39-8475-ec133afc81ca admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.575468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.576580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.576890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.577163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] PATH_INFO: `/v3/projects/df6200f7ea944cc1a200b5be64d66b3f/users/478b118c157041de85f300ed4f0c774e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.596814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6200f7ea944cc1a200b5be64d66b3f, user_id=478b118c157041de85f300ed4f0c774e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.599292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52567d03-58b3-4e46-a284-db579e83c5cf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.599552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.603051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.603667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.604147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.604359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.615682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.616504 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2469/4944] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:31 2022] PUT /identity/v3/projects/df6200f7ea944cc1a200b5be64d66b3f/users/478b118c157041de85f300ed4f0c774e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:31.617175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.620090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.628992 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2476/4945] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:24:31.631327 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:31.746446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0c87-fcba-4ef4-b9d2-1a50ef9f33ff admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.746446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecf9ba-1c2c-4f64-ad17-fd25f8eb00b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.746446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf9ba-1c2c-4f64-ad17-fd25f8eb00b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.746446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf9ba-1c2c-4f64-ad17-fd25f8eb00b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.747803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf9ba-1c2c-4f64-ad17-fd25f8eb00b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.747803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecf9ba-1c2c-4f64-ad17-fd25f8eb00b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.747803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecf9ba-1c2c-4f64-ad17-fd25f8eb00b6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.750609 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2470/4946] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:24:31.755642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.777129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eac0c-10dc-43d3-bdc7-6e3b4f9b5e6b service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:31.782903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:31.783843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.784103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.784380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] PATH_INFO: `/v3/projects/df6200f7ea944cc1a200b5be64d66b3f/users/478b118c157041de85f300ed4f0c774e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.786461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6200f7ea944cc1a200b5be64d66b3f, user_id=478b118c157041de85f300ed4f0c774e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:31.789834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:31.802344 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2477/4947] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:31 2022] PUT /identity/v3/projects/df6200f7ea944cc1a200b5be64d66b3f/users/478b118c157041de85f300ed4f0c774e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:31.815069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:31.815374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:31.815643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:31.851294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] MFA Rules not processed for user `478b118c157041de85f300ed4f0c774e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:31.852701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:31.947965 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2471/4948] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:31.955327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:31.974422 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:32.034660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67793da3-e784-4af5-af09-ddc2ac4f437f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.038975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d793f-34cb-4e06-bc3d-8edcaddc6d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.039587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d793f-34cb-4e06-bc3d-8edcaddc6d36 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.039863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d793f-34cb-4e06-bc3d-8edcaddc6d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.040129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d793f-34cb-4e06-bc3d-8edcaddc6d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.051385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d793f-34cb-4e06-bc3d-8edcaddc6d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.053211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d793f-34cb-4e06-bc3d-8edcaddc6d36 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.056998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:32.059163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:32.066339 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2478/4949] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:32.208548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac340c-22a0-46b5-99f6-7ffaef6f2709 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.213469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.215170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.218133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.218133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] PATH_INFO: `/v3/projects/6d5b8f7e13fd479a9095de1f12047697` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.218133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5b8f7e13fd479a9095de1f12047697)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.220590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.280376 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:32.297050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5b8f7e13fd479a9095de1f12047697', 'request_id': 'req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:32.309353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5b8f7e13fd479a9095de1f12047697', 'request_id': 'req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:32.316595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5b8f7e13fd479a9095de1f12047697', 'request_id': 'req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:32.331388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] The token cache is being invalidate because project 6d5b8f7e13fd479a9095de1f12047697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:32.331738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:32.332536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d90fb7d-5bd0-4688-8e84-6cf18c41559e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:32.334361 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2472/4950] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:32 2022] DELETE /identity/v3/projects/6d5b8f7e13fd479a9095de1f12047697 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:32.339470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2737-0c6d-4808-a9fc-993bfd9f7f69 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.340440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2737-0c6d-4808-a9fc-993bfd9f7f69 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.340440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2737-0c6d-4808-a9fc-993bfd9f7f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.372420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-694c2737-0c6d-4808-a9fc-993bfd9f7f69 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:32.373830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-694c2737-0c6d-4808-a9fc-993bfd9f7f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:32.448795 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2479/4951] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:32.457223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825494-f8c6-4d09-89a2-8903c174c1a5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.457672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825494-f8c6-4d09-89a2-8903c174c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.457737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825494-f8c6-4d09-89a2-8903c174c1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.478176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c2825494-f8c6-4d09-89a2-8903c174c1a5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:32.479934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c2825494-f8c6-4d09-89a2-8903c174c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:32.488505 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2473/4952] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:32.492628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c2737-0c6d-4808-a9fc-993bfd9f7f69 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:32.502758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c2737-0c6d-4808-a9fc-993bfd9f7f69 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.507744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.508351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.508623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.508929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.509569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:32.509864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.513299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.527277 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2480/4953] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:24:32.531489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2825494-f8c6-4d09-89a2-8903c174c1a5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:32.541042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2825494-f8c6-4d09-89a2-8903c174c1a5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.546509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.547130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.547409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.547682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.548333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.550336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.587728 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2474/4954] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:32 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:32.589210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:32.601206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae50f6-c9c5-4f06-97f1-de3d643a1d07 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.677470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.678335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.678627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.678921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.679744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.682267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.709641 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2481/4955] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:32 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:32.713755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:32.726715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f99f-d563-4377-b3ac-781d31258314 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.732303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.732981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.733242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.733512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.734158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.735772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.747821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2475/4956] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:24:32.752033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:32.764281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519f1e3-9030-4036-afcc-5864e85ff420 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.770368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960bdf-af0a-4468-956a-00fd094c3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.771042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960bdf-af0a-4468-956a-00fd094c3878 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.771319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960bdf-af0a-4468-956a-00fd094c3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.771596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960bdf-af0a-4468-956a-00fd094c3878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.772248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c960bdf-af0a-4468-956a-00fd094c3878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.774095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c960bdf-af0a-4468-956a-00fd094c3878 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.790604 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2482/4957] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:32.792134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:32.803456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe413-e77b-44fc-9d9b-d6a013f9fdc2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:32.809163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8988bf-674a-46dc-b2a3-0f0492319b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:32.809786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8988bf-674a-46dc-b2a3-0f0492319b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.810105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8988bf-674a-46dc-b2a3-0f0492319b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.810922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8988bf-674a-46dc-b2a3-0f0492319b0d admin admin] PATH_INFO: `/v3/projects/fb877dddfba14fe3929b1267dee0e256/users/ea86632bc35148a68dc7a10e194e184d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.829313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8988bf-674a-46dc-b2a3-0f0492319b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb877dddfba14fe3929b1267dee0e256, user_id=ea86632bc35148a68dc7a10e194e184d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:32.832189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8988bf-674a-46dc-b2a3-0f0492319b0d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:32.849765 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2476/4958] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:32 2022] PUT /identity/v3/projects/fb877dddfba14fe3929b1267dee0e256/users/ea86632bc35148a68dc7a10e194e184d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:32.861537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:32.861817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:32.862182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:32.897107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] MFA Rules not processed for user `ea86632bc35148a68dc7a10e194e184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:32.898349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:32.910746 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:33.018171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:33.018451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:33.018721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:33.023509 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2483/4959] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:33.043464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] MFA Rules not processed for user `ea86632bc35148a68dc7a10e194e184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:33.044690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:33.058660 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2477/4960] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:33.071996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:33.073515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:33.103868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:33.108879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:33.231542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9580c78-4e81-41e6-98fd-b9386df93afc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:33.232059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832819-f0af-48cb-b2a5-ca9e185d97ca None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:33.236920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:33.237555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:33.237869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:33.238179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:33.240009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:33.240256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abfd00-51ab-46a9-839c-bf09894dcfcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:33.240950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abfd00-51ab-46a9-839c-bf09894dcfcb service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:33.241231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abfd00-51ab-46a9-839c-bf09894dcfcb service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:33.241696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abfd00-51ab-46a9-839c-bf09894dcfcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:33.253484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abfd00-51ab-46a9-839c-bf09894dcfcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:33.255411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abfd00-51ab-46a9-839c-bf09894dcfcb service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:33.266418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2484/4961] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:33.401656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:33.403367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:33.408152 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:33.431487 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2478/4962] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:33.852530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:33.852980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:33.852980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:33.893604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:33.894867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:34.022351 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2485/4963] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:35.314693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:35.316363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:35.505248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8550cc-f61a-487f-ac6f-47b819957a3a service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:35.521201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2102e2-2b56-4c12-b22f-de13736d0fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:35.523089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2102e2-2b56-4c12-b22f-de13736d0fed service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:35.524921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2102e2-2b56-4c12-b22f-de13736d0fed service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:35.525550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2102e2-2b56-4c12-b22f-de13736d0fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:35.531314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8a2102e2-2b56-4c12-b22f-de13736d0fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:35.680085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2102e2-2b56-4c12-b22f-de13736d0fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:35.681571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2102e2-2b56-4c12-b22f-de13736d0fed service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:35.703547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2479/4964] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:37.039734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:37.042695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:37.105606 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:37.137376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073329fc-41bf-482f-ad4d-4be82bfa75a6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:37.143083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:37.144520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:37.144986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:37.145398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] PATH_INFO: `/v3/users/f2d075ced76c4b6faf058e8bdef9b20e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:37.146792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d075ced76c4b6faf058e8bdef9b20e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:37.150152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:37.220284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d075ced76c4b6faf058e8bdef9b20e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:37.241362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d075ced76c4b6faf058e8bdef9b20e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:37.266360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d075ced76c4b6faf058e8bdef9b20e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:37.270802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d075ced76c4b6faf058e8bdef9b20e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:37.288256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d075ced76c4b6faf058e8bdef9b20e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:37.298415 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2486/4965] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:37 2022] DELETE /identity/v3/users/f2d075ced76c4b6faf058e8bdef9b20e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:37.304295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b812d2-7805-45e2-820a-9b0c2e5070bf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:37.304295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b812d2-7805-45e2-820a-9b0c2e5070bf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:37.304295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b812d2-7805-45e2-820a-9b0c2e5070bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:37.379606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-03b812d2-7805-45e2-820a-9b0c2e5070bf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:37.381061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-03b812d2-7805-45e2-820a-9b0c2e5070bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:37.509564 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2480/4966] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:37.546334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:37.548417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:37.643974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937033f-f1a7-4b1e-bab2-c95f02ff6e3c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:37.649208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:37.649989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:37.650267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:37.650536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:37.671271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:37.672856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:37.701861 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2487/4967] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:37.991170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b61e-0978-4cca-a240-768f1422f1ee None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:37.991469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b61e-0978-4cca-a240-768f1422f1ee None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:37.991878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b61e-0978-4cca-a240-768f1422f1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:38.016965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a969b61e-0978-4cca-a240-768f1422f1ee None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:38.018289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a969b61e-0978-4cca-a240-768f1422f1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:38.155128 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:38.168307 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2481/4968] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:38.640600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:38.642986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:38.671741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845ead0-e796-4268-9870-9a7e68b27ad2 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:38.677375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:38.678119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:38.678517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:38.678991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] PATH_INFO: `/v3/projects/399fcaf2e79f49acbc4d85ec3f3daa96` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:38.680226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399fcaf2e79f49acbc4d85ec3f3daa96)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:38.682687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:38.762647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399fcaf2e79f49acbc4d85ec3f3daa96', 'request_id': 'req-e1965c84-67a4-479d-bba1-25f89f2f3710'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:38.771927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399fcaf2e79f49acbc4d85ec3f3daa96', 'request_id': 'req-e1965c84-67a4-479d-bba1-25f89f2f3710'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:38.776731 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:38.779120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399fcaf2e79f49acbc4d85ec3f3daa96', 'request_id': 'req-e1965c84-67a4-479d-bba1-25f89f2f3710'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:38.797205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] The token cache is being invalidate because project 399fcaf2e79f49acbc4d85ec3f3daa96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:38.797494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:38.798138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:38.799898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2488/4969] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:38 2022] DELETE /identity/v3/projects/399fcaf2e79f49acbc4d85ec3f3daa96 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:38.804458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969b61e-0978-4cca-a240-768f1422f1ee None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:38.823866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969b61e-0978-4cca-a240-768f1422f1ee None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:38.908361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:38.909079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:38.909426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:38.909909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] PATH_INFO: `/v3/users/478b118c157041de85f300ed4f0c774e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:38.911157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478b118c157041de85f300ed4f0c774e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:38.913195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:39.006816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478b118c157041de85f300ed4f0c774e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:39.018701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478b118c157041de85f300ed4f0c774e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:39.019406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478b118c157041de85f300ed4f0c774e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:39.047003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478b118c157041de85f300ed4f0c774e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:39.052805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16d8f743-eef8-4916-b0f8-fb7f325bef11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478b118c157041de85f300ed4f0c774e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:39.083492 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2482/4970] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:38 2022] DELETE /identity/v3/users/478b118c157041de85f300ed4f0c774e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:39.580572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:39.582706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:39.622972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1965c84-67a4-479d-bba1-25f89f2f3710 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:39.777137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a32700-49aa-49e7-93a4-34e08bffa160 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:39.777420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a32700-49aa-49e7-93a4-34e08bffa160 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:39.777725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a32700-49aa-49e7-93a4-34e08bffa160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:39.814489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:39.815393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:39.816853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:39.817338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] PATH_INFO: `/v3/projects/df6200f7ea944cc1a200b5be64d66b3f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:39.821370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6200f7ea944cc1a200b5be64d66b3f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:39.833101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:39.866733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c4a32700-49aa-49e7-93a4-34e08bffa160 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:39.870771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c4a32700-49aa-49e7-93a4-34e08bffa160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:39.970772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6200f7ea944cc1a200b5be64d66b3f', 'request_id': 'req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:39.981848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6200f7ea944cc1a200b5be64d66b3f', 'request_id': 'req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:39.986794 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2483/4971] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:40.011760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6200f7ea944cc1a200b5be64d66b3f', 'request_id': 'req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:40.040749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] The token cache is being invalidate because project df6200f7ea944cc1a200b5be64d66b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:40.041220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:40.042773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fbd9a3ba-7dce-4ff4-802f-dcd0a77311fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:40.056231 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2489/4972] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:39 2022] DELETE /identity/v3/projects/df6200f7ea944cc1a200b5be64d66b3f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:40.062293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402d59-ff3b-4f7d-b16b-bb86dedbb247 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:40.063204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402d59-ff3b-4f7d-b16b-bb86dedbb247 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:40.063967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402d59-ff3b-4f7d-b16b-bb86dedbb247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:40.181022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c5402d59-ff3b-4f7d-b16b-bb86dedbb247 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:40.184804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5402d59-ff3b-4f7d-b16b-bb86dedbb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:40.206941 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:40.301345 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2484/4973] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:40.301614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4db0-e86b-4c9e-b32a-c45744d3c396 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:40.301614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4db0-e86b-4c9e-b32a-c45744d3c396 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:40.301614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4db0-e86b-4c9e-b32a-c45744d3c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:40.333787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e3dc4db0-e86b-4c9e-b32a-c45744d3c396 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:40.334849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3dc4db0-e86b-4c9e-b32a-c45744d3c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:40.361282 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2490/4974] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:40.364475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402d59-ff3b-4f7d-b16b-bb86dedbb247 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:40.392604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402d59-ff3b-4f7d-b16b-bb86dedbb247 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:40.420501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:40.421606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:40.421888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:40.422161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:40.422827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:40.423129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:40.441691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:40.504317 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2485/4975] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:24:40.509388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4db0-e86b-4c9e-b32a-c45744d3c396 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:40.522290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4db0-e86b-4c9e-b32a-c45744d3c396 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:40.529403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:40.530116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:40.530459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:40.530793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:40.531806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:40.535532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:40.605746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:40.620944 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2491/4976] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:40 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:24:40.626591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c2249-c9d4-40ee-8a63-f0459f16768e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:40.768398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:40.771608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:40.772083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:40.772462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:40.773385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:40.778480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:40.849074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:40.863129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2486/4977] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:40 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:40.874639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af91c91-590a-4dad-a8ce-98198361de24 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:40.894703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:40.896931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:40.897261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:40.897538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:40.900249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:40.907068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:40.937462 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2492/4978] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:40.941191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:40.952990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8851-fa5b-4768-9f06-e60daa8c232e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:40.985238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deb14c-6423-40d1-b87e-2a740f828975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:40.987406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deb14c-6423-40d1-b87e-2a740f828975 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:40.987875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deb14c-6423-40d1-b87e-2a740f828975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:40.988154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deb14c-6423-40d1-b87e-2a740f828975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:40.989236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15deb14c-6423-40d1-b87e-2a740f828975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:40.992572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15deb14c-6423-40d1-b87e-2a740f828975 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:41.033562 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2487/4979] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:41.034616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:41.049539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec085-af7b-416f-974e-81078542ff40 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:41.061453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa515f1-c150-44c0-b169-5e7c5d170ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:41.062456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa515f1-c150-44c0-b169-5e7c5d170ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:41.062880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa515f1-c150-44c0-b169-5e7c5d170ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:41.065661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa515f1-c150-44c0-b169-5e7c5d170ff7 admin admin] PATH_INFO: `/v3/projects/047454232e434fba935b886e053e7656/users/2cb2d438f05848eb83b49227166387bd/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:41.111514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa515f1-c150-44c0-b169-5e7c5d170ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=047454232e434fba935b886e053e7656, user_id=2cb2d438f05848eb83b49227166387bd, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:41.114641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa515f1-c150-44c0-b169-5e7c5d170ff7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:41.161864 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2493/4980] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:41 2022] PUT /identity/v3/projects/047454232e434fba935b886e053e7656/users/2cb2d438f05848eb83b49227166387bd/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:41.165626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:41.166105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:41.166541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:41.244641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] MFA Rules not processed for user `2cb2d438f05848eb83b49227166387bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:41.248685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:41.322433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e2218-0b1c-428a-b97b-51646b398aae None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:41.322795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e2218-0b1c-428a-b97b-51646b398aae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:41.323254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e2218-0b1c-428a-b97b-51646b398aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:41.414502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ef3e2218-0b1c-428a-b97b-51646b398aae None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:41.415755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ef3e2218-0b1c-428a-b97b-51646b398aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:41.449884 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:41.457551 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2488/4981] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:41.459971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:41.464132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:41.505443 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:41.571303 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2494/4982] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:41.639773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979829d3-fdb0-4efb-8aa1-dd9d4115f650 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:41.644442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691151-59ab-4586-b0bd-25f46f6128aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:41.645263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691151-59ab-4586-b0bd-25f46f6128aa service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:41.645529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691151-59ab-4586-b0bd-25f46f6128aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:41.645832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691151-59ab-4586-b0bd-25f46f6128aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:41.680211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691151-59ab-4586-b0bd-25f46f6128aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:41.690896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691151-59ab-4586-b0bd-25f46f6128aa service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:41.746544 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2489/4983] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:42.822585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3ac0-4775-4fb7-8beb-425404541bab None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:42.823200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3ac0-4775-4fb7-8beb-425404541bab None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:42.823200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3ac0-4775-4fb7-8beb-425404541bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:42.888179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ab3d3ac0-4775-4fb7-8beb-425404541bab None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:42.889655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab3d3ac0-4775-4fb7-8beb-425404541bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:42.926816 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2495/4984] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:44.637401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db334-190a-40ac-b9b9-0d491ccc4a49 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:44.640079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db334-190a-40ac-b9b9-0d491ccc4a49 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:44.640377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db334-190a-40ac-b9b9-0d491ccc4a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:44.684277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-786db334-190a-40ac-b9b9-0d491ccc4a49 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:44.686549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-786db334-190a-40ac-b9b9-0d491ccc4a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:44.699942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2490/4985] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:46.686147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:46.687044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:46.687455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:46.765607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:46.783621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:46.804810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2496/4986] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:48.222609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:48.222609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:48.222609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:48.270078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:48.274448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:48.284354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:48.286953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:48.333564 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2491/4987] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:48.661353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feef80e-127a-4829-805e-8facfef2a39e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:48.689564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e1d6-a928-48e4-833b-f75ab8fbb01d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:48.690210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e1d6-a928-48e4-833b-f75ab8fbb01d service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:48.690486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e1d6-a928-48e4-833b-f75ab8fbb01d service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:48.691158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e1d6-a928-48e4-833b-f75ab8fbb01d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:48.693600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f96e1d6-a928-48e4-833b-f75ab8fbb01d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:48.727348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e1d6-a928-48e4-833b-f75ab8fbb01d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:48.729510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e1d6-a928-48e4-833b-f75ab8fbb01d service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:48.778234 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2497/4988] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:24:49.705898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:49.707789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:49.888420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab3b22-cd72-4360-a1d0-125a1cbf7078 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:49.898092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:49.899231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:49.899720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:49.900268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] PATH_INFO: `/v3/users/e465092cdf0e452d9a06f9f36fee5f26` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:49.904625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e465092cdf0e452d9a06f9f36fee5f26)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:49.906910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:49.995892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e465092cdf0e452d9a06f9f36fee5f26'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:50.017552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e465092cdf0e452d9a06f9f36fee5f26'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:50.018525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e465092cdf0e452d9a06f9f36fee5f26'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:50.044464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e465092cdf0e452d9a06f9f36fee5f26'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:50.045635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e465092cdf0e452d9a06f9f36fee5f26'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:50.076954 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2492/4989] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:49 2022] DELETE /identity/v3/users/e465092cdf0e452d9a06f9f36fee5f26 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:24:50.077052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4af307-8f2d-4738-bf1d-bb5089fdff7a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:50.077052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4af307-8f2d-4738-bf1d-bb5089fdff7a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:50.077052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4af307-8f2d-4738-bf1d-bb5089fdff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:50.139732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fc4af307-8f2d-4738-bf1d-bb5089fdff7a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:50.141497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fc4af307-8f2d-4738-bf1d-bb5089fdff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:50.283596 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2498/4990] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:50.321862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:50.324274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:50.362261 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:50.516137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc4d20-61f1-4056-b2fc-80cad61b079a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:50.527625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:50.530067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:50.530067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:50.530767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:50.546047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:50.548349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:50.578231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2493/4991] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:50.829280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:50.829840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:50.830290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:50.872358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:50.875029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:50.929250 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:51.061812 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2499/4992] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:52.495845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:52.510089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95ef6-0f47-40dc-993e-44bfc7f77010 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:52.526009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:52.527463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:52.527762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:52.528042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:52.532389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:52.563130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:52.565966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:52.598243 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2494/4993] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:52.809014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:52.814147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:52.850708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f06f5f-1597-4783-ab5b-4937fcb31c02 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:52.863038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:52.863821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:52.864196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:52.864566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] PATH_INFO: `/v3/projects/daa4332e29cc48169862dbf6dd5a221a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:52.871782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa4332e29cc48169862dbf6dd5a221a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:52.873997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:52.990274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa4332e29cc48169862dbf6dd5a221a', 'request_id': 'req-0998a955-9719-4aed-acb1-b39bbad281eb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.001736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa4332e29cc48169862dbf6dd5a221a', 'request_id': 'req-0998a955-9719-4aed-acb1-b39bbad281eb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.016236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa4332e29cc48169862dbf6dd5a221a', 'request_id': 'req-0998a955-9719-4aed-acb1-b39bbad281eb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.039580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] The token cache is being invalidate because project daa4332e29cc48169862dbf6dd5a221a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:53.039886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.053878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0998a955-9719-4aed-acb1-b39bbad281eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.055991 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2500/4994] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:52 2022] DELETE /identity/v3/projects/daa4332e29cc48169862dbf6dd5a221a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:53.062017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:53.076944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e5b7-8419-4c2d-9629-23291cff156e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:53.193452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:53.197090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:53.197950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:53.197950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] PATH_INFO: `/v3/users/a818a5f1d2b64a558793fe1587430335` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:53.199620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a818a5f1d2b64a558793fe1587430335)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:53.201768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:53.284974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a818a5f1d2b64a558793fe1587430335'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.296912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a818a5f1d2b64a558793fe1587430335'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.297545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a818a5f1d2b64a558793fe1587430335'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.311404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a818a5f1d2b64a558793fe1587430335'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.312228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a818a5f1d2b64a558793fe1587430335'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:53.349399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2495/4995] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:53 2022] DELETE /identity/v3/users/a818a5f1d2b64a558793fe1587430335 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:54.575096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8cb2-dec3-4c33-8bfc-5383885dfe4d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:54.575644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8cb2-dec3-4c33-8bfc-5383885dfe4d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:54.575644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8cb2-dec3-4c33-8bfc-5383885dfe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:54.612150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2e9b8cb2-dec3-4c33-8bfc-5383885dfe4d None None] MFA Rules not processed for user `79c5db05d52f4b8d91b430a8b459a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:54.613510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2e9b8cb2-dec3-4c33-8bfc-5383885dfe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:54.833996 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2501/4996] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:54.894137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:54.896132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:54.995368 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:55.108045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c071da7-0c27-4a64-9e62-958f8eafea68 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:55.132203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:55.132203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:55.132203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:55.132203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] PATH_INFO: `/v3/projects/4fbf955c40d84ca9b832f0f233e6da9d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:55.134274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbf955c40d84ca9b832f0f233e6da9d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:55.145890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:55.275174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbf955c40d84ca9b832f0f233e6da9d', 'request_id': 'req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:55.296889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbf955c40d84ca9b832f0f233e6da9d', 'request_id': 'req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:55.307979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbf955c40d84ca9b832f0f233e6da9d', 'request_id': 'req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:55.336915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] The token cache is being invalidate because project 4fbf955c40d84ca9b832f0f233e6da9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:24:55.337206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:55.339148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3192c7ec-b9a4-4aee-9f32-b3cdca41e570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:55.350330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ac00-6658-424d-890d-a7085daae276 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:55.350784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ac00-6658-424d-890d-a7085daae276 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:55.351068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ac00-6658-424d-890d-a7085daae276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:55.369442 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2496/4997] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:54 2022] DELETE /identity/v3/projects/4fbf955c40d84ca9b832f0f233e6da9d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:55.402072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c304ac00-6658-424d-890d-a7085daae276 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:55.403298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c304ac00-6658-424d-890d-a7085daae276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:55.551673 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:55.575092 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2502/4998] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:24:55.592808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3be55-a492-44aa-b6a6-3fc22ca7c0d6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:55.592808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3be55-a492-44aa-b6a6-3fc22ca7c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:55.592808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3be55-a492-44aa-b6a6-3fc22ca7c0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:55.670637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-86c3be55-a492-44aa-b6a6-3fc22ca7c0d6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:55.674741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-86c3be55-a492-44aa-b6a6-3fc22ca7c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:55.707249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304ac00-6658-424d-890d-a7085daae276 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:55.709326 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2497/4999] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:55.726215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304ac00-6658-424d-890d-a7085daae276 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:55.735616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:55.736514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:55.736514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:55.736812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:55.737444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:24:55.737741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:55.739537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:55.764971 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2503/5000] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:24:55.770422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3be55-a492-44aa-b6a6-3fc22ca7c0d6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:55.785353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3be55-a492-44aa-b6a6-3fc22ca7c0d6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:55.808192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:55.808613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:55.808962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:55.809168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:55.821166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:55.826407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:55.917228 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2498/5001] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:55.920871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:55.943787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97ca5f-7903-44fa-a8e8-41aa32e0db03 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:56.114473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:56.115572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:56.116015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:56.116536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:56.123137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:56.136324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:56.182776 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2504/5002] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:24:55 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:24:56.187797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:56.217591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d867f17-9117-406b-a0df-3c6c8282aea3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:56.225308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:56.225930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:56.226208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:56.226479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:56.227168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:56.228703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:56.267407 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2499/5003] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:24:56.270787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:56.292746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d291f-494a-4094-a0e4-bd9a527426a0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:56.310111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21aad9-57e6-4f6d-a4e4-9f806513768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:56.311161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21aad9-57e6-4f6d-a4e4-9f806513768e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:56.311577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21aad9-57e6-4f6d-a4e4-9f806513768e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:56.312493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21aad9-57e6-4f6d-a4e4-9f806513768e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:56.313661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21aad9-57e6-4f6d-a4e4-9f806513768e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:56.315559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21aad9-57e6-4f6d-a4e4-9f806513768e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:56.342533 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2505/5004] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:24:56.343797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:56.358073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3822-b500-456d-9399-2aef903bb1a6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:56.379750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:56.379750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:56.380213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:56.380582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] PATH_INFO: `/v3/projects/9b90a09bfc7a41989e74c213e394abe3/users/540eebcd901c4e84b27106e9fd275344/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:56.429869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b90a09bfc7a41989e74c213e394abe3, user_id=540eebcd901c4e84b27106e9fd275344, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:56.433262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:56.480273 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2500/5005] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:24:56 2022] PUT /identity/v3/projects/9b90a09bfc7a41989e74c213e394abe3/users/540eebcd901c4e84b27106e9fd275344/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:56.517394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597836-c425-4f71-9a95-c480843c762a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:56.519740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597836-c425-4f71-9a95-c480843c762a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:56.519740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597836-c425-4f71-9a95-c480843c762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:56.585151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d5597836-c425-4f71-9a95-c480843c762a None None] MFA Rules not processed for user `540eebcd901c4e84b27106e9fd275344`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:56.588385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d5597836-c425-4f71-9a95-c480843c762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:56.811641 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2506/5006] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:56.822753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:56.824948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:56.963957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eff9f-319a-455d-950a-cd76efbc5c15 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:56.968574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcd4fe-a470-4fcc-89fc-0c60cf3b7ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:56.969369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcd4fe-a470-4fcc-89fc-0c60cf3b7ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:56.969758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcd4fe-a470-4fcc-89fc-0c60cf3b7ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:56.970978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcd4fe-a470-4fcc-89fc-0c60cf3b7ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:56.982535 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:56.991022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcd4fe-a470-4fcc-89fc-0c60cf3b7ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:56.992469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcd4fe-a470-4fcc-89fc-0c60cf3b7ba3 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:57.013115 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2501/5007] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:57.063539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5597836-c425-4f71-9a95-c480843c762a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:57.189572 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:57.202449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5597836-c425-4f71-9a95-c480843c762a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:57.207230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:57.208314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:57.208548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:57.208874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] PATH_INFO: `/v3/users/540eebcd901c4e84b27106e9fd275344` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:57.214390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=540eebcd901c4e84b27106e9fd275344)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:57.214390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:57.295115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540eebcd901c4e84b27106e9fd275344'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:57.313511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540eebcd901c4e84b27106e9fd275344'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:57.349486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540eebcd901c4e84b27106e9fd275344'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:57.354130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540eebcd901c4e84b27106e9fd275344'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:57.377792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540eebcd901c4e84b27106e9fd275344'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:57.387578 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2507/5008] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:24:57 2022] DELETE /identity/v3/users/540eebcd901c4e84b27106e9fd275344 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:24:57.391981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17394-0f3d-4735-92c2-925605625247 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:57.392265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17394-0f3d-4735-92c2-925605625247 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:57.392807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17394-0f3d-4735-92c2-925605625247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:57.429031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-68f17394-0f3d-4735-92c2-925605625247 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:24:57.430300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68f17394-0f3d-4735-92c2-925605625247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:57.615919 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2502/5009] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:24:57.780451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:57.782513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:57.930214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05912581-253d-4865-a00b-178915e7c5ad admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:57.943418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a3706-742b-4f2f-9c9a-070a7441eb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:57.944980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3706-742b-4f2f-9c9a-070a7441eb81 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:57.944980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3706-742b-4f2f-9c9a-070a7441eb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:57.945686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3706-742b-4f2f-9c9a-070a7441eb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:57.964495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a3706-742b-4f2f-9c9a-070a7441eb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:57.967463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a3706-742b-4f2f-9c9a-070a7441eb81 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:58.005469 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2508/5010] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:59.747456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17394-0f3d-4735-92c2-925605625247 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:24:59.749472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68f17394-0f3d-4735-92c2-925605625247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:24:59.786958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17394-0f3d-4735-92c2-925605625247 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:24:59.808363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:24:59.812701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:24:59.813356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:24:59.813810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] PATH_INFO: `/v3/projects/9b90a09bfc7a41989e74c213e394abe3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:24:59.825019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b90a09bfc7a41989e74c213e394abe3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:24:59.827114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:24:59.957629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b90a09bfc7a41989e74c213e394abe3', 'request_id': 'req-06841391-d79b-45bb-a961-a3b421c3bd1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:59.980824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b90a09bfc7a41989e74c213e394abe3', 'request_id': 'req-06841391-d79b-45bb-a961-a3b421c3bd1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:24:59.989769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b90a09bfc7a41989e74c213e394abe3', 'request_id': 'req-06841391-d79b-45bb-a961-a3b421c3bd1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:00.016054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] The token cache is being invalidate because project 9b90a09bfc7a41989e74c213e394abe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:25:00.016351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:00.019944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-06841391-d79b-45bb-a961-a3b421c3bd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:00.025158 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2503/5011] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:59 2022] DELETE /identity/v3/projects/9b90a09bfc7a41989e74c213e394abe3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:00.028847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991fb2a-1273-4a8a-adfc-df611dee3ccc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.028847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991fb2a-1273-4a8a-adfc-df611dee3ccc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.034284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991fb2a-1273-4a8a-adfc-df611dee3ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.075117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b991fb2a-1273-4a8a-adfc-df611dee3ccc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:00.076665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b991fb2a-1273-4a8a-adfc-df611dee3ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:00.156025 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2509/5012] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:25:00.164077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4497bd-9bc1-4d0d-91b2-49f3015c6ac9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.165085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4497bd-9bc1-4d0d-91b2-49f3015c6ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.165393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4497bd-9bc1-4d0d-91b2-49f3015c6ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.202740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ee4497bd-9bc1-4d0d-91b2-49f3015c6ac9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:00.203948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ee4497bd-9bc1-4d0d-91b2-49f3015c6ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:00.213703 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2504/5013] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:00.218318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991fb2a-1273-4a8a-adfc-df611dee3ccc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:00.233365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991fb2a-1273-4a8a-adfc-df611dee3ccc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:00.240338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:00.241003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.241278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.241591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.242283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:25:00.242732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:00.244579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:00.259849 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2510/5014] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:25:00.264150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4497bd-9bc1-4d0d-91b2-49f3015c6ac9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:00.275448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4497bd-9bc1-4d0d-91b2-49f3015c6ac9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:00.281665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:00.282664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.283119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.283532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.284289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:00.286422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:00.327810 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2505/5015] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:25:00 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:00.332082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:00.339745 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:00.353699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbc5b3-3a06-485f-831c-d40d015fe822 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:00.490176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:00.490965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.491377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.491804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.492563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:00.494793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:00.528627 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2511/5016] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:25:00 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:00.531954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:00.548689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4907b-3474-4ace-8a22-09fb520455b8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:00.554872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:00.560830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.561321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.561735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.562597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:00.564553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:00.583543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2506/5017] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:25:00.589904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:00.603230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3abc0-2bd5-4bb1-b926-80265e1c833e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:00.609605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79937-e636-49f3-b646-81fe331df0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:00.610698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79937-e636-49f3-b646-81fe331df0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.612017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79937-e636-49f3-b646-81fe331df0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.612481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79937-e636-49f3-b646-81fe331df0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.613465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca79937-e636-49f3-b646-81fe331df0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:00.615622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca79937-e636-49f3-b646-81fe331df0c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:00.629712 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2512/5018] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:25:00.634275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:00.647826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be867c9-2333-44d8-9d73-1b13484d9333 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:00.655259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:00.656269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.656685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.657138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] PATH_INFO: `/v3/projects/42b5531aa4b24755afbfd4ad60a00131/users/d48c9a59007a4c03933c50f6d6d336ba/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.681591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b5531aa4b24755afbfd4ad60a00131, user_id=d48c9a59007a4c03933c50f6d6d336ba, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:00.685703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:00.708010 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2507/5019] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:25:00 2022] PUT /identity/v3/projects/42b5531aa4b24755afbfd4ad60a00131/users/d48c9a59007a4c03933c50f6d6d336ba/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:00.721506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:00.721819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:00.722046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:00.765746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] MFA Rules not processed for user `d48c9a59007a4c03933c50f6d6d336ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:00.767115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:00.915859 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2513/5020] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:00.930286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:00.933139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:00.993810 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:01.086799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9261bb-62fd-4aa1-9f15-2e4d44306dea admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:01.092157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:01.092971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:01.093570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:01.093917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:01.149393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:01.150906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:01.178144 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2508/5021] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:25:03.072501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:03.074094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:03.304089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816c3dc-ff72-483f-8ae0-fa6538fd6ced None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:03.324552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd506d-66e0-47d7-9e04-af0cbd5c2e05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:03.325955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd506d-66e0-47d7-9e04-af0cbd5c2e05 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:03.328119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd506d-66e0-47d7-9e04-af0cbd5c2e05 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:03.328510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd506d-66e0-47d7-9e04-af0cbd5c2e05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:03.337239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e5cd506d-66e0-47d7-9e04-af0cbd5c2e05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:03.361656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:03.363168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:03.406399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd506d-66e0-47d7-9e04-af0cbd5c2e05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:03.416386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd506d-66e0-47d7-9e04-af0cbd5c2e05 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:03.441661 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:03.465932 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2514/5022] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:03.492567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b29a0-e08c-48a8-bbba-8d8dc7242b0b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:03.493130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b29a0-e08c-48a8-bbba-8d8dc7242b0b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:03.493476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b29a0-e08c-48a8-bbba-8d8dc7242b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:03.518350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0c4b29a0-e08c-48a8-bbba-8d8dc7242b0b None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:03.521248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c4b29a0-e08c-48a8-bbba-8d8dc7242b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:03.638511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3502b-578e-494c-a48e-6f2c36ea0278 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:03.662626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:03.662876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:03.663130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:03.663396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] PATH_INFO: `/v3/users/3fbef527355e40f3af441a57cd5807be` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:03.676958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbef527355e40f3af441a57cd5807be)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:03.680657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2515/5023] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:25:03.685293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:03.824678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbef527355e40f3af441a57cd5807be'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:03.853481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbef527355e40f3af441a57cd5807be'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:03.854532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbef527355e40f3af441a57cd5807be'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:03.883052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbef527355e40f3af441a57cd5807be'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:03.885138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5e30991-ecd6-41ab-8a8f-e2a29debb3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbef527355e40f3af441a57cd5807be'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:03.956797 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2509/5024] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:25:03 2022] DELETE /identity/v3/users/3fbef527355e40f3af441a57cd5807be => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:05.026552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b29a0-e08c-48a8-bbba-8d8dc7242b0b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:05.058955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71044e-0b63-4622-8e78-dc1f7aa27ea3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:05.059412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71044e-0b63-4622-8e78-dc1f7aa27ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:05.059496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71044e-0b63-4622-8e78-dc1f7aa27ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:05.083992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b29a0-e08c-48a8-bbba-8d8dc7242b0b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:05.120590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0b71044e-0b63-4622-8e78-dc1f7aa27ea3 None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:05.121848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b71044e-0b63-4622-8e78-dc1f7aa27ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:05.228315 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:05.277056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:05.278933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:05.278933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:05.279244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] PATH_INFO: `/v3/projects/9027d7cd75f84b11a4b8846a9769e356` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:05.282743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9027d7cd75f84b11a4b8846a9769e356)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:05.283503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:05.296618 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2510/5025] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:25:05.435739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9027d7cd75f84b11a4b8846a9769e356', 'request_id': 'req-25cd9081-0316-4e70-814c-c0d528a7c48f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:05.443684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9027d7cd75f84b11a4b8846a9769e356', 'request_id': 'req-25cd9081-0316-4e70-814c-c0d528a7c48f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:05.457162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9027d7cd75f84b11a4b8846a9769e356', 'request_id': 'req-25cd9081-0316-4e70-814c-c0d528a7c48f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:05.481398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] The token cache is being invalidate because project 9027d7cd75f84b11a4b8846a9769e356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:25:05.482173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:05.483542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25cd9081-0316-4e70-814c-c0d528a7c48f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:05.485650 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2516/5026] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:05 2022] DELETE /identity/v3/projects/9027d7cd75f84b11a4b8846a9769e356 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:05.498850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817a48-0ae8-4906-97b6-aab78e3bb945 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:05.499322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817a48-0ae8-4906-97b6-aab78e3bb945 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:05.499868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817a48-0ae8-4906-97b6-aab78e3bb945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:05.540696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9e817a48-0ae8-4906-97b6-aab78e3bb945 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:05.543108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e817a48-0ae8-4906-97b6-aab78e3bb945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:05.731923 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2511/5027] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:05.740253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8e928-6744-456c-85a5-cb620a1f6dad None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:05.740569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8e928-6744-456c-85a5-cb620a1f6dad None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:05.740861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8e928-6744-456c-85a5-cb620a1f6dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:05.806747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-26d8e928-6744-456c-85a5-cb620a1f6dad None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:05.808214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-26d8e928-6744-456c-85a5-cb620a1f6dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:05.823621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2517/5028] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:05.829657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e817a48-0ae8-4906-97b6-aab78e3bb945 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:05.869498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e817a48-0ae8-4906-97b6-aab78e3bb945 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:05.906913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:05.918149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:05.918956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:05.919650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:05.921102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:25:05.921863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:05.925455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:05.974005 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2512/5029] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:25:05.976308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8e928-6744-456c-85a5-cb620a1f6dad None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:06.007876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8e928-6744-456c-85a5-cb620a1f6dad None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:06.016740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:06.018172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:06.018852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:06.019719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:06.021273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:06.025663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:06.107963 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2518/5030] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:25:05 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:06.114164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:06.129720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de66d-7877-460c-bb3e-42d96b856a1f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:06.287584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:06.290310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:06.303250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:06.305338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:06.308045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:06.317214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:06.367155 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2513/5031] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:25:06 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:25:06.372845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:06.384973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2588-0cca-461c-90ec-429279f86deb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:06.390730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:06.391328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:06.391611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:06.392040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:06.392705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:06.395561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:06.396450 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:06.433612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:06.443856 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2519/5032] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:06.456370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b99a-adbe-4629-b051-70a619c854c8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:06.467922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb177c-0942-4107-87d2-1be4c3f6ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:06.469515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb177c-0942-4107-87d2-1be4c3f6ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:06.469900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb177c-0942-4107-87d2-1be4c3f6ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:06.470519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb177c-0942-4107-87d2-1be4c3f6ef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:06.471299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb177c-0942-4107-87d2-1be4c3f6ef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:06.473107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb177c-0942-4107-87d2-1be4c3f6ef39 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:06.500617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2514/5033] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:06.502160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:06.518542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d7cb-dc32-4b12-9907-edf5093826fe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:06.532697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:06.533428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:06.536047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:06.536385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] PATH_INFO: `/v3/projects/df675371065d4276a6b4859cb0fbad0a/users/1062e039547c4ea787a9c70121afd39f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:06.578889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df675371065d4276a6b4859cb0fbad0a, user_id=1062e039547c4ea787a9c70121afd39f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:06.587053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:06.623162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2520/5034] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:25:06 2022] PUT /identity/v3/projects/df675371065d4276a6b4859cb0fbad0a/users/1062e039547c4ea787a9c70121afd39f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:06.630571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e532365-58fb-46a1-aaff-face1c8ba412 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:06.635455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e532365-58fb-46a1-aaff-face1c8ba412 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:06.636260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e532365-58fb-46a1-aaff-face1c8ba412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:06.708971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4e532365-58fb-46a1-aaff-face1c8ba412 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:06.711709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4e532365-58fb-46a1-aaff-face1c8ba412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:06.821957 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:06.855843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2515/5035] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:06.866944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:06.873971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:06.983113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac800-acac-4805-abde-7ab076b1d3c6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:06.990489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4786db-e824-4949-9288-6cce8a53cb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:06.991132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4786db-e824-4949-9288-6cce8a53cb1c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:06.993115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4786db-e824-4949-9288-6cce8a53cb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:06.993404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4786db-e824-4949-9288-6cce8a53cb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:07.017770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4786db-e824-4949-9288-6cce8a53cb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:07.022594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4786db-e824-4949-9288-6cce8a53cb1c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:07.058077 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2521/5036] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:08.060140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e532365-58fb-46a1-aaff-face1c8ba412 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:08.085144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e532365-58fb-46a1-aaff-face1c8ba412 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:08.094849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:08.095763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:08.096205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:08.096628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:08.105054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:08.137976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:08.139511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:08.145862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:08.145862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:08.146320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:08.167640 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2516/5037] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:25:08.256137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:08.263129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:08.353007 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2522/5038] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:08.392500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:08.394838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:08.657347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fddac-9f11-4655-b1bc-614b1544a63b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:08.673519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48dd1-ce1b-4c83-a2e0-16dd26e9ab36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:08.674331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48dd1-ce1b-4c83-a2e0-16dd26e9ab36 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:08.674707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48dd1-ce1b-4c83-a2e0-16dd26e9ab36 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:08.675218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48dd1-ce1b-4c83-a2e0-16dd26e9ab36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:08.701606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f48dd1-ce1b-4c83-a2e0-16dd26e9ab36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:08.703614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f48dd1-ce1b-4c83-a2e0-16dd26e9ab36 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:08.732319 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2517/5039] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:25:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:09.449461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:09.452186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:09.485978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18cb29-4afa-4f5b-8413-68f13d32406a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:09.504640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:09.506561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:09.507860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:09.512883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] PATH_INFO: `/v3/users/2cb2d438f05848eb83b49227166387bd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:09.516315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb2d438f05848eb83b49227166387bd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:09.518622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:09.662683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb2d438f05848eb83b49227166387bd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:09.677576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb2d438f05848eb83b49227166387bd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:09.709187 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:09.724715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb2d438f05848eb83b49227166387bd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:09.726872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb2d438f05848eb83b49227166387bd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:09.762882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb2d438f05848eb83b49227166387bd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:09.783181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:09.783988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:09.784427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:09.788723 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2523/5040] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:25:09 2022] DELETE /identity/v3/users/2cb2d438f05848eb83b49227166387bd => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:09.860909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:09.867398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:10.020602 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2518/5041] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:10.032408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:10.034102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:10.174753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a6de8-f226-4641-b6ac-8c628e5267fc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:10.186779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf12e45-5501-44be-9b80-7f2e6817155e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:10.187424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12e45-5501-44be-9b80-7f2e6817155e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:10.187712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12e45-5501-44be-9b80-7f2e6817155e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:10.187988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12e45-5501-44be-9b80-7f2e6817155e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:10.208870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12e45-5501-44be-9b80-7f2e6817155e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:10.211466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12e45-5501-44be-9b80-7f2e6817155e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:10.237934 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2524/5042] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:11.036902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:11.038421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:11.069423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02340d-79ff-4a8d-9fcc-89606af8ad11 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:11.102466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:11.109869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:11.110136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:11.114001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] PATH_INFO: `/v3/projects/047454232e434fba935b886e053e7656` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:11.115579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=047454232e434fba935b886e053e7656)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:11.124560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:11.346036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047454232e434fba935b886e053e7656', 'request_id': 'req-b757e1a2-ee51-4c42-9039-08dddf977583'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:11.372433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047454232e434fba935b886e053e7656', 'request_id': 'req-b757e1a2-ee51-4c42-9039-08dddf977583'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:11.378303 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:11.384784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047454232e434fba935b886e053e7656', 'request_id': 'req-b757e1a2-ee51-4c42-9039-08dddf977583'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:11.431689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] The token cache is being invalidate because project 047454232e434fba935b886e053e7656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:25:11.433628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:11.437162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b757e1a2-ee51-4c42-9039-08dddf977583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:11.443914 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2519/5043] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:11 2022] DELETE /identity/v3/projects/047454232e434fba935b886e053e7656 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:11.448357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e6d9-8f22-4567-8568-cd460c775191 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:11.448831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e6d9-8f22-4567-8568-cd460c775191 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:11.449089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e6d9-8f22-4567-8568-cd460c775191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:11.525339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e758e6d9-8f22-4567-8568-cd460c775191 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:11.526912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e758e6d9-8f22-4567-8568-cd460c775191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:11.769976 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2525/5044] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:11.771237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3acf9e-8e67-4eab-863d-a529c7d12d2e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:11.771535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3acf9e-8e67-4eab-863d-a529c7d12d2e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:11.771840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3acf9e-8e67-4eab-863d-a529c7d12d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:11.844892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7e3acf9e-8e67-4eab-863d-a529c7d12d2e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:11.849871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7e3acf9e-8e67-4eab-863d-a529c7d12d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:11.884343 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2520/5045] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:25:11.887287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e6d9-8f22-4567-8568-cd460c775191 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:11.901700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e6d9-8f22-4567-8568-cd460c775191 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:11.933552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:11.934244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:11.934875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:11.935189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:11.935865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:25:11.936169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:11.938325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:11.969779 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2526/5046] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:25:11.970584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3acf9e-8e67-4eab-863d-a529c7d12d2e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:11.990375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3acf9e-8e67-4eab-863d-a529c7d12d2e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:12.009137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:12.009793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:12.010588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:12.011252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:12.013126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:12.034222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:12.118359 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2521/5047] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:25:11 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:12.120062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:12.136908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f41519-4795-45d2-9f9b-c294544ee862 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:12.335977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:12.337047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:12.337491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:12.337925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:12.338791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:12.344622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:12.438630 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2527/5048] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:25:12 2022] POST /identity/v3/users => generated 287 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:25:12.444601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:12.469695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780cef0-3f38-437b-8a34-462dd9658fbf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:12.493003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:12.497312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:12.501687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:12.502028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:12.504738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:12.506843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:12.542783 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2522/5049] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:12.546609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:12.552639 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:12.569953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7ed0-70c0-4b1e-9664-0eb9882b75b2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:12.584276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ddfce-7070-46f0-93de-d770055e68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:12.584942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddfce-7070-46f0-93de-d770055e68c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:12.585227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddfce-7070-46f0-93de-d770055e68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:12.585503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddfce-7070-46f0-93de-d770055e68c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:12.586170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ddfce-7070-46f0-93de-d770055e68c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:12.589001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ddfce-7070-46f0-93de-d770055e68c7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:12.625395 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2528/5050] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:12.630418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:12.644909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ec94-9f67-42e3-ab92-456efe828cdd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:12.661446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:12.662312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:12.662693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:12.663069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] PATH_INFO: `/v3/projects/ce8093c1614644f6bf192eb1e39b70d6/users/cec79fa47d094ae6bcec9faa4bed075e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:12.711680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8093c1614644f6bf192eb1e39b70d6, user_id=cec79fa47d094ae6bcec9faa4bed075e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:12.717415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:12.750554 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2523/5051] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:25:12 2022] PUT /identity/v3/projects/ce8093c1614644f6bf192eb1e39b70d6/users/cec79fa47d094ae6bcec9faa4bed075e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:12.762240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:12.762676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:12.763065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:12.875794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] MFA Rules not processed for user `cec79fa47d094ae6bcec9faa4bed075e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:12.879034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:13.141715 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2529/5052] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:25:13.168002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:13.176265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:13.421653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6fc9a-9480-4f2a-908b-8c854e7fc7a6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:13.426493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:13.427315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:13.444036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:13.444625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:13.465179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:13.466921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:13.493975 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2524/5053] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:14.770015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:14.772791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:15.018573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3087dec-b732-482f-8351-6c3b3716d057 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:15.055242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddb1e6-a82b-4362-a9d3-c91dacf51426 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:15.057157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb1e6-a82b-4362-a9d3-c91dacf51426 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:15.057157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb1e6-a82b-4362-a9d3-c91dacf51426 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:15.057736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb1e6-a82b-4362-a9d3-c91dacf51426 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:15.065372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-96ddb1e6-a82b-4362-a9d3-c91dacf51426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:15.096573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddb1e6-a82b-4362-a9d3-c91dacf51426 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:15.100286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddb1e6-a82b-4362-a9d3-c91dacf51426 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:15.140899 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2530/5054] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:15.164733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:15.166333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:15.504246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2423e69-8f8e-4373-94ff-e920720cfb0e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:15.549671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac78f7-91dd-472f-b89d-940c28bdd1c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:15.550121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac78f7-91dd-472f-b89d-940c28bdd1c0 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:15.550404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac78f7-91dd-472f-b89d-940c28bdd1c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:15.550681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac78f7-91dd-472f-b89d-940c28bdd1c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:15.564529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-edac78f7-91dd-472f-b89d-940c28bdd1c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:15.647877 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:15.756326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac78f7-91dd-472f-b89d-940c28bdd1c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:15.758257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac78f7-91dd-472f-b89d-940c28bdd1c0 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:15.802715 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2525/5055] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:23.675869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:23.676397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:23.676471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:23.730298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] MFA Rules not processed for user `1062e039547c4ea787a9c70121afd39f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:23.731552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:23.930890 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:23.940261 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2531/5056] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:23.950921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8f70e-195a-403e-90d7-47a0d4d96a78 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:23.951354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8f70e-195a-403e-90d7-47a0d4d96a78 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:23.951354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8f70e-195a-403e-90d7-47a0d4d96a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:23.976791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-93f8f70e-195a-403e-90d7-47a0d4d96a78 None None] MFA Rules not processed for user `1062e039547c4ea787a9c70121afd39f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:23.978662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93f8f70e-195a-403e-90d7-47a0d4d96a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:23.995666 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2526/5057] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:25.025012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:25.026664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:25.070237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e372ee-3114-432c-899f-c085a60dca13 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:25.095680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:25.096318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:25.096592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:25.096885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:25.123253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:25.124879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:25.161537 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2532/5058] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:32.453222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f832-9891-4a23-91b3-bab4218d467d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:32.453775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f832-9891-4a23-91b3-bab4218d467d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:32.453775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f832-9891-4a23-91b3-bab4218d467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:32.503843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3cc6f832-9891-4a23-91b3-bab4218d467d None None] MFA Rules not processed for user `fe0e970187b548d0878f3cbfc89f25fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:32.505519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3cc6f832-9891-4a23-91b3-bab4218d467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:32.627890 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2527/5059] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:35.149157 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:41.306022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:41.307886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:41.531039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4e72d-5be5-462b-9bfb-120a3387f10d service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:41.547235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:41.548884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:41.550186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:41.550659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] PATH_INFO: `/v3/users/5437fbb8d7fa4c6b8dca85efdc8fc694` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:41.552288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5437fbb8d7fa4c6b8dca85efdc8fc694)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:41.554898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:41.693104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5437fbb8d7fa4c6b8dca85efdc8fc694'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:41.724687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5437fbb8d7fa4c6b8dca85efdc8fc694'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:41.751801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5437fbb8d7fa4c6b8dca85efdc8fc694'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:41.752533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5437fbb8d7fa4c6b8dca85efdc8fc694'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:41.761151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5437fbb8d7fa4c6b8dca85efdc8fc694'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:41.774913 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2533/5060] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:25:41 2022] DELETE /identity/v3/users/5437fbb8d7fa4c6b8dca85efdc8fc694 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:25:41.846943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:41.848025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:41.848636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:41.879483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:41.881916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:41.982164 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2528/5061] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:41.997765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:41.999264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:42.051369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:42.053046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:42.123562 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:42.153300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a966e-c3d9-4685-a78f-6c414ab373aa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:42.172222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:42.173194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:42.173554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:42.173911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:42.188084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:42.190491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:42.203147 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2534/5062] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:42.254769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eea594-b8ad-4324-b27c-0eb632a42930 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:42.266097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:42.266766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:42.267233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:42.267715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] PATH_INFO: `/v3/projects/9d702749939d4b8cb8471857ba668f07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:42.269649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d702749939d4b8cb8471857ba668f07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:42.272501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:42.280249 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:42.367663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d702749939d4b8cb8471857ba668f07', 'request_id': 'req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.395668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d702749939d4b8cb8471857ba668f07', 'request_id': 'req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.407136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d702749939d4b8cb8471857ba668f07', 'request_id': 'req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.445894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] The token cache is being invalidate because project 9d702749939d4b8cb8471857ba668f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:25:42.447163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.450262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.453869 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2529/5063] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:42 2022] DELETE /identity/v3/projects/9d702749939d4b8cb8471857ba668f07 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:25:42.470338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:42.481508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfba89-e2dc-45b8-a14e-5b022da05020 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:42.666548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:42.669510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:42.670468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:42.672177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] PATH_INFO: `/v3/users/29e425d4765a488ab78e36323822fd95` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:42.673870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e425d4765a488ab78e36323822fd95)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:42.680608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:42.812334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e425d4765a488ab78e36323822fd95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.826221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e425d4765a488ab78e36323822fd95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.855126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e425d4765a488ab78e36323822fd95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.857841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e425d4765a488ab78e36323822fd95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.875043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d38c917-6407-41bb-9f18-1c4ad06137b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e425d4765a488ab78e36323822fd95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:42.905939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2535/5064] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:25:42 2022] DELETE /identity/v3/users/29e425d4765a488ab78e36323822fd95 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:43.420898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:43.422370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:43.449910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d6e5-2285-4421-b36a-5a7d1d7e700e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:43.546291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:43.547738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:43.548098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:43.548447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] PATH_INFO: `/v3/projects/a126dbcfc754443283df46315b071518` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:43.550073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a126dbcfc754443283df46315b071518)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:43.552380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:43.654936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a126dbcfc754443283df46315b071518', 'request_id': 'req-9c921322-25bb-4ec7-84c7-665d05b35b66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:43.671023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a126dbcfc754443283df46315b071518', 'request_id': 'req-9c921322-25bb-4ec7-84c7-665d05b35b66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:43.685248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a126dbcfc754443283df46315b071518', 'request_id': 'req-9c921322-25bb-4ec7-84c7-665d05b35b66'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:43.706985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] The token cache is being invalidate because project a126dbcfc754443283df46315b071518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:25:43.707627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:43.708542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:43.710973 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2530/5065] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:43 2022] DELETE /identity/v3/projects/a126dbcfc754443283df46315b071518 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:43.720513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a5ff-5751-49a0-a5b6-17481578d866 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:43.720513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a5ff-5751-49a0-a5b6-17481578d866 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:43.720513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a5ff-5751-49a0-a5b6-17481578d866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:43.827632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:43.830430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:43.847538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3026a5ff-5751-49a0-a5b6-17481578d866 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:43.853809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3026a5ff-5751-49a0-a5b6-17481578d866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:43.903481 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:43.929362 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:43.968734 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2536/5066] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:43.978162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2fb00-8524-4b12-8056-4b5ef1458993 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:43.978747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2fb00-8524-4b12-8056-4b5ef1458993 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:43.979532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2fb00-8524-4b12-8056-4b5ef1458993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:43.982666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921322-25bb-4ec7-84c7-665d05b35b66 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:44.004328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:44.005460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.008474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.011030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.017772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:44.043595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8da2fb00-8524-4b12-8056-4b5ef1458993 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:44.047374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:44.047791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8da2fb00-8524-4b12-8056-4b5ef1458993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:44.050369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:44.061258 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2537/5067] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:25:44.065104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2fb00-8524-4b12-8056-4b5ef1458993 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:44.089033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2fb00-8524-4b12-8056-4b5ef1458993 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:44.090824 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2531/5068] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:25:44.101073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:44.101642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.101923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.102199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.105320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:25:44.105639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:44.109107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:44.137015 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2538/5069] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:25:44.142186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:44.173459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f65b-5950-4a9d-bfca-2318e066ac47 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:44.191464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:44.194566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.198786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.199090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.199795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:44.205684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:44.285331 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2532/5070] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:25:44 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:44.289309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:44.303963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da1b6-9de0-400e-baee-e6e54bd788bf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:44.496613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:44.497563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.497904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.498412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.499151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:44.501405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:44.533989 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2539/5071] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:25:44 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:44.538585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:44.562930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee4f57-7247-4180-a397-2455b62de219 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:44.579827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:44.580920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.581479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.582051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.583342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:44.592909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:44.628240 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2533/5072] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:44.630166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:44.649126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8119b-9658-4660-9f06-07de27fde5dd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:44.662701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993a2f3-457d-46dd-8ea4-7aced0ea7c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:44.663579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a2f3-457d-46dd-8ea4-7aced0ea7c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.664242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a2f3-457d-46dd-8ea4-7aced0ea7c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.664715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a2f3-457d-46dd-8ea4-7aced0ea7c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.666097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993a2f3-457d-46dd-8ea4-7aced0ea7c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:44.668326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993a2f3-457d-46dd-8ea4-7aced0ea7c37 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:44.688839 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2540/5073] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:44.692233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:44.716397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b2f0-021e-495a-815e-1cee607089bb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:44.742911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:44.744472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.744958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.745429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] PATH_INFO: `/v3/projects/25322a249ef24a419f9cf750797da096/users/949126b9470c418897afeacef01c275f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.778948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25322a249ef24a419f9cf750797da096, user_id=949126b9470c418897afeacef01c275f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:44.781870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:44.819419 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2534/5074] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:25:44 2022] PUT /identity/v3/projects/25322a249ef24a419f9cf750797da096/users/949126b9470c418897afeacef01c275f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:44.824732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:44.825625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:44.826117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:44.862261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:44.863917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:44.950925 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2541/5075] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:44.967601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:44.969856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:45.049839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad65b-c241-48fb-9578-4db002c54934 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:45.068704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7f24f-5bdb-45cd-80f8-10e69155e287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:45.069837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f24f-5bdb-45cd-80f8-10e69155e287 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:45.070181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f24f-5bdb-45cd-80f8-10e69155e287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:45.070522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f24f-5bdb-45cd-80f8-10e69155e287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:45.091107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7f24f-5bdb-45cd-80f8-10e69155e287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:45.093715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7f24f-5bdb-45cd-80f8-10e69155e287 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:45.126060 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2535/5076] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:47.275640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:47.277383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:47.318873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87181-d04e-48e4-a80e-d26375255df3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:47.348472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:47.349186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:47.351459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:47.354774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] PATH_INFO: `/v3/users/cec79fa47d094ae6bcec9faa4bed075e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:47.357285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec79fa47d094ae6bcec9faa4bed075e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:47.374220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:47.498654 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:47.512876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec79fa47d094ae6bcec9faa4bed075e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:47.534698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec79fa47d094ae6bcec9faa4bed075e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:47.562849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec79fa47d094ae6bcec9faa4bed075e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:47.563811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec79fa47d094ae6bcec9faa4bed075e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:47.576483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec79fa47d094ae6bcec9faa4bed075e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:47.588990 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2542/5077] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:25:47 2022] DELETE /identity/v3/users/cec79fa47d094ae6bcec9faa4bed075e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:47.593230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:47.593748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:47.593748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:47.639102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:47.650106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:47.733139 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:47.761753 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2536/5078] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:47.797776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:47.799278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:47.925311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cf490-2f45-4f3d-bba9-07c1c2c4d38a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:47.934665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc53f0-e2aa-4b2d-98b1-8c925103c218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:47.935463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc53f0-e2aa-4b2d-98b1-8c925103c218 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:47.935841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc53f0-e2aa-4b2d-98b1-8c925103c218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:47.936203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc53f0-e2aa-4b2d-98b1-8c925103c218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:47.959247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc53f0-e2aa-4b2d-98b1-8c925103c218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:47.961095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc53f0-e2aa-4b2d-98b1-8c925103c218 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:47.982858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2543/5079] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:49.324035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:49.326472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:49.359889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f11fa-7233-4d79-ab23-ec5a93bca889 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:49.388359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:49.389451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:49.389852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:49.390134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] PATH_INFO: `/v3/projects/ce8093c1614644f6bf192eb1e39b70d6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:49.396886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8093c1614644f6bf192eb1e39b70d6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:49.412918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:49.560567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8093c1614644f6bf192eb1e39b70d6', 'request_id': 'req-31e2d407-c92a-4ad9-ae31-cb0c8f580842'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:49.586198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8093c1614644f6bf192eb1e39b70d6', 'request_id': 'req-31e2d407-c92a-4ad9-ae31-cb0c8f580842'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:49.623268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8093c1614644f6bf192eb1e39b70d6', 'request_id': 'req-31e2d407-c92a-4ad9-ae31-cb0c8f580842'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:49.659185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] The token cache is being invalidate because project ce8093c1614644f6bf192eb1e39b70d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:25:49.660792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:49.662380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31e2d407-c92a-4ad9-ae31-cb0c8f580842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:49.670686 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2537/5080] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:49 2022] DELETE /identity/v3/projects/ce8093c1614644f6bf192eb1e39b70d6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:49.673456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bcd1-cd72-4bf9-b514-13f2e9136a4a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:49.673865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bcd1-cd72-4bf9-b514-13f2e9136a4a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:49.674007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bcd1-cd72-4bf9-b514-13f2e9136a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:49.732068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-beb6bcd1-cd72-4bf9-b514-13f2e9136a4a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:49.734699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-beb6bcd1-cd72-4bf9-b514-13f2e9136a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:49.963505 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2544/5081] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:49.971429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31459e-a870-4888-a117-4e987fb079b7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:49.972053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31459e-a870-4888-a117-4e987fb079b7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:49.972544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31459e-a870-4888-a117-4e987fb079b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.012541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cb31459e-a870-4888-a117-4e987fb079b7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:50.015482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cb31459e-a870-4888-a117-4e987fb079b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:50.029258 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2538/5082] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:50.033464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6bcd1-cd72-4bf9-b514-13f2e9136a4a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:50.060363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6bcd1-cd72-4bf9-b514-13f2e9136a4a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:50.094973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:50.096087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:50.096564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:50.097318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.098212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:25:50.101035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:50.105067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:50.168139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2545/5083] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:25:50.173066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31459e-a870-4888-a117-4e987fb079b7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:50.189914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31459e-a870-4888-a117-4e987fb079b7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:50.195227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:50.196572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:50.197037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:50.197742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.199186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:50.204454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:50.284642 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2539/5084] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:25:50 2022] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:50.289064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:50.303614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86154b38-e7c1-464a-ba8f-9c83db357a24 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:50.409590 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:50.429057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:50.429842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:50.431375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:50.431697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.434481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:50.439622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:50.485665 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2546/5085] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:25:50 2022] POST /identity/v3/users => generated 280 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:25:50.489950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:50.509796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc82a-f6c3-489f-bdc8-06f89b7da17c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:50.534048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:50.535978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:50.539666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:50.540179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.542868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:50.547214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:50.607741 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2540/5086] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:50.610012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:50.629801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe680-48a8-4abd-af37-96f649ddd293 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:50.643514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5bc52-afa8-46f1-b13a-ce00ac1b3ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:50.644320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5bc52-afa8-46f1-b13a-ce00ac1b3ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:50.644960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5bc52-afa8-46f1-b13a-ce00ac1b3ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:50.648014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5bc52-afa8-46f1-b13a-ce00ac1b3ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.648881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5bc52-afa8-46f1-b13a-ce00ac1b3ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:50.654908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5bc52-afa8-46f1-b13a-ce00ac1b3ed3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:50.678413 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2547/5087] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:25:50.683246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:50.704448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f406-14b4-467e-a490-3ad48bb2bf8d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:50.738414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:50.740882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:50.741380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:50.742144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] PATH_INFO: `/v3/projects/227b9365eb224bf9918d40a375a4d85c/users/803b088af7a84546a28e5a22a85f3d0f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.781209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227b9365eb224bf9918d40a375a4d85c, user_id=803b088af7a84546a28e5a22a85f3d0f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:50.784127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:50.823986 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2541/5088] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:25:50 2022] PUT /identity/v3/projects/227b9365eb224bf9918d40a375a4d85c/users/803b088af7a84546a28e5a22a85f3d0f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:50.825907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c255-6495-455c-8e80-72672bff7d07 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:50.826403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c255-6495-455c-8e80-72672bff7d07 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:50.826869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c255-6495-455c-8e80-72672bff7d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:50.920203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-78f8c255-6495-455c-8e80-72672bff7d07 None None] MFA Rules not processed for user `803b088af7a84546a28e5a22a85f3d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:50.924070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-78f8c255-6495-455c-8e80-72672bff7d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:51.093875 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2548/5089] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:51.125559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:51.127749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:51.257624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b06ff-ea2a-4307-90a7-771b4102e1a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:51.264120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:51.265091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:51.265745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:51.266613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:51.311911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:51.315307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:51.339342 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2542/5090] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:25:55.006930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:55.007416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:55.007611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:55.079079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:55.085943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:55.374420 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2549/5091] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:25:55.390089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:55.391811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:55.445355 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:55.596841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4273484-f876-4c2f-ba87-28d5d0de73dc service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:55.614814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:55.615579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:55.615973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:55.616407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:55.642864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:55.645885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:55.684859 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2543/5092] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:25:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:56.655897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:56.657489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:25:57.076013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a14797-c929-4c3a-acc1-3ee4a80c5a55 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:57.135140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:57.142159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:57.153787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:57.154150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] PATH_INFO: `/v3/users/79c5db05d52f4b8d91b430a8b459a09b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:57.157558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c5db05d52f4b8d91b430a8b459a09b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:57.167828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:57.199470 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:57.493672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c5db05d52f4b8d91b430a8b459a09b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:57.517075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c5db05d52f4b8d91b430a8b459a09b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:57.607062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c5db05d52f4b8d91b430a8b459a09b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:57.618067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c5db05d52f4b8d91b430a8b459a09b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:57.690697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a9d2d098-07c4-4c30-a68b-1039aa8c7960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c5db05d52f4b8d91b430a8b459a09b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:57.758126 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2550/5093] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:25:56 2022] DELETE /identity/v3/users/79c5db05d52f4b8d91b430a8b459a09b => generated 0 bytes in 1103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:59.141265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:25:59.163897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf1a5-78f5-4d16-af5e-ead1b09c1824 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:25:59.473959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:25:59.474657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:59.481374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:59.485267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] PATH_INFO: `/v3/projects/8f1f63bfe1664d079f0e22116f6f4e18` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:59.499488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1f63bfe1664d079f0e22116f6f4e18)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:25:59.507999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:25:59.743534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1f63bfe1664d079f0e22116f6f4e18', 'request_id': 'req-e99cbb84-e290-4460-849a-534aee003092'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:59.765812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1f63bfe1664d079f0e22116f6f4e18', 'request_id': 'req-e99cbb84-e290-4460-849a-534aee003092'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:59.792134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1f63bfe1664d079f0e22116f6f4e18', 'request_id': 'req-e99cbb84-e290-4460-849a-534aee003092'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:59.837354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] The token cache is being invalidate because project 8f1f63bfe1664d079f0e22116f6f4e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:25:59.838456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:59.841792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e99cbb84-e290-4460-849a-534aee003092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:25:59.846334 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2544/5094] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:59 2022] DELETE /identity/v3/projects/8f1f63bfe1664d079f0e22116f6f4e18 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:25:59.858512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798676eb-9058-4a60-8b9d-e853cbc8783d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:25:59.859094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798676eb-9058-4a60-8b9d-e853cbc8783d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:25:59.859094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798676eb-9058-4a60-8b9d-e853cbc8783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:25:59.910654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-798676eb-9058-4a60-8b9d-e853cbc8783d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:25:59.912518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-798676eb-9058-4a60-8b9d-e853cbc8783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:00.021430 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2551/5095] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:00.029796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bd249-53fd-4e2e-9160-dba2c4776d16 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.030087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bd249-53fd-4e2e-9160-dba2c4776d16 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.031023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bd249-53fd-4e2e-9160-dba2c4776d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.055414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fd0bd249-53fd-4e2e-9160-dba2c4776d16 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:00.059594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fd0bd249-53fd-4e2e-9160-dba2c4776d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:00.069839 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2545/5096] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:00.074415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798676eb-9058-4a60-8b9d-e853cbc8783d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:00.097525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798676eb-9058-4a60-8b9d-e853cbc8783d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:00.111412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:00.112072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.112340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.112610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.113329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:26:00.113655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:00.118525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:00.152103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bd249-53fd-4e2e-9160-dba2c4776d16 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:00.177581 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2552/5097] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:26:00.180531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bd249-53fd-4e2e-9160-dba2c4776d16 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:00.192619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:00.195518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.196049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.196567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.198343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:00.205639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:00.273219 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2546/5098] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:26:00 2022] POST /identity/v3/projects => generated 395 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:00.275810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:00.295126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb466-85e6-4ac5-aa6e-c6ef64b74231 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:00.447664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:00.450850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.451365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.451840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.452965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:00.459333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:00.504705 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:00.516551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:00.540870 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2553/5099] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:26:00 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:00.568088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d240cc6-70e9-4898-ac82-1e51f619b334 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:00.603537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:00.606830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.607163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.607443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.613057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:00.619860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:00.669323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:00.674181 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2547/5100] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:00.686098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e61d9-e31e-4756-9bf0-151c9f839485 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:00.708761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b17f8-3519-40df-be80-6c8b001261d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:00.709440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b17f8-3519-40df-be80-6c8b001261d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.718245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b17f8-3519-40df-be80-6c8b001261d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.718448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b17f8-3519-40df-be80-6c8b001261d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.720086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b17f8-3519-40df-be80-6c8b001261d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:00.741115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b17f8-3519-40df-be80-6c8b001261d8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:00.783857 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2554/5101] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:26:00.788125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:00.794001 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:00.804614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be292d17-a6c9-4b9b-b331-59219c43083c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:00.831560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:00.833914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.843503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.846297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] PATH_INFO: `/v3/projects/b5998151f0304fd48efd6b5956f27519/users/f54784294b484ac48e28a0dd50e25222/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.894540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5998151f0304fd48efd6b5956f27519, user_id=f54784294b484ac48e28a0dd50e25222, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:00.898145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:00.928348 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2548/5102] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:26:00 2022] PUT /identity/v3/projects/b5998151f0304fd48efd6b5956f27519/users/f54784294b484ac48e28a0dd50e25222/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:00.933986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27045740-0b15-4349-9f27-bc89f647acac None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:00.934573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27045740-0b15-4349-9f27-bc89f647acac None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:00.934702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27045740-0b15-4349-9f27-bc89f647acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:00.971164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-27045740-0b15-4349-9f27-bc89f647acac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:00.972461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27045740-0b15-4349-9f27-bc89f647acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:01.186880 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2555/5103] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:01.208264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:01.209897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:01.488173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fda9-83ad-46f3-88b7-52545393a256 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:01.500841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c990d1f-35f3-4224-82f0-224a8567fc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:01.501766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990d1f-35f3-4224-82f0-224a8567fc68 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:01.502195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990d1f-35f3-4224-82f0-224a8567fc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:01.502667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990d1f-35f3-4224-82f0-224a8567fc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:01.547507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c990d1f-35f3-4224-82f0-224a8567fc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:01.550020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c990d1f-35f3-4224-82f0-224a8567fc68 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:01.574614 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2549/5104] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:03.165322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:03.167215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:03.167836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:03.259880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] MFA Rules not processed for user `949126b9470c418897afeacef01c275f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:03.261668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:03.410179 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2556/5105] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:03.423145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:03.424626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:03.425118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:03.466395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] MFA Rules not processed for user `949126b9470c418897afeacef01c275f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:03.472801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:03.484962 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2550/5106] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:26:03.498521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:03.500221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:03.925636 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:03.949972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7b6e7-3ae9-4ac7-a567-3d808cf05dc1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:03.968818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c02e9-dc76-4298-bee5-a15d0f33b2fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:03.973987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c02e9-dc76-4298-bee5-a15d0f33b2fa service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:03.974474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c02e9-dc76-4298-bee5-a15d0f33b2fa service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:03.975146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c02e9-dc76-4298-bee5-a15d0f33b2fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:03.996908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c02e9-dc76-4298-bee5-a15d0f33b2fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:04.001204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c02e9-dc76-4298-bee5-a15d0f33b2fa service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:04.048891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2557/5107] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:09.818604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:09.820041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:09.846678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e419a3-8f0a-4a04-9011-a98d0b4d92c1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:09.859189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:09.862130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:09.862560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:09.863030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] PATH_INFO: `/v3/users/1062e039547c4ea787a9c70121afd39f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:09.867616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1062e039547c4ea787a9c70121afd39f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:09.871121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:10.031734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1062e039547c4ea787a9c70121afd39f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:10.058848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1062e039547c4ea787a9c70121afd39f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:10.060122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1062e039547c4ea787a9c70121afd39f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:10.073378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1062e039547c4ea787a9c70121afd39f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:10.074512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1062e039547c4ea787a9c70121afd39f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:10.134005 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2551/5108] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:26:09 2022] DELETE /identity/v3/users/1062e039547c4ea787a9c70121afd39f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:10.912470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:10.913557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:10.914247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:10.962035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:10.962838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:11.137959 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2558/5109] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:11.242669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:11.245536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:11.428110 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:11.498013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02c423-0852-460a-be26-559230c2eb39 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:11.513944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ec3f5-842c-405d-94f1-5d1dceff1444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:11.517189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ec3f5-842c-405d-94f1-5d1dceff1444 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:11.517474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ec3f5-842c-405d-94f1-5d1dceff1444 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:11.517748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ec3f5-842c-405d-94f1-5d1dceff1444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:11.544843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ec3f5-842c-405d-94f1-5d1dceff1444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:11.546491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ec3f5-842c-405d-94f1-5d1dceff1444 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:11.573576 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2552/5110] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:26:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:12.789044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:12.791187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:13.086005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18f68-9a4f-47a0-8148-182326fd6115 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:13.095495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:13.096510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:13.096510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:13.096827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] PATH_INFO: `/v3/projects/df675371065d4276a6b4859cb0fbad0a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:13.098021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df675371065d4276a6b4859cb0fbad0a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:13.099960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:13.263904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df675371065d4276a6b4859cb0fbad0a', 'request_id': 'req-15ff205f-828d-41d5-bf6e-08f08da97455'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:13.288102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df675371065d4276a6b4859cb0fbad0a', 'request_id': 'req-15ff205f-828d-41d5-bf6e-08f08da97455'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:13.302850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df675371065d4276a6b4859cb0fbad0a', 'request_id': 'req-15ff205f-828d-41d5-bf6e-08f08da97455'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:13.406388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] The token cache is being invalidate because project df675371065d4276a6b4859cb0fbad0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:26:13.406759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:13.411965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15ff205f-828d-41d5-bf6e-08f08da97455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:13.427619 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2559/5111] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:12 2022] DELETE /identity/v3/projects/df675371065d4276a6b4859cb0fbad0a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:13.437965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28daa-72a0-45f2-8f98-4aa2b80494dc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:13.438841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28daa-72a0-45f2-8f98-4aa2b80494dc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:13.439287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28daa-72a0-45f2-8f98-4aa2b80494dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:13.501014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-69d28daa-72a0-45f2-8f98-4aa2b80494dc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:13.502876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-69d28daa-72a0-45f2-8f98-4aa2b80494dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:13.789136 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2553/5112] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:13.791601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a038d66-643f-4678-87b4-c6c39d5b4d30 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:13.792075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a038d66-643f-4678-87b4-c6c39d5b4d30 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:13.792361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a038d66-643f-4678-87b4-c6c39d5b4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:13.862293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5a038d66-643f-4678-87b4-c6c39d5b4d30 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:13.863975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5a038d66-643f-4678-87b4-c6c39d5b4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:13.882702 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2560/5113] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:13.887803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28daa-72a0-45f2-8f98-4aa2b80494dc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:13.904940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28daa-72a0-45f2-8f98-4aa2b80494dc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:13.918583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:13.919409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:13.919787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:13.920169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:13.920968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:26:13.922499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:13.924256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:13.965096 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2554/5114] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:26:13.972151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a038d66-643f-4678-87b4-c6c39d5b4d30 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:13.987442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a038d66-643f-4678-87b4-c6c39d5b4d30 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:14.002210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:14.002210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:14.002669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:14.003092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:14.003857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:14.005899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:14.093998 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:14.120603 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2561/5115] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:26:13 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:14.125099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:14.145409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08237ee1-e22b-4bce-bce1-cb0b064fc471 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:14.408748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:14.427145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:14.429667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:14.430741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:14.435516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:14.445164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:14.602487 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2555/5116] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:26:14 2022] POST /identity/v3/users => generated 287 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:14.606100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:14.624255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748f63-e4fe-44c6-887b-93492967d45f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:14.651812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:14.653188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:14.653188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:14.653405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:14.654847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:14.660753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:14.697652 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2562/5117] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:14.699041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:14.731948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87ca05-9f2d-46c8-a0e9-7b97cfbfedf2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:14.757002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8fc5-8cce-43bf-a414-9528fda22b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:14.757798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8fc5-8cce-43bf-a414-9528fda22b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:14.758194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8fc5-8cce-43bf-a414-9528fda22b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:14.758600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8fc5-8cce-43bf-a414-9528fda22b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:14.759655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8fc5-8cce-43bf-a414-9528fda22b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:14.761657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8fc5-8cce-43bf-a414-9528fda22b70 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:14.799491 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2556/5118] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:14.801214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:14.819071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a044c-8ac0-46b5-bd09-71472627566e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:14.839400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:14.839602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:14.846023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:14.846023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] PATH_INFO: `/v3/projects/b07c7490e08043f89ea40531d634b859/users/19a35912e003492288b68566b677b0da/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:14.921460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07c7490e08043f89ea40531d634b859, user_id=19a35912e003492288b68566b677b0da, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:14.932572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:14.976836 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2563/5119] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:26:14 2022] PUT /identity/v3/projects/b07c7490e08043f89ea40531d634b859/users/19a35912e003492288b68566b677b0da/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:14.982351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:14.982780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:14.983522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:15.033363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:15.043916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:15.313151 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:15.515336 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2557/5120] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:15.730386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:15.732608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:15.916322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3d192-a9c6-445b-857a-76cd1d83f24a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:15.930288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0796fe-cc20-4f5d-8022-5200e624ecbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:15.932932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0796fe-cc20-4f5d-8022-5200e624ecbb service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:15.933625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0796fe-cc20-4f5d-8022-5200e624ecbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:15.940272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0796fe-cc20-4f5d-8022-5200e624ecbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:15.962555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0796fe-cc20-4f5d-8022-5200e624ecbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:15.964110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0796fe-cc20-4f5d-8022-5200e624ecbb service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:15.992434 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2564/5121] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:17.008230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:17.012994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:17.039451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b98f0-71ba-46d6-9846-c5bef7173790 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:17.060682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8e0c7-6fe4-4824-b4c9-a0499f142c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:17.062841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8e0c7-6fe4-4824-b4c9-a0499f142c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:17.065959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8e0c7-6fe4-4824-b4c9-a0499f142c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:17.068181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8e0c7-6fe4-4824-b4c9-a0499f142c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:17.078050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8fd8e0c7-6fe4-4824-b4c9-a0499f142c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:17.133104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8e0c7-6fe4-4824-b4c9-a0499f142c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:17.137624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8e0c7-6fe4-4824-b4c9-a0499f142c60 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:17.201467 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2558/5122] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:25.981393 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:27.173369 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=14 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:29.236835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:29.237723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:29.238138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:29.321529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] MFA Rules not processed for user `f54784294b484ac48e28a0dd50e25222`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:29.323076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:29.562046 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2565/5123] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:29.576973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f508d-ed1e-4e81-af2b-c42dc91c0c52 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:29.577511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f508d-ed1e-4e81-af2b-c42dc91c0c52 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:29.577511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f508d-ed1e-4e81-af2b-c42dc91c0c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:29.631798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ad0f508d-ed1e-4e81-af2b-c42dc91c0c52 None None] MFA Rules not processed for user `f54784294b484ac48e28a0dd50e25222`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:29.631798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ad0f508d-ed1e-4e81-af2b-c42dc91c0c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:29.673385 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2559/5124] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:29.743923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:29.766552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:29.970242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b168c2-22a2-43a8-9263-67d12e0eae35 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:29.997555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:29.998224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:29.999115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:29.999398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:30.020894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:30.028108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:30.054705 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2566/5125] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:29 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:32.708614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:32.710248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:32.710726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:32.761637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:32.763038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:32.905399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2560/5126] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:32.912552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:32.914977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:33.323891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a4cb-cfb6-4233-86ee-6f7303d7b45a service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:33.349400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:33.353936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:33.355517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:33.355897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:33.403546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:33.407071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:33.451083 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2567/5127] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:26:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:38.203338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:38.204828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:38.244681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c2d97-3c08-47ec-a6af-80f2680b6bc6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:38.265461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:38.267412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:38.267845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:38.269452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] PATH_INFO: `/v3/users/3338f52621ec4501b2f0b88ff5cb36fb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:38.272000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3338f52621ec4501b2f0b88ff5cb36fb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:38.278045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:38.441461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3338f52621ec4501b2f0b88ff5cb36fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:38.458205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3338f52621ec4501b2f0b88ff5cb36fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:38.459142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3338f52621ec4501b2f0b88ff5cb36fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:38.479009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3338f52621ec4501b2f0b88ff5cb36fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:38.480034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dbd1ca23-0bab-4494-bedf-fb79984411f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3338f52621ec4501b2f0b88ff5cb36fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:38.516544 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2561/5128] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:26:38 2022] DELETE /identity/v3/users/3338f52621ec4501b2f0b88ff5cb36fb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:39.533577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:39.556892 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:39.600658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35119e-0bd9-47d5-9c3d-3e528b531830 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:40.078093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:40.081877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:40.112791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:40.113238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] PATH_INFO: `/v3/projects/fe917515a56c4577b45df3eb16642a2d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:40.120972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe917515a56c4577b45df3eb16642a2d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:40.138738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:40.375650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe917515a56c4577b45df3eb16642a2d', 'request_id': 'req-fb724476-ac48-4828-9c6f-b81bc59663dc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:40.402866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe917515a56c4577b45df3eb16642a2d', 'request_id': 'req-fb724476-ac48-4828-9c6f-b81bc59663dc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:40.427116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe917515a56c4577b45df3eb16642a2d', 'request_id': 'req-fb724476-ac48-4828-9c6f-b81bc59663dc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:40.479953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] The token cache is being invalidate because project fe917515a56c4577b45df3eb16642a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:26:40.480258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:40.489816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb724476-ac48-4828-9c6f-b81bc59663dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:40.509188 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2568/5129] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:39 2022] DELETE /identity/v3/projects/fe917515a56c4577b45df3eb16642a2d => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:40.518589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa530e-356b-4087-9261-425ca4f187f1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:40.519145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa530e-356b-4087-9261-425ca4f187f1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:40.519145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa530e-356b-4087-9261-425ca4f187f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:40.573764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-21aa530e-356b-4087-9261-425ca4f187f1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:40.575070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-21aa530e-356b-4087-9261-425ca4f187f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:40.733319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7053-4066-4b6f-b8c6-b19ef716364a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:40.733889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7053-4066-4b6f-b8c6-b19ef716364a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:40.733889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7053-4066-4b6f-b8c6-b19ef716364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:40.742604 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2562/5130] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:40.793793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870dbf-fb08-4d33-ba31-a64800e8af8b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:40.794336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870dbf-fb08-4d33-ba31-a64800e8af8b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:40.794540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870dbf-fb08-4d33-ba31-a64800e8af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:40.812161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e4ab7053-4066-4b6f-b8c6-b19ef716364a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:40.813522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e4ab7053-4066-4b6f-b8c6-b19ef716364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:40.868955 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:40.885654 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2569/5131] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:26:40.886695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab7053-4066-4b6f-b8c6-b19ef716364a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:40.892054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-04870dbf-fb08-4d33-ba31-a64800e8af8b None None] MFA Rules not processed for user `19a35912e003492288b68566b677b0da`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:40.896530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-04870dbf-fb08-4d33-ba31-a64800e8af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:40.919788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab7053-4066-4b6f-b8c6-b19ef716364a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:40.942314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:40.943079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:40.943360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:40.943654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:40.944324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:26:40.944633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:40.947176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:40.996884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2570/5132] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:26:40.998108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:41.021866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85534597-1024-42ec-8fce-a7a7163a9104 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:41.037411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:41.038741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:41.039358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:41.040247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:41.041137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:41.051007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:41.122416 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2563/5133] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:41.161354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2571/5134] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:26:40 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:41.162290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870dbf-fb08-4d33-ba31-a64800e8af8b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:41.195646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870dbf-fb08-4d33-ba31-a64800e8af8b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:41.233010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:41.235043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:41.351786 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:41.432301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962db1f-cca5-4b80-9d12-c530969e6c41 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:41.449721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:41.450371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:41.450697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:41.450974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:41.457507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:41.458170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:41.458469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:41.458744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:41.459390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:41.461511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:41.549786 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2564/5135] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:26:41 2022] POST /identity/v3/users => generated 286 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:41.555040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:41.597347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f411c5e-26a1-4875-b02a-12cb031b8d57 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:41.610012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:41.611640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:41.622431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:41.624883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:41.625182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:41.625460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:41.626127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:41.627763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:41.641181 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2572/5136] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:26:41.671066 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2565/5137] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:41.675463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:41.699773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052977f9-c4e7-4b02-a703-f7e9f8e00575 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:41.716567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde8bbf-6815-4546-b195-55df0830481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:41.718534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8bbf-6815-4546-b195-55df0830481d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:41.718832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8bbf-6815-4546-b195-55df0830481d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:41.719108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8bbf-6815-4546-b195-55df0830481d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:41.719794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde8bbf-6815-4546-b195-55df0830481d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:41.726478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde8bbf-6815-4546-b195-55df0830481d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:41.759352 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2573/5138] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:41.761339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:41.774876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d32c-2245-4e79-895b-71b7315d5610 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:41.791370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:41.792069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:41.792352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:41.792626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] PATH_INFO: `/v3/projects/ae5843fcb4094624be80c2b88298e66a/users/13fb37fb933645f68ddaef25715083de/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:41.828895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5843fcb4094624be80c2b88298e66a, user_id=13fb37fb933645f68ddaef25715083de, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:41.831875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:41.859106 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2566/5139] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:26:41 2022] PUT /identity/v3/projects/ae5843fcb4094624be80c2b88298e66a/users/13fb37fb933645f68ddaef25715083de/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:41.876898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:41.876898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:41.876898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:41.942972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] MFA Rules not processed for user `13fb37fb933645f68ddaef25715083de`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:41.947851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:42.097825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:42.099828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:42.165052 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2574/5140] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:42.172182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:42.173682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:42.264345 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:42.274640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2ae0a-9c71-44e3-954d-e2c9d56d6294 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:42.285513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:42.286441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:42.286947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:42.287186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] PATH_INFO: `/v3/users/ea86632bc35148a68dc7a10e194e184d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:42.288537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea86632bc35148a68dc7a10e194e184d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:42.292302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:42.379617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea86632bc35148a68dc7a10e194e184d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:42.395345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea86632bc35148a68dc7a10e194e184d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:42.396894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea86632bc35148a68dc7a10e194e184d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:42.416069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea86632bc35148a68dc7a10e194e184d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:42.418136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad8e53de-1578-4a38-afee-842f9289cfb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea86632bc35148a68dc7a10e194e184d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:42.457354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2567/5141] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:26:42 2022] DELETE /identity/v3/users/ea86632bc35148a68dc7a10e194e184d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:42.460116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:42.460604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:42.461130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:42.505924 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:42.532913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:42.534577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:42.598061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463b6f9-a28e-4ab1-90f7-8d6c4d85dd78 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:42.771221 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2568/5142] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:42.808843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:42.810362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:42.837777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181bfd9-e64a-4df1-a15d-12b7ff679060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:42.838525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181bfd9-e64a-4df1-a15d-12b7ff679060 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:42.838878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181bfd9-e64a-4df1-a15d-12b7ff679060 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:42.839260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181bfd9-e64a-4df1-a15d-12b7ff679060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:42.843505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0181bfd9-e64a-4df1-a15d-12b7ff679060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:42.980142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5043b-c245-48f7-975f-2d18ea71fc6c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:42.984397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:42.985021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:42.985302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:42.985639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:43.006250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:43.010124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:43.029156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2569/5143] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:26:43.058413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181bfd9-e64a-4df1-a15d-12b7ff679060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:43.060112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181bfd9-e64a-4df1-a15d-12b7ff679060 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:43.131290 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2575/5144] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 960 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:26:43.556282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:43.558462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:43.593574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7975bcc-e08d-46ad-9736-766c208e964b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:43.616282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:43.619554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:43.620055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:43.620451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] PATH_INFO: `/v3/projects/fb877dddfba14fe3929b1267dee0e256` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:43.623927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb877dddfba14fe3929b1267dee0e256)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:43.629147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:43.665665 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:43.781377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb877dddfba14fe3929b1267dee0e256', 'request_id': 'req-7112019e-46d3-447e-9151-e30c5f653e60'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:43.809179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb877dddfba14fe3929b1267dee0e256', 'request_id': 'req-7112019e-46d3-447e-9151-e30c5f653e60'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:43.830273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb877dddfba14fe3929b1267dee0e256', 'request_id': 'req-7112019e-46d3-447e-9151-e30c5f653e60'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:43.875996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] The token cache is being invalidate because project fb877dddfba14fe3929b1267dee0e256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:26:43.876294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:43.883662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7112019e-46d3-447e-9151-e30c5f653e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:43.885509 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2570/5145] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:43 2022] DELETE /identity/v3/projects/fb877dddfba14fe3929b1267dee0e256 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:43.891214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef419c-b291-4cb9-81c3-c39f0f65b24a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:43.892129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef419c-b291-4cb9-81c3-c39f0f65b24a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:43.892658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef419c-b291-4cb9-81c3-c39f0f65b24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:43.954736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-28ef419c-b291-4cb9-81c3-c39f0f65b24a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:43.960602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-28ef419c-b291-4cb9-81c3-c39f0f65b24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:44.155087 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2576/5146] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:44.251609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43eb5-58ab-4b1c-b2e0-1a98226a66cf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:44.251945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43eb5-58ab-4b1c-b2e0-1a98226a66cf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:44.252211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43eb5-58ab-4b1c-b2e0-1a98226a66cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:44.289263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e9f43eb5-58ab-4b1c-b2e0-1a98226a66cf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:44.290757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e9f43eb5-58ab-4b1c-b2e0-1a98226a66cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:44.318765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef419c-b291-4cb9-81c3-c39f0f65b24a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:44.320406 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2571/5147] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:44.333556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef419c-b291-4cb9-81c3-c39f0f65b24a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:44.350942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:44.351695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:44.352137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:44.352424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:44.353747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:26:44.354299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:44.359944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:44.383915 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2577/5148] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:26:44.387964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f43eb5-58ab-4b1c-b2e0-1a98226a66cf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:44.407647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f43eb5-58ab-4b1c-b2e0-1a98226a66cf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:44.416884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:44.417940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:44.418415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:44.418957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:44.420873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:44.428181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:44.499053 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2572/5149] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:26:44 2022] POST /identity/v3/projects => generated 397 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:44.501637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:44.527878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b38f3-1241-4d69-ab6c-d3ead580f43d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:44.596808 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:44.718980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:44.719904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:44.720441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:44.720904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:44.721698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:44.729088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:44.786475 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2578/5150] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:26:44 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:44.791218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:44.808146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a72e-7604-4f03-af6e-c0403204b706 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:44.820546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:44.823100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:44.823557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:44.825537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:44.830735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:44.832618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:44.861745 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2573/5151] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:44.865576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:44.882533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32726a4f-037c-4d8a-9d35-1331fd222b86 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:44.891853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709c6d9-4ab5-437a-8ed7-1734dc545adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:44.892479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709c6d9-4ab5-437a-8ed7-1734dc545adf admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:44.892588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709c6d9-4ab5-437a-8ed7-1734dc545adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:44.893037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709c6d9-4ab5-437a-8ed7-1734dc545adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:44.894316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709c6d9-4ab5-437a-8ed7-1734dc545adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:44.897629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709c6d9-4ab5-437a-8ed7-1734dc545adf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:44.916451 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2579/5152] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:44.920573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:44.937613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8bb4-225f-46f6-850b-a591b4750a6b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:44.944332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:44.945499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:44.946405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:44.946842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] PATH_INFO: `/v3/projects/032fcd2138744226a6b98ddeeef4766d/users/d35661d01cfb4f8d90ea78c7c7ead1b6/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:44.972557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] RBAC: Authorizing `identity:create_grant(project_id=032fcd2138744226a6b98ddeeef4766d, user_id=d35661d01cfb4f8d90ea78c7c7ead1b6, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:44.976185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:45.020450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2574/5153] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:26:44 2022] PUT /identity/v3/projects/032fcd2138744226a6b98ddeeef4766d/users/d35661d01cfb4f8d90ea78c7c7ead1b6/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:45.026267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482acba-7a2b-42bd-8cef-3abc86f45434 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:45.026824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482acba-7a2b-42bd-8cef-3abc86f45434 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:45.027111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482acba-7a2b-42bd-8cef-3abc86f45434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:45.104149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1482acba-7a2b-42bd-8cef-3abc86f45434 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:45.105555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1482acba-7a2b-42bd-8cef-3abc86f45434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:45.315783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:45.315994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2580/5154] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:45.317953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:45.597140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a9cb4-360f-4b53-a5db-5619fa6852df admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:45.603838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:45.604486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:45.604761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:45.605051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:45.629805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:45.631290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:45.656483 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2575/5155] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:26:45.919912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8408e-2f25-4b5e-b26b-68c6b42a9f96 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:45.922764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8408e-2f25-4b5e-b26b-68c6b42a9f96 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:45.923263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8408e-2f25-4b5e-b26b-68c6b42a9f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:45.964819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9ec8408e-2f25-4b5e-b26b-68c6b42a9f96 None None] MFA Rules not processed for user `19a35912e003492288b68566b677b0da`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:45.970115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ec8408e-2f25-4b5e-b26b-68c6b42a9f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:46.196720 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2581/5156] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:46.421981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:46.423581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:46.443569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3e84-c5c7-42ab-b96d-6da024c2e3b2 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:46.458499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:46.459177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:46.459455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:46.459731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:46.461658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:46.572082 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:46.629531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:46.632030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:46.661843 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2576/5157] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:48.766832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8408e-2f25-4b5e-b26b-68c6b42a9f96 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:48.802462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8408e-2f25-4b5e-b26b-68c6b42a9f96 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:48.810923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:48.813294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:48.814270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:48.815491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:48.835116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:48.897700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:48.900759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:48.946164 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2582/5158] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:51.991019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:51.992557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:52.107745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6642-d103-40fc-8477-1cdc985738f0 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:52.111703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:52.112351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:52.112632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:52.117061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:52.120967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:52.185711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:52.187379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:52.228661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2577/5159] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:52.545592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:52.560091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7da0-4efa-4a25-b719-3ba77f2f84e0 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:52.571282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:52.572018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:52.572302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:52.572574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:52.577707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:52.608703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:52.610691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:52.634712 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2583/5160] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:52.851538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:52.879168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8036-0775-4ee2-a553-0768453e2585 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:52.888093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e6605-03a3-4ab8-a109-16933e085778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:52.889198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e6605-03a3-4ab8-a109-16933e085778 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:52.889621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e6605-03a3-4ab8-a109-16933e085778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:52.890036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e6605-03a3-4ab8-a109-16933e085778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:52.896846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a76e6605-03a3-4ab8-a109-16933e085778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:52.938434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e6605-03a3-4ab8-a109-16933e085778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:52.939869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e6605-03a3-4ab8-a109-16933e085778 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:52.970845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2578/5161] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:55.530453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:55.530982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:55.584405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba2774-0264-4ca0-8f5c-78ff3555156f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:55.599722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:55.601954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:55.602397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:55.602680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] PATH_INFO: `/v3/users/13fb37fb933645f68ddaef25715083de` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:55.620517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fb37fb933645f68ddaef25715083de)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:55.623196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:55.684218 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:55.765886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fb37fb933645f68ddaef25715083de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:55.789589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fb37fb933645f68ddaef25715083de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:55.813859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fb37fb933645f68ddaef25715083de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:55.814627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fb37fb933645f68ddaef25715083de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:55.828363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fb37fb933645f68ddaef25715083de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:55.848285 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2584/5162] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:26:55 2022] DELETE /identity/v3/users/13fb37fb933645f68ddaef25715083de => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:55.849884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:55.850339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:55.850621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:55.877930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:55.879427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:56.000192 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2579/5163] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:56.130401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:56.138019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:56.322512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6646-5e81-4f47-b160-1327d16765d2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:56.333102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c941a-85b7-4790-ab5c-45ad231631ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:56.333753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c941a-85b7-4790-ab5c-45ad231631ab service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:56.335471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c941a-85b7-4790-ab5c-45ad231631ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:56.335656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c941a-85b7-4790-ab5c-45ad231631ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:56.365866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c941a-85b7-4790-ab5c-45ad231631ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:56.368465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c941a-85b7-4790-ab5c-45ad231631ab service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:56.403535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2585/5164] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:57.628091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:57.629931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:57.653617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd35eb-181a-4cd2-a0d3-98d28cc10705 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:57.666135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:57.666812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:57.667088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:57.670195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] PATH_INFO: `/v3/projects/ae5843fcb4094624be80c2b88298e66a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:57.672982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5843fcb4094624be80c2b88298e66a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:57.683850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:57.832209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5843fcb4094624be80c2b88298e66a', 'request_id': 'req-de1da39b-b552-4e7d-b0ce-d2197123aa37'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:57.837633 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:57.854982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5843fcb4094624be80c2b88298e66a', 'request_id': 'req-de1da39b-b552-4e7d-b0ce-d2197123aa37'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:57.864426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5843fcb4094624be80c2b88298e66a', 'request_id': 'req-de1da39b-b552-4e7d-b0ce-d2197123aa37'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:57.890972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] The token cache is being invalidate because project ae5843fcb4094624be80c2b88298e66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:26:57.891575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:57.892390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de1da39b-b552-4e7d-b0ce-d2197123aa37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:57.894398 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2580/5165] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:57 2022] DELETE /identity/v3/projects/ae5843fcb4094624be80c2b88298e66a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:57.899602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:57.900107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:57.900224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:57.944501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:57.945919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:58.128121 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2586/5166] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:58.214076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ccb89-c6f0-4b3c-8f32-bb99a01239ae None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.214823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ccb89-c6f0-4b3c-8f32-bb99a01239ae None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.214823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ccb89-c6f0-4b3c-8f32-bb99a01239ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.236410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:58.238247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:58.249336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-844ccb89-c6f0-4b3c-8f32-bb99a01239ae None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:58.250586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-844ccb89-c6f0-4b3c-8f32-bb99a01239ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:58.255932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd351c-f4f2-4f70-933d-b29088055ab9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:58.265696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:58.266371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.266713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.266914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] PATH_INFO: `/v3/users/d48c9a59007a4c03933c50f6d6d336ba` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.278824 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2581/5167] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:58.284445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48c9a59007a4c03933c50f6d6d336ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:58.286489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:58.287849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ccb89-c6f0-4b3c-8f32-bb99a01239ae None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:58.313297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ccb89-c6f0-4b3c-8f32-bb99a01239ae None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:58.321247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:58.322062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.324126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.325603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.326346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:26:58.326653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:58.332135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:58.356579 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2582/5168] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:26:58.370410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:58.380259 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:58.407424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c58e-212f-4b25-b123-ce0c935c7d53 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:58.417725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48c9a59007a4c03933c50f6d6d336ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:58.420797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:58.421079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.421359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.421634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.422263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:58.426379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:58.446370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48c9a59007a4c03933c50f6d6d336ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:58.469167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48c9a59007a4c03933c50f6d6d336ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:58.472918 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2583/5169] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:26:58 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:26:58.476664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48c9a59007a4c03933c50f6d6d336ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:58.478454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:58.493969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d71afb7-0410-40bf-a20c-26c29e31282a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48c9a59007a4c03933c50f6d6d336ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:26:58.508928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2587/5170] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:26:58 2022] DELETE /identity/v3/users/d48c9a59007a4c03933c50f6d6d336ba => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:26:58.513436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.513757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.515494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.551048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:58.552315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:58.613998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fc58-2e31-42ff-ba4a-0c93d9e4d9b7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:58.645189 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2588/5171] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:58.667650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:58.671877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:58.794367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:58.795355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.795781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.796156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.797009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:58.799294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:58.831712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bb5cd-579f-4d30-841f-2f4ad0225631 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:58.845773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cc2d3-c121-4ac6-99c2-481bf2b13c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:58.846914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cc2d3-c121-4ac6-99c2-481bf2b13c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.847442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cc2d3-c121-4ac6-99c2-481bf2b13c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.848019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cc2d3-c121-4ac6-99c2-481bf2b13c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.869854 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2584/5172] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:26:58 2022] POST /identity/v3/users => generated 284 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:26:58.874884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:58.884319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:58.885043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cc2d3-c121-4ac6-99c2-481bf2b13c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:58.887659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cc2d3-c121-4ac6-99c2-481bf2b13c42 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:58.917903 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2589/5173] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:26:58.936277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290bb4b-5186-4def-9abe-4caa8dcd5488 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:58.958543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:58.959884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.960172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.960683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:58.964272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:58.966466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:58.991525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2585/5174] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:58.996853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:58.997641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:58.997926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:58.998202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:59.010538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1336-d963-4f01-9f3f-bafc22fb38a4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:59.017985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:59.019022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:59.019483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:59.019952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:59.020814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:59.022727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:59.037775 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2586/5175] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:26:59.042274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:59.042681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:59.043970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:59.079144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d5f35-725f-4f95-9ff4-f0872a51d18a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:59.094683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aa78a-d2e9-41e2-9d93-ac4f873ddfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:59.095382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa78a-d2e9-41e2-9d93-ac4f873ddfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:59.095661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa78a-d2e9-41e2-9d93-ac4f873ddfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:59.095932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa78a-d2e9-41e2-9d93-ac4f873ddfc7 admin admin] PATH_INFO: `/v3/projects/59005901ac964f268e060d592aa96e26/users/4ca21b8131964f77bd73f26700e8da03/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:59.114641 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:59.151044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aa78a-d2e9-41e2-9d93-ac4f873ddfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59005901ac964f268e060d592aa96e26, user_id=4ca21b8131964f77bd73f26700e8da03, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:59.154002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aa78a-d2e9-41e2-9d93-ac4f873ddfc7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:59.165449 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:59.176418 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2587/5176] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:26:59 2022] PUT /identity/v3/projects/59005901ac964f268e060d592aa96e26/users/4ca21b8131964f77bd73f26700e8da03/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:26:59.194144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:59.200330 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2590/5177] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:59.201475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:59.201968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:59.217192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:59.222280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:59.323854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] MFA Rules not processed for user `4ca21b8131964f77bd73f26700e8da03`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:26:59.324902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:59.458307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaa8c8-87d1-4821-ac67-25a0cf7258f5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:59.522888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2588/5178] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:26:59.530041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:26:59.532177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:26:59.677319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29278ce7-1101-4ca1-93fd-ba0b737962ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:59.678549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29278ce7-1101-4ca1-93fd-ba0b737962ab service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:59.678666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29278ce7-1101-4ca1-93fd-ba0b737962ab service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:59.679431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29278ce7-1101-4ca1-93fd-ba0b737962ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:59.705758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1aedd-9b14-4a5f-b167-e08d9203d918 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:26:59.720625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:26:59.721311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:26:59.721592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:26:59.721861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:26:59.749910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:59.751850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:59.766014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2589/5179] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:26:59.836460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29278ce7-1101-4ca1-93fd-ba0b737962ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:26:59.838296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29278ce7-1101-4ca1-93fd-ba0b737962ab service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:26:59.867198 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2591/5180] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:26:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:00.918263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:00.921099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:01.183326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aace92-89ac-4d0d-a07a-58d791a08ceb service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:01.207153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:01.208887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:01.209324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:01.209733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] PATH_INFO: `/v3/projects/42b5531aa4b24755afbfd4ad60a00131` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:01.212197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b5531aa4b24755afbfd4ad60a00131)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:01.215150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:01.278597 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:01.340567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b5531aa4b24755afbfd4ad60a00131', 'request_id': 'req-1e6e7680-7cb2-4856-8aee-b1193b78e47e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:01.364660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b5531aa4b24755afbfd4ad60a00131', 'request_id': 'req-1e6e7680-7cb2-4856-8aee-b1193b78e47e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:01.372277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b5531aa4b24755afbfd4ad60a00131', 'request_id': 'req-1e6e7680-7cb2-4856-8aee-b1193b78e47e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:01.416248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] The token cache is being invalidate because project 42b5531aa4b24755afbfd4ad60a00131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:01.416848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:01.421308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e6e7680-7cb2-4856-8aee-b1193b78e47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:01.425281 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2590/5181] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:00 2022] DELETE /identity/v3/projects/42b5531aa4b24755afbfd4ad60a00131 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:01.431041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3017b-fcae-4e14-ae6e-d09c8f23c24e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:01.431577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3017b-fcae-4e14-ae6e-d09c8f23c24e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:01.431905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3017b-fcae-4e14-ae6e-d09c8f23c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:01.489542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e3f3017b-fcae-4e14-ae6e-d09c8f23c24e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:01.495310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3f3017b-fcae-4e14-ae6e-d09c8f23c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:01.653949 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:01.747611 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2592/5182] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:27:01.750966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1605-3077-466a-bf0f-72d907aef916 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:01.751261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1605-3077-466a-bf0f-72d907aef916 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:01.751544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1605-3077-466a-bf0f-72d907aef916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:01.843351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0a9e1605-3077-466a-bf0f-72d907aef916 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:01.844638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0a9e1605-3077-466a-bf0f-72d907aef916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:01.897768 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2591/5183] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:01.899195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3017b-fcae-4e14-ae6e-d09c8f23c24e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:01.916898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3017b-fcae-4e14-ae6e-d09c8f23c24e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:01.951337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:01.954496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:01.955039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:01.958387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:01.961983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:01.964196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:01.969679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:02.049179 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2593/5184] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:02.053635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1605-3077-466a-bf0f-72d907aef916 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:02.101917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1605-3077-466a-bf0f-72d907aef916 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:02.131279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:02.131949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:02.132230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:02.132532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:02.133346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:02.135249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:02.240149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2592/5185] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:02 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:02.244512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:02.262121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc311d9-412c-41c4-952b-519664e18141 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:02.446367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:02.447189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:02.447584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:02.448101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:02.448998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:02.459422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:02.524002 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2594/5186] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:02 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:02.530077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:02.576877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369cf17-08ce-4f14-9521-fc43c94e1109 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:02.594044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:02.596883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:02.597369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:02.597777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:02.604822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:02.613648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:02.673167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:02.674320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2593/5187] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:02.695629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ee13b-7909-4e28-8a38-7edbdcc32ea8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:02.713492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a58a7-37dd-497a-95f4-2555ee0d02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:02.714514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a58a7-37dd-497a-95f4-2555ee0d02c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:02.716019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a58a7-37dd-497a-95f4-2555ee0d02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:02.731243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a58a7-37dd-497a-95f4-2555ee0d02c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:02.732186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a58a7-37dd-497a-95f4-2555ee0d02c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:02.752603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a58a7-37dd-497a-95f4-2555ee0d02c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:02.802732 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2595/5188] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:27:02.809464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:02.843957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611cfd0-d564-45fe-8670-1ddb408b89d7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:02.860880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:02.861591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:02.861877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:02.865032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] PATH_INFO: `/v3/projects/a7b55b90b0074893a07f9f6a7025f979/users/013fa3849dde4b198ffb9b39be757f4e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:02.941840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b55b90b0074893a07f9f6a7025f979, user_id=013fa3849dde4b198ffb9b39be757f4e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:02.945960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:02.982787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477249e-7edd-48fc-ac9d-ce447bdd7c02 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:02.983037 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2594/5189] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:02 2022] PUT /identity/v3/projects/a7b55b90b0074893a07f9f6a7025f979/users/013fa3849dde4b198ffb9b39be757f4e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:02.983288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477249e-7edd-48fc-ac9d-ce447bdd7c02 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:02.983636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477249e-7edd-48fc-ac9d-ce447bdd7c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:03.051071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1477249e-7edd-48fc-ac9d-ce447bdd7c02 None None] MFA Rules not processed for user `013fa3849dde4b198ffb9b39be757f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:03.052176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1477249e-7edd-48fc-ac9d-ce447bdd7c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:03.358404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:03.361023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:03.369776 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2596/5190] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:27:03.542685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb207a-f59c-4be7-b599-49fa456e61ff admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:03.555043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0009f0b-dc37-4b73-b03f-d6ccc6e2bfda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:03.556599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009f0b-dc37-4b73-b03f-d6ccc6e2bfda service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:03.556931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009f0b-dc37-4b73-b03f-d6ccc6e2bfda service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:03.558710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009f0b-dc37-4b73-b03f-d6ccc6e2bfda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:03.604489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0009f0b-dc37-4b73-b03f-d6ccc6e2bfda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:03.614486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0009f0b-dc37-4b73-b03f-d6ccc6e2bfda service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:03.665063 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2595/5191] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:27:05.020883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:05.020883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:05.021553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:05.158907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] MFA Rules not processed for user `d35661d01cfb4f8d90ea78c7c7ead1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:05.160175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:05.233577 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:05.359982 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2597/5192] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:05.370440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ff66-9ccf-4c77-ab11-882ae931fe28 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:05.370986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ff66-9ccf-4c77-ab11-882ae931fe28 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:05.370986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ff66-9ccf-4c77-ab11-882ae931fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:05.438344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e374ff66-9ccf-4c77-ab11-882ae931fe28 None None] MFA Rules not processed for user `d35661d01cfb4f8d90ea78c7c7ead1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:05.446438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e374ff66-9ccf-4c77-ab11-882ae931fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:05.488577 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2596/5193] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:05.500294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:05.501844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:05.885971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c39314-f978-4ae4-87f5-e3a4523062d3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:05.913090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:05.913891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:05.914594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:05.914758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:05.946588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:05.948277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:05.989346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2598/5194] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:07.608664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53834-2ecb-424f-9937-61d4947df010 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:07.609243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53834-2ecb-424f-9937-61d4947df010 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:07.609346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53834-2ecb-424f-9937-61d4947df010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:07.707047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-40a53834-2ecb-424f-9937-61d4947df010 None None] MFA Rules not processed for user `f54784294b484ac48e28a0dd50e25222`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:07.709891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40a53834-2ecb-424f-9937-61d4947df010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:07.832210 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:07.860023 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2597/5195] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:08.019480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:08.020942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:08.217424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f187d0-141d-4f32-8c46-c97e5e3b7b78 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:08.231074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:08.232061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:08.232661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:08.233140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:08.238205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:08.269705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:08.269705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:08.293128 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2599/5196] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:09.074334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5319-ac45-43c7-bc96-8460be76c3f8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:09.074926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:09.075798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5319-ac45-43c7-bc96-8460be76c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:09.076285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5319-ac45-43c7-bc96-8460be76c3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:09.077630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:09.146668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-831d5319-ac45-43c7-bc96-8460be76c3f8 None None] MFA Rules not processed for user `f54784294b484ac48e28a0dd50e25222`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:09.148744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-831d5319-ac45-43c7-bc96-8460be76c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:09.178353 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2598/5197] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:09.257499 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:09.308788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48006b6-d282-42f4-8e08-daae219a29fb service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:09.325853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f6803-980d-46e0-8785-8825519a25bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:09.327340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6803-980d-46e0-8785-8825519a25bd service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:09.327792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6803-980d-46e0-8785-8825519a25bd service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:09.329719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6803-980d-46e0-8785-8825519a25bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:09.337807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-126f6803-980d-46e0-8785-8825519a25bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:09.376798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f6803-980d-46e0-8785-8825519a25bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:09.378707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f6803-980d-46e0-8785-8825519a25bd service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:09.411983 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2600/5198] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:09.464453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84303f-1a3e-49b4-9dee-ff8bbc3694ed None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:09.464737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84303f-1a3e-49b4-9dee-ff8bbc3694ed None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:09.465206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84303f-1a3e-49b4-9dee-ff8bbc3694ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:09.494346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2d84303f-1a3e-49b4-9dee-ff8bbc3694ed None None] MFA Rules not processed for user `f54784294b484ac48e28a0dd50e25222`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:09.496327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2d84303f-1a3e-49b4-9dee-ff8bbc3694ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:09.525325 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2599/5199] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:09.566814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3f2b-9b31-41af-a837-5ca1b26ddeaa None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:09.567099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3f2b-9b31-41af-a837-5ca1b26ddeaa None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:09.567368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3f2b-9b31-41af-a837-5ca1b26ddeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:09.618039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-276b3f2b-9b31-41af-a837-5ca1b26ddeaa None None] MFA Rules not processed for user `f54784294b484ac48e28a0dd50e25222`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:09.619325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-276b3f2b-9b31-41af-a837-5ca1b26ddeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:09.656889 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2601/5200] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:09.692971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:09.693254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:09.693525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:09.746096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] MFA Rules not processed for user `f54784294b484ac48e28a0dd50e25222`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:09.754491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:09.781912 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2600/5201] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:12.053721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:12.054822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:12.055592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:12.115584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] MFA Rules not processed for user `949126b9470c418897afeacef01c275f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:12.117498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:12.292951 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2602/5202] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:15.935935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:15.939130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:15.984544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ef7d-54a5-48c6-9d19-155f3ee9d8e0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:15.991192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15fe72-2f36-4938-9fb3-04297d7f7113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:15.992443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15fe72-2f36-4938-9fb3-04297d7f7113 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:15.992913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15fe72-2f36-4938-9fb3-04297d7f7113 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:15.993483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15fe72-2f36-4938-9fb3-04297d7f7113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:15.997261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4d15fe72-2f36-4938-9fb3-04297d7f7113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:16.015957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15fe72-2f36-4938-9fb3-04297d7f7113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:16.024508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15fe72-2f36-4938-9fb3-04297d7f7113 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:16.057456 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2601/5203] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:19.391674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:19.393508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:19.582801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e59b3a-dd15-4874-8f08-6a1251dab3d2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:19.594388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:19.595449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:19.595927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:19.596527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] PATH_INFO: `/v3/users/803b088af7a84546a28e5a22a85f3d0f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:19.607255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803b088af7a84546a28e5a22a85f3d0f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:19.608614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:19.684200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803b088af7a84546a28e5a22a85f3d0f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:19.695886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803b088af7a84546a28e5a22a85f3d0f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:19.712873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803b088af7a84546a28e5a22a85f3d0f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:19.713687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803b088af7a84546a28e5a22a85f3d0f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:19.722138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803b088af7a84546a28e5a22a85f3d0f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:19.724647 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:19.743528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2603/5204] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:19 2022] DELETE /identity/v3/users/803b088af7a84546a28e5a22a85f3d0f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:19.743830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:19.743830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:19.743830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:19.780224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:19.781786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:19.982729 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2602/5205] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:20.005655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:20.007619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:20.277132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3806-80dc-4cd2-ad93-4762a993e7e3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:20.294746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb629c9-610e-424f-8e03-acccc1a6ed53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:20.296077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb629c9-610e-424f-8e03-acccc1a6ed53 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:20.296077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb629c9-610e-424f-8e03-acccc1a6ed53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:20.296313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb629c9-610e-424f-8e03-acccc1a6ed53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:20.326521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb629c9-610e-424f-8e03-acccc1a6ed53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:20.328900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb629c9-610e-424f-8e03-acccc1a6ed53 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:20.349273 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2604/5206] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:20.668118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:20.669853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:20.695575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4447a-7e77-427c-bb5f-94fa07e0e03d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:20.720236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:20.720971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:20.721406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:20.721674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] PATH_INFO: `/v3/projects/227b9365eb224bf9918d40a375a4d85c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:20.733888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=227b9365eb224bf9918d40a375a4d85c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:20.736170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:20.861467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227b9365eb224bf9918d40a375a4d85c', 'request_id': 'req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:20.878886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227b9365eb224bf9918d40a375a4d85c', 'request_id': 'req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:20.890217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227b9365eb224bf9918d40a375a4d85c', 'request_id': 'req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:20.905666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] The token cache is being invalidate because project 227b9365eb224bf9918d40a375a4d85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:20.906390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:20.907376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8f4af44-a596-487d-bd2c-73ef2fe6aafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:20.910030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2603/5207] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:20 2022] DELETE /identity/v3/projects/227b9365eb224bf9918d40a375a4d85c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:20.916812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9c2e-0218-4644-92bd-c5c4db8eefe0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:20.920420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9c2e-0218-4644-92bd-c5c4db8eefe0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:20.920710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9c2e-0218-4644-92bd-c5c4db8eefe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:20.984412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-279d9c2e-0218-4644-92bd-c5c4db8eefe0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:20.991102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-279d9c2e-0218-4644-92bd-c5c4db8eefe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:21.202892 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2605/5208] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:21.209463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b292-a2c6-447f-ab64-df679dc8c76e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:21.210146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b292-a2c6-447f-ab64-df679dc8c76e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:21.211369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b292-a2c6-447f-ab64-df679dc8c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:21.247134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5621b292-a2c6-447f-ab64-df679dc8c76e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:21.251075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5621b292-a2c6-447f-ab64-df679dc8c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:21.297338 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2604/5209] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:21.302292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d9c2e-0218-4644-92bd-c5c4db8eefe0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:21.319895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d9c2e-0218-4644-92bd-c5c4db8eefe0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:21.334357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:21.338257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:21.338989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:21.339409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:21.340252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:21.340712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:21.345061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:21.378381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2606/5210] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:21.379723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621b292-a2c6-447f-ab64-df679dc8c76e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:21.393906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621b292-a2c6-447f-ab64-df679dc8c76e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:21.417503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:21.418557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:21.419040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:21.419559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:21.420411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:21.426012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:21.547080 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2605/5211] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:21 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:21.552928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:21.608797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae77c6e-737d-4bdb-82cc-013ae29a5afb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:21.844730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:21.845991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:21.847984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:21.848255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:21.855462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:21.861036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:21.913720 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2607/5212] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:21 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:21.913878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:21.938320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512e070-d52c-4df1-94a8-25f2b30e7fdb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:21.948879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:21.951535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:21.951933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:21.952309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:21.953908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:21.956614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:21.967057 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:21.994570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:22.007155 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2606/5213] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:22.010029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd389cf-c75a-4271-9523-679ee93794d6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:22.021775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c7ef4-ad4a-4f9f-bf4c-2a825d4516e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:22.022592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c7ef4-ad4a-4f9f-bf4c-2a825d4516e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:22.023070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c7ef4-ad4a-4f9f-bf4c-2a825d4516e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:22.023608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c7ef4-ad4a-4f9f-bf4c-2a825d4516e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:22.027705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c7ef4-ad4a-4f9f-bf4c-2a825d4516e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:22.030348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c7ef4-ad4a-4f9f-bf4c-2a825d4516e0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:22.066160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:22.070267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2608/5214] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:27:22.110014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc98f-3c72-4461-8b7b-fcb5f2f40b86 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:22.122232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:22.125183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:22.128722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:22.129330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] PATH_INFO: `/v3/projects/6145bce412d24991ab5aae4d3355b8a6/users/a0414d680c0f45f5832781cbda2c5f10/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:22.198698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6145bce412d24991ab5aae4d3355b8a6, user_id=a0414d680c0f45f5832781cbda2c5f10, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:22.209048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:22.267385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:22.267840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:22.268222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:22.271284 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2607/5215] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:22 2022] PUT /identity/v3/projects/6145bce412d24991ab5aae4d3355b8a6/users/a0414d680c0f45f5832781cbda2c5f10/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:22.311370 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:22.334326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] MFA Rules not processed for user `a0414d680c0f45f5832781cbda2c5f10`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:22.335899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:22.490669 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2609/5216] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:22.542841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:22.544906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:22.683140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772b9c1-defb-4388-9668-a15d58bbaa01 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:22.693916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:22.694627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:22.695427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:22.695427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:22.714854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:22.716315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:22.732184 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2608/5217] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:25.923254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:25.926306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:26.102442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:26.114834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8956a7-9738-42f0-b42b-3b5ab0ab9485 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:26.127788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9f142-7605-4ccf-91b5-c8fdea46a093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:26.129743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9f142-7605-4ccf-91b5-c8fdea46a093 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:26.130982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9f142-7605-4ccf-91b5-c8fdea46a093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:26.132453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9f142-7605-4ccf-91b5-c8fdea46a093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:26.138382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5de9f142-7605-4ccf-91b5-c8fdea46a093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:26.180102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4b3f0-8bec-4a87-ad49-bc0d6ab2814c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:26.182691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9f142-7605-4ccf-91b5-c8fdea46a093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:26.184152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9f142-7605-4ccf-91b5-c8fdea46a093 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:26.202027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:26.204722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:26.205194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:26.205472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:26.210303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:26.213766 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2609/5218] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:27:26.243702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:26.249941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:26.292967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2610/5219] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:29.190943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:29.192032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:29.192518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:29.215642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:29.220145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:29.376222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:29.381095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:29.401815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34131acc-80e7-4efe-97b5-0371e0937ff1 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:29.407300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:29.408729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:29.409211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:29.409981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] PATH_INFO: `/v3/users/4ca21b8131964f77bd73f26700e8da03` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:29.411931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca21b8131964f77bd73f26700e8da03)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:29.414486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:29.467921 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:29.507063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca21b8131964f77bd73f26700e8da03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:29.522132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca21b8131964f77bd73f26700e8da03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:29.540426 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2610/5220] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:29.556231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca21b8131964f77bd73f26700e8da03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:29.558249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca21b8131964f77bd73f26700e8da03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:29.567945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:29.570228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:29.574528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aacaa26b-5804-4439-b174-1a6c71afbef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca21b8131964f77bd73f26700e8da03'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:29.593116 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2611/5221] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:29 2022] DELETE /identity/v3/users/4ca21b8131964f77bd73f26700e8da03 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:29.597489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:29.599207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:29.599632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:29.683257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:29.691432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:29.752910 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:29.911559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056d8dd-f1aa-4958-9bfe-c3b115b65b1e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:29.956391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2612/5222] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:29.990108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:29.992587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:30.026692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80327a-58aa-429f-b04d-88ea38c8c875 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:30.027331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80327a-58aa-429f-b04d-88ea38c8c875 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:30.027607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80327a-58aa-429f-b04d-88ea38c8c875 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:30.027878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80327a-58aa-429f-b04d-88ea38c8c875 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:30.030004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8e80327a-58aa-429f-b04d-88ea38c8c875 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:30.131045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934c9e5-6bda-497f-bf13-75d42cab1d15 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:30.135418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:30.136664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:30.136999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:30.137590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:30.159521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:30.161656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:30.178461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80327a-58aa-429f-b04d-88ea38c8c875 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:30.180349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80327a-58aa-429f-b04d-88ea38c8c875 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:30.186577 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2613/5223] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:30.229833 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2611/5224] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:27:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:27:31.638198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:31.640585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:31.674484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638c68-5040-4046-8a40-2fcb9e1f5db6 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:31.685386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:31.687688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:31.688516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:31.688734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] PATH_INFO: `/v3/projects/59005901ac964f268e060d592aa96e26` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:31.699299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=59005901ac964f268e060d592aa96e26)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:31.699299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:31.825886 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:31.837129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59005901ac964f268e060d592aa96e26', 'request_id': 'req-8ce7837e-2e2a-4279-a0b0-48d633952bff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:31.856068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59005901ac964f268e060d592aa96e26', 'request_id': 'req-8ce7837e-2e2a-4279-a0b0-48d633952bff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:31.875369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59005901ac964f268e060d592aa96e26', 'request_id': 'req-8ce7837e-2e2a-4279-a0b0-48d633952bff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:31.907361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] The token cache is being invalidate because project 59005901ac964f268e060d592aa96e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:31.908024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:31.908981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8ce7837e-2e2a-4279-a0b0-48d633952bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:31.911073 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2614/5225] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:31 2022] DELETE /identity/v3/projects/59005901ac964f268e060d592aa96e26 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:31.916133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448015c-8706-447b-b00a-2bfbca6b6ac6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:31.916606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448015c-8706-447b-b00a-2bfbca6b6ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:31.916715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448015c-8706-447b-b00a-2bfbca6b6ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:31.965414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5448015c-8706-447b-b00a-2bfbca6b6ac6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:31.966685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5448015c-8706-447b-b00a-2bfbca6b6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:32.072121 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2612/5226] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:32.081887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3c2f-00c3-46d0-944d-3a9f2bf6100a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.082459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3c2f-00c3-46d0-944d-3a9f2bf6100a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.082934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3c2f-00c3-46d0-944d-3a9f2bf6100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.121685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-792f3c2f-00c3-46d0-944d-3a9f2bf6100a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:32.123839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-792f3c2f-00c3-46d0-944d-3a9f2bf6100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:32.135543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2615/5227] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:32.140124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448015c-8706-447b-b00a-2bfbca6b6ac6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:32.154030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448015c-8706-447b-b00a-2bfbca6b6ac6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:32.174560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:32.175631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.176147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.176633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.177575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:32.178085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:32.189661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:32.230030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3c2f-00c3-46d0-944d-3a9f2bf6100a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:32.240819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3c2f-00c3-46d0-944d-3a9f2bf6100a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:32.241311 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2613/5228] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:32.255474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:32.256442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.256919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.257290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.258222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:32.271511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:32.370056 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2616/5229] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:32 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:32.373987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:32.382007 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:32.387491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49703-0808-4d0f-8fc1-7226015d1779 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:32.540880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:32.541522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.541802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.542072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.542712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:32.544756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:32.594287 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2614/5230] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:32 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:32.598583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:32.613848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625aad9-3c2b-4b39-8f82-32db35efa949 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:32.633084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:32.633732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.634005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.634272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.634924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:32.636582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:32.658750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2617/5231] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:32.664676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:32.679320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff49d22-3d03-43c2-80b6-466d193b497a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:32.691775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c8a10-662b-4487-853d-a6206905f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:32.692458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8a10-662b-4487-853d-a6206905f950 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.692733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8a10-662b-4487-853d-a6206905f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.693025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8a10-662b-4487-853d-a6206905f950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.693691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c8a10-662b-4487-853d-a6206905f950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:32.696239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c8a10-662b-4487-853d-a6206905f950 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:32.739767 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2615/5232] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:32.739939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:32.764667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0ffc7-4d02-45cb-9c08-c2bc5732c04d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:32.780590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:32.781303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.781578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.781851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] PATH_INFO: `/v3/projects/199fba4d83764ebbb35031c97b6fdd8d/users/7b4c276d7dbe422ca97da4d297149be7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.811100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] RBAC: Authorizing `identity:create_grant(project_id=199fba4d83764ebbb35031c97b6fdd8d, user_id=7b4c276d7dbe422ca97da4d297149be7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:32.814988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:32.852985 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2618/5233] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:32 2022] PUT /identity/v3/projects/199fba4d83764ebbb35031c97b6fdd8d/users/7b4c276d7dbe422ca97da4d297149be7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:32.857946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:32.858437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:32.858819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:32.926683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] MFA Rules not processed for user `7b4c276d7dbe422ca97da4d297149be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:32.929981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:33.091865 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2616/5234] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:33.307383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:33.310672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:33.485003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6131e7-a43e-4b06-a94a-4d6bdab0748c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:33.497866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4670fac-2fc6-41fc-9010-65a9cc9000f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:33.498507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670fac-2fc6-41fc-9010-65a9cc9000f0 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:33.498785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670fac-2fc6-41fc-9010-65a9cc9000f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:33.499056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670fac-2fc6-41fc-9010-65a9cc9000f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:33.524691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4670fac-2fc6-41fc-9010-65a9cc9000f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:33.526362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4670fac-2fc6-41fc-9010-65a9cc9000f0 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:33.549381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2619/5235] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:34.321870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:34.324138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:34.477885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce9413-5013-4b2d-895b-c4b5c0ed1791 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:34.482742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:34.483409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:34.483683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:34.483948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] PATH_INFO: `/v3/users/013fa3849dde4b198ffb9b39be757f4e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:34.485133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=013fa3849dde4b198ffb9b39be757f4e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:34.487428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:34.527772 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:34.616998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013fa3849dde4b198ffb9b39be757f4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:34.636386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013fa3849dde4b198ffb9b39be757f4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:34.637300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013fa3849dde4b198ffb9b39be757f4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:34.649666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013fa3849dde4b198ffb9b39be757f4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:34.650436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013fa3849dde4b198ffb9b39be757f4e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:34.689761 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2617/5236] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:34 2022] DELETE /identity/v3/users/013fa3849dde4b198ffb9b39be757f4e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:34.694276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:34.695272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:34.696063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:34.754267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:34.758726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:34.892863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:34.892863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:34.943578 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:35.001073 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2620/5237] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:35.032285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3547a-6f27-4c57-8a87-b80f34f8dffa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:35.044761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:35.045504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:35.045758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:35.046024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] PATH_INFO: `/v3/users/19a35912e003492288b68566b677b0da` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:35.048548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a35912e003492288b68566b677b0da)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:35.054515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:35.095642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:35.098069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:35.159444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a35912e003492288b68566b677b0da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.182267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a35912e003492288b68566b677b0da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.182883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a35912e003492288b68566b677b0da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.199096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a35912e003492288b68566b677b0da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.201012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a35912e003492288b68566b677b0da'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.257157 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2618/5238] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:34 2022] DELETE /identity/v3/users/19a35912e003492288b68566b677b0da => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:35.304090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad21832-c52b-4360-9381-85155fa1b7a5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:35.366376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:35.367960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:35.403302 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:35.472726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:35.475770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:35.476732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:35.476732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:35.483514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:35.637446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44df5-ddee-468c-aa24-302191f90971 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:35.671735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:35.672539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:35.675094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:35.676558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] PATH_INFO: `/v3/users/7b4c276d7dbe422ca97da4d297149be7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:35.682769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4c276d7dbe422ca97da4d297149be7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:35.686564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:35.797366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:35.804942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:35.826965 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2621/5239] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:27:35.829044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:35.831013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:35.831655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4c276d7dbe422ca97da4d297149be7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.852757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4c276d7dbe422ca97da4d297149be7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.853448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4c276d7dbe422ca97da4d297149be7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.856230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6850d4-660b-4691-83d7-0556f017aff1 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:35.866198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:35.867724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:35.868203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:35.869334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] PATH_INFO: `/v3/projects/b07c7490e08043f89ea40531d634b859` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:35.871068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07c7490e08043f89ea40531d634b859)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:35.880053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:35.886537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4c276d7dbe422ca97da4d297149be7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.887864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2a94dd90-412f-49a4-8d85-8f8611861ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4c276d7dbe422ca97da4d297149be7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.946505 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2619/5240] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:35 2022] DELETE /identity/v3/users/7b4c276d7dbe422ca97da4d297149be7 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:35.951179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:35.951670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:35.952123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:35.972876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07c7490e08043f89ea40531d634b859', 'request_id': 'req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.976708 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:35.983017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07c7490e08043f89ea40531d634b859', 'request_id': 'req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:35.988647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:35.990033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:35.998781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07c7490e08043f89ea40531d634b859', 'request_id': 'req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:36.026764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] The token cache is being invalidate because project b07c7490e08043f89ea40531d634b859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:36.027061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:36.028657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47d55f1a-a406-4b74-b71b-5ddafe7ed6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:36.030630 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2622/5241] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:35 2022] DELETE /identity/v3/projects/b07c7490e08043f89ea40531d634b859 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:36.035748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69879f94-8fc5-42f1-a6d1-b92b5fae78ee None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.036235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69879f94-8fc5-42f1-a6d1-b92b5fae78ee None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.036620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69879f94-8fc5-42f1-a6d1-b92b5fae78ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.093729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-69879f94-8fc5-42f1-a6d1-b92b5fae78ee None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:36.097551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-69879f94-8fc5-42f1-a6d1-b92b5fae78ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:36.180118 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2620/5242] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:36.204486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:36.206711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:36.332140 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2623/5243] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:27:36.336652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4cd27-4eaa-4506-8bcc-1adef5ec15d4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.338378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4cd27-4eaa-4506-8bcc-1adef5ec15d4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.341432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4cd27-4eaa-4506-8bcc-1adef5ec15d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.385864 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:36.406382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d8c4cd27-4eaa-4506-8bcc-1adef5ec15d4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:36.409343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d8c4cd27-4eaa-4506-8bcc-1adef5ec15d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:36.435037 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2624/5244] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:36.436597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4cd27-4eaa-4506-8bcc-1adef5ec15d4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:36.459415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4cd27-4eaa-4506-8bcc-1adef5ec15d4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:36.471726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:36.472617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.473015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.473292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.477452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:36.477839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:36.480234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:36.509722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65272a-566c-41d5-b924-a43bc2bab5d1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:36.516885 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2625/5245] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:36.517045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:36.517045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.517045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.517045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.519704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:36.536744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:36.543284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:36.552340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767aed-72ce-4d26-8ec6-126842a678b4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:36.569362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:36.570004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.570287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.570559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.571208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:36.573199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:36.576630 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2621/5246] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:27:36.661708 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2626/5247] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:36 2022] POST /identity/v3/projects => generated 395 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:36.664240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:36.686972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853d6d-5544-4c36-859b-6b2338bb7792 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:36.833056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:36.834239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.834758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.835233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.836187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:36.839468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:36.889375 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2622/5248] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:36 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:36.890687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:36.904646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707b26-cf0a-4413-bbbb-c5d6ad0f5b05 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:36.911882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:36.912987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.913306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.913529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.914358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:36.916269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:36.939671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:36.947749 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2627/5249] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:36.955508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1d7a9-69a9-46d2-850d-14f58fc3928b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:36.967662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:36.968214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:36.968498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:36.968798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:36.969459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:36.971918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.005735 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2623/5250] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:37.007663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.022763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4d58-db4c-4db7-b16e-6e7b9c459957 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.028978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497c798-bd46-4736-b79a-3282c2b3a543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.029660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c798-bd46-4736-b79a-3282c2b3a543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.029941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c798-bd46-4736-b79a-3282c2b3a543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.030210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c798-bd46-4736-b79a-3282c2b3a543 admin admin] PATH_INFO: `/v3/projects/0c6c6457b07a43f193af082ada523651/users/400e677f335446c0817c32b85e1e24b1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.034486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.036228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:37.058904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd42d7-cf87-4fb5-b8a4-37a85ceedb19 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.069319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497c798-bd46-4736-b79a-3282c2b3a543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6c6457b07a43f193af082ada523651, user_id=400e677f335446c0817c32b85e1e24b1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.080063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.080782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.080892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497c798-bd46-4736-b79a-3282c2b3a543 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.081154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.081498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] PATH_INFO: `/v3/projects/199fba4d83764ebbb35031c97b6fdd8d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.082793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=199fba4d83764ebbb35031c97b6fdd8d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.085554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.122647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2628/5251] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:37 2022] PUT /identity/v3/projects/0c6c6457b07a43f193af082ada523651/users/400e677f335446c0817c32b85e1e24b1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:37.125147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91185bc-9305-46e1-8f06-1c2605e9972a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.125535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91185bc-9305-46e1-8f06-1c2605e9972a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.125997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91185bc-9305-46e1-8f06-1c2605e9972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.166468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199fba4d83764ebbb35031c97b6fdd8d', 'request_id': 'req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:37.186296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199fba4d83764ebbb35031c97b6fdd8d', 'request_id': 'req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:37.192463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c91185bc-9305-46e1-8f06-1c2605e9972a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:37.196217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199fba4d83764ebbb35031c97b6fdd8d', 'request_id': 'req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:37.196702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c91185bc-9305-46e1-8f06-1c2605e9972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:37.212388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] The token cache is being invalidate because project 199fba4d83764ebbb35031c97b6fdd8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:37.212388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:37.212649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d1bc7d44-5890-4bd7-86ab-1bc76c8f4c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:37.214815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2624/5252] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:37 2022] DELETE /identity/v3/projects/199fba4d83764ebbb35031c97b6fdd8d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:37.220502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.220832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.221118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.248243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:37.250054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:37.293705 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:37.353907 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2629/5253] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:37.354124 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2625/5254] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:37.361800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebc264-855c-4a98-bf1e-a2a32d9bedb0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.362221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebc264-855c-4a98-bf1e-a2a32d9bedb0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.362598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebc264-855c-4a98-bf1e-a2a32d9bedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.381671 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:37.395174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.397272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:37.406811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1aebc264-855c-4a98-bf1e-a2a32d9bedb0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:37.408078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1aebc264-855c-4a98-bf1e-a2a32d9bedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:37.435409 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2630/5255] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:37.439344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebc264-855c-4a98-bf1e-a2a32d9bedb0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.468626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebc264-855c-4a98-bf1e-a2a32d9bedb0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.491347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.492072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.492285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.492563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.493273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:37.493573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.495282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.521926 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2631/5256] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:37.533684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.544500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3d55-396b-4ac2-b8f6-5d3323f568c1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.554410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.556093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.557879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a782f-84e7-4eed-bbcb-55998def4268 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.558086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.558556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.571672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.572712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.574127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.574534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.577083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.580444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.585507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.588525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.615807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2626/5257] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:27:37.641506 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2632/5258] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:37 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:37.645772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.666503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c6407-3ea7-42a2-80a7-c57784dbe137 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.766550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.767244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.767529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.767853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.768498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.770763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.805061 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2627/5259] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:37 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:37.810226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.824980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de7b3c-2918-4554-8597-1f8ce065972a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.841192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.842685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.842969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.846442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.847300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.852533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.876898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2633/5260] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:37.880875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.894411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f74a6-0ba3-49d1-acae-012c07db5479 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.902889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dc3ea-4f2b-48e9-96dd-de2d346f21ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.903604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dc3ea-4f2b-48e9-96dd-de2d346f21ff admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.903948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dc3ea-4f2b-48e9-96dd-de2d346f21ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.904285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dc3ea-4f2b-48e9-96dd-de2d346f21ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.906221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dc3ea-4f2b-48e9-96dd-de2d346f21ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:37.907630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dc3ea-4f2b-48e9-96dd-de2d346f21ff admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:37.926456 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2628/5261] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:27:37.929792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:37.951539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa859b-c7a1-4848-a976-7f44fdbc3119 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:37.963857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:37.964676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:37.965042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:37.965382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] PATH_INFO: `/v3/projects/4775bbedc36f41dda6a4ef9fe22beca7/users/281df8a4fa814c4aa22a40125df26a0a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:37.999861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4775bbedc36f41dda6a4ef9fe22beca7, user_id=281df8a4fa814c4aa22a40125df26a0a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.003202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.025200 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2634/5262] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:37 2022] PUT /identity/v3/projects/4775bbedc36f41dda6a4ef9fe22beca7/users/281df8a4fa814c4aa22a40125df26a0a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:38.037335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd2037-2c8a-465d-9e50-d0989d458536 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.037924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd2037-2c8a-465d-9e50-d0989d458536 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.039058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd2037-2c8a-465d-9e50-d0989d458536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.082619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0cbd2037-2c8a-465d-9e50-d0989d458536 None None] MFA Rules not processed for user `281df8a4fa814c4aa22a40125df26a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:38.083550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0cbd2037-2c8a-465d-9e50-d0989d458536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:38.149384 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:38.172249 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2629/5263] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:38.176806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:38.254341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee4379-764b-4d44-9284-191775ee7f9c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:38.259582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:38.260291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.260573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.260883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.261692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.263629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.300108 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2635/5264] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:38 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:38.304420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd2037-2c8a-465d-9e50-d0989d458536 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:38.319510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd2037-2c8a-465d-9e50-d0989d458536 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:38.394070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:38.396519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:38.429317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:38.430161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.430451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.430772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.431706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.441368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.483607 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2630/5265] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:38 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:27:38.484687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:38.508419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1c8d-51a1-489e-a461-4309c4a5c441 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:38.511064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f712be7-05f4-413f-9593-100a374321e0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:38.511697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:38.512423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.512785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.513246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] PATH_INFO: `/v3/projects/a7b55b90b0074893a07f9f6a7025f979` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.514457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b55b90b0074893a07f9f6a7025f979)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.516570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.516919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:38.517538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.518289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.518648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.519209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.520828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.533416 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2631/5266] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:27:38.538254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:38.555076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07599f0-3baa-4959-9246-f887cdec83f0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:38.561718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:38.562594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.563095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.563469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] PATH_INFO: `/v3/projects/141a6f83335d468f9b61e95008eb2c71/users/fbfdeef161244c9cb8d277496863da5c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.582512 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:38.607868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=141a6f83335d468f9b61e95008eb2c71, user_id=fbfdeef161244c9cb8d277496863da5c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.633228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.635234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b55b90b0074893a07f9f6a7025f979', 'request_id': 'req-990e6b35-1e4c-4784-9929-3d653e06abaf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:38.650791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b55b90b0074893a07f9f6a7025f979', 'request_id': 'req-990e6b35-1e4c-4784-9929-3d653e06abaf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:38.668467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b55b90b0074893a07f9f6a7025f979', 'request_id': 'req-990e6b35-1e4c-4784-9929-3d653e06abaf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:38.672249 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2632/5267] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:38 2022] PUT /identity/v3/projects/141a6f83335d468f9b61e95008eb2c71/users/fbfdeef161244c9cb8d277496863da5c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:38.674473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:38.698039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] The token cache is being invalidate because project a7b55b90b0074893a07f9f6a7025f979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:38.699984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:38.701156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-990e6b35-1e4c-4784-9929-3d653e06abaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:38.708809 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2636/5268] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:38 2022] DELETE /identity/v3/projects/a7b55b90b0074893a07f9f6a7025f979 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:38.712584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701257e-2eaf-4aaf-b50c-22a62529d8ae None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.714050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701257e-2eaf-4aaf-b50c-22a62529d8ae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.714430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701257e-2eaf-4aaf-b50c-22a62529d8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.771598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9701257e-2eaf-4aaf-b50c-22a62529d8ae None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:38.777168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9701257e-2eaf-4aaf-b50c-22a62529d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:38.811025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1ac9-f529-4fcf-8f15-3d5f42fb82dd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:38.818435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:38.819660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.820022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.820314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.821013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.822745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.841729 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2633/5269] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:27:38.845109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:38.847599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:38.876515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e8977-f08a-43a0-888e-baf3919d1e73 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:38.898833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a060ea5-54d1-4abf-8531-240a07d58737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:38.899549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a060ea5-54d1-4abf-8531-240a07d58737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.899828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a060ea5-54d1-4abf-8531-240a07d58737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.900295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a060ea5-54d1-4abf-8531-240a07d58737 admin admin] PATH_INFO: `/v3/projects/141a6f83335d468f9b61e95008eb2c71/users/fbfdeef161244c9cb8d277496863da5c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.902336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a060ea5-54d1-4abf-8531-240a07d58737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141a6f83335d468f9b61e95008eb2c71, user_id=fbfdeef161244c9cb8d277496863da5c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:38.905338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a060ea5-54d1-4abf-8531-240a07d58737 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:38.927390 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2637/5270] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:38.929910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa1888-f6da-42f2-9332-a992d7dfa870 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.930593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa1888-f6da-42f2-9332-a992d7dfa870 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.930593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa1888-f6da-42f2-9332-a992d7dfa870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.935967 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2634/5271] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:38 2022] PUT /identity/v3/projects/141a6f83335d468f9b61e95008eb2c71/users/fbfdeef161244c9cb8d277496863da5c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:38.937726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223b59-92ef-4fb8-be1f-233ede8dcdc8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:38.938058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223b59-92ef-4fb8-be1f-233ede8dcdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:38.938335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223b59-92ef-4fb8-be1f-233ede8dcdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:38.971416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-48fa1888-f6da-42f2-9332-a992d7dfa870 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:38.973020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-48fa1888-f6da-42f2-9332-a992d7dfa870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:38.974153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a0223b59-92ef-4fb8-be1f-233ede8dcdc8 None None] MFA Rules not processed for user `fbfdeef161244c9cb8d277496863da5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:38.975593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0223b59-92ef-4fb8-be1f-233ede8dcdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:38.989598 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:39.063858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2638/5272] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:39.068549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa1888-f6da-42f2-9332-a992d7dfa870 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.071504 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2635/5273] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:39.081355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0223b59-92ef-4fb8-be1f-233ede8dcdc8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.095740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0223b59-92ef-4fb8-be1f-233ede8dcdc8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.097538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa1888-f6da-42f2-9332-a992d7dfa870 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.106044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.107402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.107402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.107626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.108485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.109229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.110644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.110915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.111344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.112981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.114168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:39.114637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.117532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invalid input for field 'name': '' is too short Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: On instance['name']: Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: On instance['name']: Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: '' Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise error Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application '' Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.121624 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:27:39.123204 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application '' Aug 21 01:27:39.124155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.136971 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2636/5274] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:27:39 2022] POST /identity/v3/domains => generated 283 bytes in 47 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:27:39.136971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.157626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eb86b-7578-42c0-b16e-42e605c622aa tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.177130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.178064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2639/5275] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:27:39.187202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.192913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.193465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.193979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.194881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.197706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.212106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a08023-f432-4412-af2f-d1cd2117a78d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: On instance['name']: Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: On instance['name']: Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise error Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.214939 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 21 01:27:39.216428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application On instance['name']: Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:27:39.217762 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.224383 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2637/5276] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:27:39 2022] POST /identity/v3/domains => generated 412 bytes in 96 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:27:39.236119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.252021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489583f-b2b8-4848-a9b6-ceebdb1d1a49 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.253201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.254584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.255068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.255436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.256297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.258412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.259688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.260122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.260573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.260804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.261600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.263410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.293423 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2638/5277] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:27:39 2022] POST /identity/v3/domains => generated 276 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:39.294937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.307145 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2640/5278] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:39 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:39.308368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.321173 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:39.419965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0d60-b22e-4f28-8a67-b2ad2d70000f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.470910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18691a85-e7d2-4f54-bd68-0aebd1bc0314 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.481494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.482146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.482422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.482697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.483340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.485348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.550686 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2641/5279] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:39 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:39.552563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.567954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92e75f-aeac-4ab3-a050-3cf62bf5e372 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.577479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.579873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.580407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.580931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.582509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.585352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.603769 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2642/5280] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:39.605104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.618282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ac4d-896f-49e5-ab12-2afbf35eb53b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.625616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.626553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.628055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.629225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.630130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.630458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains/87acd7225597402888895b28357a6522` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.630789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.631260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.632323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.635444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.668619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=87acd7225597402888895b28357a6522)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.670585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.692439 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2643/5281] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:39.695577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 21 01:27:39.716888 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 21 01:27:39.718179 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:39.718729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb138-c669-43b7-bc2b-751500795ff5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.729108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6695-bb50-44f0-8897-b721c4f4bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.730197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6695-bb50-44f0-8897-b721c4f4bcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.731641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6695-bb50-44f0-8897-b721c4f4bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.732042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6695-bb50-44f0-8897-b721c4f4bcdd admin admin] PATH_INFO: `/v3/projects/c92a6cc6152c46bb982b30251f7aad18/users/f0524cc60bd640ca9ae88845970eb013/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.738105 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2639/5282] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:27:39 2022] DELETE /identity/v3/domains/87acd7225597402888895b28357a6522 => generated 120 bytes in 444 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:27:39.741895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.772694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6695-bb50-44f0-8897-b721c4f4bcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92a6cc6152c46bb982b30251f7aad18, user_id=f0524cc60bd640ca9ae88845970eb013, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.780082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6695-bb50-44f0-8897-b721c4f4bcdd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.787249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d02af-d413-4c4b-af49-6b169bece77e tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:39.796933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:39.797839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.807343 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2644/5283] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:39 2022] PUT /identity/v3/projects/c92a6cc6152c46bb982b30251f7aad18/users/f0524cc60bd640ca9ae88845970eb013/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:39.812505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:39.812970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.813349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.823493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:39.825052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains/87acd7225597402888895b28357a6522` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:39.826988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=87acd7225597402888895b28357a6522)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:39.828630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:39.847768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:39.849466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:39.884532 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:39.896710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '87acd7225597402888895b28357a6522'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:39.897904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '87acd7225597402888895b28357a6522'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:39.937420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '87acd7225597402888895b28357a6522'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:39.938303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '87acd7225597402888895b28357a6522'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:39.944347 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2640/5284] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:27:39 2022] PATCH /identity/v3/domains/87acd7225597402888895b28357a6522 => generated 277 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:39.946302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:39.947675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:40.005345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2645/5285] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:27:40.012623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:40.017173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:40.095127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf7a7a-f710-4040-a7b4-84eeb275644f tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:40.104667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:40.106807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:40.107093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:40.107440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains/87acd7225597402888895b28357a6522` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:40.159662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=87acd7225597402888895b28357a6522)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:40.164310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:40.214702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44f1b-c101-4cdc-8405-cc370df7942d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:40.255562 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:40.257922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '87acd7225597402888895b28357a6522'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.265691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '87acd7225597402888895b28357a6522'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.384605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87acd7225597402888895b28357a6522', 'request_id': 'req-4749e452-b6be-4ce8-a590-aecf10325831'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.398646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87acd7225597402888895b28357a6522', 'request_id': 'req-4749e452-b6be-4ce8-a590-aecf10325831'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.406767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87acd7225597402888895b28357a6522', 'request_id': 'req-4749e452-b6be-4ce8-a590-aecf10325831'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.425430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:40.426785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:40.427284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:40.427760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:40.434108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] The token cache is being invalidate because project 87acd7225597402888895b28357a6522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:40.434435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.435067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.451797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '87acd7225597402888895b28357a6522', 'request_id': 'req-4749e452-b6be-4ce8-a590-aecf10325831'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.452421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '87acd7225597402888895b28357a6522', 'request_id': 'req-4749e452-b6be-4ce8-a590-aecf10325831'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.453029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '87acd7225597402888895b28357a6522', 'request_id': 'req-4749e452-b6be-4ce8-a590-aecf10325831'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:40.469605 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2641/5286] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:27:39 2022] DELETE /identity/v3/domains/87acd7225597402888895b28357a6522 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:40.474636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:40.477500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:40.515006 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:40.546253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:40.548854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:40.575928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2646/5287] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:40.621615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e452-b6be-4ce8-a590-aecf10325831 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:40.646265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:40.648153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:40.649657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:40.650029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains/10e5cb3dd8614588a0bcc5774eef1252` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:40.670518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Could not find domain: 10e5cb3dd8614588a0bcc5774eef1252.: keystone.exception.DomainNotFound: Could not find domain: 10e5cb3dd8614588a0bcc5774eef1252. Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 10e5cb3dd8614588a0bcc5774eef1252. Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:27:40.686848 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:27:40.688188 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:27:40.689608 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 10e5cb3dd8614588a0bcc5774eef1252. Aug 21 01:27:40.690861 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.690861 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2642/5288] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:27:40 2022] DELETE /identity/v3/domains/10e5cb3dd8614588a0bcc5774eef1252 => generated 112 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:27:40.693618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:40.706908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac62d4-84b1-4a29-9048-f34a0045b399 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:40.712573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:40.713450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:40.713739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:40.714095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:40.714929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:40.716742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:40.753802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2647/5289] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:27:40 2022] POST /identity/v3/domains => generated 252 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:27:40.758795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:40.790363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0a97-09d9-407b-88c3-eeaa80404ee3 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:40.896503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:40.898887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:40.899536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:40.899961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:40.901725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:40.903997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:40.920492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.sql.core [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-505345108' for key 'project.ixu_project_name_domain_id'") Aug 21 01:27:40.920492 n-d-master-1 devstack@keystone.service[81886]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 01:27:40.920492 n-d-master-1 devstack@keystone.service[81886]: [parameters: {'id': 'b8702b4e65dd485aa471c770d41643ee', 'name': 'tempest-domain-dup-505345108', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 21 01:27:40.920492 n-d-master-1 devstack@keystone.service[81886]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81886) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-505345108.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-505345108. Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application conn.query(q) Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:27:40.929439 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result.read() Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-505345108' for key 'project.ixu_project_name_domain_id'") Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 21 01:27:40.930346 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application next(self.gen) Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application yield resource Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application next(self.gen) Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise self.value Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application session.commit() Aug 21 01:27:40.931886 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.session.flush() Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application compat.raise_( Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 01:27:40.933603 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 01:27:40.935387 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application conn.query(q) Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application result.read() Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:27:40.936431 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-505345108' for key 'project.ixu_project_name_domain_id'") Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [parameters: {'id': 'b8702b4e65dd485aa471c770d41643ee', 'name': 'tempest-domain-dup-505345108', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.937814 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-505345108. Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:27:40.939429 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-505345108. Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:40.941380 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2643/5290] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:27:40 2022] POST /identity/v3/domains => generated 211 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 01:27:40.942443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:40.956685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383d35-e426-47cc-8cfa-e50c1eaa9195 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:40.966155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:40.967740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:40.967740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:40.967740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains/34965a7a425d418cb0738eaa0b4bb87c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:40.992494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:40.994927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=34965a7a425d418cb0738eaa0b4bb87c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:40.996427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:40.997040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:41.027766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.029225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.105327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.106349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.109897 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2648/5291] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:27:40 2022] PATCH /identity/v3/domains/34965a7a425d418cb0738eaa0b4bb87c => generated 253 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:41.113651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:41.117548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:41.136477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872afe7-3707-43b7-83ca-dc129a2f909a tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:41.199829 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:41.208619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ff3b4-b784-44ce-9914-68b785ec00cb tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:41.220567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:41.221404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:41.221853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:41.222392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains/34965a7a425d418cb0738eaa0b4bb87c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:41.245697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=34965a7a425d418cb0738eaa0b4bb87c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:41.245697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:41.274068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:41.274068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:41.274068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:41.274068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] PATH_INFO: `/v3/users/f54784294b484ac48e28a0dd50e25222` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:41.277165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54784294b484ac48e28a0dd50e25222)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:41.280329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:41.282929 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:41.309584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.320466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.365206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54784294b484ac48e28a0dd50e25222'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.383825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54784294b484ac48e28a0dd50e25222'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.385424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54784294b484ac48e28a0dd50e25222'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.400253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54784294b484ac48e28a0dd50e25222'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.401233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54784294b484ac48e28a0dd50e25222'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.419601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c', 'request_id': 'req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.452444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c', 'request_id': 'req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.460467 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2644/5292] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:40 2022] DELETE /identity/v3/users/f54784294b484ac48e28a0dd50e25222 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:41.471294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c', 'request_id': 'req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.509995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] The token cache is being invalidate because project 34965a7a425d418cb0738eaa0b4bb87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:41.510334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.511219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.522030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c', 'request_id': 'req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.523034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c', 'request_id': 'req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.523832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '34965a7a425d418cb0738eaa0b4bb87c', 'request_id': 'req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:41.554668 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2649/5293] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:27:41 2022] DELETE /identity/v3/domains/34965a7a425d418cb0738eaa0b4bb87c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:41.555713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:41.557951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:41.693183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58252a2a-6e12-4418-990e-f7be7c699e7a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:41.702430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deba8d-6f90-4e19-abc5-ed721b07c7ba tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfdeef161244c9cb8d277496863da5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '141a6f83335d468f9b61e95008eb2c71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:41.703306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deba8d-6f90-4e19-abc5-ed721b07c7ba tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:41.704123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deba8d-6f90-4e19-abc5-ed721b07c7ba tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:41.704435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deba8d-6f90-4e19-abc5-ed721b07c7ba tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] PATH_INFO: `/v3/domains/87acd7225597402888895b28357a6522` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:41.730496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2deba8d-6f90-4e19-abc5-ed721b07c7ba tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a2deba8d-6f90-4e19-abc5-ed721b07c7ba tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Could not find domain: 87acd7225597402888895b28357a6522.: keystone.exception.DomainNotFound: Could not find domain: 87acd7225597402888895b28357a6522. Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 87acd7225597402888895b28357a6522. Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:27:41.738772 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:27:41.745232 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:27:41.746632 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 87acd7225597402888895b28357a6522. Aug 21 01:27:41.748417 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:27:41.748417 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2645/5294] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:27:41 2022] PATCH /identity/v3/domains/87acd7225597402888895b28357a6522 => generated 112 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:27:41.748694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:41.749316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:41.876272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c24f4-c3cf-4d55-8674-4d27a097b2e2 tempest-DomainsNegativeTestJSON-87463850 tempest-DomainsNegativeTestJSON-87463850-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:41.972228 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:42.024323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:42.025091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.025369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.025634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] PATH_INFO: `/v3/users/281df8a4fa814c4aa22a40125df26a0a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.032820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281df8a4fa814c4aa22a40125df26a0a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:42.032820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:42.164707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281df8a4fa814c4aa22a40125df26a0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.179975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281df8a4fa814c4aa22a40125df26a0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.207038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281df8a4fa814c4aa22a40125df26a0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.209326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281df8a4fa814c4aa22a40125df26a0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.222313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281df8a4fa814c4aa22a40125df26a0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.234098 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2650/5295] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:41 2022] DELETE /identity/v3/users/281df8a4fa814c4aa22a40125df26a0a => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:42.239202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.239718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.240145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.273937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:42.276448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.391766 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2646/5296] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:42.413715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:42.415451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.439461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890f6e7-955f-4f12-b317-bf6fa2be68d3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:42.449295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:42.450304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.450304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.450899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] PATH_INFO: `/v3/projects/b5998151f0304fd48efd6b5956f27519` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.451950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:42.455043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5998151f0304fd48efd6b5956f27519)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:42.457455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:42.467186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.508106 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:42.585150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5998151f0304fd48efd6b5956f27519', 'request_id': 'req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.599934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf57b-be65-4f88-908f-5b1a15c4436d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:42.606025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5998151f0304fd48efd6b5956f27519', 'request_id': 'req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.618771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5998151f0304fd48efd6b5956f27519', 'request_id': 'req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.641271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] The token cache is being invalidate because project b5998151f0304fd48efd6b5956f27519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:42.641562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.642775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1a78b55e-1f2c-4bd3-96ac-f74a43aa1bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:42.645900 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2651/5297] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:42 2022] DELETE /identity/v3/projects/b5998151f0304fd48efd6b5956f27519 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:42.647622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.647906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.648177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.686203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] MFA Rules not processed for user `f0524cc60bd640ca9ae88845970eb013`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:42.688931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.706657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7c4c4-84ac-4e90-a8d2-570bb75a2859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:42.708286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c4c4-84ac-4e90-a8d2-570bb75a2859 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.708475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c4c4-84ac-4e90-a8d2-570bb75a2859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.708712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c4c4-84ac-4e90-a8d2-570bb75a2859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.711807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dfe7c4c4-84ac-4e90-a8d2-570bb75a2859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.757998 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:42.803968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7c4c4-84ac-4e90-a8d2-570bb75a2859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:42.805504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7c4c4-84ac-4e90-a8d2-570bb75a2859 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:42.819338 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2647/5298] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:42.821087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62ad48-5521-48d8-b65f-e89a4d38e076 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.821372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62ad48-5521-48d8-b65f-e89a4d38e076 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.822121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62ad48-5521-48d8-b65f-e89a4d38e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.831747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2652/5299] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:42.847067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:42.849739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.864953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ff62ad48-5521-48d8-b65f-e89a4d38e076 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:42.868595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ff62ad48-5521-48d8-b65f-e89a4d38e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.886928 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2648/5300] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:42.904806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f31d-523f-494a-8c2d-081d36aa1dde None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.904806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f31d-523f-494a-8c2d-081d36aa1dde None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.904806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f31d-523f-494a-8c2d-081d36aa1dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.929499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5a32f31d-523f-494a-8c2d-081d36aa1dde None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:42.946368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5a32f31d-523f-494a-8c2d-081d36aa1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:42.956420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2649/5301] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:27:42.957410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f31d-523f-494a-8c2d-081d36aa1dde None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:42.979485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f31d-523f-494a-8c2d-081d36aa1dde None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:42.994716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:42.997659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:42.997947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:42.998220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:42.998891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:42.999194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.006094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.037753 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2650/5302] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:43.042534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:43.053793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e61527-1650-4c48-be5d-d7b72a17157c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:43.056918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6bce-7688-4ca2-869c-53f94c5ad475 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:43.062101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:43.062814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.063157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.063497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.073698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.075237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.088682 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2653/5303] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:43.099368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:43.099866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.100296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.100470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.101141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.103078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.191022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2651/5304] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:43 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:43.192155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:43.207778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d548a27-5204-4be9-b35a-1e4921bac6f7 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:43.332147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:43.332892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.333397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.333683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.334405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.336709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.372650 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2654/5305] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:43 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:43.377930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:43.402470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4bea-ed80-4177-8bf1-1fd3f232a405 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:43.408356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:43.409057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.409376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.409653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.410302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.411934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.429514 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2652/5306] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:43.430952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:43.442713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c03e6a-d47d-400e-ba09-6cff7b8f0efa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:43.448753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c111a-d355-41f9-bf17-8b06fae587f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:43.449833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c111a-d355-41f9-bf17-8b06fae587f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.461719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c111a-d355-41f9-bf17-8b06fae587f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.462384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c111a-d355-41f9-bf17-8b06fae587f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.464145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c111a-d355-41f9-bf17-8b06fae587f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.468951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c111a-d355-41f9-bf17-8b06fae587f2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.500234 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2655/5307] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:43.504275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:43.524657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2aac7-ab38-4c71-b0a8-c9fe98e8b66a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:43.540598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:43.541429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.541920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.542259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] PATH_INFO: `/v3/projects/0514462a9a1b45ac9b7b3285fd0bf6af/users/bd0447e656f9418da68b308f19e8e807/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.588930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0514462a9a1b45ac9b7b3285fd0bf6af, user_id=bd0447e656f9418da68b308f19e8e807, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.600118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.614113 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:43.629195 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2653/5308] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:43 2022] PUT /identity/v3/projects/0514462a9a1b45ac9b7b3285fd0bf6af/users/bd0447e656f9418da68b308f19e8e807/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:43.631022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.631281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.631649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.677829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:43.679166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:43.779163 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:43.801747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2656/5309] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:43.833159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:43.835883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:43.919924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91149851-d654-4400-857b-dfc397fce782 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:43.927514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:43.941994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:43.941994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:43.941994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:43.945927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:43.948292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:43.969283 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2654/5310] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:44.053635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:44.055320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:44.070228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4d37-9f1a-4592-a60f-a585c8479fcc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:44.077041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:44.078212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:44.078662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:44.079121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] PATH_INFO: `/v3/projects/4775bbedc36f41dda6a4ef9fe22beca7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:44.093635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4775bbedc36f41dda6a4ef9fe22beca7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:44.095905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:44.217900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4775bbedc36f41dda6a4ef9fe22beca7', 'request_id': 'req-93c41f56-77cb-402f-9ba7-e213a3791816'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.226683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4775bbedc36f41dda6a4ef9fe22beca7', 'request_id': 'req-93c41f56-77cb-402f-9ba7-e213a3791816'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.235182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4775bbedc36f41dda6a4ef9fe22beca7', 'request_id': 'req-93c41f56-77cb-402f-9ba7-e213a3791816'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.305310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] The token cache is being invalidate because project 4775bbedc36f41dda6a4ef9fe22beca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:44.305947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.307229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.309400 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2657/5311] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:44 2022] DELETE /identity/v3/projects/4775bbedc36f41dda6a4ef9fe22beca7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:44.313613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:44.345888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5d53-17ec-4f8b-be9d-fb1886de4577 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:44.508002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:44.508991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:44.509477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:44.509973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] PATH_INFO: `/v3/users/fbfdeef161244c9cb8d277496863da5c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:44.523791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbfdeef161244c9cb8d277496863da5c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:44.529549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:44.699712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbfdeef161244c9cb8d277496863da5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.721598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbfdeef161244c9cb8d277496863da5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.722349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbfdeef161244c9cb8d277496863da5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.743900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbfdeef161244c9cb8d277496863da5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.745017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7552c992-0779-4396-950f-ba9413641749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbfdeef161244c9cb8d277496863da5c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:44.821475 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2655/5312] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:44 2022] DELETE /identity/v3/users/fbfdeef161244c9cb8d277496863da5c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:47.001291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:47.002800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:47.028821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41f56-77cb-402f-9ba7-e213a3791816 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:47.172434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:47.173129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:47.173404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:47.173673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] PATH_INFO: `/v3/projects/141a6f83335d468f9b61e95008eb2c71` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:47.177608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] RBAC: Authorizing `identity:delete_project(project_id=141a6f83335d468f9b61e95008eb2c71)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:47.179945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:47.271036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141a6f83335d468f9b61e95008eb2c71', 'request_id': 'req-46173b55-b55f-4917-ae57-09c05071356b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:47.279522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141a6f83335d468f9b61e95008eb2c71', 'request_id': 'req-46173b55-b55f-4917-ae57-09c05071356b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:47.294960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141a6f83335d468f9b61e95008eb2c71', 'request_id': 'req-46173b55-b55f-4917-ae57-09c05071356b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:47.317595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] The token cache is being invalidate because project 141a6f83335d468f9b61e95008eb2c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:47.317921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:47.318762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-46173b55-b55f-4917-ae57-09c05071356b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:47.322227 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2658/5313] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:47 2022] DELETE /identity/v3/projects/141a6f83335d468f9b61e95008eb2c71 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:47.327759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d755-e295-40a1-a78d-677093794948 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:47.328272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d755-e295-40a1-a78d-677093794948 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:47.328272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d755-e295-40a1-a78d-677093794948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:47.351461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d944d755-e295-40a1-a78d-677093794948 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:47.353735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d944d755-e295-40a1-a78d-677093794948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:47.377426 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:47.441700 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2656/5314] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:47.451802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733abda8-ead1-41f6-b9ca-b12d77b239b6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:47.452157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733abda8-ead1-41f6-b9ca-b12d77b239b6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:47.452341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733abda8-ead1-41f6-b9ca-b12d77b239b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:47.472144 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:47.480963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-733abda8-ead1-41f6-b9ca-b12d77b239b6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:47.482824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-733abda8-ead1-41f6-b9ca-b12d77b239b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:47.500938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944d755-e295-40a1-a78d-677093794948 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:47.501953 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2659/5315] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:47.518955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944d755-e295-40a1-a78d-677093794948 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:47.524977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:47.525850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:47.526196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:47.526533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:47.527365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:47.527774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:47.529699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:47.545146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2657/5316] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:47.551710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733abda8-ead1-41f6-b9ca-b12d77b239b6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:47.564438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733abda8-ead1-41f6-b9ca-b12d77b239b6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:47.571093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:47.571829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:47.572178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:47.572516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:47.573260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:47.577154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:47.620688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:47.630977 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2660/5317] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:47 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:47.634315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9dea9-0fc5-4f50-b55e-5409347208f9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:47.851207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:47.851871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:47.852141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:47.852418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:47.853123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:47.865827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:47.927733 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2658/5318] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:47 2022] POST /identity/v3/users => generated 285 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:47.930695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:47.957786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04ed5d-91f8-48b6-88d4-72c28236ac9b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:47.994083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:47.997962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:47.998236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:47.998511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:47.999180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:48.007420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:48.046509 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2661/5319] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:48.048101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:48.074661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cd318-cf20-40b0-b057-e5e2c444fc2c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:48.090961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fc2ce-8786-4ed2-b1f4-ce87915b419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:48.091772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc2ce-8786-4ed2-b1f4-ce87915b419a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:48.092152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc2ce-8786-4ed2-b1f4-ce87915b419a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:48.092518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc2ce-8786-4ed2-b1f4-ce87915b419a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:48.093315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fc2ce-8786-4ed2-b1f4-ce87915b419a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:48.095021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fc2ce-8786-4ed2-b1f4-ce87915b419a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:48.133899 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2659/5320] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:48.138688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:48.159647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf54b-5620-4e72-8b70-c4b3a4990835 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:48.172853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:48.173727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:48.174099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:48.174460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] PATH_INFO: `/v3/projects/2de52f74746b40b2a1d0f256e39f9e98/users/63489d6166e44cb7bdb3b279c89a45a4/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:48.220761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de52f74746b40b2a1d0f256e39f9e98, user_id=63489d6166e44cb7bdb3b279c89a45a4, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:48.224012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:48.252535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2662/5321] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:48 2022] PUT /identity/v3/projects/2de52f74746b40b2a1d0f256e39f9e98/users/63489d6166e44cb7bdb3b279c89a45a4/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:48.263097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b112c2-4571-4848-8233-1c13ac103847 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:48.263542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b112c2-4571-4848-8233-1c13ac103847 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:48.263911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b112c2-4571-4848-8233-1c13ac103847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:48.322539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-68b112c2-4571-4848-8233-1c13ac103847 None None] MFA Rules not processed for user `63489d6166e44cb7bdb3b279c89a45a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:48.323912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68b112c2-4571-4848-8233-1c13ac103847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:48.464812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2660/5322] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:48.465786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:48.572582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace1a15-873d-48c4-bdad-9c46f464887f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:48.588416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:48.589278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:48.589431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:48.589732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:48.590351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:48.592317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:48.675844 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2663/5323] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:48 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:27:48.680458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b112c2-4571-4848-8233-1c13ac103847 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:48.708448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b112c2-4571-4848-8233-1c13ac103847 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:48.730684 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:48.820885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:48.824369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:48.824369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:48.824369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:48.824984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:48.828995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:48.873501 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2661/5324] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:48 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:48.878075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:48.894885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5affb-6ae7-42fe-a14b-4046b5a4e41a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:48.909511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:48.910158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:48.910434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:48.910705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:48.911472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:48.915419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:48.947752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:48.948727 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2664/5325] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:48.967653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1370-28d2-4ead-b721-ad1badaca7a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:48.985757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:48.987235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:48.987743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:48.988188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] PATH_INFO: `/v3/projects/12ed138ce27e4020bb3b3096f252c52b/users/97c296efed3b4e68abe31d14ccebb625/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:49.034094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ed138ce27e4020bb3b3096f252c52b, user_id=97c296efed3b4e68abe31d14ccebb625, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:49.039315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:49.071553 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2662/5326] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:48 2022] PUT /identity/v3/projects/12ed138ce27e4020bb3b3096f252c52b/users/97c296efed3b4e68abe31d14ccebb625/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:49.074633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:49.110802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b73b52-32b9-4c4b-93c9-cfcde508bf44 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:49.263061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5673600-14d1-4e44-9b45-32b4e2867190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:49.263819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5673600-14d1-4e44-9b45-32b4e2867190 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:49.264102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5673600-14d1-4e44-9b45-32b4e2867190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:49.264377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5673600-14d1-4e44-9b45-32b4e2867190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:49.265060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5673600-14d1-4e44-9b45-32b4e2867190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:49.268223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5673600-14d1-4e44-9b45-32b4e2867190 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:49.304267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2665/5327] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:49.305675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:49.329608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6162cb-00be-496b-9ba7-19d05b67d2af admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:49.348297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:49.348604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:49.348867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:49.349142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] PATH_INFO: `/v3/projects/12ed138ce27e4020bb3b3096f252c52b/users/97c296efed3b4e68abe31d14ccebb625/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:49.353733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ed138ce27e4020bb3b3096f252c52b, user_id=97c296efed3b4e68abe31d14ccebb625, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:49.357488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:49.390482 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2663/5328] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:49 2022] PUT /identity/v3/projects/12ed138ce27e4020bb3b3096f252c52b/users/97c296efed3b4e68abe31d14ccebb625/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:49.392352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188998f-f60e-4d33-b194-912fa9f73a0a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:49.392743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188998f-f60e-4d33-b194-912fa9f73a0a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:49.393149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188998f-f60e-4d33-b194-912fa9f73a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:49.444229 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:49.453621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f188998f-f60e-4d33-b194-912fa9f73a0a None None] MFA Rules not processed for user `97c296efed3b4e68abe31d14ccebb625`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:49.455732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f188998f-f60e-4d33-b194-912fa9f73a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:49.610412 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2666/5329] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:49.613169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:49.677208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99c4e-5403-434e-ba91-c603dd2881c8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:49.701165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:49.701815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:49.702102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:49.702378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:49.703057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:49.704695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:49.777300 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2664/5330] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:49 2022] POST /identity/v3/services => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:49.783951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188998f-f60e-4d33-b194-912fa9f73a0a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:49.810020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188998f-f60e-4d33-b194-912fa9f73a0a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:49.895446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:49.896089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:49.896366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:49.896650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:49.898062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:49.899978 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:49.899978 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:27:49.899978 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:27:49.901519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:49.928884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2667/5331] 10.222.0.46 () {60 vars in 1213 bytes} [Sun Aug 21 01:27:49 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:49.934341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:49.956680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cb072-de44-42f4-a48e-a78031834b32 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:49.964570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:49.965234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:49.965525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:49.965802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:49.966481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:49.970384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.002702 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2665/5332] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:49 2022] POST /identity/v3/services => generated 290 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:50.007298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.024273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee61af-ff58-4129-b743-fdd43071f0ff tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.107848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.110276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.113225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.113741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.116063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.125317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.154011 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2668/5333] 10.222.0.46 () {60 vars in 1213 bytes} [Sun Aug 21 01:27:50 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:50.160056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.196037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91294b2d-a56f-43ff-9728-7d34aa7f9d43 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.209451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.210998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.211463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.212184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.213009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.218334 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:50.218334 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:27:50.218334 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:27:50.219926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.234524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.235907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2666/5334] 10.222.0.46 () {58 vars in 1191 bytes} [Sun Aug 21 01:27:50 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:50.251515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c28829-042e-41df-a14f-8aa4d7d87efa tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.263517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.264751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.265240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.265679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.266437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=4db465739c614d0c9b4e80128ed0ba94)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.267713 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:50.267713 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:27:50.267713 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:27:50.274951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.296457 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2669/5335] 10.222.0.46 () {58 vars in 1290 bytes} [Sun Aug 21 01:27:50 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94 => generated 332 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:50.298027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.313347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777415-c704-4fe1-acf7-eacb8eddee81 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.329074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.330050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.330561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.331195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.331949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=4db465739c614d0c9b4e80128ed0ba94)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.333907 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:50.333907 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:27:50.333907 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:27:50.335827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.362111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.363967 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2667/5336] 10.222.0.46 () {58 vars in 1291 bytes} [Sun Aug 21 01:27:50 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 21 01:27:50.379085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30063b-d4e5-4be0-b9ca-740373f96e83 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.391537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.392494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.392960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.393570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.394343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=4db465739c614d0c9b4e80128ed0ba94)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.395555 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:50.395555 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:27:50.395555 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:27:50.402715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.431194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.432022 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2670/5337] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:27:50 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:50.442083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087603-d61a-4048-bd94-608d49a2ae72 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.459112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.461020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.461020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.461020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.461696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.463258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.477485 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2668/5338] 10.222.0.46 () {58 vars in 1191 bytes} [Sun Aug 21 01:27:50 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:50.482092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.502197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032eb81-73ce-4ce0-85ab-817cab313c8e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.513491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.514184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.514474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.514747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.515347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=4db465739c614d0c9b4e80128ed0ba94)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.517024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Could not find Endpoint Group: 4db465739c614d0c9b4e80128ed0ba94.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 4db465739c614d0c9b4e80128ed0ba94. Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 21 01:27:50.555369 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 21 01:27:50.556954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 21 01:27:50.556954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 21 01:27:50.556954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 21 01:27:50.556954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 21 01:27:50.556954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 4db465739c614d0c9b4e80128ed0ba94. Aug 21 01:27:50.556954 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:27:50.560173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2671/5339] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:27:50 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/4db465739c614d0c9b4e80128ed0ba94 => generated 120 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:27:50.564438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.580469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3681-e410-4f87-a08f-900084a73a1e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.597098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.597775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.598046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.598319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services/028565e84c564543858ba65ab747512a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.599112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_service(service_id=028565e84c564543858ba65ab747512a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.601058 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:50.601058 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:27:50.601058 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:27:50.602330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.674963 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2669/5340] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:50 2022] DELETE /identity/v3/services/028565e84c564543858ba65ab747512a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:50.677685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.706782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da9a04-faf2-4cbf-84ea-0d5c3b9c53b0 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.747586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.751386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.751823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.752224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.753880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.756161 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:50.756161 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:27:50.756161 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:27:50.760207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.801624 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2672/5341] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:50 2022] POST /identity/v3/services => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:50.804664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.848484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1422b-43bb-40c3-8c8e-ed429a046475 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.899826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.901119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.901552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.901951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.902823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.904393 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:50.904393 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:27:50.904393 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:27:50.905694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:50.923230 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2670/5342] 10.222.0.46 () {60 vars in 1213 bytes} [Sun Aug 21 01:27:50 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:50.927224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:50.956569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0024c9-6d57-4fd8-8bd6-383fe62489b9 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:50.974221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:50.975448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:50.975950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:50.976560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:50.977402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:50.979184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:51.002461 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2673/5343] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:50 2022] POST /identity/v3/services => generated 288 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:27:51.007145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:51.019829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60da26c-ec56-400a-ba3e-c90f83787a53 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:51.061265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:51.064633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:51.065229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:51.065619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0053fdb94a604e078c8b44841d91f614` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:51.066411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=0053fdb94a604e078c8b44841d91f614)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:51.070696 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:51.070696 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:27:51.070696 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:27:51.072811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:51.099436 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2671/5344] 10.222.0.46 () {60 vars in 1313 bytes} [Sun Aug 21 01:27:51 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/0053fdb94a604e078c8b44841d91f614 => generated 334 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:51.102040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:51.121208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261d37-2b8b-4dcb-9134-981edd7be66b tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:51.127307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:51.127777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:51.128152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:51.128567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services/e14105e91b434007b46b39a515d73b31` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:51.129844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e14105e91b434007b46b39a515d73b31)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:51.132648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:51.175433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2674/5345] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:51 2022] DELETE /identity/v3/services/e14105e91b434007b46b39a515d73b31 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:51.178634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:51.192855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e79a1-8d46-4324-b30a-ac8020d10e65 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:51.238119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:51.239155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:51.239652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:51.240153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0053fdb94a604e078c8b44841d91f614` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:51.241258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0053fdb94a604e078c8b44841d91f614)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:51.242506 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:27:51.242506 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:27:51.242506 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:27:51.243866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:51.245646 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:INSERT=8,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:51.277370 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2672/5346] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:27:51 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0053fdb94a604e078c8b44841d91f614 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:51.282207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:51.311280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7826a-ad22-42c6-b039-c668b3a3cd1c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:51.330866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:51.331578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:51.332066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:51.332364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services/60694a7900d84cfa952649378d54ff78` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:51.333013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_service(service_id=60694a7900d84cfa952649378d54ff78)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:51.338458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:51.460601 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2675/5347] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:51 2022] DELETE /identity/v3/services/60694a7900d84cfa952649378d54ff78 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:51.467713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:51.496035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfb772-5462-4ff8-9ed1-8028369fe3ac tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:51.530658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:51.537875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:51.538518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:51.538518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/280e255de4614d0bb0f1a00311f903ac` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:51.539134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=280e255de4614d0bb0f1a00311f903ac)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:51.558367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:51.606883 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2673/5348] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:27:51 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/280e255de4614d0bb0f1a00311f903ac => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:51.608344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:51.637889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92d6f9-9717-4b8a-a3be-e995eb1d276e tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:51.665862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d2909-e911-4fcc-894f-2a5614e9c6e2 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c296efed3b4e68abe31d14ccebb625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ed138ce27e4020bb3b3096f252c52b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:51.666562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2909-e911-4fcc-894f-2a5614e9c6e2 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:51.669138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2909-e911-4fcc-894f-2a5614e9c6e2 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:51.669460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2909-e911-4fcc-894f-2a5614e9c6e2 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] PATH_INFO: `/v3/services/7d6484963460464aafbec179e69c2f0d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:51.670112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d2909-e911-4fcc-894f-2a5614e9c6e2 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7d6484963460464aafbec179e69c2f0d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:51.676047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d2909-e911-4fcc-894f-2a5614e9c6e2 tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:51.689558 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:51.766285 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2676/5349] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:51 2022] DELETE /identity/v3/services/7d6484963460464aafbec179e69c2f0d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:51.770542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:51.993644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f75f1-619e-4897-b5e4-41f002d2f11c tempest-EndPointGroupsTest-1677064373 tempest-EndPointGroupsTest-1677064373-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:52.044141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:52.045289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:52.045741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:52.049643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] PATH_INFO: `/v3/users/63489d6166e44cb7bdb3b279c89a45a4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:52.051939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63489d6166e44cb7bdb3b279c89a45a4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:52.057712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:52.206915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63489d6166e44cb7bdb3b279c89a45a4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:52.241784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63489d6166e44cb7bdb3b279c89a45a4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:52.242425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63489d6166e44cb7bdb3b279c89a45a4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:52.263768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63489d6166e44cb7bdb3b279c89a45a4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:52.267796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63489d6166e44cb7bdb3b279c89a45a4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:52.313207 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2674/5350] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:51 2022] DELETE /identity/v3/users/63489d6166e44cb7bdb3b279c89a45a4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:52.315298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43620a4e-3053-47f4-a1bc-bb1cf6069b3a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:52.315739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43620a4e-3053-47f4-a1bc-bb1cf6069b3a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:52.315911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43620a4e-3053-47f4-a1bc-bb1cf6069b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:52.347280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-43620a4e-3053-47f4-a1bc-bb1cf6069b3a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:52.348877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-43620a4e-3053-47f4-a1bc-bb1cf6069b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:52.439858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2677/5351] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:52.532292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:52.533814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:52.629726 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:52.696749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30565783-ceac-4d12-a86b-00bd45676f85 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:52.705819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9a341-fde3-446e-8685-2a22a6df27d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:52.706325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9a341-fde3-446e-8685-2a22a6df27d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:52.706783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9a341-fde3-446e-8685-2a22a6df27d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:52.707210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9a341-fde3-446e-8685-2a22a6df27d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:52.727652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9a341-fde3-446e-8685-2a22a6df27d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:52.729515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9a341-fde3-446e-8685-2a22a6df27d7 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:52.752332 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2675/5352] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:53.553529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:53.554334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:53.554480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:53.593291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] MFA Rules not processed for user `bd0447e656f9418da68b308f19e8e807`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:53.594527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:53.761453 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2678/5353] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:53.773176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:53.773723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:53.773723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:53.841403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] MFA Rules not processed for user `bd0447e656f9418da68b308f19e8e807`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:53.842642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:53.867399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2676/5354] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:54.124481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:54.125984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:54.276716 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:54.280445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26466c5e-3312-4af1-92a2-2398737f8dd0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:54.287945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:54.289301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:54.290026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:54.290701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:54.304800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:54.307322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:54.321341 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2679/5355] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:27:55.143263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:55.146316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:55.183424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa2ae4-bea0-4291-a7b7-ba8e7508beb5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:55.188614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:55.189597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:55.190150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:55.190597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] PATH_INFO: `/v3/projects/2de52f74746b40b2a1d0f256e39f9e98` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:55.192323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de52f74746b40b2a1d0f256e39f9e98)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:55.226291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:55.316681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de52f74746b40b2a1d0f256e39f9e98', 'request_id': 'req-16936c73-8edb-4371-82d3-53ef5641422b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.329040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de52f74746b40b2a1d0f256e39f9e98', 'request_id': 'req-16936c73-8edb-4371-82d3-53ef5641422b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.345306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de52f74746b40b2a1d0f256e39f9e98', 'request_id': 'req-16936c73-8edb-4371-82d3-53ef5641422b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.361289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] The token cache is being invalidate because project 2de52f74746b40b2a1d0f256e39f9e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:55.361486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.362171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16936c73-8edb-4371-82d3-53ef5641422b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.367795 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2677/5356] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:55 2022] DELETE /identity/v3/projects/2de52f74746b40b2a1d0f256e39f9e98 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:55.371792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:55.392887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd356-7624-4d01-ac94-be5fffe49ea7 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:55.521842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:55.522650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:55.522997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:55.523280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] PATH_INFO: `/v3/users/97c296efed3b4e68abe31d14ccebb625` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:55.525161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c296efed3b4e68abe31d14ccebb625)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:55.529297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:55.628222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c296efed3b4e68abe31d14ccebb625'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.645443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c296efed3b4e68abe31d14ccebb625'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.684087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c296efed3b4e68abe31d14ccebb625'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.684985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c296efed3b4e68abe31d14ccebb625'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.710818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c296efed3b4e68abe31d14ccebb625'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:55.725187 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2680/5357] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:27:55 2022] DELETE /identity/v3/users/97c296efed3b4e68abe31d14ccebb625 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:55.948020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef2627-325e-4fdf-b874-31005da376bc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:55.948626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef2627-325e-4fdf-b874-31005da376bc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:55.949697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef2627-325e-4fdf-b874-31005da376bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:55.994798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2cef2627-325e-4fdf-b874-31005da376bc None None] MFA Rules not processed for user `bd0447e656f9418da68b308f19e8e807`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:55.998904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2cef2627-325e-4fdf-b874-31005da376bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:56.206436 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2678/5358] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:57.133034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:57.134866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:57.291148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0797-a02f-4456-b515-d0552eaa7898 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:57.305048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650238f-c4d7-4d38-89a7-fb5ed8c349ff None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:57.306479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650238f-c4d7-4d38-89a7-fb5ed8c349ff None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:57.306956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650238f-c4d7-4d38-89a7-fb5ed8c349ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:57.307393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:57.308188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:57.308568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:57.308978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] PATH_INFO: `/v3/projects/12ed138ce27e4020bb3b3096f252c52b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:57.310231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ed138ce27e4020bb3b3096f252c52b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:57.312513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:57.361691 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:57.367938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6650238f-c4d7-4d38-89a7-fb5ed8c349ff None None] MFA Rules not processed for user `400e677f335446c0817c32b85e1e24b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:57.378344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6650238f-c4d7-4d38-89a7-fb5ed8c349ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:57.494622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ed138ce27e4020bb3b3096f252c52b', 'request_id': 'req-5d6460e2-15c7-434e-884c-83114f1f1a12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:57.499530 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:57.512738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ed138ce27e4020bb3b3096f252c52b', 'request_id': 'req-5d6460e2-15c7-434e-884c-83114f1f1a12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:57.528282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ed138ce27e4020bb3b3096f252c52b', 'request_id': 'req-5d6460e2-15c7-434e-884c-83114f1f1a12'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:57.566052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] The token cache is being invalidate because project 12ed138ce27e4020bb3b3096f252c52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:27:57.566430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:57.570901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d6460e2-15c7-434e-884c-83114f1f1a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:27:57.577777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2681/5359] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:27:57 2022] DELETE /identity/v3/projects/12ed138ce27e4020bb3b3096f252c52b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:27:57.583036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e63c-accf-493c-9464-c497572920a2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:57.586171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e63c-accf-493c-9464-c497572920a2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:57.587913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e63c-accf-493c-9464-c497572920a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:57.662499 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2679/5360] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:27:57.706396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eb47e63c-accf-493c-9464-c497572920a2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:57.707856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb47e63c-accf-493c-9464-c497572920a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:57.778541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15fdc-2089-4039-a2c3-b395cf6581d7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:57.778829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15fdc-2089-4039-a2c3-b395cf6581d7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:57.779112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15fdc-2089-4039-a2c3-b395cf6581d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:57.865583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-30a15fdc-2089-4039-a2c3-b395cf6581d7 None None] MFA Rules not processed for user `400e677f335446c0817c32b85e1e24b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:57.875305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30a15fdc-2089-4039-a2c3-b395cf6581d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:57.983204 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2682/5361] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:57.988340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b8d5-acdd-4579-a729-14186af49326 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:57.988671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b8d5-acdd-4579-a729-14186af49326 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:57.988965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b8d5-acdd-4579-a729-14186af49326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:58.092483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ee89b8d5-acdd-4579-a729-14186af49326 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:58.094307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ee89b8d5-acdd-4579-a729-14186af49326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:58.159794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2683/5362] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:58.162276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b8d5-acdd-4579-a729-14186af49326 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:58.207583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b8d5-acdd-4579-a729-14186af49326 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:58.228225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:58.228892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:58.229182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:58.229446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:58.230114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:27:58.230418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:58.232018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:58.244499 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2680/5363] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:27:58.296384 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2684/5364] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:27:58.307119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15fdc-2089-4039-a2c3-b395cf6581d7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:58.333314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15fdc-2089-4039-a2c3-b395cf6581d7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:58.385372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:58.386315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:58.386739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:58.387194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:58.389601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:58.394730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:58.474011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:58.475180 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2681/5365] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:58 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:58.493109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a393-1bbe-4591-9440-f93bf72fcaab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:58.690141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:58.693540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:58.693834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:58.694183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:58.694752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:58.696701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:58.782089 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2685/5366] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:58 2022] POST /identity/v3/users => generated 288 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:27:58.783784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:58.809064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beb4c1-4bd8-43c4-acef-eec6dfea19e5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:58.821168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:58.830378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:58.831560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:58.832693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:58.834388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:58.838555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:58.893528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2682/5367] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:58.895110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:58.921390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c157e4-3ac2-4ca7-aefc-98264603465f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:58.943512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b43f-a537-42d7-882a-767038f44b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:58.945180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b43f-a537-42d7-882a-767038f44b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:58.945696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b43f-a537-42d7-882a-767038f44b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:58.947356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b43f-a537-42d7-882a-767038f44b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:58.948202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520b43f-a537-42d7-882a-767038f44b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:58.951453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520b43f-a537-42d7-882a-767038f44b01 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:58.968140 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:58.985852 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2686/5368] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:27:58.990025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:59.012351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc11c-4e67-4941-9cb2-0fbd4e00b9ef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:59.020875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:59.022053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:59.022708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:59.023213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] PATH_INFO: `/v3/projects/c2324adca2e944db878739f374be4954/users/e92e5f4c53aa43e3aad51bfb135fb393/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:59.085251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2324adca2e944db878739f374be4954, user_id=e92e5f4c53aa43e3aad51bfb135fb393, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:59.104887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:59.146748 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2683/5369] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:27:58 2022] PUT /identity/v3/projects/c2324adca2e944db878739f374be4954/users/e92e5f4c53aa43e3aad51bfb135fb393/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:27:59.157182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:59.157521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:59.157705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:59.237867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] MFA Rules not processed for user `e92e5f4c53aa43e3aad51bfb135fb393`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:27:59.239861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:59.500048 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2687/5370] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:27:59.501882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:59.534711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:59.536228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:27:59.673810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b498a-471d-432d-a3fc-7af4b7ce8d5a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:59.691211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:59.692083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:59.696634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:59.697293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:59.697998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:59.699947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:59.701901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad985849-9c74-4e40-abcf-1412e753a3f0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:27:59.720324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:27:59.721009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:27:59.721267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:27:59.721531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:27:59.822134 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2684/5371] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:27:59 2022] POST /identity/v3/projects => generated 375 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:27:59.826552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:27:59.916239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:27:59.918109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:27:59.948168 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:00.005196 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2688/5372] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:27:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:00.253830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139d43-82e4-41f3-9736-77f1840d50d2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:00.272673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:00.273782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:00.274226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:00.274660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:00.275448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:00.277587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:00.388118 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2685/5373] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:27:59 2022] POST /identity/v3/users => generated 294 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:00.389162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:00.413628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2a8c-1244-4f07-9816-27ab56306fc2 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:00.442128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:00.442766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:00.443077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:00.443402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:00.478644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:00.487332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:00.528583 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2689/5374] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:00.532829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:00.560677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae275d-92ed-4ce4-8e42-84e7e9cddcb5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:00.584003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:00.588727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:00.589127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:00.589474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] PATH_INFO: `/v3/projects/42a789eff5f642d397b503ae3dfbd23a/users/cc51b3ac80b7449092f47032064363f6/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:00.626112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a789eff5f642d397b503ae3dfbd23a, user_id=cc51b3ac80b7449092f47032064363f6, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:00.636060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:00.675376 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2686/5375] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:00 2022] PUT /identity/v3/projects/42a789eff5f642d397b503ae3dfbd23a/users/cc51b3ac80b7449092f47032064363f6/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:28:00.681861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:00.718971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea27c0-71e1-415c-8032-97c4f563ce42 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:00.790179 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:00.964496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47ea6-9d99-4d71-a40e-a7572beac48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:00.965247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47ea6-9d99-4d71-a40e-a7572beac48d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:00.985223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47ea6-9d99-4d71-a40e-a7572beac48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:00.985653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47ea6-9d99-4d71-a40e-a7572beac48d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:00.986455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47ea6-9d99-4d71-a40e-a7572beac48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:00.988211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47ea6-9d99-4d71-a40e-a7572beac48d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:01.026308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:01.026935 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2690/5376] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:01.060524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b8924-701d-4cab-8f36-0c296576a4be admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:01.087995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:01.088903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:01.089898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:01.091070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] PATH_INFO: `/v3/projects/42a789eff5f642d397b503ae3dfbd23a/users/cc51b3ac80b7449092f47032064363f6/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:01.099890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a789eff5f642d397b503ae3dfbd23a, user_id=cc51b3ac80b7449092f47032064363f6, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:01.110163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:01.152088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2687/5377] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:01 2022] PUT /identity/v3/projects/42a789eff5f642d397b503ae3dfbd23a/users/cc51b3ac80b7449092f47032064363f6/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:28:01.163933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c8f6f-a97f-44f8-95c9-b91e7e7efbf6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:01.164351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c8f6f-a97f-44f8-95c9-b91e7e7efbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:01.164628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c8f6f-a97f-44f8-95c9-b91e7e7efbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:01.321605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-745c8f6f-a97f-44f8-95c9-b91e7e7efbf6 None None] MFA Rules not processed for user `cc51b3ac80b7449092f47032064363f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:01.325603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-745c8f6f-a97f-44f8-95c9-b91e7e7efbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:01.722205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2691/5378] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:01.729135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:01.777339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014aac9-d7db-4eec-9db3-39a88762c00b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:01.789699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:01.790627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:01.791068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:01.791483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:01.792262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:01.793472 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:01.793472 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:28:01.793472 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:28:01.794690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:01.827543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2688/5379] 10.222.0.46 () {60 vars in 1185 bytes} [Sun Aug 21 01:28:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:01.831389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c8f6f-a97f-44f8-95c9-b91e7e7efbf6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:01.841814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c8f6f-a97f-44f8-95c9-b91e7e7efbf6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:01.869740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:01.871418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:01.879722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:01.881108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/713d4fb05f354d1f8f630848e569afc7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:01.882234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=713d4fb05f354d1f8f630848e569afc7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:01.885823 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:01.885823 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:28:01.885823 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:28:01.887014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:01.933975 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2692/5380] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:28:01 2022] GET /identity/v3/OS-OAUTH1/consumers/713d4fb05f354d1f8f630848e569afc7 => generated 220 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:01.950146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:01.974064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03040c5b-2acc-4c92-8f50-b0afcc7ea2d4 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:02.010869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:02.011549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:02.011835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:02.012113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/713d4fb05f354d1f8f630848e569afc7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:02.024435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=713d4fb05f354d1f8f630848e569afc7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:02.025350 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:02.025350 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:28:02.025350 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:28:02.026721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:02.030538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invalidating token cache because consumer 713d4fb05f354d1f8f630848e569afc7 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:02.031126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.036096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.166685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '713d4fb05f354d1f8f630848e569afc7', 'request_id': 'req-8a051509-8d00-4724-890b-a833e408698f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.213217 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2689/5381] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:28:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/713d4fb05f354d1f8f630848e569afc7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:28:02.217754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:02.219863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:02.244037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25ee4-c1c5-4db2-a753-7fde59b308af tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:02.265813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:02.266719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:02.268949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:02.269708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:02.273317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:02.274867 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:02.274867 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:28:02.274867 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:28:02.277448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:02.337111 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2693/5382] 10.222.0.46 () {60 vars in 1185 bytes} [Sun Aug 21 01:28:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:02.342314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:02.362657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051509-8d00-4724-890b-a833e408698f tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:02.379256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:02.383604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:02.385923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:02.389419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:02.390076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=dee093fa15934ee1b2de847c090e7421)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:02.391447 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:02.391447 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:28:02.391447 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:28:02.397662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:02.439403 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2690/5383] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:28:02 2022] GET /identity/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421 => generated 221 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:02.446830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:02.468186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d9422-7edc-4ce8-9e60-6c091578738a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:02.481546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:02.484045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:02.485986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:02.486561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:02.487427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=dee093fa15934ee1b2de847c090e7421)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:02.489767 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:02.489767 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:28:02.489767 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:28:02.493310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:02.494843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invalidating token cache because consumer dee093fa15934ee1b2de847c090e7421 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:02.496570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.498576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.548183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'dee093fa15934ee1b2de847c090e7421', 'request_id': 'req-e5a6de70-625b-4df7-a6b0-9dac24d7b761'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.592552 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2694/5384] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:28:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:02.596575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:02.598668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:02.648973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bf62-1696-452a-afde-4480836c2e00 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:02.683971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:02.685234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:02.685939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:02.686547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:02.687287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=dee093fa15934ee1b2de847c090e7421)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:02.700791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 21 01:28:02.740107 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 21 01:28:02.741944 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:28:02.748384 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2691/5385] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:28:02 2022] GET /identity/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421 => generated 74 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 01:28:02.751312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:02.798500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6de70-625b-4df7-a6b0-9dac24d7b761 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:02.821035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:02.822433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:02.823489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:02.824044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:02.825335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=dee093fa15934ee1b2de847c090e7421)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:02.827761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:02.828265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invalidating token cache because consumer dee093fa15934ee1b2de847c090e7421 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:02.828806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.831460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 21 01:28:02.900797 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 21 01:28:02.901824 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:28:02.908926 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2695/5386] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:28:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/dee093fa15934ee1b2de847c090e7421 => generated 74 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 01:28:02.927842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:02.931027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:03.009424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc9936-e1d9-4ae3-923c-dc5a9959c1da tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.029922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.033233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.035823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.036121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.041846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.052305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:03.094974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2692/5387] 10.222.0.46 () {60 vars in 1185 bytes} [Sun Aug 21 01:28:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:03.100711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:03.119546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510eed-b5ef-4b96-9837-43e0d49e1936 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.171850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.172484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.172777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.173091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.174623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.178376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:03.221200 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2696/5388] 10.222.0.46 () {60 vars in 1185 bytes} [Sun Aug 21 01:28:03 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:03.225603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:03.244466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f986c-561b-443d-bf2f-9ec8da104e4c tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.254364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.255024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.259670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.259956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.264320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.272288 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:03.272288 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:28:03.272288 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:28:03.278205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:03.307880 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2693/5389] 10.222.0.46 () {58 vars in 1164 bytes} [Sun Aug 21 01:28:03 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:28:03.312150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:03.329470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502abb-ac64-466c-bc8e-f150362dc643 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.348853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.353101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.353900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.354756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6b1f329634a04684a23e350863f6bf09` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.355841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=6b1f329634a04684a23e350863f6bf09)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.362764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:03.363693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invalidating token cache because consumer 6b1f329634a04684a23e350863f6bf09 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:03.364333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:03.369967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:03.403675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '6b1f329634a04684a23e350863f6bf09', 'request_id': 'req-2fffe9bf-f52a-40f3-a46c-42b1f628d501'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:03.408758 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:03.440356 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2697/5390] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:28:03 2022] DELETE /identity/v3/OS-OAUTH1/consumers/6b1f329634a04684a23e350863f6bf09 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:28:03.442198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:03.444205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:03.484921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac7a02-929b-48e0-9861-5278f277e51d tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.516252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.516252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.520834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.521111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7dcc0f229c9f439493de697f71394123` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.526765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=7dcc0f229c9f439493de697f71394123)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.536715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:03.538105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invalidating token cache because consumer 7dcc0f229c9f439493de697f71394123 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:03.543293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:03.545035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:03.612633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '7dcc0f229c9f439493de697f71394123', 'request_id': 'req-7807c1a0-0523-4d99-b448-61069153b655'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:03.675025 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2694/5391] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:28:03 2022] DELETE /identity/v3/OS-OAUTH1/consumers/7dcc0f229c9f439493de697f71394123 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:03.684375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:03.703154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe9bf-f52a-40f3-a46c-42b1f628d501 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.724688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.728911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.731447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.731757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.740884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.747148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:03.805295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:03.806527 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2698/5392] 10.222.0.46 () {60 vars in 1185 bytes} [Sun Aug 21 01:28:03 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:03.808741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:03.842344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807c1a0-0523-4d99-b448-61069153b655 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.869616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.870596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.870947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.871285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/06db547559e5492c91d4657c2edaaa74` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.872130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=06db547559e5492c91d4657c2edaaa74)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.873195 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:28:03.873195 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:28:03.873195 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:28:03.878026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:03.951715 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2695/5393] 10.222.0.46 () {60 vars in 1285 bytes} [Sun Aug 21 01:28:03 2022] PATCH /identity/v3/OS-OAUTH1/consumers/06db547559e5492c91d4657c2edaaa74 => generated 220 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:28:03.957679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:03.975635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8c33f-3cc3-4467-80fd-4024c3700f7b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:03.986634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:03.988501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:03.988894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:03.989178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/06db547559e5492c91d4657c2edaaa74` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:03.991438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=06db547559e5492c91d4657c2edaaa74)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:03.998001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:04.016334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:04.023411 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:INSERT=9,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:04.023850 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2699/5394] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:28:03 2022] GET /identity/v3/OS-OAUTH1/consumers/06db547559e5492c91d4657c2edaaa74 => generated 220 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:04.033953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ffc40-2301-4ff5-89fd-8fdb6887ed80 tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:04.042456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc51b3ac80b7449092f47032064363f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a789eff5f642d397b503ae3dfbd23a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:04.044267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:04.044981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:04.045759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/06db547559e5492c91d4657c2edaaa74` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:04.047029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=06db547559e5492c91d4657c2edaaa74)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:04.049635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:04.050116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invalidating token cache because consumer 06db547559e5492c91d4657c2edaaa74 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:04.050631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.051766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.072809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d7daacfb-8e26-4ee6-96d7-a06f2126438a tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '06db547559e5492c91d4657c2edaaa74', 'request_id': 'req-d7daacfb-8e26-4ee6-96d7-a06f2126438a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.116116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:04.119335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:04.129211 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2696/5395] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:28:04 2022] DELETE /identity/v3/OS-OAUTH1/consumers/06db547559e5492c91d4657c2edaaa74 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:04.273460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39828f-515a-44cd-a105-5685eabee73b tempest-OAUTHConsumersV3Test-280129288 tempest-OAUTHConsumersV3Test-280129288-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:04.278790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:04.279463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:04.279744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:04.280099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] PATH_INFO: `/v3/users/e92e5f4c53aa43e3aad51bfb135fb393` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:04.281480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92e5f4c53aa43e3aad51bfb135fb393)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:04.283973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:04.378181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92e5f4c53aa43e3aad51bfb135fb393'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.396235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92e5f4c53aa43e3aad51bfb135fb393'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.483882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92e5f4c53aa43e3aad51bfb135fb393'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.489336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92e5f4c53aa43e3aad51bfb135fb393'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.507589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92e5f4c53aa43e3aad51bfb135fb393'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:04.529244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2700/5396] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:04 2022] DELETE /identity/v3/users/e92e5f4c53aa43e3aad51bfb135fb393 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:04.533786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:04.534139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:04.534511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:04.574352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:04.578200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:04.730319 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2697/5397] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:04.748117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:04.750160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:04.929304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6811-5fd0-483a-8b16-c3d3196c2b55 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:04.939302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:04.941711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:04.942962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:04.944012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:04.953956 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:04.959833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:04.964486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:05.003852 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2701/5398] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:06.894016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:06.896105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:06.928224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f66f6-6fb8-4b0c-8dce-d2ad84176482 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:06.953300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:06.953988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:06.954266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:06.954540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] PATH_INFO: `/v3/projects/c2324adca2e944db878739f374be4954` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:06.956522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2324adca2e944db878739f374be4954)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:06.958510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:07.070907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2324adca2e944db878739f374be4954', 'request_id': 'req-43c99ddf-e97b-444f-8c9d-1342f67b35fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.089064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2324adca2e944db878739f374be4954', 'request_id': 'req-43c99ddf-e97b-444f-8c9d-1342f67b35fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.100124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2324adca2e944db878739f374be4954', 'request_id': 'req-43c99ddf-e97b-444f-8c9d-1342f67b35fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.142378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] The token cache is being invalidate because project c2324adca2e944db878739f374be4954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:07.142678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.143466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43c99ddf-e97b-444f-8c9d-1342f67b35fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.145287 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2698/5399] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:06 2022] DELETE /identity/v3/projects/c2324adca2e944db878739f374be4954 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:07.149515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:07.165469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19634-efeb-4993-9815-dbb0dbbb7bbe service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:07.277592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:07.278251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:07.278530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:07.278805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] PATH_INFO: `/v3/users/cc51b3ac80b7449092f47032064363f6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:07.281219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc51b3ac80b7449092f47032064363f6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:07.285491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:07.425023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc51b3ac80b7449092f47032064363f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.433015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc51b3ac80b7449092f47032064363f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.462263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc51b3ac80b7449092f47032064363f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.466104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc51b3ac80b7449092f47032064363f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.481895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc51b3ac80b7449092f47032064363f6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:07.491414 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2702/5400] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:07 2022] DELETE /identity/v3/users/cc51b3ac80b7449092f47032064363f6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:28:07.663840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f986-aea0-4881-82c5-f3314ec9eb6e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:07.664163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f986-aea0-4881-82c5-f3314ec9eb6e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:07.665662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f986-aea0-4881-82c5-f3314ec9eb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:07.940962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a5a6f986-aea0-4881-82c5-f3314ec9eb6e None None] MFA Rules not processed for user `d35661d01cfb4f8d90ea78c7c7ead1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:07.942425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a5a6f986-aea0-4881-82c5-f3314ec9eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:08.108691 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:08.157511 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2699/5401] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:08.319881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:08.321537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:08.524336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58f949-950e-4926-801a-aa7168cf4635 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:08.534528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:08.535636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:08.535932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:08.536192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] PATH_INFO: `/v3/projects/42a789eff5f642d397b503ae3dfbd23a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:08.538989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a789eff5f642d397b503ae3dfbd23a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:08.541645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:08.588830 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:08.673274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a789eff5f642d397b503ae3dfbd23a', 'request_id': 'req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:08.682055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a789eff5f642d397b503ae3dfbd23a', 'request_id': 'req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:08.691140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a789eff5f642d397b503ae3dfbd23a', 'request_id': 'req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:08.712245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] The token cache is being invalidate because project 42a789eff5f642d397b503ae3dfbd23a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:08.712573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:08.713388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8e70ea93-aa4b-4be6-84b0-ad19bad49eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:08.715477 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2703/5402] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:08 2022] DELETE /identity/v3/projects/42a789eff5f642d397b503ae3dfbd23a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:08.724596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556bde-ace2-4f4d-a930-1b56a6b32c6c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:08.725605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556bde-ace2-4f4d-a930-1b56a6b32c6c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:08.725605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556bde-ace2-4f4d-a930-1b56a6b32c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:08.767481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5b556bde-ace2-4f4d-a930-1b56a6b32c6c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:08.770151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b556bde-ace2-4f4d-a930-1b56a6b32c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:08.915516 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2700/5403] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:08.916822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73025-ff18-4f6b-9df0-f90402180b2f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:08.917113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73025-ff18-4f6b-9df0-f90402180b2f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:08.917387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73025-ff18-4f6b-9df0-f90402180b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:08.964565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a4c73025-ff18-4f6b-9df0-f90402180b2f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:08.971025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a4c73025-ff18-4f6b-9df0-f90402180b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:08.996225 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2704/5404] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:08.998612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556bde-ace2-4f4d-a930-1b56a6b32c6c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:09.012886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556bde-ace2-4f4d-a930-1b56a6b32c6c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:09.018755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:09.019432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.019717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.020092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.020982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:28:09.022527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:09.024990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:09.050345 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2701/5405] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:09.053990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73025-ff18-4f6b-9df0-f90402180b2f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:09.078222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73025-ff18-4f6b-9df0-f90402180b2f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:09.090185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:09.090819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.091100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.091428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.092084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:09.094051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:09.157449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2705/5406] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:09 2022] POST /identity/v3/projects => generated 395 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:09.162919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:09.178103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181e4c4-6191-4632-a103-b8657380d7fc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:09.347071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:09.347947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.349158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.350252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.351990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:09.358449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:09.410100 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2702/5407] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:09 2022] POST /identity/v3/users => generated 304 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:09.413494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:09.432925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebf437-4785-48b5-95b3-0fdbf192a51e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:09.453376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:09.454041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.454317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.454589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.455251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:09.465585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:09.483420 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2706/5408] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:09.488414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:09.504857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c0e50-2200-4a9b-b2b2-3fcec2cee3a6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:09.510801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:09.511642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.512058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.513651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] PATH_INFO: `/v3/projects/795f0e91646949bbac479cbdc7513e49/users/3eff4d69788a46a8b73e36c4735c068f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.565660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=795f0e91646949bbac479cbdc7513e49, user_id=3eff4d69788a46a8b73e36c4735c068f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:09.572129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:09.617339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:09.624156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2703/5409] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:09 2022] PUT /identity/v3/projects/795f0e91646949bbac479cbdc7513e49/users/3eff4d69788a46a8b73e36c4735c068f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:09.631328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff4c8-f7ae-4760-a106-d060652df805 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:09.732879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94efb-4817-4799-be0c-989c029de31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:09.733856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94efb-4817-4799-be0c-989c029de31b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.734307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94efb-4817-4799-be0c-989c029de31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.734781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94efb-4817-4799-be0c-989c029de31b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.735598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f94efb-4817-4799-be0c-989c029de31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:09.737441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f94efb-4817-4799-be0c-989c029de31b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:09.763182 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2707/5410] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:09.767741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:09.803621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea6409-690f-452a-8ca2-e6076058a90e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:09.818362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:09.819511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.820150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.821720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] PATH_INFO: `/v3/projects/795f0e91646949bbac479cbdc7513e49/users/3eff4d69788a46a8b73e36c4735c068f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.828667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=795f0e91646949bbac479cbdc7513e49, user_id=3eff4d69788a46a8b73e36c4735c068f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:09.834943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:09.872912 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2704/5411] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:09 2022] PUT /identity/v3/projects/795f0e91646949bbac479cbdc7513e49/users/3eff4d69788a46a8b73e36c4735c068f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:09.883775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e18fc-d697-4fda-bbdd-67d480c58c59 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:09.884100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e18fc-d697-4fda-bbdd-67d480c58c59 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:09.884328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e18fc-d697-4fda-bbdd-67d480c58c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:09.941139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-659e18fc-d697-4fda-bbdd-67d480c58c59 None None] MFA Rules not processed for user `3eff4d69788a46a8b73e36c4735c068f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:09.942982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-659e18fc-d697-4fda-bbdd-67d480c58c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:10.051935 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:10.089508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2708/5412] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:10.091217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:10.146651 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:10.185180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221ab9-9e3e-4f97-900b-62e0ffbdd9eb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:10.191115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:10.191740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:10.192232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:10.192492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:10.193292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:10.195280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:10.239488 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2705/5413] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:10 2022] POST /identity/v3/projects => generated 397 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:10.243967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e18fc-d697-4fda-bbdd-67d480c58c59 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:10.259180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e18fc-d697-4fda-bbdd-67d480c58c59 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:10.374322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:10.376724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:10.377412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:10.378590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:10.381287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:10.386003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:10.450519 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2709/5414] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:10 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:28:10.454183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:10.481031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4603e-dbfa-4224-a529-a7e81716b0b0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:10.499956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:10.500599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:10.501721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:10.501944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:10.502616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:10.504989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:10.534566 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2706/5415] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:10.538539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:10.556312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24cebe-a92c-4810-bf82-70ddf1b09392 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:10.570555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d5cde-c2cb-4880-ae25-c7b0732e7d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:10.571199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5cde-c2cb-4880-ae25-c7b0732e7d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:10.571475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5cde-c2cb-4880-ae25-c7b0732e7d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:10.571746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5cde-c2cb-4880-ae25-c7b0732e7d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:10.572398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d5cde-c2cb-4880-ae25-c7b0732e7d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:10.574055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d5cde-c2cb-4880-ae25-c7b0732e7d1f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:10.605777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2710/5416] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:10.609922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:10.626864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb466a4-a326-48b5-b0ca-be46d743d2a4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:10.638332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:10.639028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:10.639304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:10.639582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] PATH_INFO: `/v3/projects/84840fec07ec4a789fd807f43ca2104b/users/4ecd22ca51cc47088c8a9b40a10f23e7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:10.696307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84840fec07ec4a789fd807f43ca2104b, user_id=4ecd22ca51cc47088c8a9b40a10f23e7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:10.713039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:10.763175 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2707/5417] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:10 2022] PUT /identity/v3/projects/84840fec07ec4a789fd807f43ca2104b/users/4ecd22ca51cc47088c8a9b40a10f23e7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:10.774274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69204b-8c85-49af-b6d6-91d4f4ece49f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:10.774559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69204b-8c85-49af-b6d6-91d4f4ece49f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:10.774834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69204b-8c85-49af-b6d6-91d4f4ece49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:10.812406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ee69204b-8c85-49af-b6d6-91d4f4ece49f None None] MFA Rules not processed for user `4ecd22ca51cc47088c8a9b40a10f23e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:10.813786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ee69204b-8c85-49af-b6d6-91d4f4ece49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:10.942403 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2711/5418] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:28:10.954398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:10.958072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:11.092304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7bb0b-dfcb-483f-9869-5e9568cb9067 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:11.097443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19118664-fa33-4d19-a132-17900012c2e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:11.098784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118664-fa33-4d19-a132-17900012c2e2 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:11.099213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118664-fa33-4d19-a132-17900012c2e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:11.099660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118664-fa33-4d19-a132-17900012c2e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:11.184703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19118664-fa33-4d19-a132-17900012c2e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:11.186255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19118664-fa33-4d19-a132-17900012c2e2 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:11.205303 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2708/5419] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:11.967461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69204b-8c85-49af-b6d6-91d4f4ece49f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:12.204695 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:12.228476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69204b-8c85-49af-b6d6-91d4f4ece49f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:12.249567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:12.250237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:12.250514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:12.250786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] PATH_INFO: `/v3/users/3eff4d69788a46a8b73e36c4735c068f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:12.258297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eff4d69788a46a8b73e36c4735c068f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:12.259640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:12.403093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eff4d69788a46a8b73e36c4735c068f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:12.423156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eff4d69788a46a8b73e36c4735c068f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:12.475182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eff4d69788a46a8b73e36c4735c068f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:12.476235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eff4d69788a46a8b73e36c4735c068f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:12.507151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eff4d69788a46a8b73e36c4735c068f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:12.547079 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2712/5420] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:11 2022] DELETE /identity/v3/users/3eff4d69788a46a8b73e36c4735c068f => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:12.549136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:12.549587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:12.549680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:12.594073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:12.595335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:12.633207 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:12.722571 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2709/5421] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:12.747602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:12.749113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:12.894092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883de44-7ae8-49e9-acb4-4a7701590c77 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:12.911608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:12.912370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:12.912670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:12.912989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:12.947078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:12.948606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:12.979478 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2713/5422] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:14.478316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:14.479878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:14.516337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf83d10-3b87-4f1f-b6dc-be6b9d7c0750 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:14.538458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:14.539303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:14.539687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:14.540062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] PATH_INFO: `/v3/projects/795f0e91646949bbac479cbdc7513e49` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:14.545796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795f0e91646949bbac479cbdc7513e49)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:14.548290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:14.681631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795f0e91646949bbac479cbdc7513e49', 'request_id': 'req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:14.698118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795f0e91646949bbac479cbdc7513e49', 'request_id': 'req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:14.705394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795f0e91646949bbac479cbdc7513e49', 'request_id': 'req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:14.735338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] The token cache is being invalidate because project 795f0e91646949bbac479cbdc7513e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:14.735939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:14.736823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:14.739003 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2710/5423] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:14 2022] DELETE /identity/v3/projects/795f0e91646949bbac479cbdc7513e49 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:14.743148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:14.753986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427563e4-7fa1-4983-82f9-55683162f1f5 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:14.859273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:14.860091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:14.860435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:14.860975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] PATH_INFO: `/v3/users/4ecd22ca51cc47088c8a9b40a10f23e7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:14.862893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ecd22ca51cc47088c8a9b40a10f23e7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:14.866199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:14.892453 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:14.953280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ecd22ca51cc47088c8a9b40a10f23e7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:14.974043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ecd22ca51cc47088c8a9b40a10f23e7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:14.999565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ecd22ca51cc47088c8a9b40a10f23e7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:15.000317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ecd22ca51cc47088c8a9b40a10f23e7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:15.010497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00299897-c896-484d-9885-e8fc23c1721f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ecd22ca51cc47088c8a9b40a10f23e7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:15.024881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2714/5424] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:14 2022] DELETE /identity/v3/users/4ecd22ca51cc47088c8a9b40a10f23e7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:16.208960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:16.210523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:16.236076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6981-39f8-4a5b-aa69-c66d6bfbbc35 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:16.465617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:16.466585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:16.467050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:16.467502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] PATH_INFO: `/v3/projects/84840fec07ec4a789fd807f43ca2104b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:16.468995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84840fec07ec4a789fd807f43ca2104b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:16.471063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:16.575111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84840fec07ec4a789fd807f43ca2104b', 'request_id': 'req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:16.581851 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:16.601274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84840fec07ec4a789fd807f43ca2104b', 'request_id': 'req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:16.614199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84840fec07ec4a789fd807f43ca2104b', 'request_id': 'req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:16.639814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] The token cache is being invalidate because project 84840fec07ec4a789fd807f43ca2104b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:16.640107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:16.640941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c0aa22b-ada8-4dc2-8b7e-0d6c48f80db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:16.646310 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2711/5425] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:16 2022] DELETE /identity/v3/projects/84840fec07ec4a789fd807f43ca2104b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:16.648049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0689-dc5b-4f4d-ab08-6464d4ff7e52 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:16.648591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0689-dc5b-4f4d-ab08-6464d4ff7e52 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:16.648591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0689-dc5b-4f4d-ab08-6464d4ff7e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:16.674253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-461f0689-dc5b-4f4d-ab08-6464d4ff7e52 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:16.678031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-461f0689-dc5b-4f4d-ab08-6464d4ff7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:16.764945 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2715/5426] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:16.773160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1f8af-57ac-4fac-ba67-93a0770ab6b9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:16.773431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1f8af-57ac-4fac-ba67-93a0770ab6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:16.773901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1f8af-57ac-4fac-ba67-93a0770ab6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:16.796502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-29f1f8af-57ac-4fac-ba67-93a0770ab6b9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:16.797799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-29f1f8af-57ac-4fac-ba67-93a0770ab6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:16.807192 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2712/5427] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:16.811433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f0689-dc5b-4f4d-ab08-6464d4ff7e52 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:16.825444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f0689-dc5b-4f4d-ab08-6464d4ff7e52 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:16.836999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:16.837903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:16.838328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:16.839113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:16.839924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:28:16.840499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:16.842373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:16.874527 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2716/5428] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:16.884862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1f8af-57ac-4fac-ba67-93a0770ab6b9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:16.896624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1f8af-57ac-4fac-ba67-93a0770ab6b9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:16.902515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:16.903274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:16.903552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:16.903814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:16.904450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:16.906845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:16.967221 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2713/5429] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:16 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:16.968092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:16.986862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436bb79-37ee-40e9-9b6a-46da26b9c0b4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:17.141749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:17.142678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:17.143108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:17.143526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:17.144498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:17.148625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:17.189449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2717/5430] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:16 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:17.191011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:17.206577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32463f82-96c0-4e4f-b1b9-03d24f27e260 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:17.215432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:17.216077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:17.216338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:17.216609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:17.217295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:17.218989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:17.235721 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2714/5431] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:17.240212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:17.255246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64af04c-7263-4045-adb4-28f88d4fe383 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:17.261222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95612c50-255b-491e-abbd-045eae3a81b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:17.262450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612c50-255b-491e-abbd-045eae3a81b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:17.262818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612c50-255b-491e-abbd-045eae3a81b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:17.263152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612c50-255b-491e-abbd-045eae3a81b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:17.264228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95612c50-255b-491e-abbd-045eae3a81b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:17.267142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95612c50-255b-491e-abbd-045eae3a81b3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:17.287651 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2718/5432] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:17.289043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:17.301428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ab083-0f4c-4571-9e99-b0bed4113fb9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:17.309652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:17.310580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:17.311100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:17.311511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] PATH_INFO: `/v3/projects/1252b4d7672e46e0b9380d4b80ad3cc5/users/d8692b86bfac4bf490b8e8b8147bfd38/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:17.335752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1252b4d7672e46e0b9380d4b80ad3cc5, user_id=d8692b86bfac4bf490b8e8b8147bfd38, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:17.339671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:17.370320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2715/5433] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:17 2022] PUT /identity/v3/projects/1252b4d7672e46e0b9380d4b80ad3cc5/users/d8692b86bfac4bf490b8e8b8147bfd38/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:17.384525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4854f2-026e-46e1-b1e4-1c44e957cc28 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:17.384916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4854f2-026e-46e1-b1e4-1c44e957cc28 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:17.385308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4854f2-026e-46e1-b1e4-1c44e957cc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:17.394808 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:17.447326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9d4854f2-026e-46e1-b1e4-1c44e957cc28 None None] MFA Rules not processed for user `d8692b86bfac4bf490b8e8b8147bfd38`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:17.449950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d4854f2-026e-46e1-b1e4-1c44e957cc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:17.583535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2719/5434] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:17.595780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:17.598491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:17.704354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466638-ff1a-4274-945d-8635de9cf94d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:17.709055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e518cd0-1461-4f93-99fd-f579af1ecc27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:17.710049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518cd0-1461-4f93-99fd-f579af1ecc27 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:17.710422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518cd0-1461-4f93-99fd-f579af1ecc27 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:17.710889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518cd0-1461-4f93-99fd-f579af1ecc27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:17.724935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e518cd0-1461-4f93-99fd-f579af1ecc27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:17.726718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e518cd0-1461-4f93-99fd-f579af1ecc27 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:17.739451 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2716/5435] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:17.900270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4854f2-026e-46e1-b1e4-1c44e957cc28 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:17.957630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:17.957964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:17.958285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:18.018279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] MFA Rules not processed for user `949126b9470c418897afeacef01c275f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:18.025420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:18.086113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4854f2-026e-46e1-b1e4-1c44e957cc28 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:18.093621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:18.095321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:18.095774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:18.096210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] PATH_INFO: `/v3/users/d8692b86bfac4bf490b8e8b8147bfd38` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:18.098918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8692b86bfac4bf490b8e8b8147bfd38)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:18.102239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:18.143344 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2717/5436] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:28:18.147975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:18.149753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:18.161941 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:18.217792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8692b86bfac4bf490b8e8b8147bfd38'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:18.239722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8692b86bfac4bf490b8e8b8147bfd38'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:18.286931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8692b86bfac4bf490b8e8b8147bfd38'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:18.287681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8692b86bfac4bf490b8e8b8147bfd38'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:18.296880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9619653e-8dbd-4752-a9f8-594d6671a7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8692b86bfac4bf490b8e8b8147bfd38'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:18.315196 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2720/5437] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:17 2022] DELETE /identity/v3/users/d8692b86bfac4bf490b8e8b8147bfd38 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:18.318743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:18.319220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:18.320997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:18.339924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ff528-277b-4cbc-abf1-66a2473524aa None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:18.375949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:18.381756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:18.422714 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:18.534457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:18.537188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:18.538583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:18.539668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:18.545103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:18.603773 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2721/5438] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:18.684506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:18.686580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:18.749471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:18.751103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:18.771044 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2718/5439] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:18.850176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9c6e1-c6a8-4f1f-bffd-f66f532effd6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:18.863005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d928b6-611b-4b30-8cad-d17f0a3eaadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:18.863792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d928b6-611b-4b30-8cad-d17f0a3eaadf service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:18.864141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d928b6-611b-4b30-8cad-d17f0a3eaadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:18.864418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d928b6-611b-4b30-8cad-d17f0a3eaadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:18.884407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d928b6-611b-4b30-8cad-d17f0a3eaadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:18.886528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d928b6-611b-4b30-8cad-d17f0a3eaadf service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:18.912845 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2722/5440] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:28:21.973706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:21.976381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:22.023927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66cfdc-02f5-4621-a02f-ef7dc7a731ab service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:22.033482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:22.034895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:22.035306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:22.035672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] PATH_INFO: `/v3/projects/1252b4d7672e46e0b9380d4b80ad3cc5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:22.039339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1252b4d7672e46e0b9380d4b80ad3cc5)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:22.041340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:22.171982 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:22.207712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1252b4d7672e46e0b9380d4b80ad3cc5', 'request_id': 'req-a3c5ec23-461e-45a1-b0f3-d3141554e255'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:22.225772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1252b4d7672e46e0b9380d4b80ad3cc5', 'request_id': 'req-a3c5ec23-461e-45a1-b0f3-d3141554e255'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:22.234490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1252b4d7672e46e0b9380d4b80ad3cc5', 'request_id': 'req-a3c5ec23-461e-45a1-b0f3-d3141554e255'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:22.274431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] The token cache is being invalidate because project 1252b4d7672e46e0b9380d4b80ad3cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:22.275239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:22.276124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3c5ec23-461e-45a1-b0f3-d3141554e255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:22.280441 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2719/5441] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:21 2022] DELETE /identity/v3/projects/1252b4d7672e46e0b9380d4b80ad3cc5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:22.288169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1846-1abb-4775-921e-bac79d889bf5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:22.288661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1846-1abb-4775-921e-bac79d889bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:22.288926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1846-1abb-4775-921e-bac79d889bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:22.346727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-12cc1846-1abb-4775-921e-bac79d889bf5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:22.348126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-12cc1846-1abb-4775-921e-bac79d889bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:22.547705 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2723/5442] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:22.549333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e9ce-8fb3-4ab0-b257-bbd7d21c0d10 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:22.549930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e9ce-8fb3-4ab0-b257-bbd7d21c0d10 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:22.550218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e9ce-8fb3-4ab0-b257-bbd7d21c0d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:22.606666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3539e9ce-8fb3-4ab0-b257-bbd7d21c0d10 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:22.612948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3539e9ce-8fb3-4ab0-b257-bbd7d21c0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:22.633996 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2720/5443] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:22.638286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc1846-1abb-4775-921e-bac79d889bf5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:22.669376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc1846-1abb-4775-921e-bac79d889bf5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:22.681318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:22.681966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:22.682887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:22.683164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:22.684922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:28:22.685448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:22.687557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:22.703337 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2724/5444] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:28:22.707842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539e9ce-8fb3-4ab0-b257-bbd7d21c0d10 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:22.724577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539e9ce-8fb3-4ab0-b257-bbd7d21c0d10 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:22.730376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:22.731548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:22.731548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:22.736121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:22.736121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:22.736121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:22.785667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:22.793408 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2721/5445] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:22 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:22.797207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5bd66-548c-4e4d-a912-89b09b6e214c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:22.920265 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:22.963847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:22.965876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:22.966162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:22.967562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:22.968237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:22.973426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:23.037918 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2725/5446] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:22 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:28:23.041731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:23.056405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1f772-69f3-4e79-b770-048d15dc0b3f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:23.065119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:23.066827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:23.067604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:23.068404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:23.070000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:23.073957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:23.078364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:23.086908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:23.154566 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2722/5447] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:23.161819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:23.207252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d436-7039-4228-8acd-05497b44e00c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:23.223633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:23.226685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:23.227346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:23.228095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:23.231499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:23.236166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:23.261579 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2723/5448] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:23.276754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:23.324396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdde27f-6a07-4f43-a04e-07867f3e7a22 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:23.346999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71202f-e5a8-4a31-a21e-5d32b10ee648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:23.348254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b04a-89da-49e1-835d-4aca6142be85 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:23.349145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71202f-e5a8-4a31-a21e-5d32b10ee648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:23.349145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71202f-e5a8-4a31-a21e-5d32b10ee648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:23.349145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71202f-e5a8-4a31-a21e-5d32b10ee648 admin admin] PATH_INFO: `/v3/projects/749b76dac8624a9cb06358e05e5006b0/users/1e9f4fee60d546af8934ec7f613ee473/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:23.379839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:23.380980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71202f-e5a8-4a31-a21e-5d32b10ee648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749b76dac8624a9cb06358e05e5006b0, user_id=1e9f4fee60d546af8934ec7f613ee473, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:23.383898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:23.384099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71202f-e5a8-4a31-a21e-5d32b10ee648 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:23.385569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:23.390734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:23.402264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:23.422775 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2724/5449] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:23 2022] PUT /identity/v3/projects/749b76dac8624a9cb06358e05e5006b0/users/1e9f4fee60d546af8934ec7f613ee473/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:23.440661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44875a1-4ebb-470f-85bb-17b4467e8741 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:23.440963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44875a1-4ebb-470f-85bb-17b4467e8741 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:23.441232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44875a1-4ebb-470f-85bb-17b4467e8741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:23.448553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:23.450244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:23.488165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a44875a1-4ebb-470f-85bb-17b4467e8741 None None] MFA Rules not processed for user `1e9f4fee60d546af8934ec7f613ee473`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:23.491260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a44875a1-4ebb-470f-85bb-17b4467e8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:23.492529 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2726/5450] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:23.704036 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2725/5451] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:23.717285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:23.719017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:23.881415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5567a6-a61e-4f08-9236-f1bfa7ef17b1 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:23.944555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:23.946209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:23.946583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:23.946950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:23.982531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:23.985049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:24.000251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2727/5452] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:24.505994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44875a1-4ebb-470f-85bb-17b4467e8741 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:24.590300 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:24.633964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:24.636480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:24.641571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44875a1-4ebb-470f-85bb-17b4467e8741 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:24.647073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:24.647731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:24.648010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:24.648281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] PATH_INFO: `/v3/users/1e9f4fee60d546af8934ec7f613ee473` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:24.649651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9f4fee60d546af8934ec7f613ee473)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:24.651753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:24.672244 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:24.721745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9f4fee60d546af8934ec7f613ee473'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:24.736437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9f4fee60d546af8934ec7f613ee473'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:24.737196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9f4fee60d546af8934ec7f613ee473'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:24.750052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9f4fee60d546af8934ec7f613ee473'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:24.751332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-037c3c83-7c1c-4b03-adae-d859c754855a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9f4fee60d546af8934ec7f613ee473'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:24.788371 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2726/5453] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:24 2022] DELETE /identity/v3/users/1e9f4fee60d546af8934ec7f613ee473 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:24.794253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:24.794530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:24.794960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:24.802289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271c04-05f9-4aa7-8599-faa7b805bcfe service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:24.847020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:24.852139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:24.916472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:24.917673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:24.917968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:24.918234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:24.922135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:24.992863 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2727/5454] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:25.026720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:25.028546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:25.030829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:25.032393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:25.068047 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2728/5455] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:28:25.163633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7d08c-4554-4f1e-b9c0-da264b0aca0b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:25.169754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:25.172485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:25.174894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:25.175783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:25.176266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:25.176847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:25.211443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:25.212060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09faaca-37eb-4703-8a88-bd8bc55e334c service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:25.214789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:25.223107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fea7-5f4f-434c-afe6-839d736be23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:25.224123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fea7-5f4f-434c-afe6-839d736be23f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:25.224502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fea7-5f4f-434c-afe6-839d736be23f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:25.224897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fea7-5f4f-434c-afe6-839d736be23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:25.227616 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:25.229566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9440fea7-5f4f-434c-afe6-839d736be23f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:25.242629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2728/5456] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:25.254758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fea7-5f4f-434c-afe6-839d736be23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:25.256398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fea7-5f4f-434c-afe6-839d736be23f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:25.270183 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2729/5457] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:27.257185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:27.259836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:27.307163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1357-f268-4e88-8c31-23ac11b07971 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:27.351947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:27.359853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:27.364146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:27.364847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] PATH_INFO: `/v3/projects/749b76dac8624a9cb06358e05e5006b0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:27.366375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749b76dac8624a9cb06358e05e5006b0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:27.372969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:27.489478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749b76dac8624a9cb06358e05e5006b0', 'request_id': 'req-a7af362d-8ba1-4966-ab9f-a4ac3f341914'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:27.507200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749b76dac8624a9cb06358e05e5006b0', 'request_id': 'req-a7af362d-8ba1-4966-ab9f-a4ac3f341914'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:27.532635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749b76dac8624a9cb06358e05e5006b0', 'request_id': 'req-a7af362d-8ba1-4966-ab9f-a4ac3f341914'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:27.549075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] The token cache is being invalidate because project 749b76dac8624a9cb06358e05e5006b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:27.549392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:27.550061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7af362d-8ba1-4966-ab9f-a4ac3f341914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:27.553100 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2729/5458] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:27 2022] DELETE /identity/v3/projects/749b76dac8624a9cb06358e05e5006b0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:27.558428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c08ca-0271-4617-b420-5af673ecaa12 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:27.558939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c08ca-0271-4617-b420-5af673ecaa12 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:27.559045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c08ca-0271-4617-b420-5af673ecaa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:27.593685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b74c08ca-0271-4617-b420-5af673ecaa12 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:27.594933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b74c08ca-0271-4617-b420-5af673ecaa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:27.654968 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:27.763539 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2730/5459] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:27.775978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6ded-960d-4be5-8d1a-35dd5c8ffb08 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:27.776378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6ded-960d-4be5-8d1a-35dd5c8ffb08 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:27.776943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6ded-960d-4be5-8d1a-35dd5c8ffb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:27.831156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-de4a6ded-960d-4be5-8d1a-35dd5c8ffb08 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:27.836053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de4a6ded-960d-4be5-8d1a-35dd5c8ffb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:27.857303 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2730/5460] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:27.861851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c08ca-0271-4617-b420-5af673ecaa12 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:27.880276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c08ca-0271-4617-b420-5af673ecaa12 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:27.886647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:27.887475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:27.888524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:27.889017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:27.890100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:28:27.891443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:27.893672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:27.912316 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2731/5461] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:27.917013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a6ded-960d-4be5-8d1a-35dd5c8ffb08 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:27.931170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a6ded-960d-4be5-8d1a-35dd5c8ffb08 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:27.938628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:27.939855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:27.940305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:27.941268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:27.942083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:27.944429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:27.988730 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2731/5462] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:27 2022] POST /identity/v3/projects => generated 361 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:27.992965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:28.005762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94888b-3a53-438b-adbd-52c37a59471a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:28.109233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:28.109868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:28.110145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:28.117968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:28.119341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:28.122311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:28.199821 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2732/5463] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:27 2022] POST /identity/v3/users => generated 281 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:28.204013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:28.218349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5be25a-fbdf-467d-a18e-6acfab94080a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:28.223565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:28.224389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:28.224814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:28.225184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:28.226270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:28.229195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:28.242862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2732/5464] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:28.247264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:28.261692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02d62-9e8c-40c0-9a00-e2c3f4fec7b5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:28.268247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42c2a5-89fe-49f0-80a1-a43eb88e191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:28.269073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42c2a5-89fe-49f0-80a1-a43eb88e191c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:28.269360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42c2a5-89fe-49f0-80a1-a43eb88e191c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:28.269634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42c2a5-89fe-49f0-80a1-a43eb88e191c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:28.270461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42c2a5-89fe-49f0-80a1-a43eb88e191c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:28.272545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42c2a5-89fe-49f0-80a1-a43eb88e191c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:28.293610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:28.301158 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2733/5465] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:28.309188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d0f20-7090-4ac1-9304-69139987e072 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:28.314144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:28.314823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:28.315144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:28.315418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] PATH_INFO: `/v3/projects/f50bdf80c64d46d3a1b616b01559c8f3/users/26c36cf838934e1d9cbce876d850a830/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:28.339452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50bdf80c64d46d3a1b616b01559c8f3, user_id=26c36cf838934e1d9cbce876d850a830, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:28.342380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:28.368852 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2733/5466] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:28 2022] PUT /identity/v3/projects/f50bdf80c64d46d3a1b616b01559c8f3/users/26c36cf838934e1d9cbce876d850a830/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:28.379210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de1a5-0dff-46cd-a59a-5ab30167e3f6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:28.379210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de1a5-0dff-46cd-a59a-5ab30167e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:28.379210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de1a5-0dff-46cd-a59a-5ab30167e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:28.422171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2e2de1a5-0dff-46cd-a59a-5ab30167e3f6 None None] MFA Rules not processed for user `26c36cf838934e1d9cbce876d850a830`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:28.424353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2e2de1a5-0dff-46cd-a59a-5ab30167e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:28.557005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2734/5467] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:28.569993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:28.703664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783509f6-4a3a-49a3-a625-961c3f9afcf3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:28.710638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:28.711249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:28.711643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:28.711923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] PATH_INFO: `/v3/users/26c36cf838934e1d9cbce876d850a830` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:28.713412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c36cf838934e1d9cbce876d850a830)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:28.716105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:28.749558 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:28.815936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c36cf838934e1d9cbce876d850a830'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:28.835931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c36cf838934e1d9cbce876d850a830'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:28.836551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c36cf838934e1d9cbce876d850a830'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:28.871158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c36cf838934e1d9cbce876d850a830'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:28.872233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c36cf838934e1d9cbce876d850a830'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:28.931639 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2734/5468] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:28 2022] DELETE /identity/v3/users/26c36cf838934e1d9cbce876d850a830 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:28.935393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:28.935914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:28.936151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:28.964815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:28.966089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:28.993014 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:29.045379 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2735/5469] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:29.053345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:29.055176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:29.123100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09295-19d6-4d56-9b99-4367bb73131e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:29.133310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f57aa-fe6a-4ad4-bd22-8c4597af7f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:29.133979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f57aa-fe6a-4ad4-bd22-8c4597af7f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:29.134254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f57aa-fe6a-4ad4-bd22-8c4597af7f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:29.134520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f57aa-fe6a-4ad4-bd22-8c4597af7f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:29.153027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f57aa-fe6a-4ad4-bd22-8c4597af7f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:29.154525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f57aa-fe6a-4ad4-bd22-8c4597af7f97 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:29.171407 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2735/5470] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:28:29.622119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:29.624259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:29.642528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40176719-56a1-41f8-9a8c-fcdcbc3cb058 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:29.657315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:29.657981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:29.658364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:29.659001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] PATH_INFO: `/v3/projects/f50bdf80c64d46d3a1b616b01559c8f3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:29.661488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50bdf80c64d46d3a1b616b01559c8f3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:29.663194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:30.003336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50bdf80c64d46d3a1b616b01559c8f3', 'request_id': 'req-db9a8255-7d5a-484b-8888-cb068f6de9c9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:30.014529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50bdf80c64d46d3a1b616b01559c8f3', 'request_id': 'req-db9a8255-7d5a-484b-8888-cb068f6de9c9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:30.022547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50bdf80c64d46d3a1b616b01559c8f3', 'request_id': 'req-db9a8255-7d5a-484b-8888-cb068f6de9c9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:30.042566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] The token cache is being invalidate because project f50bdf80c64d46d3a1b616b01559c8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:30.042871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:30.043842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-db9a8255-7d5a-484b-8888-cb068f6de9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:30.049457 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2736/5471] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:29 2022] DELETE /identity/v3/projects/f50bdf80c64d46d3a1b616b01559c8f3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:30.050938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3e81c-65e3-4d91-942c-386c45fadd03 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.051435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3e81c-65e3-4d91-942c-386c45fadd03 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.051530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3e81c-65e3-4d91-942c-386c45fadd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.086337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ccf3e81c-65e3-4d91-942c-386c45fadd03 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:30.087594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ccf3e81c-65e3-4d91-942c-386c45fadd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:30.182660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028b56-fcdf-4d6f-8469-cd77b7d605e2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.183013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028b56-fcdf-4d6f-8469-cd77b7d605e2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.183319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028b56-fcdf-4d6f-8469-cd77b7d605e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.183526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2736/5472] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:30.204105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-65028b56-fcdf-4d6f-8469-cd77b7d605e2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:30.205473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-65028b56-fcdf-4d6f-8469-cd77b7d605e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:30.217795 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2737/5473] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:30.218694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3e81c-65e3-4d91-942c-386c45fadd03 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:30.229134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3e81c-65e3-4d91-942c-386c45fadd03 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:30.233975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:30.234674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.235013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.235346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.236097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:28:30.236461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:30.238349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:30.258352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028b56-fcdf-4d6f-8469-cd77b7d605e2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:30.264852 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2737/5474] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:28:30.269513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028b56-fcdf-4d6f-8469-cd77b7d605e2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:30.275189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:30.276119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.276394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.276655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.277398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:30.279430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:30.319691 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2738/5475] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:30 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:28:30.324929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:30.341422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac194e4-a52d-4628-b673-f42963c3aa7d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:30.386064 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:30.468353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:30.469249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.469527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.469798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.470746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:30.477420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:30.530840 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2738/5476] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:30 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:28:30.532039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:30.553344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1d48-45f0-469e-b318-bdafcae976d9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:30.563646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:30.564276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.564550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.564840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.565490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:30.567085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:30.591955 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2739/5477] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:30.596199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:30.627425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575ff8f-517b-4d10-a434-bc64d56e663e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:30.642405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40312db9-e3b8-4346-90e7-86548f86615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:30.643128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40312db9-e3b8-4346-90e7-86548f86615b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.645646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40312db9-e3b8-4346-90e7-86548f86615b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.646216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40312db9-e3b8-4346-90e7-86548f86615b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.647101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40312db9-e3b8-4346-90e7-86548f86615b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:30.648761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40312db9-e3b8-4346-90e7-86548f86615b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:30.690432 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2739/5478] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:30.695494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:30.713244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486031-05d3-45e2-975e-3068c03f4674 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:30.727766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:30.728464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.728742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.729044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] PATH_INFO: `/v3/projects/99f8ebc3fe124ac095dbc051a37ea215/users/4c21c97f1c494126bd1c977f9c725deb/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.772409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f8ebc3fe124ac095dbc051a37ea215, user_id=4c21c97f1c494126bd1c977f9c725deb, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:30.776281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:30.806846 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2740/5479] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:30 2022] PUT /identity/v3/projects/99f8ebc3fe124ac095dbc051a37ea215/users/4c21c97f1c494126bd1c977f9c725deb/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:30.808972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd6deb-4cc9-4e95-adc6-5ef49d9490ab None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:30.809258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd6deb-4cc9-4e95-adc6-5ef49d9490ab None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:30.809528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd6deb-4cc9-4e95-adc6-5ef49d9490ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:30.872362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7bdd6deb-4cc9-4e95-adc6-5ef49d9490ab None None] MFA Rules not processed for user `4c21c97f1c494126bd1c977f9c725deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:30.876097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7bdd6deb-4cc9-4e95-adc6-5ef49d9490ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:31.000547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2740/5480] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:31.001776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:31.118190 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:31.199648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317b055-8cf2-4106-afd1-ab08577fc0fa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:31.204891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:31.210737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:31.211016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:31.211339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:31.211999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:31.218261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:31.280741 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2741/5481] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:31 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:28:31.285980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd6deb-4cc9-4e95-adc6-5ef49d9490ab None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:31.304383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd6deb-4cc9-4e95-adc6-5ef49d9490ab None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:31.424519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:31.425575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:31.425942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:31.426395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:31.427586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:31.430106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:31.462881 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2741/5482] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:31 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:31.467350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:31.484508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4c97-eeb7-484f-a042-d78a9c088114 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:31.494770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:31.495512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:31.496951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:31.497300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:31.500076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:31.501760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:31.522836 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2742/5483] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:31.533721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:31.551162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc491-4d14-4263-bb8c-7f74b8a5f35f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:31.565390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f134-b46c-4a57-9f46-87ecf5e93313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:31.566054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f134-b46c-4a57-9f46-87ecf5e93313 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:31.566339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f134-b46c-4a57-9f46-87ecf5e93313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:31.566613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f134-b46c-4a57-9f46-87ecf5e93313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:31.567295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f134-b46c-4a57-9f46-87ecf5e93313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:31.571998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f134-b46c-4a57-9f46-87ecf5e93313 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:31.611878 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2742/5484] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:31.612693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:31.630528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5f4d-a9cf-44f2-8006-1412849cfa0d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:31.637198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:31.637891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:31.638171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:31.638448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] PATH_INFO: `/v3/projects/bc9d773334d7496a974d7679645bc887/users/c1b3fadf40124a94a57a31a5ecdae53d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:31.673009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9d773334d7496a974d7679645bc887, user_id=c1b3fadf40124a94a57a31a5ecdae53d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:31.677583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:31.730353 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2743/5485] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:31 2022] PUT /identity/v3/projects/bc9d773334d7496a974d7679645bc887/users/c1b3fadf40124a94a57a31a5ecdae53d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:31.743013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0e261-fa00-465f-b2de-7d9fa6dd5f39 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:31.743285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0e261-fa00-465f-b2de-7d9fa6dd5f39 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:31.743652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0e261-fa00-465f-b2de-7d9fa6dd5f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:31.834108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cbd0e261-fa00-465f-b2de-7d9fa6dd5f39 None None] MFA Rules not processed for user `c1b3fadf40124a94a57a31a5ecdae53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:31.835644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cbd0e261-fa00-465f-b2de-7d9fa6dd5f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:31.845543 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:32.045382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:32.047313 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2743/5486] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:32.181150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1b27b-431a-4f4c-b21b-cf114d5cc602 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:32.191075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:32.191809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:32.194398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:32.197102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:32.197944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:32.204304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:32.270450 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2744/5487] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:32 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:28:32.276905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0e261-fa00-465f-b2de-7d9fa6dd5f39 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:32.293359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0e261-fa00-465f-b2de-7d9fa6dd5f39 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:32.460518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:32.461221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:32.461506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:32.461783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:32.462456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:32.464419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:32.519555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2744/5488] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:32 2022] POST /identity/v3/users => generated 296 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:32.537793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:32.549281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c9cd-dea8-4a79-9ff3-82145e99e46b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:32.562074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:32.563686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:32.563972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:32.564611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:32.565312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:32.566942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:32.583409 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2745/5489] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:32.585628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:32.598494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb8af-0e2c-4514-871a-d6c3a24a5274 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:32.617622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:32.618285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:32.619025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:32.619025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] PATH_INFO: `/v3/projects/17bd163bf8204a588ada1d9d83988605/users/3fa3e7a94f0c4762a83ceb8c27067baa/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:32.654598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bd163bf8204a588ada1d9d83988605, user_id=3fa3e7a94f0c4762a83ceb8c27067baa, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:32.662244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:32.720114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:32.720487 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2745/5490] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:32 2022] PUT /identity/v3/projects/17bd163bf8204a588ada1d9d83988605/users/3fa3e7a94f0c4762a83ceb8c27067baa/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:32.744528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbc3b9-8152-4b55-a812-6c8fb065605c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:32.825232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2d099-362c-4e51-94df-330720f5dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:32.825949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2d099-362c-4e51-94df-330720f5dd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:32.826377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2d099-362c-4e51-94df-330720f5dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:32.826658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2d099-362c-4e51-94df-330720f5dd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:32.827367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2d099-362c-4e51-94df-330720f5dd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:32.829165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2d099-362c-4e51-94df-330720f5dd87 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:32.847072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:32.854761 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2746/5491] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:32.860795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db15e-b4f6-4308-ad50-1fe8c4eb8700 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:32.867700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:32.868689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:32.868995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:32.869306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] PATH_INFO: `/v3/projects/17bd163bf8204a588ada1d9d83988605/users/3fa3e7a94f0c4762a83ceb8c27067baa/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:32.871950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bd163bf8204a588ada1d9d83988605, user_id=3fa3e7a94f0c4762a83ceb8c27067baa, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:32.874708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:32.894913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2746/5492] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:32 2022] PUT /identity/v3/projects/17bd163bf8204a588ada1d9d83988605/users/3fa3e7a94f0c4762a83ceb8c27067baa/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:32.906657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:32.906947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:32.907232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:32.937049 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:33.032247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] MFA Rules not processed for user `3fa3e7a94f0c4762a83ceb8c27067baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:33.032247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:33.167471 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2747/5493] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:33.181720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:33.183878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:33.276125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651212d-48e7-4118-94ab-a59af8d6d25a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:33.280475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:33.282267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:33.292982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:33.293419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:33.310392 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:33.424531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:33.426408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:33.443979 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2747/5494] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:35.716530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:35.719243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:35.894704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4770-530b-43cd-9260-8c0736de8efd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:35.910249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:35.911151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:35.911579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:35.912172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] PATH_INFO: `/v3/users/fe0e970187b548d0878f3cbfc89f25fc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:35.914347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0e970187b548d0878f3cbfc89f25fc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:35.917640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:36.005497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0e970187b548d0878f3cbfc89f25fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:36.038860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0e970187b548d0878f3cbfc89f25fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:36.066052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0e970187b548d0878f3cbfc89f25fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:36.066861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0e970187b548d0878f3cbfc89f25fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:36.086484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b33b939c-4950-41d6-ad02-dd4997c84c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0e970187b548d0878f3cbfc89f25fc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:36.107760 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2748/5495] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:35 2022] DELETE /identity/v3/users/fe0e970187b548d0878f3cbfc89f25fc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:37.249922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:37.268886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420b5d-cb5a-473d-ae7b-3f2188bae037 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:37.385344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:37.386405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:37.386895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:37.387551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] PATH_INFO: `/v3/projects/6d9f6cf1c2694e7099cff8757420b421` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:37.389059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9f6cf1c2694e7099cff8757420b421)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:37.391421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:37.452953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9f6cf1c2694e7099cff8757420b421', 'request_id': 'req-8ff41320-ee09-4168-ba91-9338d87c92c5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:37.465441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9f6cf1c2694e7099cff8757420b421', 'request_id': 'req-8ff41320-ee09-4168-ba91-9338d87c92c5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:37.473448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9f6cf1c2694e7099cff8757420b421', 'request_id': 'req-8ff41320-ee09-4168-ba91-9338d87c92c5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:37.487393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] The token cache is being invalidate because project 6d9f6cf1c2694e7099cff8757420b421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:37.487687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:37.488546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ff41320-ee09-4168-ba91-9338d87c92c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:37.490514 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2748/5496] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:37 2022] DELETE /identity/v3/projects/6d9f6cf1c2694e7099cff8757420b421 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:37.495196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d30ee-8e1a-4cd7-98f5-61653e01ac81 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:37.496261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d30ee-8e1a-4cd7-98f5-61653e01ac81 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:37.497079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d30ee-8e1a-4cd7-98f5-61653e01ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:37.523219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f61d30ee-8e1a-4cd7-98f5-61653e01ac81 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:37.524636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f61d30ee-8e1a-4cd7-98f5-61653e01ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:37.530018 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:37.641935 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2749/5497] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:37.651006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f79e-21d6-4b51-a9e9-ca3b9aa2f6c1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:37.651288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f79e-21d6-4b51-a9e9-ca3b9aa2f6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:37.651557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f79e-21d6-4b51-a9e9-ca3b9aa2f6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:37.674994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-26f0f79e-21d6-4b51-a9e9-ca3b9aa2f6c1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:37.676323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26f0f79e-21d6-4b51-a9e9-ca3b9aa2f6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:37.727445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d30ee-8e1a-4cd7-98f5-61653e01ac81 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:37.733969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2749/5498] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:37.740661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d30ee-8e1a-4cd7-98f5-61653e01ac81 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:37.758119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:37.758753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:37.759028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:37.759295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:37.759958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:28:37.760257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:37.763684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:37.797567 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2750/5499] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:37.802724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0f79e-21d6-4b51-a9e9-ca3b9aa2f6c1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:37.825307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0f79e-21d6-4b51-a9e9-ca3b9aa2f6c1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:37.838918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:37.839590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:37.842323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:37.844425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:37.845167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:37.853503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:37.921101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:37.928134 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2750/5500] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:37 2022] POST /identity/v3/projects => generated 399 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:37.933169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762128-9015-4ae0-b9af-607d6739cdf7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:38.046990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:38.047496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:38.047838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:38.050397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:38.051176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:38.056179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:38.114819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:38.131136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9587957-cb7b-41e1-b3ec-f3b48a47e794 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:38.133789 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2751/5501] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:37 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:38.151403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:38.151986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:38.152271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:38.152539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:38.153248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:38.155635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:38.201089 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2751/5502] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:38.201731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:38.218787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed6e03-9e4d-4b0d-b7aa-788b367c86c9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:38.235629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6eff3-a042-4fdf-9d25-3ad981b63691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:38.236278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6eff3-a042-4fdf-9d25-3ad981b63691 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:38.236559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6eff3-a042-4fdf-9d25-3ad981b63691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:38.236917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6eff3-a042-4fdf-9d25-3ad981b63691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:38.237771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6eff3-a042-4fdf-9d25-3ad981b63691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:38.240111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6eff3-a042-4fdf-9d25-3ad981b63691 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:38.274010 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2752/5503] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:38.277839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:38.283663 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:38.294441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca58d-7465-410e-995a-bb597417e8a9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:38.315817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:38.316657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:38.317212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:38.317800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] PATH_INFO: `/v3/projects/03907b633d3a422c808aecd7dcf9d63c/users/fed991777d2442ae89b8c923d6bdefdb/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:38.356678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03907b633d3a422c808aecd7dcf9d63c, user_id=fed991777d2442ae89b8c923d6bdefdb, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:38.369225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:38.399472 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2752/5504] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:38 2022] PUT /identity/v3/projects/03907b633d3a422c808aecd7dcf9d63c/users/fed991777d2442ae89b8c923d6bdefdb/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:38.410864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495580-fe9b-47c1-bacf-db7db1f17801 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:38.411239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495580-fe9b-47c1-bacf-db7db1f17801 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:38.411784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495580-fe9b-47c1-bacf-db7db1f17801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:38.480186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1b495580-fe9b-47c1-bacf-db7db1f17801 None None] MFA Rules not processed for user `fed991777d2442ae89b8c923d6bdefdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:38.481461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1b495580-fe9b-47c1-bacf-db7db1f17801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:38.639940 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2753/5505] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:38.935465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:39.095321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a846c5-3bd9-4e3a-bbda-a95f53c593bb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:39.101957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:39.102876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:39.103417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:39.103840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] PATH_INFO: `/v3/users/fed991777d2442ae89b8c923d6bdefdb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:39.108630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed991777d2442ae89b8c923d6bdefdb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:39.116797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:39.294159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed991777d2442ae89b8c923d6bdefdb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:39.311176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed991777d2442ae89b8c923d6bdefdb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:39.311924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed991777d2442ae89b8c923d6bdefdb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:39.322584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed991777d2442ae89b8c923d6bdefdb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:39.327319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed991777d2442ae89b8c923d6bdefdb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:39.363179 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2753/5506] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:38 2022] DELETE /identity/v3/users/fed991777d2442ae89b8c923d6bdefdb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:39.365188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:39.365481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:39.365754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:39.376708 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:39.403886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:39.405218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:39.519468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2754/5507] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:39.530672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:39.532520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:39.669251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf365-8bc6-4a54-84da-a19dfddef633 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:39.673398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198de9-5eb1-4d61-a49a-225af1f8bbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:39.674030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198de9-5eb1-4d61-a49a-225af1f8bbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:39.674368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198de9-5eb1-4d61-a49a-225af1f8bbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:39.674800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198de9-5eb1-4d61-a49a-225af1f8bbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:39.687110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198de9-5eb1-4d61-a49a-225af1f8bbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:39.689184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198de9-5eb1-4d61-a49a-225af1f8bbc1 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:39.700413 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:39.724635 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2754/5508] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:40.281137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:40.288467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:40.311511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c599f-d9a8-46f5-bb8c-f51054cd755b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:40.320047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:40.320733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:40.321040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:40.321320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] PATH_INFO: `/v3/projects/03907b633d3a422c808aecd7dcf9d63c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:40.322607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03907b633d3a422c808aecd7dcf9d63c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:40.324480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:40.414601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03907b633d3a422c808aecd7dcf9d63c', 'request_id': 'req-c89a8d98-6017-45eb-aae4-a67fdec1465c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:40.421543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03907b633d3a422c808aecd7dcf9d63c', 'request_id': 'req-c89a8d98-6017-45eb-aae4-a67fdec1465c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:40.441774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03907b633d3a422c808aecd7dcf9d63c', 'request_id': 'req-c89a8d98-6017-45eb-aae4-a67fdec1465c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:40.464153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] The token cache is being invalidate because project 03907b633d3a422c808aecd7dcf9d63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:28:40.464680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:40.465548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c89a8d98-6017-45eb-aae4-a67fdec1465c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:40.469898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2755/5509] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:40 2022] DELETE /identity/v3/projects/03907b633d3a422c808aecd7dcf9d63c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:40.475490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70b7c-a3f9-4938-af06-2c42a1ffc049 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:40.476035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70b7c-a3f9-4938-af06-2c42a1ffc049 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:40.476035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70b7c-a3f9-4938-af06-2c42a1ffc049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:40.521973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f0d70b7c-a3f9-4938-af06-2c42a1ffc049 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:40.523257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f0d70b7c-a3f9-4938-af06-2c42a1ffc049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:40.620926 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2755/5510] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:40.625780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebe8e-7abf-40b8-9448-3073299a43a1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:40.626243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebe8e-7abf-40b8-9448-3073299a43a1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:40.626726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebe8e-7abf-40b8-9448-3073299a43a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:40.650016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-df0ebe8e-7abf-40b8-9448-3073299a43a1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:40.652993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-df0ebe8e-7abf-40b8-9448-3073299a43a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:40.680275 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2756/5511] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:40.680620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70b7c-a3f9-4938-af06-2c42a1ffc049 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:40.686723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70b7c-a3f9-4938-af06-2c42a1ffc049 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:40.692280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:40.693328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:40.693744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:40.694123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:40.694902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:28:40.695633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:40.699665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:40.716906 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2756/5512] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:28:40.720966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ebe8e-7abf-40b8-9448-3073299a43a1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:40.733794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ebe8e-7abf-40b8-9448-3073299a43a1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:40.749907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:40.751013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:40.751489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:40.752798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:40.753852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:40.756385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:40.793106 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2757/5513] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:28:40 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:28:40.797330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:40.810811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802035-f927-4202-b200-7cc279679a55 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:40.978435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:40.980546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:40.981418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:40.984954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:40.985651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:40.996044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:41.050972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:41.070956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50ab47-2a65-43d7-979f-1a68d9cdbc8e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:41.072980 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2757/5514] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:28:40 2022] POST /identity/v3/users => generated 295 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:28:41.091628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:41.092269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:41.092547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:41.092839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:41.093497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:41.095104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:41.176097 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2758/5515] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:28:41.178292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:41.193658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b914-6dca-41c1-8bc2-9355fdff32d0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:41.215646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09157d5a-6015-40f2-bdf1-d9057debfe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:41.222289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157d5a-6015-40f2-bdf1-d9057debfe2c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:41.222592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157d5a-6015-40f2-bdf1-d9057debfe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:41.222877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157d5a-6015-40f2-bdf1-d9057debfe2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:41.230279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09157d5a-6015-40f2-bdf1-d9057debfe2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:41.240565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09157d5a-6015-40f2-bdf1-d9057debfe2c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:41.299246 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2758/5516] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:28:41.302211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:41.320349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386da88-4f4e-417d-8e4b-8437c011ae13 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:41.349444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:41.350920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:41.351498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:41.384106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] PATH_INFO: `/v3/projects/22b84439bde64075ab7459b430b0e612/users/61445b694d0c484c99648ec99f21a34a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:41.428363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b84439bde64075ab7459b430b0e612, user_id=61445b694d0c484c99648ec99f21a34a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:41.432001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:41.506419 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2759/5517] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:28:41 2022] PUT /identity/v3/projects/22b84439bde64075ab7459b430b0e612/users/61445b694d0c484c99648ec99f21a34a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:41.508035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfb36-b232-4d6a-a06d-5769507c4949 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:41.508467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfb36-b232-4d6a-a06d-5769507c4949 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:41.508561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfb36-b232-4d6a-a06d-5769507c4949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:41.566145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-deadfb36-b232-4d6a-a06d-5769507c4949 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:41.572000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-deadfb36-b232-4d6a-a06d-5769507c4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:41.701525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2759/5518] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:41.712008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:41.714929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:41.802197 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:41.880793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8e4c-6852-4dd2-a075-748d6f64c115 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:41.915772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:41.917098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:41.917626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:41.918099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:41.941869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:41.943891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:41.966802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2760/5519] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:28:51.682572 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:51.956242 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=15 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:55.125932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c258d2-caeb-489f-9cd1-2a5e5a43911f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:55.126479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c258d2-caeb-489f-9cd1-2a5e5a43911f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:55.126611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c258d2-caeb-489f-9cd1-2a5e5a43911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:55.191218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c1c258d2-caeb-489f-9cd1-2a5e5a43911f None None] MFA Rules not processed for user `61445b694d0c484c99648ec99f21a34a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:55.193567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c1c258d2-caeb-489f-9cd1-2a5e5a43911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:55.299547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2760/5520] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:55.316258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:55.319620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:55.544513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73caa-95ba-4d8b-9b71-f9961d04c467 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:55.551470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:55.553305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:55.554690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:55.555133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:55.566304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:55.569009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:55.580871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2761/5521] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:28:58.060007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588af8-c155-40c9-a305-dbf8eafacbe1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:58.060859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588af8-c155-40c9-a305-dbf8eafacbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:58.061300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588af8-c155-40c9-a305-dbf8eafacbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:58.101903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-79588af8-c155-40c9-a305-dbf8eafacbe1 None None] MFA Rules not processed for user `d35661d01cfb4f8d90ea78c7c7ead1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:28:58.108146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79588af8-c155-40c9-a305-dbf8eafacbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:58.189699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:58.191838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:58.218436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a839fc-647d-4952-80c4-7928703d9a9d service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:58.235241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:58.236211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:58.236658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:58.237104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] PATH_INFO: `/v3/users/949126b9470c418897afeacef01c275f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:58.238662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949126b9470c418897afeacef01c275f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:58.238977 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2761/5522] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:28:58.241441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:58.354084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949126b9470c418897afeacef01c275f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:58.413007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949126b9470c418897afeacef01c275f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:58.437102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949126b9470c418897afeacef01c275f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:58.438333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949126b9470c418897afeacef01c275f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:58.453722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949126b9470c418897afeacef01c275f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:28:58.507216 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2762/5523] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:28:58 2022] DELETE /identity/v3/users/949126b9470c418897afeacef01c275f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:28:58.559669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79588af8-c155-40c9-a305-dbf8eafacbe1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:28:58.594889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79588af8-c155-40c9-a305-dbf8eafacbe1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:28:58.750755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75b0f1-818e-43c8-ba86-f8275bc0878d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:28:58.751835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b0f1-818e-43c8-ba86-f8275bc0878d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:28:58.752661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b0f1-818e-43c8-ba86-f8275bc0878d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:28:58.753262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b0f1-818e-43c8-ba86-f8275bc0878d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:28:58.755585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ad75b0f1-818e-43c8-ba86-f8275bc0878d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:28:58.850712 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:58.882324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75b0f1-818e-43c8-ba86-f8275bc0878d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:28:58.884664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75b0f1-818e-43c8-ba86-f8275bc0878d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:28:58.910260 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2762/5524] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:00.338841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:00.344671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:00.438706 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:00.453387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf11ff-4a5e-40b2-8e66-b3a89805af64 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:00.461437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:00.463011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:00.463599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:00.464321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] PATH_INFO: `/v3/projects/25322a249ef24a419f9cf750797da096` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:00.466399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25322a249ef24a419f9cf750797da096)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:00.468677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:00.545787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25322a249ef24a419f9cf750797da096', 'request_id': 'req-adf4b010-5a41-40d3-8d00-8196c77d7590'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:00.553368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25322a249ef24a419f9cf750797da096', 'request_id': 'req-adf4b010-5a41-40d3-8d00-8196c77d7590'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:00.559956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2fde7-18f4-49b2-b32c-08f14a9f4379 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:00.562050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2fde7-18f4-49b2-b32c-08f14a9f4379 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:00.562860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2fde7-18f4-49b2-b32c-08f14a9f4379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:00.563156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25322a249ef24a419f9cf750797da096', 'request_id': 'req-adf4b010-5a41-40d3-8d00-8196c77d7590'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:00.581552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] The token cache is being invalidate because project 25322a249ef24a419f9cf750797da096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:29:00.582008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:00.582921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-adf4b010-5a41-40d3-8d00-8196c77d7590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:00.592131 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2763/5525] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:29:00 2022] DELETE /identity/v3/projects/25322a249ef24a419f9cf750797da096 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:00.594116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8611bd-f133-4600-9065-a3ba486b404e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:00.594511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8611bd-f133-4600-9065-a3ba486b404e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:00.594985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8611bd-f133-4600-9065-a3ba486b404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:00.606955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4fd2fde7-18f4-49b2-b32c-08f14a9f4379 None None] MFA Rules not processed for user `61445b694d0c484c99648ec99f21a34a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:00.609635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4fd2fde7-18f4-49b2-b32c-08f14a9f4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:00.625328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-da8611bd-f133-4600-9065-a3ba486b404e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:00.626752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-da8611bd-f133-4600-9065-a3ba486b404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:00.699547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2763/5526] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:00.773157 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2764/5527] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:00.781164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379ad8-1c5a-4a38-8ec8-3e8a40da444c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:00.781723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379ad8-1c5a-4a38-8ec8-3e8a40da444c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:00.782166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379ad8-1c5a-4a38-8ec8-3e8a40da444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:00.806672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-85379ad8-1c5a-4a38-8ec8-3e8a40da444c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:00.808334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-85379ad8-1c5a-4a38-8ec8-3e8a40da444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:00.818004 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2764/5528] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:29:00.822468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8611bd-f133-4600-9065-a3ba486b404e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:00.835723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8611bd-f133-4600-9065-a3ba486b404e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:00.844432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:00.845551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:00.845985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:00.846842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:00.848014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:29:00.848677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:00.850564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:00.867426 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2765/5529] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:29:00.876480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85379ad8-1c5a-4a38-8ec8-3e8a40da444c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:00.894510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85379ad8-1c5a-4a38-8ec8-3e8a40da444c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:00.911488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:00.912535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:00.912996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:00.913418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:00.916232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:00.919275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:01.022268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:01.034940 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2765/5530] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:29:00 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:29:01.043859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dad93-174a-4445-b216-656cd1fec44b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:01.339700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:01.340414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:01.341490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:01.341490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:01.341490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:01.343397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:01.398372 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2766/5531] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:29:01 2022] POST /identity/v3/users => generated 287 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:29:01.401245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:01.422410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8288-d2ed-4e90-991f-b13b58304de1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:01.438264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:01.439105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:01.439999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:01.441247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:01.442579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:01.446056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:01.463917 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2766/5532] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:29:01.464626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:01.471400 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:01.477876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d9060-193a-4663-9fb5-31cb0ec8e733 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:01.499373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1d524-32e3-48e0-ac80-d92e471cbfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:01.500182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d524-32e3-48e0-ac80-d92e471cbfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:01.500461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d524-32e3-48e0-ac80-d92e471cbfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:01.500730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d524-32e3-48e0-ac80-d92e471cbfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:01.501399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1d524-32e3-48e0-ac80-d92e471cbfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:01.503000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1d524-32e3-48e0-ac80-d92e471cbfe4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:01.553633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:01.574488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3a57-e6b0-46b9-afbb-7a9d6bf09134 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:01.575224 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2767/5533] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:29:01.594722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:01.595611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:01.596041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:01.596463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] PATH_INFO: `/v3/projects/c8a2139ece3e4b669c5c1262f24e6771/users/bfef9e4f835c4533acc3a00772c71561/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:01.630699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a2139ece3e4b669c5c1262f24e6771, user_id=bfef9e4f835c4533acc3a00772c71561, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:01.634876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:01.701328 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2767/5534] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:29:01 2022] PUT /identity/v3/projects/c8a2139ece3e4b669c5c1262f24e6771/users/bfef9e4f835c4533acc3a00772c71561/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:01.702205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:01.702514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:01.702785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:01.761818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:01.763091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:01.868982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:01.870762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:01.960268 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2768/5535] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:01.977718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:01.979439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:02.118941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263dcc8-0bd0-461f-8cd0-93c42d7412fa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:02.120156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6568-051e-4287-8475-e76b180e4c08 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:02.124533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:02.129250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:02.131300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:02.131669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c607e-690f-43b8-a36e-9b6bcc407837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:02.132032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:02.132418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c607e-690f-43b8-a36e-9b6bcc407837 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:02.132736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c607e-690f-43b8-a36e-9b6bcc407837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:02.133803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c607e-690f-43b8-a36e-9b6bcc407837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:02.147044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:02.181513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:02.182573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c607e-690f-43b8-a36e-9b6bcc407837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:02.183901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:02.184049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c607e-690f-43b8-a36e-9b6bcc407837 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:02.218637 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2768/5536] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:02.225307 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2769/5537] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:12.205579 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:12.213570 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=56 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:12.910445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:12.925458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4390ac-4202-4441-91bc-4a89fa0db4d4 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:12.953149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751306d-11a4-4270-b868-2fac3465f115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:12.954137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751306d-11a4-4270-b868-2fac3465f115 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:12.957922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751306d-11a4-4270-b868-2fac3465f115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:12.958671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751306d-11a4-4270-b868-2fac3465f115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:12.965846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c751306d-11a4-4270-b868-2fac3465f115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:13.210923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751306d-11a4-4270-b868-2fac3465f115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:13.213422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751306d-11a4-4270-b868-2fac3465f115 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:13.230555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2769/5538] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:16.178106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb510d-557b-445c-b570-3c8cfb06d852 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:16.179321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb510d-557b-445c-b570-3c8cfb06d852 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:16.179871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb510d-557b-445c-b570-3c8cfb06d852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:16.246213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-80eb510d-557b-445c-b570-3c8cfb06d852 None None] MFA Rules not processed for user `bfef9e4f835c4533acc3a00772c71561`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:16.248975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80eb510d-557b-445c-b570-3c8cfb06d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:16.430010 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2770/5539] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:16.445587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:16.446122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:16.446587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:16.484318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] MFA Rules not processed for user `bfef9e4f835c4533acc3a00772c71561`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:16.486872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:16.502749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2770/5540] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:16.955122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147685a0-b7b7-46b3-8efd-a83e7291c238 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:16.955122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147685a0-b7b7-46b3-8efd-a83e7291c238 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:16.955122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147685a0-b7b7-46b3-8efd-a83e7291c238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:16.991938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-147685a0-b7b7-46b3-8efd-a83e7291c238 None None] MFA Rules not processed for user `f0524cc60bd640ca9ae88845970eb013`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:16.994228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-147685a0-b7b7-46b3-8efd-a83e7291c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:17.102765 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2771/5541] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:17.342582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:17.344345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:17.474016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ff7a-b080-4936-bc1b-1ee25365b37e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:17.482323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:17.483198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:17.483660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:17.484645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:17.498580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:17.500213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:17.513652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2771/5542] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:29:18.361085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147685a0-b7b7-46b3-8efd-a83e7291c238 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:18.375713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147685a0-b7b7-46b3-8efd-a83e7291c238 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:18.382350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:18.383348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:18.383841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:18.384321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:18.386901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:18.410215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:18.412426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:18.427428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2772/5543] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:27.508252 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=65 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:28.418844 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=67 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:33.341338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:33.342713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:33.449160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83bc84-2c82-4dd7-9bd0-17efbb0d9a69 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:33.454294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a72d5e-f37e-4a57-9b40-54d4ba252827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:33.454925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a72d5e-f37e-4a57-9b40-54d4ba252827 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:33.455200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a72d5e-f37e-4a57-9b40-54d4ba252827 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:33.455470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a72d5e-f37e-4a57-9b40-54d4ba252827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:33.457414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f3a72d5e-f37e-4a57-9b40-54d4ba252827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:33.471951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a72d5e-f37e-4a57-9b40-54d4ba252827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:33.473848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a72d5e-f37e-4a57-9b40-54d4ba252827 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:33.487337 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2772/5544] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:34.983786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:34.986202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:35.018355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb7547-3725-4e87-8bec-48faa1e8b548 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:35.031662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:35.032644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:35.033128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:35.034203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] PATH_INFO: `/v3/users/4c21c97f1c494126bd1c977f9c725deb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:35.036493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c21c97f1c494126bd1c977f9c725deb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:35.041207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:35.190773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c21c97f1c494126bd1c977f9c725deb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:35.210136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c21c97f1c494126bd1c977f9c725deb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:35.230078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c21c97f1c494126bd1c977f9c725deb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:35.231139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c21c97f1c494126bd1c977f9c725deb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:35.254509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c21c97f1c494126bd1c977f9c725deb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:35.267326 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2773/5545] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:29:34 2022] DELETE /identity/v3/users/4c21c97f1c494126bd1c977f9c725deb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:35.272220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:35.273180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:35.273745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:35.311864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:35.313543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:35.472912 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2773/5546] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:29:35.533333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:35.535280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:35.658980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3be4d-2251-41cf-aecc-46e4327abf72 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:35.668390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:35.669295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:35.670478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:35.670973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:35.698730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:35.700432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:35.728024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2774/5547] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:36.544647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:36.549205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:36.564754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb1851-a3ec-4d87-9b5b-09d2ded71452 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:36.572453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:36.573538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:36.600113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:36.600522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] PATH_INFO: `/v3/projects/99f8ebc3fe124ac095dbc051a37ea215` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:36.603981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f8ebc3fe124ac095dbc051a37ea215)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:36.608837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:36.752875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f8ebc3fe124ac095dbc051a37ea215', 'request_id': 'req-0090f618-b214-4603-acc6-e157d943d139'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:36.773476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f8ebc3fe124ac095dbc051a37ea215', 'request_id': 'req-0090f618-b214-4603-acc6-e157d943d139'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:36.809457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f8ebc3fe124ac095dbc051a37ea215', 'request_id': 'req-0090f618-b214-4603-acc6-e157d943d139'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:36.830313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] The token cache is being invalidate because project 99f8ebc3fe124ac095dbc051a37ea215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:29:36.830536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:36.836984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0090f618-b214-4603-acc6-e157d943d139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:36.846223 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2774/5548] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:29:36 2022] DELETE /identity/v3/projects/99f8ebc3fe124ac095dbc051a37ea215 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:36.850940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:36.885231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604c8f-3f01-4f3b-8b05-2fd05387be1e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:36.994131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:36.994952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:36.995321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:36.996201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] PATH_INFO: `/v3/users/c1b3fadf40124a94a57a31a5ecdae53d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:36.998164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b3fadf40124a94a57a31a5ecdae53d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:37.002531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:37.022893 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:37.112138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b3fadf40124a94a57a31a5ecdae53d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:37.138366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b3fadf40124a94a57a31a5ecdae53d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:37.165890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b3fadf40124a94a57a31a5ecdae53d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:37.167049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b3fadf40124a94a57a31a5ecdae53d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:37.178603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b3fadf40124a94a57a31a5ecdae53d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:37.241456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2775/5549] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:29:36 2022] DELETE /identity/v3/users/c1b3fadf40124a94a57a31a5ecdae53d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:37.987631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7292eb-f6d8-4022-9772-4cdeee8ccc59 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:37.988101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7292eb-f6d8-4022-9772-4cdeee8ccc59 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:37.988290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7292eb-f6d8-4022-9772-4cdeee8ccc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:38.005896 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:38.006594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:38.008231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:38.034130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5c7292eb-f6d8-4022-9772-4cdeee8ccc59 None None] MFA Rules not processed for user `bd0447e656f9418da68b308f19e8e807`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:38.036287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5c7292eb-f6d8-4022-9772-4cdeee8ccc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:38.133007 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2775/5550] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:38.174649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a64e1-57d3-4aea-84a2-7a9723a64b87 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:38.189461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:38.190120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:38.190387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:38.190847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] PATH_INFO: `/v3/projects/bc9d773334d7496a974d7679645bc887` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:38.193000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9d773334d7496a974d7679645bc887)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:38.197363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:38.305535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9d773334d7496a974d7679645bc887', 'request_id': 'req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.320547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9d773334d7496a974d7679645bc887', 'request_id': 'req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.335459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9d773334d7496a974d7679645bc887', 'request_id': 'req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.380921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] The token cache is being invalidate because project bc9d773334d7496a974d7679645bc887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:29:38.380921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.380921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.384147 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2776/5551] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:29:38 2022] DELETE /identity/v3/projects/bc9d773334d7496a974d7679645bc887 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:29:38.388599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7292eb-f6d8-4022-9772-4cdeee8ccc59 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:38.406187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7292eb-f6d8-4022-9772-4cdeee8ccc59 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:38.507653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:38.509374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:38.509660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:38.509932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] PATH_INFO: `/v3/users/3fa3e7a94f0c4762a83ceb8c27067baa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:38.511248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa3e7a94f0c4762a83ceb8c27067baa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:38.513914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:38.605886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa3e7a94f0c4762a83ceb8c27067baa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.620794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa3e7a94f0c4762a83ceb8c27067baa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.622119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa3e7a94f0c4762a83ceb8c27067baa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.645798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa3e7a94f0c4762a83ceb8c27067baa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.646649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1669445-4c68-46f6-8390-80533da4a41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa3e7a94f0c4762a83ceb8c27067baa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:38.678775 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2776/5552] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:29:38 2022] DELETE /identity/v3/users/3fa3e7a94f0c4762a83ceb8c27067baa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:40.202496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:40.214295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:40.249041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90b1b-3b5e-44b5-87f1-782ed8bdddb9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:40.297234 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:40.423534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:40.424799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:40.425301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:40.425691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] PATH_INFO: `/v3/projects/17bd163bf8204a588ada1d9d83988605` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:40.427465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17bd163bf8204a588ada1d9d83988605)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:40.430286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:40.578267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17bd163bf8204a588ada1d9d83988605', 'request_id': 'req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:40.591836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17bd163bf8204a588ada1d9d83988605', 'request_id': 'req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:40.600458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17bd163bf8204a588ada1d9d83988605', 'request_id': 'req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:40.621937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] The token cache is being invalidate because project 17bd163bf8204a588ada1d9d83988605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:29:40.622736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:40.623658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce84f5d3-f6db-4197-bdaa-78df3699b7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:40.626450 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2777/5553] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:29:40 2022] DELETE /identity/v3/projects/17bd163bf8204a588ada1d9d83988605 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:40.632231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad070aa-20ea-470d-90f0-df5723f11a97 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:40.634658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad070aa-20ea-470d-90f0-df5723f11a97 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:40.635337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad070aa-20ea-470d-90f0-df5723f11a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:40.672067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8ad070aa-20ea-470d-90f0-df5723f11a97 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:40.676271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ad070aa-20ea-470d-90f0-df5723f11a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:40.724884 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:40.820876 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2777/5554] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:40.828595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727df01-f5f7-43a0-8738-512dbca9844e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:40.828986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727df01-f5f7-43a0-8738-512dbca9844e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:40.829350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727df01-f5f7-43a0-8738-512dbca9844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:40.865880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8727df01-f5f7-43a0-8738-512dbca9844e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:40.867446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8727df01-f5f7-43a0-8738-512dbca9844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:40.901340 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2778/5555] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:29:40.906246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad070aa-20ea-470d-90f0-df5723f11a97 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:40.934827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad070aa-20ea-470d-90f0-df5723f11a97 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:40.953104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:40.954776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:40.955281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:40.955982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:40.958804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:29:40.959189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:40.963269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:41.000738 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2778/5556] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:29:41.002274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727df01-f5f7-43a0-8738-512dbca9844e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:41.032727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727df01-f5f7-43a0-8738-512dbca9844e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:41.037302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:41.037928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:41.038209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:41.038530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:41.039240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:41.042850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:41.100958 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2779/5557] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:29:41 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:29:41.104871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:41.118414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c674-a1f3-4c24-9e9b-8fd15f9b44ed admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:41.227305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:41.228478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:41.240659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:41.241257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:41.243693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:41.247265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:41.288135 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2779/5558] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:29:41 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:29:41.292859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:41.324912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636db73-7227-4474-9cc4-a2624e2dae4a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:41.356143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:41.357291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:41.357821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:41.358943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:41.359924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:41.361836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:41.397705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:41.398939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2780/5559] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:29:41.412260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99cf7f-bbe2-4dab-859c-73154508a833 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:41.422300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19e1c-c30d-4fa9-b282-4d7df0c1bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:41.423081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19e1c-c30d-4fa9-b282-4d7df0c1bbfa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:41.423433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19e1c-c30d-4fa9-b282-4d7df0c1bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:41.423774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19e1c-c30d-4fa9-b282-4d7df0c1bbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:41.424499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19e1c-c30d-4fa9-b282-4d7df0c1bbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:41.426586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19e1c-c30d-4fa9-b282-4d7df0c1bbfa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:41.446175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:41.452998 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2780/5560] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:29:41.460019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e46a-ba9b-4c6f-b35a-deae2df438ad admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:41.481458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:41.482343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:41.482580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:41.482846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] PATH_INFO: `/v3/projects/d3c12d1c655640b887ddf3290e67bbce/users/58a8fc237526469e85ab43847e480093/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:41.526866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c12d1c655640b887ddf3290e67bbce, user_id=58a8fc237526469e85ab43847e480093, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:41.529613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:41.568819 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2781/5561] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:29:41 2022] PUT /identity/v3/projects/d3c12d1c655640b887ddf3290e67bbce/users/58a8fc237526469e85ab43847e480093/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:41.569366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:41.569669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:41.569914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:41.656581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] MFA Rules not processed for user `58a8fc237526469e85ab43847e480093`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:41.656581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:41.859252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2781/5562] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:41.868905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:41.870960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:41.967325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3e91b-1981-43bb-8a8f-3dbbb518eaf3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:41.974515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:41.975224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:41.975830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:41.976186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:41.984742 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:42.000230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:42.006942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:42.025638 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2782/5563] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:51.847324 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:52.016884 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:53.222698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:53.224158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:53.394264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba21bb-8409-4818-bf8d-94ebfe27ddcc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:53.405787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:53.406942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:53.407525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:53.408096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] PATH_INFO: `/v3/users/d35661d01cfb4f8d90ea78c7c7ead1b6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:53.410050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35661d01cfb4f8d90ea78c7c7ead1b6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:53.412469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:53.517564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35661d01cfb4f8d90ea78c7c7ead1b6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:53.533860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35661d01cfb4f8d90ea78c7c7ead1b6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:53.534846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35661d01cfb4f8d90ea78c7c7ead1b6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:53.548054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35661d01cfb4f8d90ea78c7c7ead1b6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:53.548491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9f834d1-6c88-465f-bd33-543df343231a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35661d01cfb4f8d90ea78c7c7ead1b6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:53.585564 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2782/5564] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:29:53 2022] DELETE /identity/v3/users/d35661d01cfb4f8d90ea78c7c7ead1b6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:54.381150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:54.399685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf3b57-d1dc-4baf-b473-8cb05118feb4 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:54.537496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:54.538172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:54.538458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:54.538812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] PATH_INFO: `/v3/projects/032fcd2138744226a6b98ddeeef4766d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:54.539989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032fcd2138744226a6b98ddeeef4766d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:54.542512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:54.685890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032fcd2138744226a6b98ddeeef4766d', 'request_id': 'req-45d29253-f767-453c-b9c2-6363b299c596'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:54.693978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032fcd2138744226a6b98ddeeef4766d', 'request_id': 'req-45d29253-f767-453c-b9c2-6363b299c596'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:54.701668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032fcd2138744226a6b98ddeeef4766d', 'request_id': 'req-45d29253-f767-453c-b9c2-6363b299c596'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:54.721301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] The token cache is being invalidate because project 032fcd2138744226a6b98ddeeef4766d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:29:54.721707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:54.724137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45d29253-f767-453c-b9c2-6363b299c596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:29:54.726854 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2783/5565] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:29:54 2022] DELETE /identity/v3/projects/032fcd2138744226a6b98ddeeef4766d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:54.731481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4cf1-e5ba-4d86-a334-e11f385df6ce None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:54.732078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4cf1-e5ba-4d86-a334-e11f385df6ce None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:54.732078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4cf1-e5ba-4d86-a334-e11f385df6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:54.773512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ea1b4cf1-e5ba-4d86-a334-e11f385df6ce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:54.774771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ea1b4cf1-e5ba-4d86-a334-e11f385df6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:55.013137 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2783/5566] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:55.021415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b498e4f-c0e6-4886-ae77-1d79505969f6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.021908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b498e4f-c0e6-4886-ae77-1d79505969f6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.024901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b498e4f-c0e6-4886-ae77-1d79505969f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.110753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2b498e4f-c0e6-4886-ae77-1d79505969f6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:55.125695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2b498e4f-c0e6-4886-ae77-1d79505969f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:55.137832 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2784/5567] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:55.142293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4cf1-e5ba-4d86-a334-e11f385df6ce None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:55.164161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4cf1-e5ba-4d86-a334-e11f385df6ce None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:55.164161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:55.164161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.164161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.164659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.165848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:29:55.166157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:55.167781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:55.188817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2784/5568] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:29:55.192119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b498e4f-c0e6-4886-ae77-1d79505969f6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:55.203200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b498e4f-c0e6-4886-ae77-1d79505969f6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:55.209820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:55.210584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.210908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.211230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.211997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:55.214076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:55.258596 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2785/5569] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:29:55 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:29:55.259011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:55.272578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b34c-aad0-4da6-9531-ccfe7185e8f7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:55.281043 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:55.429135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:55.430059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.430517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.431646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.433266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:55.438020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:55.492125 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2785/5570] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:29:55 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:29:55.497081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:55.513896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31003cc-4c5c-470f-a688-2aa23dc34c21 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:55.544578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:55.546969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.549618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.549957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.550767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:55.564149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:55.608482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:55.609391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2786/5571] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:29:55.624456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264d76e-ae81-4935-9053-c805418d5813 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:55.649969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d44e52-2561-4904-9eb8-2ceb90a12d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:55.652655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44e52-2561-4904-9eb8-2ceb90a12d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.652974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44e52-2561-4904-9eb8-2ceb90a12d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.653256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44e52-2561-4904-9eb8-2ceb90a12d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.653943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d44e52-2561-4904-9eb8-2ceb90a12d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:55.655627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d44e52-2561-4904-9eb8-2ceb90a12d27 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:55.698638 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2786/5572] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:29:55.701059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:55.720829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bf4e6-6c76-441d-9d77-c9c0984693ff admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:55.732616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:55.734217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.734722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.735210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] PATH_INFO: `/v3/projects/7111e801da7a46f99a04f9a6d4a59312/users/aa5eb68dbbb34d1b9bc4ec9ebac6ff08/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.786209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7111e801da7a46f99a04f9a6d4a59312, user_id=aa5eb68dbbb34d1b9bc4ec9ebac6ff08, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:55.790746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:55.838504 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2787/5573] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:29:55 2022] PUT /identity/v3/projects/7111e801da7a46f99a04f9a6d4a59312/users/aa5eb68dbbb34d1b9bc4ec9ebac6ff08/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:29:55.840222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ace8-251a-4162-bc21-e0f6a3f6bad7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:55.840686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ace8-251a-4162-bc21-e0f6a3f6bad7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:55.840850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ace8-251a-4162-bc21-e0f6a3f6bad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:55.908183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d467ace8-251a-4162-bc21-e0f6a3f6bad7 None None] MFA Rules not processed for user `aa5eb68dbbb34d1b9bc4ec9ebac6ff08`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:55.909514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d467ace8-251a-4162-bc21-e0f6a3f6bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:56.049458 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2787/5574] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:56.060172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:56.061997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:56.220920 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:56.295420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf44f-918e-4c4e-9cea-8dc29e1059d0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:56.306951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:56.308628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:56.309982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:56.311385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:56.334821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:56.337575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:56.361891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2788/5575] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:29:57.639382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815bcb-0e95-4c1e-94f9-521a188602b4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:57.639908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815bcb-0e95-4c1e-94f9-521a188602b4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:57.639908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815bcb-0e95-4c1e-94f9-521a188602b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:57.681535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-77815bcb-0e95-4c1e-94f9-521a188602b4 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:57.684446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-77815bcb-0e95-4c1e-94f9-521a188602b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:57.892139 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2788/5576] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:57.958606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:57.960158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:58.109408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690124fe-3879-410b-bf5e-0a57614f4574 service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:58.115473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:58.116115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:58.116391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:58.116660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:58.130082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:58.132337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:29:58.151789 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2789/5577] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:29:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:29:59.831707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:59.832241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:59.832349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:59.877364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:29:59.879353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:29:59.911286 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2789/5578] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:29:59.921368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:29:59.946221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97ff50-9024-4cc9-9ba4-6d9e26ce0a4b service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:29:59.964456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dbebb-98e4-41dd-8e39-4371351d7d18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:29:59.965125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbebb-98e4-41dd-8e39-4371351d7d18 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:29:59.965403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbebb-98e4-41dd-8e39-4371351d7d18 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:29:59.965670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbebb-98e4-41dd-8e39-4371351d7d18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:29:59.985124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dbebb-98e4-41dd-8e39-4371351d7d18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:29:59.986790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dbebb-98e4-41dd-8e39-4371351d7d18 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:00.002955 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2790/5579] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:30:01.033431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:01.035240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:01.050639 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:01.291339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b24d82-9e71-448e-ab8b-3545fad12f4b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:01.306781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:01.307464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:01.307747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:01.308022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] PATH_INFO: `/v3/users/400e677f335446c0817c32b85e1e24b1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:01.314882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=400e677f335446c0817c32b85e1e24b1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:01.323034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:01.460080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400e677f335446c0817c32b85e1e24b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:01.481178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400e677f335446c0817c32b85e1e24b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:01.482322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400e677f335446c0817c32b85e1e24b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:01.503548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400e677f335446c0817c32b85e1e24b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:01.504281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400e677f335446c0817c32b85e1e24b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:01.569968 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2790/5580] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:01 2022] DELETE /identity/v3/users/400e677f335446c0817c32b85e1e24b1 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:01.761801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89f6a-bf0d-4300-a47b-0470f532ef7b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:01.762651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89f6a-bf0d-4300-a47b-0470f532ef7b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:01.763076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89f6a-bf0d-4300-a47b-0470f532ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:01.816460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cbd89f6a-bf0d-4300-a47b-0470f532ef7b None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:01.817743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cbd89f6a-bf0d-4300-a47b-0470f532ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:01.982170 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2791/5581] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:01.994975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:01.996595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:02.171080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d731-36eb-4436-9ed2-e5b137ccf07a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:02.188842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:02.189415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:02.189694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:02.190031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:02.215101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:02.216726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:02.244812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2791/5582] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:30:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:30:02.656315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f48b-4e3f-4d05-a898-2255edc8ba2c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:02.656600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f48b-4e3f-4d05-a898-2255edc8ba2c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:02.657056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f48b-4e3f-4d05-a898-2255edc8ba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:02.707481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2d43f48b-4e3f-4d05-a898-2255edc8ba2c None None] MFA Rules not processed for user `aa5eb68dbbb34d1b9bc4ec9ebac6ff08`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:02.708785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2d43f48b-4e3f-4d05-a898-2255edc8ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:02.812549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:02.814321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:02.826184 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:02.856398 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:02.871923 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2792/5583] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:03.047924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e1e0-3e5a-4d91-abd5-c66e8af216c4 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:03.054481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:03.055146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:03.055430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:03.055702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] PATH_INFO: `/v3/projects/0c6c6457b07a43f193af082ada523651` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:03.057180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6c6457b07a43f193af082ada523651)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:03.059423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:03.164860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6c6457b07a43f193af082ada523651', 'request_id': 'req-ac71285d-f070-45ab-a100-dd246180f5bc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:03.207625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6c6457b07a43f193af082ada523651', 'request_id': 'req-ac71285d-f070-45ab-a100-dd246180f5bc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:03.245257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6c6457b07a43f193af082ada523651', 'request_id': 'req-ac71285d-f070-45ab-a100-dd246180f5bc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:03.278357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] The token cache is being invalidate because project 0c6c6457b07a43f193af082ada523651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:03.280025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:03.281037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ac71285d-f070-45ab-a100-dd246180f5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:03.286874 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2792/5584] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:02 2022] DELETE /identity/v3/projects/0c6c6457b07a43f193af082ada523651 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:03.292104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd16ea-31bb-40e3-b4de-c6c86a1d96a1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:03.292323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd16ea-31bb-40e3-b4de-c6c86a1d96a1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:03.292792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd16ea-31bb-40e3-b4de-c6c86a1d96a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:03.334389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-aebd16ea-31bb-40e3-b4de-c6c86a1d96a1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:03.335958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aebd16ea-31bb-40e3-b4de-c6c86a1d96a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:03.485017 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2793/5585] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:03.486620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b5cbc-6aab-4ace-9c38-80909121a744 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:03.487222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b5cbc-6aab-4ace-9c38-80909121a744 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:03.487816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b5cbc-6aab-4ace-9c38-80909121a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:03.557097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-872b5cbc-6aab-4ace-9c38-80909121a744 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:03.566621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-872b5cbc-6aab-4ace-9c38-80909121a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:03.589010 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2793/5586] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:30:03.593364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd16ea-31bb-40e3-b4de-c6c86a1d96a1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:03.604848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd16ea-31bb-40e3-b4de-c6c86a1d96a1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:03.625279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:03.625932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:03.626210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:03.626481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:03.627439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:03.627575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:03.631271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:03.679658 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2794/5587] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:03.683960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b5cbc-6aab-4ace-9c38-80909121a744 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:03.696290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b5cbc-6aab-4ace-9c38-80909121a744 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:03.711380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:03.712279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:03.712656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:03.713125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:03.713905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:03.717318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:03.784073 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2794/5588] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:03 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:03.789158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:03.801750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff35f2-8fbf-457b-9544-7a4e4b5e8a0d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:03.919190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:03.919889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:03.920112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:03.920383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:03.921053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:03.923039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:03.968728 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2795/5589] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:03 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:03.970223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:03.983712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0530-87ee-4c84-bb12-d4bfcae4f206 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:03.989870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:03.990957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:03.991313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:03.991643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:03.992385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:03.994242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:04.014469 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2795/5590] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:30:04.019475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:04.034990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc713a-bdb6-4ec3-b7a6-661486e24c43 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:04.049537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7eea6-163f-4496-b760-9786df8d7772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:04.050659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7eea6-163f-4496-b760-9786df8d7772 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:04.051122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7eea6-163f-4496-b760-9786df8d7772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:04.051607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7eea6-163f-4496-b760-9786df8d7772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:04.053579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7eea6-163f-4496-b760-9786df8d7772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:04.055437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7eea6-163f-4496-b760-9786df8d7772 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:04.072098 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2796/5591] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:04.076312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:04.091679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ed1e5-8fe9-4258-bb7a-08801b142ce1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:04.103220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c1052-1e9a-4bfc-b797-c6a64eeb4de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:04.104299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c1052-1e9a-4bfc-b797-c6a64eeb4de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:04.104925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c1052-1e9a-4bfc-b797-c6a64eeb4de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:04.105286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c1052-1e9a-4bfc-b797-c6a64eeb4de1 admin admin] PATH_INFO: `/v3/projects/3d517c1a32d848318f1ec8d585b6bf59/users/5291995841a14b9da3075d5b45500312/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:04.164664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c1052-1e9a-4bfc-b797-c6a64eeb4de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d517c1a32d848318f1ec8d585b6bf59, user_id=5291995841a14b9da3075d5b45500312, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:04.167465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c1052-1e9a-4bfc-b797-c6a64eeb4de1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:04.195198 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2796/5592] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:04 2022] PUT /identity/v3/projects/3d517c1a32d848318f1ec8d585b6bf59/users/5291995841a14b9da3075d5b45500312/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:04.207643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f6f1-d892-4ca4-a45c-643ab257c962 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:04.208071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f6f1-d892-4ca4-a45c-643ab257c962 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:04.208430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f6f1-d892-4ca4-a45c-643ab257c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:04.258073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a244f6f1-d892-4ca4-a45c-643ab257c962 None None] MFA Rules not processed for user `5291995841a14b9da3075d5b45500312`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:04.259753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a244f6f1-d892-4ca4-a45c-643ab257c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:04.342933 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:04.370710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2835d-c990-4fe9-aad7-84c91c411a0a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:04.371275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2835d-c990-4fe9-aad7-84c91c411a0a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:04.371491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2835d-c990-4fe9-aad7-84c91c411a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:04.385031 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2797/5593] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:04 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:04.386875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f6f1-d892-4ca4-a45c-643ab257c962 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:04.416354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ced2835d-c990-4fe9-aad7-84c91c411a0a None None] MFA Rules not processed for user `aa5eb68dbbb34d1b9bc4ec9ebac6ff08`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:04.418033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ced2835d-c990-4fe9-aad7-84c91c411a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:04.502853 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:04.538911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f6f1-d892-4ca4-a45c-643ab257c962 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:04.551286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:04.552177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:04.553400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:04.554518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:04.555741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:04.561330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:04.570657 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2797/5594] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:30:04.682236 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2798/5595] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:04 2022] POST /identity/v3/projects => generated 399 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:04.685154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2835d-c990-4fe9-aad7-84c91c411a0a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:04.711046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2835d-c990-4fe9-aad7-84c91c411a0a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:04.872557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:04.873827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:04.874704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:04.875216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:04.876566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:04.878994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:04.924016 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2798/5596] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:04 2022] POST /identity/v3/users => generated 306 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:04.928698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:04.945068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd933f-6571-42a1-8a5d-3e13f0637787 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:04.963308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:04.963995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:04.965406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:04.966157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:04.967102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:04.968719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:05.006129 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2799/5597] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:05.008430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:05.024466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa306-bd75-4ecf-80ec-724be42ee235 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:05.043938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:05.045771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:05.046059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:05.047586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] PATH_INFO: `/v3/projects/7eddc181c8364071b3cf3ce8480eee80/users/5ae76b955cd847e29b3de274e749deda/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:05.091401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eddc181c8364071b3cf3ce8480eee80, user_id=5ae76b955cd847e29b3de274e749deda, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:05.098013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:05.144013 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2799/5598] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:05 2022] PUT /identity/v3/projects/7eddc181c8364071b3cf3ce8480eee80/users/5ae76b955cd847e29b3de274e749deda/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:05.147837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:05.163232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d467-c3e1-4610-9419-fe1d10dd4e37 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:05.302075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48792dd6-b1d6-4617-9383-23ffe23683a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:05.303042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48792dd6-b1d6-4617-9383-23ffe23683a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:05.303317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48792dd6-b1d6-4617-9383-23ffe23683a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:05.303585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48792dd6-b1d6-4617-9383-23ffe23683a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:05.304302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48792dd6-b1d6-4617-9383-23ffe23683a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:05.306537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48792dd6-b1d6-4617-9383-23ffe23683a6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:05.335105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:05.344445 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2800/5599] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:05.355240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc827485-8ba7-4899-b053-b6f72b7681dc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:05.362525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:05.363283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:05.363627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:05.363959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] PATH_INFO: `/v3/projects/7eddc181c8364071b3cf3ce8480eee80/users/5ae76b955cd847e29b3de274e749deda/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:05.367268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eddc181c8364071b3cf3ce8480eee80, user_id=5ae76b955cd847e29b3de274e749deda, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:05.370346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:05.384111 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2800/5600] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:05 2022] PUT /identity/v3/projects/7eddc181c8364071b3cf3ce8480eee80/users/5ae76b955cd847e29b3de274e749deda/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:05.394681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e2ad7-8b78-42c1-a90c-a32451f6e3ff None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:05.400688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e2ad7-8b78-42c1-a90c-a32451f6e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:05.401692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e2ad7-8b78-42c1-a90c-a32451f6e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:05.461343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3d9e2ad7-8b78-42c1-a90c-a32451f6e3ff None None] MFA Rules not processed for user `5ae76b955cd847e29b3de274e749deda`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:05.463614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d9e2ad7-8b78-42c1-a90c-a32451f6e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:05.515871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:05.519479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:05.629922 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:05.735488 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2801/5601] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:05 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:05.739031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e2ad7-8b78-42c1-a90c-a32451f6e3ff None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:05.754693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7ae9-a8c0-49ae-b59b-2095234f2448 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:05.771758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:05.772250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e2ad7-8b78-42c1-a90c-a32451f6e3ff None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:05.773956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:05.774492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:05.776017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] PATH_INFO: `/v3/users/bfef9e4f835c4533acc3a00772c71561` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:05.779890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfef9e4f835c4533acc3a00772c71561)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:05.786318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:05.788452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae76b955cd847e29b3de274e749deda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eddc181c8364071b3cf3ce8480eee80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:05.788724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:05.788978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:05.789315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:05.790034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:05.796265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:05.864097 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2802/5602] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:30:05 2022] POST /identity/v3/roles => generated 240 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:05.868133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:05.890694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5339f-68ab-41f8-815a-9652265f9e75 tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:05.902561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae76b955cd847e29b3de274e749deda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eddc181c8364071b3cf3ce8480eee80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:05.903424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:05.903813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:05.904196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] PATH_INFO: `/v3/projects/3d517c1a32d848318f1ec8d585b6bf59/users/5291995841a14b9da3075d5b45500312/roles/92895604c3a34d04b39cafb4109da212` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:05.906731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3d517c1a32d848318f1ec8d585b6bf59, user_id=5291995841a14b9da3075d5b45500312, role_id=92895604c3a34d04b39cafb4109da212)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:05.911774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:05.936387 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2803/5603] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:05 2022] PUT /identity/v3/projects/3d517c1a32d848318f1ec8d585b6bf59/users/5291995841a14b9da3075d5b45500312/roles/92895604c3a34d04b39cafb4109da212 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:05.940743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:05.953565 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:05.973438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfef9e4f835c4533acc3a00772c71561'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:05.998242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfef9e4f835c4533acc3a00772c71561'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:05.999603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfef9e4f835c4533acc3a00772c71561'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:06.012513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfef9e4f835c4533acc3a00772c71561'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:06.019866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c3994db4-0fa1-450c-9d45-3c685f556a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfef9e4f835c4533acc3a00772c71561'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:06.117578 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2801/5604] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:05 2022] DELETE /identity/v3/users/bfef9e4f835c4533acc3a00772c71561 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:06.120480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833478d7-489b-448e-b25c-403343f409ea tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:06.267031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5291995841a14b9da3075d5b45500312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d517c1a32d848318f1ec8d585b6bf59', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1213280379', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:06.274716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:06.275008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:06.275432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] PATH_INFO: `/v3/users/5291995841a14b9da3075d5b45500312/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:06.276211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] RBAC: Authorizing `identity:create_application_credential(user_id=5291995841a14b9da3075d5b45500312)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:06.277501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:06.432953 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2804/5605] 10.222.0.46 () {60 vars in 1315 bytes} [Sun Aug 21 01:30:05 2022] POST /identity/v3/users/5291995841a14b9da3075d5b45500312/application_credentials => generated 660 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:06.436381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:06.437285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:06.437737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:06.491906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] MFA Rules not processed for user `5291995841a14b9da3075d5b45500312`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:06.494197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:06.777177 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2802/5606] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 21 01:30:06.782179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:06.784817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:06.840516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa45f-d465-4ebe-ba1f-4667e2903654 tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:06.858247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5291995841a14b9da3075d5b45500312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d517c1a32d848318f1ec8d585b6bf59', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1213280379', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:06.859616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:06.860208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:06.860803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] PATH_INFO: `/v3/users/5291995841a14b9da3075d5b45500312/application_credentials/4ebc78d0d3674e34864f8c43836ce35f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:06.864269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5291995841a14b9da3075d5b45500312, application_credential_id=4ebc78d0d3674e34864f8c43836ce35f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:06.871304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:06.874935 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:06.978585 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2805/5607] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:30:06 2022] DELETE /identity/v3/users/5291995841a14b9da3075d5b45500312/application_credentials/4ebc78d0d3674e34864f8c43836ce35f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:06.983275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:06.985193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:07.118386 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:07.172258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e5bb4-f195-44f7-adae-09522017a9cb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:07.184972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae76b955cd847e29b3de274e749deda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eddc181c8364071b3cf3ce8480eee80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:07.186912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:07.190007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:07.190438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] PATH_INFO: `/v3/roles/92895604c3a34d04b39cafb4109da212` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:07.198603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: Authorizing `identity:delete_role(role_id=92895604c3a34d04b39cafb4109da212)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:07.202598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:07.517016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Invalidating the token cache because role 92895604c3a34d04b39cafb4109da212 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:07.517697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:07.522472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:07.533124 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2803/5608] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:06 2022] DELETE /identity/v3/roles/92895604c3a34d04b39cafb4109da212 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:07.538533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:07.544732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:07.722416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:07.724509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:07.775898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc773da7-6587-4fcc-a676-160469060c9c tempest-ApplicationCredentialsV3AdminTest-988113739 tempest-ApplicationCredentialsV3AdminTest-988113739-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:07.875729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a3300-fcd2-49c9-b906-5b343338763b tempest-ApplicationCredentialsV3AdminTest-26949875 tempest-ApplicationCredentialsV3AdminTest-26949875-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:07.882338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:07.883037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:07.883399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:07.883676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] PATH_INFO: `/v3/projects/c8a2139ece3e4b669c5c1262f24e6771` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:07.885223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a2139ece3e4b669c5c1262f24e6771)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:07.887585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:07.965782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:07.966701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:07.967125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:07.967559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] PATH_INFO: `/v3/users/5291995841a14b9da3075d5b45500312` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:07.975769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a2139ece3e4b669c5c1262f24e6771', 'request_id': 'req-8665938b-8c8e-4531-aaa6-b09333f4416d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:07.976937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5291995841a14b9da3075d5b45500312)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:07.979199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:07.985206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a2139ece3e4b669c5c1262f24e6771', 'request_id': 'req-8665938b-8c8e-4531-aaa6-b09333f4416d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:07.993816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a2139ece3e4b669c5c1262f24e6771', 'request_id': 'req-8665938b-8c8e-4531-aaa6-b09333f4416d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.006911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] The token cache is being invalidate because project c8a2139ece3e4b669c5c1262f24e6771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:08.007452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.008503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8665938b-8c8e-4531-aaa6-b09333f4416d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.010748 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2804/5609] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:07 2022] DELETE /identity/v3/projects/c8a2139ece3e4b669c5c1262f24e6771 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:08.016998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ad15-4601-4be4-a7a6-b85ab84661f9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:08.017990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ad15-4601-4be4-a7a6-b85ab84661f9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:08.020173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ad15-4601-4be4-a7a6-b85ab84661f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:08.068814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2667ad15-4601-4be4-a7a6-b85ab84661f9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:08.073247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2667ad15-4601-4be4-a7a6-b85ab84661f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:08.103442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5291995841a14b9da3075d5b45500312'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.129366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5291995841a14b9da3075d5b45500312'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.149081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5291995841a14b9da3075d5b45500312'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.150179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5291995841a14b9da3075d5b45500312'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.159448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-809fb7a3-5554-4e52-8ac6-250d3eae5a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5291995841a14b9da3075d5b45500312'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:08.172878 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2806/5610] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:07 2022] DELETE /identity/v3/users/5291995841a14b9da3075d5b45500312 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:08.175117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:08.175608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:08.176133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:08.223621 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:08.229430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:08.236448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:08.253292 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:08.271310 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2805/5611] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:08.273567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c479e6-7f87-4709-b1bc-267eb58fb48f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:08.273937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c479e6-7f87-4709-b1bc-267eb58fb48f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:08.274284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c479e6-7f87-4709-b1bc-267eb58fb48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:08.335803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-70c479e6-7f87-4709-b1bc-267eb58fb48f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:08.337990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-70c479e6-7f87-4709-b1bc-267eb58fb48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:08.420946 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2807/5612] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:08.422158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:08.423697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:08.478840 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2806/5613] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:30:08.482786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c479e6-7f87-4709-b1bc-267eb58fb48f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:08.493412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c479e6-7f87-4709-b1bc-267eb58fb48f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:08.509379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:08.510066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:08.510282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:08.510555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:08.511410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:08.511719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:08.513353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:08.552982 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2807/5614] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:30:08.553835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:08.562235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:08.583181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c05d0-96c0-48df-9980-4c2bc9f86046 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:08.588864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:08.589504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:08.589779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:08.590053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:08.591923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:08.614136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:08.618698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:08.648294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2808/5615] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:08.649244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:08.673270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d1c41-d7e5-4296-84a1-66f60dc188d0 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:08.688815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:08.689435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:08.689792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:08.690673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:08.691331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:08.693317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:08.694724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbac01-082e-4f59-8618-69b8b8c926f4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:08.698606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:08.699335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:08.699618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:08.699890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:08.721498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:08.722970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:08.750932 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2808/5616] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:08.787844 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2809/5617] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:08 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:08.792082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:08.813967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28b7a3-e2be-4d53-adc1-1b61156166ec service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:09.029295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:09.031196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:09.031323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:09.032163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:09.035059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:09.039814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:09.088901 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2809/5618] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:08 2022] POST /identity/v3/users => generated 303 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:09.091356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:09.127367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6f61-bb64-4d2a-b131-4f7ae82172f8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:09.135175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:09.136069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:09.136508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:09.136994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:09.137802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:09.141300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:09.166313 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2810/5619] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:09.170532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:09.183261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9219f6a-baf0-4598-95e2-6a127dae23f2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:09.190227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa4f0b-e26d-4ea1-b548-011036ad3a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:09.191661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4f0b-e26d-4ea1-b548-011036ad3a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:09.191932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4f0b-e26d-4ea1-b548-011036ad3a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:09.192203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4f0b-e26d-4ea1-b548-011036ad3a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:09.192927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa4f0b-e26d-4ea1-b548-011036ad3a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:09.194606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa4f0b-e26d-4ea1-b548-011036ad3a24 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:09.197453 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:09.213433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:09.223331 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2810/5620] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:30:09.226443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61d15e-8585-45fe-bc35-310c712633ca admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:09.231789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:09.232726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:09.233202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:09.233631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] PATH_INFO: `/v3/projects/9700d334841645fca1319e2b2bfbc03b/users/9af3b140e73141479d1a6e7d7b7266f2/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:09.250744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9700d334841645fca1319e2b2bfbc03b, user_id=9af3b140e73141479d1a6e7d7b7266f2, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:09.259257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:09.280667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2811/5621] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:09 2022] PUT /identity/v3/projects/9700d334841645fca1319e2b2bfbc03b/users/9af3b140e73141479d1a6e7d7b7266f2/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:09.285838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:09.286307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:09.286662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:09.337492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:09.340393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:09.546861 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2811/5622] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:09.590223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:09.716349 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:09.743552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ff67-4ec6-456e-8d4f-f362ca56e217 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:09.753198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:09.754176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:09.754582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:09.755017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:09.787016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:09.788701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:09.808702 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2812/5623] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:10.740622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:10.742917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:10.771403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419f091-3c03-41fc-9a37-8e65526a2e3e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:10.784993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:10.786922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:10.787215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:10.787477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] PATH_INFO: `/v3/projects/3d517c1a32d848318f1ec8d585b6bf59` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:10.789330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d517c1a32d848318f1ec8d585b6bf59)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:10.794140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:10.920941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d517c1a32d848318f1ec8d585b6bf59', 'request_id': 'req-6a810f87-e415-45dc-923a-40cb6499fcae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:10.940247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d517c1a32d848318f1ec8d585b6bf59', 'request_id': 'req-6a810f87-e415-45dc-923a-40cb6499fcae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:10.953902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d517c1a32d848318f1ec8d585b6bf59', 'request_id': 'req-6a810f87-e415-45dc-923a-40cb6499fcae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:10.984963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] The token cache is being invalidate because project 3d517c1a32d848318f1ec8d585b6bf59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:10.986931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:10.992421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:10.994186 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2812/5624] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:10 2022] DELETE /identity/v3/projects/3d517c1a32d848318f1ec8d585b6bf59 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:10.998686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:11.022543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19519e-bd5c-4061-b3b0-5203092c13df service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:11.167370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:11.168080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:11.168360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:11.168630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] PATH_INFO: `/v3/users/5ae76b955cd847e29b3de274e749deda` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:11.170824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae76b955cd847e29b3de274e749deda)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:11.176728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:11.285470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae76b955cd847e29b3de274e749deda'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:11.297600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae76b955cd847e29b3de274e749deda'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:11.357912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae76b955cd847e29b3de274e749deda'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:11.361507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae76b955cd847e29b3de274e749deda'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:11.389676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28a9e6f2-08d7-4637-9873-7405c77522de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae76b955cd847e29b3de274e749deda'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:11.429174 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2813/5625] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:10 2022] DELETE /identity/v3/users/5ae76b955cd847e29b3de274e749deda => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:14.527669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:14.533636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:14.556192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810f87-e415-45dc-923a-40cb6499fcae admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:14.776703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:14.777398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:14.777672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:14.777938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] PATH_INFO: `/v3/projects/7eddc181c8364071b3cf3ce8480eee80` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:14.784470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eddc181c8364071b3cf3ce8480eee80)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:14.786505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:14.864653 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:14.921801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eddc181c8364071b3cf3ce8480eee80', 'request_id': 'req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:14.937045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eddc181c8364071b3cf3ce8480eee80', 'request_id': 'req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:14.946622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eddc181c8364071b3cf3ce8480eee80', 'request_id': 'req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:14.974791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] The token cache is being invalidate because project 7eddc181c8364071b3cf3ce8480eee80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:14.975075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:14.975740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9ddd2956-c0e9-4618-8a0f-d4f08fea87f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:14.977314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2813/5626] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:14 2022] DELETE /identity/v3/projects/7eddc181c8364071b3cf3ce8480eee80 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:14.982326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f4fe-b181-4258-8e00-ad4330e4990d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:14.983488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f4fe-b181-4258-8e00-ad4330e4990d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:14.984504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f4fe-b181-4258-8e00-ad4330e4990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.035515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9251f4fe-b181-4258-8e00-ad4330e4990d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:15.037797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9251f4fe-b181-4258-8e00-ad4330e4990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:15.194984 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2814/5627] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:15.196328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d346d6-2d80-4144-8d59-e27da152807b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:15.196615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d346d6-2d80-4144-8d59-e27da152807b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:15.198075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d346d6-2d80-4144-8d59-e27da152807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.243595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e8d346d6-2d80-4144-8d59-e27da152807b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:15.245689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e8d346d6-2d80-4144-8d59-e27da152807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:15.281110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2814/5628] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:15.285192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251f4fe-b181-4258-8e00-ad4330e4990d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:15.299105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251f4fe-b181-4258-8e00-ad4330e4990d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:15.311231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:15.311872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:15.312145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:15.312413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.316032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:15.324593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:15.327990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:15.329874 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:15.368987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d346d6-2d80-4144-8d59-e27da152807b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:15.377074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2815/5629] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:15.381063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d346d6-2d80-4144-8d59-e27da152807b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:15.419104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:15.420488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:15.420838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:15.421116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.421778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:15.425781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:15.482541 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2815/5630] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:15 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:15.486928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:15.517216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17286acb-0ea4-4397-b79e-a24ca6bec728 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:15.691413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:15.692314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:15.693962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:15.694422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.697227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:15.704287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:15.749653 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2816/5631] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:15 2022] POST /identity/v3/users => generated 284 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:15.750214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:15.762470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddd1e-3d33-4dc3-8c1d-a4930a95e182 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:15.770699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:15.771335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:15.771617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:15.771953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.772615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:15.774279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:15.807333 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2816/5632] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:30:15.808832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:15.824249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687cb7a-e2ac-4991-b8f1-22fe61bb86a9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:15.839043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcd0d4-2812-4b1b-8ff3-cde071b2e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:15.839693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcd0d4-2812-4b1b-8ff3-cde071b2e9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:15.839974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcd0d4-2812-4b1b-8ff3-cde071b2e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:15.840247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcd0d4-2812-4b1b-8ff3-cde071b2e9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.840943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcd0d4-2812-4b1b-8ff3-cde071b2e9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:15.842619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcd0d4-2812-4b1b-8ff3-cde071b2e9a5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:15.860671 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2817/5633] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:15.862575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:15.884157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a70ca-ce77-49ac-972b-5e817de299ae admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:15.892890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:15.894110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:15.895940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:15.895940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] PATH_INFO: `/v3/projects/5e9692589853462f880d6a1e83e3bb40/users/3737e15fc5ed405ea32ef78ccb81738f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:15.958423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9692589853462f880d6a1e83e3bb40, user_id=3737e15fc5ed405ea32ef78ccb81738f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:15.966558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:16.005314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2817/5634] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:15 2022] PUT /identity/v3/projects/5e9692589853462f880d6a1e83e3bb40/users/3737e15fc5ed405ea32ef78ccb81738f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:16.027389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faa9c2-c655-4e8f-98b3-1eb6f9410c3f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:16.027941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faa9c2-c655-4e8f-98b3-1eb6f9410c3f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:16.027941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faa9c2-c655-4e8f-98b3-1eb6f9410c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:16.067079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d8faa9c2-c655-4e8f-98b3-1eb6f9410c3f None None] MFA Rules not processed for user `3737e15fc5ed405ea32ef78ccb81738f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:16.068731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d8faa9c2-c655-4e8f-98b3-1eb6f9410c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:16.186140 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2818/5635] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:16.190747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:16.382203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438caf3-8f79-4db5-a291-ef316944fdab admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:16.404920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:16.405787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:16.406175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:16.406551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:16.407363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:16.409816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:16.471171 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2818/5636] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:16 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:16.475967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8faa9c2-c655-4e8f-98b3-1eb6f9410c3f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:16.505380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8faa9c2-c655-4e8f-98b3-1eb6f9410c3f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:16.659282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:16.660413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:16.662673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:16.663129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:16.663953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:16.667618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:16.681297 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:16.726311 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2819/5637] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:16 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:16.730760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:16.752487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ffd53-06da-4b69-836d-9ec110550c6e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:16.777809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:16.778762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:16.780058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:16.781110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:16.782609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:16.785411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:16.810782 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2819/5638] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:16.814238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:16.835700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759189-e0db-4ac2-80a0-90cacfec031b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:16.853566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:16.854325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:16.854714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:16.855098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] PATH_INFO: `/v3/projects/d41d59904312495f8c9d310aabf4350c/users/50bad40931ca4c49b886e3866899ad06/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:16.894330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41d59904312495f8c9d310aabf4350c, user_id=50bad40931ca4c49b886e3866899ad06, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:16.897857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:16.925021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2820/5639] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:16 2022] PUT /identity/v3/projects/d41d59904312495f8c9d310aabf4350c/users/50bad40931ca4c49b886e3866899ad06/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:16.929539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:16.942877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef19a8-c7dd-4dc2-b758-9e379da0687b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:16.982059 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:17.097931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499be140-5f3b-49e4-b4ad-bf94b71a0a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.098735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499be140-5f3b-49e4-b4ad-bf94b71a0a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.099015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499be140-5f3b-49e4-b4ad-bf94b71a0a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.099284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499be140-5f3b-49e4-b4ad-bf94b71a0a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.106264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499be140-5f3b-49e4-b4ad-bf94b71a0a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.108022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499be140-5f3b-49e4-b4ad-bf94b71a0a9b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.145129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2820/5640] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:17.148587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:17.162241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253de78-13dc-476a-be33-f17690f8a062 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:17.172841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.173935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.177727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.177727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] PATH_INFO: `/v3/projects/d41d59904312495f8c9d310aabf4350c/users/50bad40931ca4c49b886e3866899ad06/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.194010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41d59904312495f8c9d310aabf4350c, user_id=50bad40931ca4c49b886e3866899ad06, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.198017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.225902 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2821/5641] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:17 2022] PUT /identity/v3/projects/d41d59904312495f8c9d310aabf4350c/users/50bad40931ca4c49b886e3866899ad06/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:17.229101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.229392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.229729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.314526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] MFA Rules not processed for user `50bad40931ca4c49b886e3866899ad06`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:17.316066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:17.438870 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2821/5642] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:17.443515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:17.457590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:17.460254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:17.466605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72726-f126-43a6-99f5-901b067eb0ce admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:17.471939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.472979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.473947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.475054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.477222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.479295 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:30:17.479295 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:30:17.479295 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:30:17.480593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.518947 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2822/5643] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:30:17 2022] POST /identity/v3/regions => generated 223 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:17.520450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:17.586973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fba31-9118-4a91-a0ba-8f50b97e29cd tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:17.600012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.602239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.604420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.604820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.605620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.608756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.623409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bf2b1-a892-47c3-807f-a7fdb43ace30 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:17.688492 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2823/5644] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:30:17 2022] POST /identity/v3/regions => generated 223 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:17.688741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.689865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:17.693853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.694140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.694420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.704238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:17.741527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.744437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.752549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61789-fdf6-46ee-9c25-7e956807403c tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:17.771991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.772653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.773086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.773372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/f2808fe0-fb4c-48ba-b713-3124e3aabd46` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.774590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:create_region(region_id=f2808fe0-fb4c-48ba-b713-3124e3aabd46)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.778708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.780178 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2822/5645] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:17.809861 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2824/5646] 10.222.0.46 () {60 vars in 1259 bytes} [Sun Aug 21 01:30:17 2022] PUT /identity/v3/regions/f2808fe0-fb4c-48ba-b713-3124e3aabd46 => generated 232 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:17.814542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:17.837323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd820-fbf3-4a06-99a6-72f9ae7ecf4d service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:17.859735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.860562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.861006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.861622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/f2808fe0-fb4c-48ba-b713-3124e3aabd46` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.863005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f2808fe0-fb4c-48ba-b713-3124e3aabd46)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.865690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.877631 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:17.898294 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2823/5647] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:30:17 2022] DELETE /identity/v3/regions/f2808fe0-fb4c-48ba-b713-3124e3aabd46 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:17.905164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:17.921639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a612d-c049-414a-b3bd-71e99e71ba64 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:17.954814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:17.955435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:17.955754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:17.956082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:17.956979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:17.958654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:17.989057 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2825/5648] 10.222.0.46 () {60 vars in 1150 bytes} [Sun Aug 21 01:30:17 2022] POST /identity/v3/regions => generated 254 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:17.995002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.013809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9af8b-cfc6-4e2e-a4d3-1618d03f66ca tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.041455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.042474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.042908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.043330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.044141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:update_region(region_id=d7b198e3d4f04daea448e4ecc4a1b399)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.047910 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:30:18.047910 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:30:18.047910 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:30:18.050370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.093858 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2824/5649] 10.222.0.46 () {60 vars in 1250 bytes} [Sun Aug 21 01:30:17 2022] PATCH /identity/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399 => generated 254 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:18.098365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.115703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f91c4-09a2-4f2e-b783-a8331808bea9 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.142678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.143603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.143881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.144246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.145168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:get_region(region_id=d7b198e3d4f04daea448e4ecc4a1b399)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.157511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.176433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.178393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:18.210241 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2826/5650] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:30:18 2022] GET /identity/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399 => generated 254 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:18.211626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.252440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb45b-af32-4919-9d0d-adfeb1025ca4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.266361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.268949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.269709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.273377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.274555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d7b198e3d4f04daea448e4ecc4a1b399)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.276900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.323328 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2827/5651] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:30:18 2022] DELETE /identity/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:18.323849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.389747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d2bc2-b751-4675-818a-953a8c917dcc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.390994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff685c-e97a-45dd-8f3a-05d6ecef0f96 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.401562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.404356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.405569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.406211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.407148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.408674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.420927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.421591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.422007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.422333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] PATH_INFO: `/v3/users/58a8fc237526469e85ab43847e480093` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.425667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a8fc237526469e85ab43847e480093)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.427963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.440257 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2828/5652] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:30:18 2022] GET /identity/v3/regions => generated 668 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:18.445690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.484365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde3687-d1d0-4ef7-8b72-114decd8857e tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.501100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.503541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.504673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.506082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.508101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d7b198e3d4f04daea448e4ecc4a1b399)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.510969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.523793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a8fc237526469e85ab43847e480093'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:18.535233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a8fc237526469e85ab43847e480093'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:18.535916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a8fc237526469e85ab43847e480093'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:18.546318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a8fc237526469e85ab43847e480093'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Could not find region: d7b198e3d4f04daea448e4ecc4a1b399.: keystone.exception.RegionNotFound: Could not find region: d7b198e3d4f04daea448e4ecc4a1b399. Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: d7b198e3d4f04daea448e4ecc4a1b399. Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:30:18.546997 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: d7b198e3d4f04daea448e4ecc4a1b399. Aug 21 01:30:18.548434 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:30:18.549603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7c1855b5-c652-4886-952c-008a64315c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a8fc237526469e85ab43847e480093'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:18.554190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2829/5653] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:30:18 2022] DELETE /identity/v3/regions/d7b198e3d4f04daea448e4ecc4a1b399 => generated 112 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:30:18.555661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.562610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:18.598510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4cf1-527b-475c-8b1f-6d561feff4fe tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.602304 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2825/5654] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:18 2022] DELETE /identity/v3/users/58a8fc237526469e85ab43847e480093 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:18.610411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd40ea-ca77-40a0-9571-9cd7859812db None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.610717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd40ea-ca77-40a0-9571-9cd7859812db None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.610989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd40ea-ca77-40a0-9571-9cd7859812db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.615762 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=8,keystone:SELECT=91,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:18.670252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5bdd40ea-ca77-40a0-9571-9cd7859812db None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:18.672583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5bdd40ea-ca77-40a0-9571-9cd7859812db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:18.724866 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:18.760230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.762235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.762528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.762805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.763901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.771732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.783345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2830/5655] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:30:18 2022] GET /identity/v3/regions => generated 668 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:18.788208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.813567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20980b7-e25d-4412-acba-9caafd64f146 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.828486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.829159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.829447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.829723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.830441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.836065 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2826/5656] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:18.839631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.871367 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2831/5657] 10.222.0.46 () {60 vars in 1150 bytes} [Sun Aug 21 01:30:18 2022] POST /identity/v3/regions => generated 253 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:18.875905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd40ea-ca77-40a0-9571-9cd7859812db None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.895741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:18.900551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:18.904658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd40ea-ca77-40a0-9571-9cd7859812db None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:18.952092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:18.953859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:18.954163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:18.954441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:18.959421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Adding query filter params (parent_region_id=a3882c1a25f446ed80c5513f5335c08d) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:18.959745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:18.962637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:18.987709 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2827/5658] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:30:18 2022] GET /identity/v3/regions?parent_region_id=a3882c1a25f446ed80c5513f5335c08d => generated 399 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:18.990945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:19.025932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47a4e-175e-426f-83d7-3336304e2b2f tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:19.029880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80e4f3-97c7-44aa-8fc2-de6bcfb8aae4 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:19.033389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:19.034077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:19.034590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:19.034875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/eecbff865cc54104890912c2c695d303` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:19.035475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=eecbff865cc54104890912c2c695d303)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:19.040127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:19.041994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:19.042987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:19.043444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:19.044592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:19.073897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:19.077910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:19.088094 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2828/5659] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:30:18 2022] DELETE /identity/v3/regions/eecbff865cc54104890912c2c695d303 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:19.101178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:19.131105 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2832/5660] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:30:19.160693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06833a2-f012-494d-8b79-3981a98346cc tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:19.170313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:19.171572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:19.171865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:19.175223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/e2e22e4339ea458a914f00acf4966f46` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:19.175223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e2e22e4339ea458a914f00acf4966f46)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:19.182502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:19.239034 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2829/5661] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:30:19 2022] DELETE /identity/v3/regions/e2e22e4339ea458a914f00acf4966f46 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:19.244332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:19.259767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2ce41-e54f-4c46-8c58-d51b41e8d5dd service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:19.297947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11769e-8a17-4692-bc2d-f48dcba76998 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bad40931ca4c49b886e3866899ad06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41d59904312495f8c9d310aabf4350c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:19.298226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11769e-8a17-4692-bc2d-f48dcba76998 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:19.299045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11769e-8a17-4692-bc2d-f48dcba76998 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:19.299045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11769e-8a17-4692-bc2d-f48dcba76998 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] PATH_INFO: `/v3/regions/a3882c1a25f446ed80c5513f5335c08d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:19.299362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11769e-8a17-4692-bc2d-f48dcba76998 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a3882c1a25f446ed80c5513f5335c08d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:19.300955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11769e-8a17-4692-bc2d-f48dcba76998 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:19.381585 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2833/5662] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:30:19 2022] DELETE /identity/v3/regions/a3882c1a25f446ed80c5513f5335c08d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:19.383945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:19.386248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:19.453257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7de1e-28ac-4547-8416-1ca6f5f75253 tempest-RegionsTestJSON-252260774 tempest-RegionsTestJSON-252260774-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:19.491178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:19.496598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:19.497247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:19.498012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] PATH_INFO: `/v3/users/3737e15fc5ed405ea32ef78ccb81738f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:19.501343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3737e15fc5ed405ea32ef78ccb81738f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:19.507876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:19.624430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3737e15fc5ed405ea32ef78ccb81738f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:19.638231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3737e15fc5ed405ea32ef78ccb81738f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:19.639276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3737e15fc5ed405ea32ef78ccb81738f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:19.653374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3737e15fc5ed405ea32ef78ccb81738f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:19.654179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3737e15fc5ed405ea32ef78ccb81738f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:19.679456 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2830/5663] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:19 2022] DELETE /identity/v3/users/3737e15fc5ed405ea32ef78ccb81738f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:19.684569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:19.684877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:19.685159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:19.732934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:19.734255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:19.839547 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:19.919204 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2834/5664] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:19.995960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:19.997477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:20.026933 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:20.173493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c502e-8ca2-438e-a3b5-5e386b48abac admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:20.181456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76ee31-e5f3-48ec-82ab-4fd9da24997c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:20.182108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ee31-e5f3-48ec-82ab-4fd9da24997c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:20.182387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ee31-e5f3-48ec-82ab-4fd9da24997c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:20.182656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ee31-e5f3-48ec-82ab-4fd9da24997c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:20.203320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76ee31-e5f3-48ec-82ab-4fd9da24997c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:20.204938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76ee31-e5f3-48ec-82ab-4fd9da24997c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:20.230590 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2831/5665] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:20.397837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:20.399416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:20.431798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8db2f-74d3-4dea-b071-8677bf8fedb4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:20.441242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:20.441986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:20.442278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:20.442463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] PATH_INFO: `/v3/projects/d3c12d1c655640b887ddf3290e67bbce` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:20.443626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c12d1c655640b887ddf3290e67bbce)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:20.445783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:20.575063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c12d1c655640b887ddf3290e67bbce', 'request_id': 'req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:20.592684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c12d1c655640b887ddf3290e67bbce', 'request_id': 'req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:20.606092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c12d1c655640b887ddf3290e67bbce', 'request_id': 'req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:20.631761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] The token cache is being invalidate because project d3c12d1c655640b887ddf3290e67bbce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:20.632096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:20.633121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fe7768c-aaa7-4678-b190-bf43f9ea7fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:20.635496 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2835/5666] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:20 2022] DELETE /identity/v3/projects/d3c12d1c655640b887ddf3290e67bbce => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:20.641605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc9bf-b3c9-4878-927a-6a6eab20a039 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:20.642159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc9bf-b3c9-4878-927a-6a6eab20a039 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:20.643539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc9bf-b3c9-4878-927a-6a6eab20a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:20.715787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-085dc9bf-b3c9-4878-927a-6a6eab20a039 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:20.720397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-085dc9bf-b3c9-4878-927a-6a6eab20a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:20.889068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52d3c-6692-4645-89db-ebdabfb51368 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:20.889360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52d3c-6692-4645-89db-ebdabfb51368 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:20.889640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52d3c-6692-4645-89db-ebdabfb51368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:20.890774 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2832/5667] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:20.961350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9ca52d3c-6692-4645-89db-ebdabfb51368 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:20.962767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ca52d3c-6692-4645-89db-ebdabfb51368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:20.993198 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2836/5668] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:30:20.998925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dc9bf-b3c9-4878-927a-6a6eab20a039 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.020210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dc9bf-b3c9-4878-927a-6a6eab20a039 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:21.028353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:21.028353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.028670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.028761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.030056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:21.030361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:21.032726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:21.053932 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2833/5669] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:21.055470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52d3c-6692-4645-89db-ebdabfb51368 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.065768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52d3c-6692-4645-89db-ebdabfb51368 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:21.070420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:21.071028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.071302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.071568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.072192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:21.074223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:21.121774 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2837/5670] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:21 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:21.123568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.135973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fca33-1eaa-4970-a7b5-10278d0fafcf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:21.303354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:21.304155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.305187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.305187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.306155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:21.319360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:21.375471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2834/5671] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:21 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:21.379838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.395604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e79d3c-31dc-467b-b210-1d4294559a37 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:21.414275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:21.415746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.416233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.416691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.417553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:21.419813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:21.436654 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2838/5672] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:30:21.442997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.460034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02bb7c-5875-42fc-bfec-4bcdc8a07ddb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:21.470988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c05e-4626-455b-a4f9-a06e5c348725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:21.472370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c05e-4626-455b-a4f9-a06e5c348725 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.472834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c05e-4626-455b-a4f9-a06e5c348725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.473283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c05e-4626-455b-a4f9-a06e5c348725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.474128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c05e-4626-455b-a4f9-a06e5c348725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:21.476887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c05e-4626-455b-a4f9-a06e5c348725 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:21.496245 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2835/5673] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:21.497163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.511810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442da9-9e09-424a-9741-958bd885e0e4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:21.528330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:21.529590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.543941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.544864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] PATH_INFO: `/v3/projects/b339b367412c4294b021172c1778fa92/users/382ce87324084b459505b2edde5a7196/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.577219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b339b367412c4294b021172c1778fa92, user_id=382ce87324084b459505b2edde5a7196, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:21.583589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:21.626250 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2839/5674] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:21 2022] PUT /identity/v3/projects/b339b367412c4294b021172c1778fa92/users/382ce87324084b459505b2edde5a7196/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:21.627899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.628262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.628539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.689802 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:21.703629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] MFA Rules not processed for user `382ce87324084b459505b2edde5a7196`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:21.705794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:21.837210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.839756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:21.844817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2836/5675] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:21.898262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:21.900985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:21.971506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26f01b-ef1a-45df-b82e-409c58875bad admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:21.979894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:21.981826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:21.981826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:21.998366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] PATH_INFO: `/v3/projects/5e9692589853462f880d6a1e83e3bb40` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:21.999926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9692589853462f880d6a1e83e3bb40)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:22.003120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:22.006882 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:22.043965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd03f6-78f1-4b3c-a003-e71df0edef01 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:22.048801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:22.049632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:22.050088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:22.050359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:22.066727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:22.068520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:22.090486 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2837/5676] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:22.124124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9692589853462f880d6a1e83e3bb40', 'request_id': 'req-8914a1ab-2bf8-4840-8e5a-8ca385773512'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.144993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9692589853462f880d6a1e83e3bb40', 'request_id': 'req-8914a1ab-2bf8-4840-8e5a-8ca385773512'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.152134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9692589853462f880d6a1e83e3bb40', 'request_id': 'req-8914a1ab-2bf8-4840-8e5a-8ca385773512'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.168357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] The token cache is being invalidate because project 5e9692589853462f880d6a1e83e3bb40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:22.168618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.169342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8914a1ab-2bf8-4840-8e5a-8ca385773512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.175208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:22.175531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2840/5677] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:21 2022] DELETE /identity/v3/projects/5e9692589853462f880d6a1e83e3bb40 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:22.196304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8b9d-90a1-49ca-ad85-8f2ed5ea5974 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:22.317919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:22.318486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:22.318906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:22.320295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] PATH_INFO: `/v3/users/50bad40931ca4c49b886e3866899ad06` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:22.327875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bad40931ca4c49b886e3866899ad06)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:22.331268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:22.447022 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:22.452860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bad40931ca4c49b886e3866899ad06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.481584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bad40931ca4c49b886e3866899ad06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.483322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bad40931ca4c49b886e3866899ad06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.493507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bad40931ca4c49b886e3866899ad06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.502638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bad40931ca4c49b886e3866899ad06'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:22.532048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2838/5678] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:22 2022] DELETE /identity/v3/users/50bad40931ca4c49b886e3866899ad06 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:22.665945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e400e3-48fc-4531-b1e0-2fac9e3e31f4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:22.666837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e400e3-48fc-4531-b1e0-2fac9e3e31f4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:22.667371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e400e3-48fc-4531-b1e0-2fac9e3e31f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:22.758467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-27e400e3-48fc-4531-b1e0-2fac9e3e31f4 None None] MFA Rules not processed for user `9af3b140e73141479d1a6e7d7b7266f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:22.762552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-27e400e3-48fc-4531-b1e0-2fac9e3e31f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:22.894119 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2841/5679] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:22.898840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:22.900911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:22.987115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010bd9-c9b9-4f7d-b759-e25691d69678 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:22.994939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:22.995595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:22.995883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:22.996159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:22.996851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:22.999776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:23.039852 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2839/5680] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:22 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:23.041104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e400e3-48fc-4531-b1e0-2fac9e3e31f4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:23.055855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e400e3-48fc-4531-b1e0-2fac9e3e31f4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:23.137137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:23.137860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:23.138250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:23.138517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:23.139522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:23.147630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:23.203777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2842/5681] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:23 2022] POST /identity/v3/users => generated 303 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:23.208541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:23.226148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337431-c2c7-46b0-b722-6b046e41a6b9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:23.242166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:23.242809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:23.243083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:23.243357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:23.244016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:23.252127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:23.274919 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2840/5682] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:23.278738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:23.289524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59768f8-d2cc-4a09-85ac-9c2ed4fa2bea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:23.294457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:23.296468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:23.296468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:23.296671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:23.297427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:23.299375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:23.306139 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:23.316033 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2843/5683] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:23.317397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:23.335218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117494-2a12-4e94-b2b4-ddf89e8e9f38 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:23.345485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14562168-b947-4372-bafc-bc87ee5d6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:23.346212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14562168-b947-4372-bafc-bc87ee5d6745 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:23.346442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14562168-b947-4372-bafc-bc87ee5d6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:23.346736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14562168-b947-4372-bafc-bc87ee5d6745 admin admin] PATH_INFO: `/v3/projects/9a073fbd601544e5a39dff3bf0703583/users/e7850bbac189450495a33daf0b0d7429/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:23.377900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14562168-b947-4372-bafc-bc87ee5d6745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a073fbd601544e5a39dff3bf0703583, user_id=e7850bbac189450495a33daf0b0d7429, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:23.386637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14562168-b947-4372-bafc-bc87ee5d6745 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:23.416533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2841/5684] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:23 2022] PUT /identity/v3/projects/9a073fbd601544e5a39dff3bf0703583/users/e7850bbac189450495a33daf0b0d7429/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:24.410027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:24.412077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:24.434954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9084af-b58f-45d1-9dcf-8ab40dcf4c66 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:24.531691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:24.532537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:24.533101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:24.533629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] PATH_INFO: `/v3/projects/d41d59904312495f8c9d310aabf4350c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:24.536464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41d59904312495f8c9d310aabf4350c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:24.539023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:24.616643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41d59904312495f8c9d310aabf4350c', 'request_id': 'req-e3f770d0-a308-4775-ad83-88260464829c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:24.626288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41d59904312495f8c9d310aabf4350c', 'request_id': 'req-e3f770d0-a308-4775-ad83-88260464829c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:24.635657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41d59904312495f8c9d310aabf4350c', 'request_id': 'req-e3f770d0-a308-4775-ad83-88260464829c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:24.650099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] The token cache is being invalidate because project d41d59904312495f8c9d310aabf4350c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:24.650747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:24.651486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3f770d0-a308-4775-ad83-88260464829c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:24.655988 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2844/5685] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:24 2022] DELETE /identity/v3/projects/d41d59904312495f8c9d310aabf4350c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:24.663486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991b942-86c9-4aca-8a12-94ab762edae7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:24.664360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991b942-86c9-4aca-8a12-94ab762edae7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:24.664807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991b942-86c9-4aca-8a12-94ab762edae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:24.692266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e991b942-86c9-4aca-8a12-94ab762edae7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:24.693600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e991b942-86c9-4aca-8a12-94ab762edae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:24.764133 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2842/5686] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:24.774434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2725c9-f392-40fd-8063-8e2b0ebc745a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:24.775099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2725c9-f392-40fd-8063-8e2b0ebc745a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:24.776160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2725c9-f392-40fd-8063-8e2b0ebc745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:24.804946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7b2725c9-f392-40fd-8063-8e2b0ebc745a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:24.807808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7b2725c9-f392-40fd-8063-8e2b0ebc745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:24.817531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2845/5687] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:24.822072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991b942-86c9-4aca-8a12-94ab762edae7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:24.832716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991b942-86c9-4aca-8a12-94ab762edae7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:24.840296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:24.841124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:24.841474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:24.841816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:24.843631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:24.843631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:24.844898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:24.860096 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:24.869944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2725c9-f392-40fd-8063-8e2b0ebc745a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:24.879495 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2843/5688] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:30:24.885465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2725c9-f392-40fd-8063-8e2b0ebc745a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:24.902877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:24.904546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:24.905395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:24.905844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:24.906851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:24.911376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:24.979262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2846/5689] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:24 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:24.980296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:24.996231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dadcb-9a49-4bcf-beef-92699c0833eb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.083505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.084198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.084470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.085085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.085610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.087849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.116240 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2844/5690] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:24 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:25.118700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:25.130715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df029e-4db9-4fc0-9b70-f6ccf231bb79 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.138233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.138865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.139144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.139417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.140067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.141735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.156752 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2847/5691] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:25.157657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:25.175455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195d33f-6874-441f-8913-d6f0a2602fa8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.184475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a9902-a9ec-47fb-85ca-3f3cef5d97cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.185261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9902-a9ec-47fb-85ca-3f3cef5d97cf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.185425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9902-a9ec-47fb-85ca-3f3cef5d97cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.185686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9902-a9ec-47fb-85ca-3f3cef5d97cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.186366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a9902-a9ec-47fb-85ca-3f3cef5d97cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.188156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a9902-a9ec-47fb-85ca-3f3cef5d97cf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.209137 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2845/5692] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:25.210640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:25.223038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3386-e07c-4e16-aebf-bc4e5e35205d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.228346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.229313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.229587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.229859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] PATH_INFO: `/v3/projects/378154d3002c4a18b178c6654ad4bf9b/users/33433d4aa82048c6b6d8a06326d98031/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.247490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=378154d3002c4a18b178c6654ad4bf9b, user_id=33433d4aa82048c6b6d8a06326d98031, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.250831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.274348 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2848/5693] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:25 2022] PUT /identity/v3/projects/378154d3002c4a18b178c6654ad4bf9b/users/33433d4aa82048c6b6d8a06326d98031/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:25.289584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b055e8-b8fb-46dc-a861-376eca4c06fd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.289939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b055e8-b8fb-46dc-a861-376eca4c06fd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.290257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b055e8-b8fb-46dc-a861-376eca4c06fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.383530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-09b055e8-b8fb-46dc-a861-376eca4c06fd None None] MFA Rules not processed for user `33433d4aa82048c6b6d8a06326d98031`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:25.385477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-09b055e8-b8fb-46dc-a861-376eca4c06fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:25.529785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:25.531967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:25.544516 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2846/5694] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:25.547671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b055e8-b8fb-46dc-a861-376eca4c06fd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:25.573378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b055e8-b8fb-46dc-a861-376eca4c06fd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.587405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.587952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.588295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.588493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.589599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:create_application_credential(user_id=33433d4aa82048c6b6d8a06326d98031)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.590791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.605128 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:25.698521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981a6c-15d8-4900-bd2f-1067445a8a3e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.707496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.708228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.708910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.709737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.712247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:25.735176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.737818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.755560 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2849/5695] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:30:25.773770 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:25.796721 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2847/5696] 10.222.0.46 () {60 vars in 1315 bytes} [Sun Aug 21 01:30:25 2022] POST /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials => generated 920 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:25.801384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:25.815982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897857ec-2a79-47b4-aa96-3652f473614b service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.821929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.822663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.823216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.823612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules/50077f7666c34bd194d0b0425afeebae` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.831491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:delete_access_rule(user_id=33433d4aa82048c6b6d8a06326d98031, access_rule_id=50077f7666c34bd194d0b0425afeebae)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.831491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application session.delete(ref) Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application yield resource Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application next(self.gen) Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:30:25.891141 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise self.value Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application session.commit() Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.session.flush() Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 01:30:25.892287 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application compat.raise_( Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._synchronize( Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise AssertionError( Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 21 01:30:25.893440 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:30:25.894625 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:30:25.895659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 21 01:30:25.895659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 21 01:30:25.895659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 21 01:30:25.895659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 21 01:30:25.895659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 21 01:30:25.895659 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:30:25.895659 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2850/5697] 10.222.0.46 () {58 vars in 1362 bytes} [Sun Aug 21 01:30:25 2022] DELETE /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules/50077f7666c34bd194d0b0425afeebae => generated 89 bytes in 94 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 21 01:30:25.898972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:25.912640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10b3e-cb01-4e76-aaca-399b0e83b88f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:25.918482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:25.919196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:25.919723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:25.920395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials/5c719493181f4601af32594d7ed67457` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:25.936815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:delete_application_credential(user_id=33433d4aa82048c6b6d8a06326d98031, application_credential_id=5c719493181f4601af32594d7ed67457)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:25.938833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:25.979073 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2848/5698] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:30:25 2022] DELETE /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials/5c719493181f4601af32594d7ed67457 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:25.980840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.019634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575e44-19ff-42e9-9148-a0acbc78f924 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.034450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.037198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.037863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.040651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.051592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:list_access_rules(user_id=33433d4aa82048c6b6d8a06326d98031)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.058053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.073492 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2851/5699] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:30:25 2022] GET /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules => generated 369 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:26.077844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.092956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c31fc-0134-4cbd-8f42-c46e20556f7e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.105653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.106401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.106690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.108826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules/50077f7666c34bd194d0b0425afeebae` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.112341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:delete_access_rule(user_id=33433d4aa82048c6b6d8a06326d98031, access_rule_id=50077f7666c34bd194d0b0425afeebae)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.113734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.187947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2849/5700] 10.222.0.46 () {58 vars in 1362 bytes} [Sun Aug 21 01:30:26 2022] DELETE /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules/50077f7666c34bd194d0b0425afeebae => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:26.193249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.211397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5f8d6-e9b3-4e0c-ba75-0ac4c06774da tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.222141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.223395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.223395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.223648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.230793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:list_access_rules(user_id=33433d4aa82048c6b6d8a06326d98031)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.232318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.252976 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2852/5701] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:30:26 2022] GET /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules => generated 158 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:26.258106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.274321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59aad-9b5a-4885-91d0-63e3fbb70338 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.280859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.281548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.282507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.283016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.284008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:create_application_credential(user_id=33433d4aa82048c6b6d8a06326d98031)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.285283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.419098 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2850/5702] 10.222.0.46 () {60 vars in 1315 bytes} [Sun Aug 21 01:30:26 2022] POST /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials => generated 921 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:26.421207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.442696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa878eb-81db-4cc7-b907-b0f93458ae1f tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.455263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.491760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.497099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.499274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.509985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:list_access_rules(user_id=33433d4aa82048c6b6d8a06326d98031)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.519854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.539227 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2853/5703] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:30:26 2022] GET /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules => generated 369 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:26.544426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.558193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6f4e7-9c22-4dfa-bf2f-196889f53eaf tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.571398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.572504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.572975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.573405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.574233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:create_application_credential(user_id=33433d4aa82048c6b6d8a06326d98031)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.578566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.689161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.694067 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2851/5704] 10.222.0.46 () {60 vars in 1315 bytes} [Sun Aug 21 01:30:26 2022] POST /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/application_credentials => generated 920 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:26.699758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0556-0f96-4399-9b6f-2e672610cb3e tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.704535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30afc8-81e9-40c6-bad2-399e7ef41a54 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33433d4aa82048c6b6d8a06326d98031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '378154d3002c4a18b178c6654ad4bf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.705454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30afc8-81e9-40c6-bad2-399e7ef41a54 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.705811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30afc8-81e9-40c6-bad2-399e7ef41a54 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.706157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30afc8-81e9-40c6-bad2-399e7ef41a54 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules/e08c89be792c4fd9b83b795ed704fa33` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.707425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30afc8-81e9-40c6-bad2-399e7ef41a54 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorizing `identity:get_access_rule(user_id=33433d4aa82048c6b6d8a06326d98031, access_rule_id=e08c89be792c4fd9b83b795ed704fa33)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.709025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30afc8-81e9-40c6-bad2-399e7ef41a54 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.721705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:26.722231 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2854/5705] 10.222.0.46 () {58 vars in 1359 bytes} [Sun Aug 21 01:30:26 2022] GET /identity/v3/users/33433d4aa82048c6b6d8a06326d98031/access_rules/e08c89be792c4fd9b83b795ed704fa33 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:26.740963 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:26.813250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e554f-d0e2-4b13-8d66-93ddab4e6d00 tempest-AccessRulesV3Test-1860062973 tempest-AccessRulesV3Test-1860062973-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:26.818770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:26.819529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:26.819879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:26.820214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] PATH_INFO: `/v3/users/33433d4aa82048c6b6d8a06326d98031` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:26.821491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33433d4aa82048c6b6d8a06326d98031)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:26.823746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:26.896003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33433d4aa82048c6b6d8a06326d98031'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:26.910970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33433d4aa82048c6b6d8a06326d98031'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:26.912601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33433d4aa82048c6b6d8a06326d98031'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:26.925157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33433d4aa82048c6b6d8a06326d98031'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:26.927009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33433d4aa82048c6b6d8a06326d98031'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:27.004489 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2852/5706] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:26 2022] DELETE /identity/v3/users/33433d4aa82048c6b6d8a06326d98031 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:27.006545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:27.006837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:27.007106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:27.052930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:27.054249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:27.181298 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2855/5707] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:27.211099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:27.212878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:27.367436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c1f91-b147-4efe-bacc-aa7482e09082 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:27.380660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e24fcd-7f04-4adc-b887-da350cf5f3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:27.381577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24fcd-7f04-4adc-b887-da350cf5f3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:27.382027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24fcd-7f04-4adc-b887-da350cf5f3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:27.382403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24fcd-7f04-4adc-b887-da350cf5f3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:27.415364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e24fcd-7f04-4adc-b887-da350cf5f3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:27.417381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e24fcd-7f04-4adc-b887-da350cf5f3f1 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:27.434069 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2853/5708] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:29.343268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:29.349327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:29.451194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6e311-815a-4fc5-a92f-acf61fa6d0c5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:29.481721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:29.482777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:29.483066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:29.483339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] PATH_INFO: `/v3/projects/378154d3002c4a18b178c6654ad4bf9b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:29.484684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=378154d3002c4a18b178c6654ad4bf9b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:29.492197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:29.668738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378154d3002c4a18b178c6654ad4bf9b', 'request_id': 'req-efc861b2-820d-4be8-9a98-7ba092d0e5de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:29.714510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378154d3002c4a18b178c6654ad4bf9b', 'request_id': 'req-efc861b2-820d-4be8-9a98-7ba092d0e5de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:29.741798 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:29.755630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378154d3002c4a18b178c6654ad4bf9b', 'request_id': 'req-efc861b2-820d-4be8-9a98-7ba092d0e5de'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:29.782076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] The token cache is being invalidate because project 378154d3002c4a18b178c6654ad4bf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:29.782368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:29.783115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-efc861b2-820d-4be8-9a98-7ba092d0e5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:29.789881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2856/5709] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:29 2022] DELETE /identity/v3/projects/378154d3002c4a18b178c6654ad4bf9b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:29.792513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bffa8d-87df-417d-8511-621d7a00e07a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:29.793006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bffa8d-87df-417d-8511-621d7a00e07a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:29.793222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bffa8d-87df-417d-8511-621d7a00e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:29.897521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-16bffa8d-87df-417d-8511-621d7a00e07a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:29.909324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-16bffa8d-87df-417d-8511-621d7a00e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:29.938713 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:30.362722 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2854/5710] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:30.369056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e29c8e-35f0-4b4c-a59b-957446e0711e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:30.369589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e29c8e-35f0-4b4c-a59b-957446e0711e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:30.369675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e29c8e-35f0-4b4c-a59b-957446e0711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:30.459161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-29e29c8e-35f0-4b4c-a59b-957446e0711e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:30.478609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-29e29c8e-35f0-4b4c-a59b-957446e0711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:30.529848 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2857/5711] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:30.533258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bffa8d-87df-417d-8511-621d7a00e07a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:30.558877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bffa8d-87df-417d-8511-621d7a00e07a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:30.599162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:30.604750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:30.605391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:30.605900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:30.606841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:30.608114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:30.611072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:30.677725 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2855/5712] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:30.678135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e29c8e-35f0-4b4c-a59b-957446e0711e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:30.717309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e29c8e-35f0-4b4c-a59b-957446e0711e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:30.753823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:30.757883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:30.759922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:30.761025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:30.763560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:30.800117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:30.936994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2858/5713] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:30 2022] POST /identity/v3/projects => generated 363 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:30.942702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:30.967207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edeb88-d56d-42e1-9993-92ae86fd5525 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:31.245602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:31.246407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:31.246794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:31.248980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:31.248980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:31.252183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:31.309534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2856/5714] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:30 2022] POST /identity/v3/users => generated 282 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:31.314144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:31.361728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965958c7-2c65-471f-8560-a6646845de3c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:31.380948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:31.391311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:31.391572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:31.394132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:31.398702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:31.410668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:31.450627 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2859/5715] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:31.451670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:31.494630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1bd12-d4a2-49ca-8111-30f480447b34 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:31.529325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d66f7-973a-4cfe-9cfc-4bc5137dcb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:31.534439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d66f7-973a-4cfe-9cfc-4bc5137dcb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:31.536649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d66f7-973a-4cfe-9cfc-4bc5137dcb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:31.537929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d66f7-973a-4cfe-9cfc-4bc5137dcb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:31.542731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d66f7-973a-4cfe-9cfc-4bc5137dcb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:31.544894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d66f7-973a-4cfe-9cfc-4bc5137dcb96 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:31.596531 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2857/5716] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:30:31.602854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:31.626466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5359642-40b8-4dd6-8533-9966b45dcbd1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:31.652408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:31.653438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:31.656182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:31.660388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] PATH_INFO: `/v3/projects/c42d3760f4bc409c9cbcb1d6456402bb/users/1e6af6dd92da432da9f1d61748264509/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:31.712521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42d3760f4bc409c9cbcb1d6456402bb, user_id=1e6af6dd92da432da9f1d61748264509, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:31.723096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:31.795428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2860/5717] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:31 2022] PUT /identity/v3/projects/c42d3760f4bc409c9cbcb1d6456402bb/users/1e6af6dd92da432da9f1d61748264509/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:31.797354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e273d-f48f-4eeb-a763-03b88dc07209 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:31.798770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e273d-f48f-4eeb-a763-03b88dc07209 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:31.798770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e273d-f48f-4eeb-a763-03b88dc07209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:31.904809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4a0e273d-f48f-4eeb-a763-03b88dc07209 None None] MFA Rules not processed for user `1e6af6dd92da432da9f1d61748264509`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:31.909061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a0e273d-f48f-4eeb-a763-03b88dc07209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:32.169231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2858/5718] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:32.170504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:32.193998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008d8f6-ea13-48f4-bed8-72c566a123d5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:32.218205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6d835-2b52-41db-bfaa-393cc2a0b082 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6af6dd92da432da9f1d61748264509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c42d3760f4bc409c9cbcb1d6456402bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:32.221151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d835-2b52-41db-bfaa-393cc2a0b082 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:32.227786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d835-2b52-41db-bfaa-393cc2a0b082 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:32.228338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d835-2b52-41db-bfaa-393cc2a0b082 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] PATH_INFO: `/v3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:32.231286 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2861/5719] 10.222.0.46 () {58 vars in 1104 bytes} [Sun Aug 21 01:30:32 2022] GET /identity/v3 => generated 255 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:32.235146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e273d-f48f-4eeb-a763-03b88dc07209 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:32.263330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e273d-f48f-4eeb-a763-03b88dc07209 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:32.283643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18b5c5-078a-47e5-a790-da1fa96d76ee tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6af6dd92da432da9f1d61748264509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c42d3760f4bc409c9cbcb1d6456402bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:32.285668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18b5c5-078a-47e5-a790-da1fa96d76ee tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:32.285957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18b5c5-078a-47e5-a790-da1fa96d76ee tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:32.286229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18b5c5-078a-47e5-a790-da1fa96d76ee tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] PATH_INFO: `/v3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:32.301232 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2859/5720] 10.222.0.46 () {58 vars in 1104 bytes} [Sun Aug 21 01:30:32 2022] GET /identity/v3 => generated 255 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:32.305310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6d835-2b52-41db-bfaa-393cc2a0b082 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:32.320019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6d835-2b52-41db-bfaa-393cc2a0b082 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:32.332804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e63f-f3d4-41e1-b0fa-8b13a6b65d65 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6af6dd92da432da9f1d61748264509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c42d3760f4bc409c9cbcb1d6456402bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:32.333768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e63f-f3d4-41e1-b0fa-8b13a6b65d65 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:32.334046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e63f-f3d4-41e1-b0fa-8b13a6b65d65 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:32.334316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e63f-f3d4-41e1-b0fa-8b13a6b65d65 tempest-TestApiDiscovery-2552179 tempest-TestApiDiscovery-2552179-project] PATH_INFO: `/v3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:32.335678 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2862/5721] 10.222.0.46 () {58 vars in 1104 bytes} [Sun Aug 21 01:30:32 2022] GET /identity/v3 => generated 255 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:32.342183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854080d-dfc3-4196-a70a-0832346cce34 None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:32.342463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854080d-dfc3-4196-a70a-0832346cce34 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:32.342731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854080d-dfc3-4196-a70a-0832346cce34 None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:32.344255 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2860/5722] 10.222.0.46 () {56 vars in 895 bytes} [Sun Aug 21 01:30:32 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:30:32.349676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8395dc-fcad-46d1-8619-06ebec1eaa54 None None] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:32.349933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8395dc-fcad-46d1-8619-06ebec1eaa54 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:32.350205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8395dc-fcad-46d1-8619-06ebec1eaa54 None None] PATH_INFO: `/` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:32.351820 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2863/5723] 10.222.0.46 () {56 vars in 895 bytes} [Sun Aug 21 01:30:32 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:30:32.356264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854080d-dfc3-4196-a70a-0832346cce34 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:32.367734 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:32.614670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854080d-dfc3-4196-a70a-0832346cce34 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:32.633604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:32.634898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:32.639608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:32.640143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] PATH_INFO: `/v3/users/1e6af6dd92da432da9f1d61748264509` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:32.641882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6af6dd92da432da9f1d61748264509)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:32.646614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:32.787441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6af6dd92da432da9f1d61748264509'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:32.833717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6af6dd92da432da9f1d61748264509'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:32.834582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6af6dd92da432da9f1d61748264509'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:32.853027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6af6dd92da432da9f1d61748264509'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:32.854144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6af6dd92da432da9f1d61748264509'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:32.920031 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2861/5724] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:32 2022] DELETE /identity/v3/users/1e6af6dd92da432da9f1d61748264509 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:32.924958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:32.925430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:32.925544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:32.960455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:32.964750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:33.127427 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2864/5725] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:33.153725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:33.155092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:33.397557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1713c-a380-41d2-bbe7-855b52ca33e7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:33.406279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79687996-687d-4f2d-aa52-3a9977161b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:33.406932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79687996-687d-4f2d-aa52-3a9977161b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:33.407206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79687996-687d-4f2d-aa52-3a9977161b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:33.407478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79687996-687d-4f2d-aa52-3a9977161b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:33.438711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79687996-687d-4f2d-aa52-3a9977161b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:33.440206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79687996-687d-4f2d-aa52-3a9977161b6f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:33.467545 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2862/5726] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:35.261578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:35.263836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:35.290605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b9ead-5bed-4a34-8b93-158981e0224c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:35.304321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:35.305067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:35.305343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:35.305618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] PATH_INFO: `/v3/projects/c42d3760f4bc409c9cbcb1d6456402bb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:35.307709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42d3760f4bc409c9cbcb1d6456402bb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:35.319169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:35.429406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42d3760f4bc409c9cbcb1d6456402bb', 'request_id': 'req-04875cc3-242e-4078-be1d-697c08b12114'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:35.451011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42d3760f4bc409c9cbcb1d6456402bb', 'request_id': 'req-04875cc3-242e-4078-be1d-697c08b12114'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:35.457671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42d3760f4bc409c9cbcb1d6456402bb', 'request_id': 'req-04875cc3-242e-4078-be1d-697c08b12114'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:35.461979 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:35.488928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] The token cache is being invalidate because project c42d3760f4bc409c9cbcb1d6456402bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:35.490322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:35.491775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-04875cc3-242e-4078-be1d-697c08b12114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:35.493974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2865/5727] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:35 2022] DELETE /identity/v3/projects/c42d3760f4bc409c9cbcb1d6456402bb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:35.498765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349c46-90f2-4638-a32d-b4a1f343cded None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:35.499268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349c46-90f2-4638-a32d-b4a1f343cded None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:35.499391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349c46-90f2-4638-a32d-b4a1f343cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:35.533608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d349c46-90f2-4638-a32d-b4a1f343cded None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:35.535154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d349c46-90f2-4638-a32d-b4a1f343cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:35.570078 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:35.686153 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2863/5728] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:35.694257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7b41c-54b6-444d-afaf-487ed156e4f5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:35.694543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7b41c-54b6-444d-afaf-487ed156e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:35.694820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7b41c-54b6-444d-afaf-487ed156e4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:35.745017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eaa7b41c-54b6-444d-afaf-487ed156e4f5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:35.746278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eaa7b41c-54b6-444d-afaf-487ed156e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:35.781601 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2866/5729] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:35.783372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349c46-90f2-4638-a32d-b4a1f343cded None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:35.819460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349c46-90f2-4638-a32d-b4a1f343cded None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:35.831546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:35.833059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:35.833604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:35.834487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:35.835608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:35.836789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:35.839249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:35.858607 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2864/5730] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:35.862963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7b41c-54b6-444d-afaf-487ed156e4f5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:35.894945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7b41c-54b6-444d-afaf-487ed156e4f5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:35.935554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:35.936194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:35.936476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:35.936751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:35.937496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:35.950672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:36.012639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2867/5731] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:35 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:36.017639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:36.036234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601d652-4615-4d5e-ab6b-0e320d8fe9c8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:36.299981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:36.305516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:36.313487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:36.316426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:36.318826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:36.328518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:36.436749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2865/5732] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:36 2022] POST /identity/v3/users => generated 289 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:36.441469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:36.468599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb1ef6-c98b-4da2-9ab9-38193f0bdc91 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:36.478042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:36.479081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:36.479592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:36.480106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:36.481070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:36.483032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:36.540507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:36.552444 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2868/5733] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:36.557056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90d0b-0ae6-4013-b7f9-37389a5b8f92 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:36.578838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d02e6-809b-4c7e-a6d0-44bea496d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:36.580533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d02e6-809b-4c7e-a6d0-44bea496d19b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:36.581164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d02e6-809b-4c7e-a6d0-44bea496d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:36.581689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d02e6-809b-4c7e-a6d0-44bea496d19b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:36.586017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d02e6-809b-4c7e-a6d0-44bea496d19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:36.588333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d02e6-809b-4c7e-a6d0-44bea496d19b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:36.632937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:36.639709 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2866/5734] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:36.649665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d518c4d-658c-461c-a5e9-214bcca1600e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:36.671624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:36.672486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:36.672957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:36.673528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] PATH_INFO: `/v3/projects/45d353a3a0d14102b86205dd69202958/users/f3deb6ff83124ab4acc681e9f35841c8/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:36.729504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d353a3a0d14102b86205dd69202958, user_id=f3deb6ff83124ab4acc681e9f35841c8, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:36.733601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:36.770785 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2869/5735] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:36 2022] PUT /identity/v3/projects/45d353a3a0d14102b86205dd69202958/users/f3deb6ff83124ab4acc681e9f35841c8/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:36.781653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020fe79-5de9-4a6f-84b5-3aae4b78e6a1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:36.782733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020fe79-5de9-4a6f-84b5-3aae4b78e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:36.783581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020fe79-5de9-4a6f-84b5-3aae4b78e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:36.842933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0020fe79-5de9-4a6f-84b5-3aae4b78e6a1 None None] MFA Rules not processed for user `f3deb6ff83124ab4acc681e9f35841c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:36.845029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0020fe79-5de9-4a6f-84b5-3aae4b78e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:37.016934 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2867/5736] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:37.023755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:37.050843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27dacc-5ac0-4b79-aff0-d552accbd738 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:37.067707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cf51d-88b2-44d1-ac04-1ce05fd2b0da tempest-DefaultDomainTestJSON-625304049 tempest-DefaultDomainTestJSON-625304049-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3deb6ff83124ab4acc681e9f35841c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45d353a3a0d14102b86205dd69202958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:37.068679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cf51d-88b2-44d1-ac04-1ce05fd2b0da tempest-DefaultDomainTestJSON-625304049 tempest-DefaultDomainTestJSON-625304049-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:37.069172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cf51d-88b2-44d1-ac04-1ce05fd2b0da tempest-DefaultDomainTestJSON-625304049 tempest-DefaultDomainTestJSON-625304049-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:37.069701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cf51d-88b2-44d1-ac04-1ce05fd2b0da tempest-DefaultDomainTestJSON-625304049 tempest-DefaultDomainTestJSON-625304049-project] PATH_INFO: `/v3/domains/default` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:37.073763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cf51d-88b2-44d1-ac04-1ce05fd2b0da tempest-DefaultDomainTestJSON-625304049 tempest-DefaultDomainTestJSON-625304049-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:37.081842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cf51d-88b2-44d1-ac04-1ce05fd2b0da tempest-DefaultDomainTestJSON-625304049 tempest-DefaultDomainTestJSON-625304049-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:37.085596 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2870/5737] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:30:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:37.096274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020fe79-5de9-4a6f-84b5-3aae4b78e6a1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:37.140005 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:37.310171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020fe79-5de9-4a6f-84b5-3aae4b78e6a1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:37.338059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:37.339064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:37.339455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:37.339838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] PATH_INFO: `/v3/users/f3deb6ff83124ab4acc681e9f35841c8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:37.344479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3deb6ff83124ab4acc681e9f35841c8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:37.347476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:37.498408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3deb6ff83124ab4acc681e9f35841c8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:37.520414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3deb6ff83124ab4acc681e9f35841c8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:37.521232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3deb6ff83124ab4acc681e9f35841c8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:37.538129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3deb6ff83124ab4acc681e9f35841c8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:37.541197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3deb6ff83124ab4acc681e9f35841c8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:37.606694 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2868/5738] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:37 2022] DELETE /identity/v3/users/f3deb6ff83124ab4acc681e9f35841c8 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:37.609668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef30d-691c-43da-a105-4ae44cd12ea4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:37.610166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef30d-691c-43da-a105-4ae44cd12ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:37.610266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef30d-691c-43da-a105-4ae44cd12ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:37.669750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3ccef30d-691c-43da-a105-4ae44cd12ea4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:37.672539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3ccef30d-691c-43da-a105-4ae44cd12ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:37.805151 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2871/5739] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:37.848038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:37.849583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:38.024417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1f89-be14-4689-b113-9e861cbf39f6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:38.034649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:38.037686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:38.038124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:38.038252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:38.067730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:38.069398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:38.095851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2869/5740] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:39.759106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:39.759620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:39.759973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:39.814837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:39.814837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:40.252398 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2872/5741] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:40.323976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:40.329146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:40.633161 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:40.846764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c484fa-413d-40ca-b5f0-a1ae0fbff686 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:40.853576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98445f09-44c8-4ed0-8191-a638beed392a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:40.854372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98445f09-44c8-4ed0-8191-a638beed392a service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:40.854745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98445f09-44c8-4ed0-8191-a638beed392a service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:40.855113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98445f09-44c8-4ed0-8191-a638beed392a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:40.902026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98445f09-44c8-4ed0-8191-a638beed392a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:40.906294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98445f09-44c8-4ed0-8191-a638beed392a service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:40.968855 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2870/5742] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:30:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:30:41.825977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:41.837721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:41.904031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75226a5-3318-4dc7-b03c-ac86b5b70d8a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:41.937218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:41.944547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:41.946032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:41.946767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] PATH_INFO: `/v3/projects/45d353a3a0d14102b86205dd69202958` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:41.965066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ea9fe-aecd-40e8-9bd4-e8c2c6f8a53b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:41.965605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d353a3a0d14102b86205dd69202958)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:41.966805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ea9fe-aecd-40e8-9bd4-e8c2c6f8a53b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:41.967883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ea9fe-aecd-40e8-9bd4-e8c2c6f8a53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:41.995170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:42.090721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6a5ea9fe-aecd-40e8-9bd4-e8c2c6f8a53b None None] MFA Rules not processed for user `e7850bbac189450495a33daf0b0d7429`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:42.097407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a5ea9fe-aecd-40e8-9bd4-e8c2c6f8a53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:42.101524 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:42.195435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d353a3a0d14102b86205dd69202958', 'request_id': 'req-15953caa-9af1-4e5a-be8b-079e90d17d58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:42.203764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d353a3a0d14102b86205dd69202958', 'request_id': 'req-15953caa-9af1-4e5a-be8b-079e90d17d58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:42.219682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d353a3a0d14102b86205dd69202958', 'request_id': 'req-15953caa-9af1-4e5a-be8b-079e90d17d58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:42.246310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] The token cache is being invalidate because project 45d353a3a0d14102b86205dd69202958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:42.247456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:42.249753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-15953caa-9af1-4e5a-be8b-079e90d17d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:42.255446 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2873/5743] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:41 2022] DELETE /identity/v3/projects/45d353a3a0d14102b86205dd69202958 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:42.271550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1c498-8025-4412-8b3f-548707c7bc32 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.271921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1c498-8025-4412-8b3f-548707c7bc32 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.272266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1c498-8025-4412-8b3f-548707c7bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.299182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9ca1c498-8025-4412-8b3f-548707c7bc32 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:42.303247 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2871/5744] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:42.304615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ca1c498-8025-4412-8b3f-548707c7bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:42.314671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.315370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.315886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.355702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] MFA Rules not processed for user `9af3b140e73141479d1a6e7d7b7266f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:42.359278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:42.394205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2874/5745] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:42.396675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fb545-b2ff-4030-a9af-fdf92a1e84c7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.397177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fb545-b2ff-4030-a9af-fdf92a1e84c7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.397626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fb545-b2ff-4030-a9af-fdf92a1e84c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.420372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-985fb545-b2ff-4030-a9af-fdf92a1e84c7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:42.421565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-985fb545-b2ff-4030-a9af-fdf92a1e84c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:42.431911 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2875/5746] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:42.436512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fb545-b2ff-4030-a9af-fdf92a1e84c7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:42.454202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fb545-b2ff-4030-a9af-fdf92a1e84c7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:42.461514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:42.462145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.462417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.462685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.463521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:42.463823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:42.465462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:42.485596 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2876/5747] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:42.486636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:42.500541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b56e5-1611-4e59-aef2-eb41ff58deac admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:42.506787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:42.507416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.507687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.507951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.508583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:42.512128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:42.518820 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2872/5748] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:30:42.529509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:42.533772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:42.555766 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2877/5749] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:42 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:42.560991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:42.675665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838b0d0-0500-41ae-962a-4ec1a2d9d5c5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:42.685635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:42.686271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.692247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.693009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.694085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:42.696548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:42.697974 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:42.713242 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:42.759724 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2878/5750] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:42 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:42.761160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:42.774402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a176c-f07e-4e36-9b6b-69f485d3dd73 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:42.780328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:42.780990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.781406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.781683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.782444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:42.786011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:42.799646 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2879/5751] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:42.806126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:42.815361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe17283-898a-4456-b716-db02b1381c67 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:42.830336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4cd2-5791-43bc-b1ee-3719bf4f52f8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:42.850958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:42.851606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.851889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.852166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:42.852845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:42.854476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:42.903234 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2880/5752] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:42.904550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:42.943525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa14a-4829-4607-b847-484b93149595 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:42.972688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac674-38a9-4bfc-b6fe-c4b2f931e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:42.974553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac674-38a9-4bfc-b6fe-c4b2f931e3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:42.974824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac674-38a9-4bfc-b6fe-c4b2f931e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:42.975095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac674-38a9-4bfc-b6fe-c4b2f931e3b6 admin admin] PATH_INFO: `/v3/projects/88802f688297411885fa50cb2e7c30c4/users/302a1e87194940d685b02e1bb421031c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:43.063777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cac674-38a9-4bfc-b6fe-c4b2f931e3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88802f688297411885fa50cb2e7c30c4, user_id=302a1e87194940d685b02e1bb421031c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:43.066766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cac674-38a9-4bfc-b6fe-c4b2f931e3b6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:43.094776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:43.095605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:43.101697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:43.102042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:43.118156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:43.118366 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2881/5753] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:42 2022] PUT /identity/v3/projects/88802f688297411885fa50cb2e7c30c4/users/302a1e87194940d685b02e1bb421031c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:43.128146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf55f81-50b2-4e3a-b5be-61efbfa090c5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:43.128677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf55f81-50b2-4e3a-b5be-61efbfa090c5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:43.129147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf55f81-50b2-4e3a-b5be-61efbfa090c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:43.262720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7cf55f81-50b2-4e3a-b5be-61efbfa090c5 None None] MFA Rules not processed for user `302a1e87194940d685b02e1bb421031c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:43.264016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7cf55f81-50b2-4e3a-b5be-61efbfa090c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:43.401414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:43.412187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:43.462277 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2873/5754] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:42 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 934 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:43.674996 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2882/5755] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:43.680413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:43.696835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d31a-968a-46ab-8a75-d43e68741f19 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:43.856194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:43.856904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:43.857185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:43.857454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:43.858107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:43.860055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:43.928648 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2874/5756] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:43 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:43.931935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf55f81-50b2-4e3a-b5be-61efbfa090c5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:43.948299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf55f81-50b2-4e3a-b5be-61efbfa090c5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:44.143778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:44.144893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:44.145390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:44.145871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:44.146971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:44.151983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:44.195803 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2883/5757] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:43 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:44.199806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:44.236920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7cb0-e186-486f-ad2e-c6094891f09d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:44.258540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:44.259248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:44.259248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:44.259743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:44.261981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:44.269206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:44.277444 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:44.296781 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2875/5758] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:44.300982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:44.351453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa87662-c29e-4e62-85e3-e71bcd48e328 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:44.364309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a894059-d16e-4335-8405-7289902338ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:44.367766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894059-d16e-4335-8405-7289902338ba admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:44.367766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894059-d16e-4335-8405-7289902338ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:44.367766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894059-d16e-4335-8405-7289902338ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:44.367766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a894059-d16e-4335-8405-7289902338ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:44.369078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a894059-d16e-4335-8405-7289902338ba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:44.395934 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2884/5759] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:44.400836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:44.420126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024640-7517-4d91-8437-f7a0c70a086e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:44.435013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:44.435719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:44.435997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:44.436269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] PATH_INFO: `/v3/projects/437446bb052c4e6fad1e627036a3671d/users/7121fc5e240c42138715b49e3fc98ca7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:44.472605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=437446bb052c4e6fad1e627036a3671d, user_id=7121fc5e240c42138715b49e3fc98ca7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:44.477297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:44.538454 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2876/5760] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:44 2022] PUT /identity/v3/projects/437446bb052c4e6fad1e627036a3671d/users/7121fc5e240c42138715b49e3fc98ca7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:44.549611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e303-35ad-4af8-afa0-23b8a7cc8ab0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:44.549958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e303-35ad-4af8-afa0-23b8a7cc8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:44.550165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e303-35ad-4af8-afa0-23b8a7cc8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:44.625309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1f37e303-35ad-4af8-afa0-23b8a7cc8ab0 None None] MFA Rules not processed for user `7121fc5e240c42138715b49e3fc98ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:44.626733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1f37e303-35ad-4af8-afa0-23b8a7cc8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:44.647301 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:44.794393 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2885/5761] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:44.804861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:44.814094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:45.039662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe37f8d-45fa-4b52-a2cf-07a60e9cf5da admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:45.052339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:45.056259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:45.056259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:45.056259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:45.240272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:45.242669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:45.269727 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2877/5762] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:45.884302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e303-35ad-4af8-afa0-23b8a7cc8ab0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:45.907764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e303-35ad-4af8-afa0-23b8a7cc8ab0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:45.936365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff2f94-cfde-4dbe-81c0-86b7f26f0049 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:45.937596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2f94-cfde-4dbe-81c0-86b7f26f0049 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:45.938240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2f94-cfde-4dbe-81c0-86b7f26f0049 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:45.939005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2f94-cfde-4dbe-81c0-86b7f26f0049 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:46.057713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2f94-cfde-4dbe-81c0-86b7f26f0049 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:46.060513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2f94-cfde-4dbe-81c0-86b7f26f0049 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:46.129603 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2886/5763] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:50.005981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:50.255111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff4f3-4ef2-4a74-9dad-ef69525efcc5 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:50.276808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:50.277504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:50.277776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:50.278326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] PATH_INFO: `/v3/users/302a1e87194940d685b02e1bb421031c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:50.281893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302a1e87194940d685b02e1bb421031c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:50.284214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:50.382704 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:50.470973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302a1e87194940d685b02e1bb421031c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:50.507043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302a1e87194940d685b02e1bb421031c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:50.513435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302a1e87194940d685b02e1bb421031c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:50.537458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302a1e87194940d685b02e1bb421031c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:50.548498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302a1e87194940d685b02e1bb421031c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:50.637187 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2878/5764] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:50 2022] DELETE /identity/v3/users/302a1e87194940d685b02e1bb421031c => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:50.643435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:50.644313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:50.644747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:50.689189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:50.691852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:50.914503 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2887/5765] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:51.049310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:51.052198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:51.204300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238db411-daa7-44cc-bcc2-07c938590626 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:51.212280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:51.213739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:51.216266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:51.216737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:51.246867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:51.251949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:51.280908 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2879/5766] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:30:54.637211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:54.638732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:54.676695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ff4c-b8ff-4294-a750-f5a44a976a1d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:54.710775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:54.711923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:54.713146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:54.713868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] PATH_INFO: `/v3/projects/88802f688297411885fa50cb2e7c30c4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:54.717482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=88802f688297411885fa50cb2e7c30c4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:54.725573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:54.836392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88802f688297411885fa50cb2e7c30c4', 'request_id': 'req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:54.844068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88802f688297411885fa50cb2e7c30c4', 'request_id': 'req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:54.852072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88802f688297411885fa50cb2e7c30c4', 'request_id': 'req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:54.880303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] The token cache is being invalidate because project 88802f688297411885fa50cb2e7c30c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:54.882155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:54.883104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:54.885639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2888/5767] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:54 2022] DELETE /identity/v3/projects/88802f688297411885fa50cb2e7c30c4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:54.889579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:54.909317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab164c8-5156-482f-98df-aaf1960524e3 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:54.991030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:54.991710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:54.992134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:54.992460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] PATH_INFO: `/v3/users/7121fc5e240c42138715b49e3fc98ca7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:54.994472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7121fc5e240c42138715b49e3fc98ca7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:54.997906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:55.096702 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:55.102243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7121fc5e240c42138715b49e3fc98ca7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:55.123792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7121fc5e240c42138715b49e3fc98ca7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:55.146154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7121fc5e240c42138715b49e3fc98ca7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:55.156401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7121fc5e240c42138715b49e3fc98ca7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:55.182308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26f4c378-61ff-4bdf-8be6-3daeebe3a0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7121fc5e240c42138715b49e3fc98ca7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:55.212984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2880/5768] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:30:54 2022] DELETE /identity/v3/users/7121fc5e240c42138715b49e3fc98ca7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:56.208249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:56.210332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:56.235222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd2cf2-0fbd-4b6f-a4d7-a663082b1bcb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:56.257513 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:56.336430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:56.337377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:56.337902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:56.338411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] PATH_INFO: `/v3/projects/437446bb052c4e6fad1e627036a3671d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:56.340603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437446bb052c4e6fad1e627036a3671d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:56.343076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:56.443113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437446bb052c4e6fad1e627036a3671d', 'request_id': 'req-21e8a577-f87b-476f-8a29-716fd24bc131'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:56.457256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437446bb052c4e6fad1e627036a3671d', 'request_id': 'req-21e8a577-f87b-476f-8a29-716fd24bc131'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:56.467765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437446bb052c4e6fad1e627036a3671d', 'request_id': 'req-21e8a577-f87b-476f-8a29-716fd24bc131'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:56.504147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] The token cache is being invalidate because project 437446bb052c4e6fad1e627036a3671d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:30:56.504551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:56.505146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21e8a577-f87b-476f-8a29-716fd24bc131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:30:56.506987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2889/5769] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:56 2022] DELETE /identity/v3/projects/437446bb052c4e6fad1e627036a3671d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:56.513918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b09e46-4a5b-4068-aa92-33192adbc504 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:56.514462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b09e46-4a5b-4068-aa92-33192adbc504 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:56.514462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b09e46-4a5b-4068-aa92-33192adbc504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:56.552006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f9b09e46-4a5b-4068-aa92-33192adbc504 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:56.553513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f9b09e46-4a5b-4068-aa92-33192adbc504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:56.678752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2881/5770] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:56.688709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843068ec-9a1d-42dc-b6fd-e717cb1f1ffa None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:56.689155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843068ec-9a1d-42dc-b6fd-e717cb1f1ffa None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:56.689664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843068ec-9a1d-42dc-b6fd-e717cb1f1ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:56.741803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-843068ec-9a1d-42dc-b6fd-e717cb1f1ffa None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:56.743816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-843068ec-9a1d-42dc-b6fd-e717cb1f1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:56.756818 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2890/5771] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:56.763084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b09e46-4a5b-4068-aa92-33192adbc504 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:56.810284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b09e46-4a5b-4068-aa92-33192adbc504 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:56.824876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:56.825519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:56.825970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:56.826840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:56.829522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:30:56.830220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:56.834110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:56.869279 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2882/5772] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:30:56.870093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843068ec-9a1d-42dc-b6fd-e717cb1f1ffa None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:56.885941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843068ec-9a1d-42dc-b6fd-e717cb1f1ffa None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:56.899359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:56.900486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:56.901119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:56.902348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:56.903252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:56.921486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:57.008247 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2891/5773] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:56 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:57.013095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:57.028594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8296-d502-4880-ad46-92bc54842566 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:57.224614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:57.225346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:57.225779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:57.226143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:57.226872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:57.228932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:57.275918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:57.308935 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2883/5774] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:57 2022] POST /identity/v3/users => generated 295 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:57.313799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58dc71-214b-4538-89a4-40832647521a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:57.319650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:57.320547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:57.321123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:57.322303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:57.323072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:57.324881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:57.347598 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2892/5775] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:57.352641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:57.370889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e041f0d-0e32-4834-b10f-f21f4a431818 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:57.404088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e27640-7d82-4fd5-8287-0615150284d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:57.404853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e27640-7d82-4fd5-8287-0615150284d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:57.408125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e27640-7d82-4fd5-8287-0615150284d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:57.408455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e27640-7d82-4fd5-8287-0615150284d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:57.409183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e27640-7d82-4fd5-8287-0615150284d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:57.413775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e27640-7d82-4fd5-8287-0615150284d7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:57.482018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:57.487317 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2884/5776] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:30:57.508364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b7da-f5c4-47de-b2bc-5d646d00b226 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:57.514241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:57.515184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:57.515620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:57.516074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] PATH_INFO: `/v3/projects/197437d82bb94a46b456f4cc93fd9371/users/f7b4ada54a774375b8a22e4d59d1c802/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:57.553931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197437d82bb94a46b456f4cc93fd9371, user_id=f7b4ada54a774375b8a22e4d59d1c802, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:57.557221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:57.605955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341ce1-7b2f-469a-9d5f-d14724adc737 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:57.606821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341ce1-7b2f-469a-9d5f-d14724adc737 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:57.607310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341ce1-7b2f-469a-9d5f-d14724adc737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:57.614176 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2893/5777] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:57 2022] PUT /identity/v3/projects/197437d82bb94a46b456f4cc93fd9371/users/f7b4ada54a774375b8a22e4d59d1c802/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:57.695375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-33341ce1-7b2f-469a-9d5f-d14724adc737 None None] MFA Rules not processed for user `f7b4ada54a774375b8a22e4d59d1c802`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:57.700542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33341ce1-7b2f-469a-9d5f-d14724adc737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:57.757575 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:57.927884 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2885/5778] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:30:57.932269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:58.149964 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:58.284577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02dfa-5ae2-4917-9680-19ac608667c3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:58.310672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:58.316960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:58.319801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:58.323960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:58.339776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:58.356434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:58.457801 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2894/5779] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:30:57 2022] POST /identity/v3/projects => generated 389 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:30:58.458766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33341ce1-7b2f-469a-9d5f-d14724adc737 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:58.488247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33341ce1-7b2f-469a-9d5f-d14724adc737 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:58.641334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:58.652038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:58.652418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:58.659705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:58.663718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:58.665909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:58.768524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:58.790443 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2886/5780] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:30:58 2022] POST /identity/v3/users => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:30:58.793419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9327d-c3c7-4fba-90fe-2895ae558595 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:58.807751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:58.809216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:58.809710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:58.810214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:58.811151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:58.813422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:58.846967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:58.854848 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2895/5781] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:58.863203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d0bc8-29b5-43e7-a23a-0480969d95d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:58.883985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:58.885319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:58.885825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:58.886317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] PATH_INFO: `/v3/projects/a7a16265092640da8c667690e0a8b9e3/users/de30a3f15aec4649b3c6ed4db12e635b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:58.925434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a16265092640da8c667690e0a8b9e3, user_id=de30a3f15aec4649b3c6ed4db12e635b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:58.934571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:58.977863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:58.988178 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2887/5782] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:58 2022] PUT /identity/v3/projects/a7a16265092640da8c667690e0a8b9e3/users/de30a3f15aec4649b3c6ed4db12e635b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:30:58.990766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733275-d8e8-4b09-83cd-d9277f5c4219 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:59.141609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d49348-a66e-44ef-8949-b40ec2f9a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:59.142394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d49348-a66e-44ef-8949-b40ec2f9a488 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:59.142769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d49348-a66e-44ef-8949-b40ec2f9a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:59.145198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d49348-a66e-44ef-8949-b40ec2f9a488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:59.145973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d49348-a66e-44ef-8949-b40ec2f9a488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:59.152170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d49348-a66e-44ef-8949-b40ec2f9a488 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:59.182644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:59.193511 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2896/5783] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:30:59.194863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607552b-7d97-4168-a5fe-37a132ab05ab admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:59.208675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:59.209664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:59.210041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:59.210439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] PATH_INFO: `/v3/projects/a7a16265092640da8c667690e0a8b9e3/users/de30a3f15aec4649b3c6ed4db12e635b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:59.216175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a16265092640da8c667690e0a8b9e3, user_id=de30a3f15aec4649b3c6ed4db12e635b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:59.223046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:59.264480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:59.265273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:59.265725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:59.273447 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2888/5784] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:30:59 2022] PUT /identity/v3/projects/a7a16265092640da8c667690e0a8b9e3/users/de30a3f15aec4649b3c6ed4db12e635b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:30:59.326497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] MFA Rules not processed for user `de30a3f15aec4649b3c6ed4db12e635b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:30:59.328633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:59.426212 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2897/5785] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:30:59.492458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:30:59.494298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:30:59.653178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f355d1-4f9b-4434-8d42-d2accb384810 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:30:59.666121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574ed0-b5e2-458e-9c08-b02b530407b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:30:59.667972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574ed0-b5e2-458e-9c08-b02b530407b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:30:59.668476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574ed0-b5e2-458e-9c08-b02b530407b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:30:59.669023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574ed0-b5e2-458e-9c08-b02b530407b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:30:59.721638 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:59.788858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d574ed0-b5e2-458e-9c08-b02b530407b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:30:59.790967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d574ed0-b5e2-458e-9c08-b02b530407b7 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:30:59.809054 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2889/5786] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:04.874262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:04.875842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:04.991453 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:05.071549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1a7e2-7284-4838-81f1-8afc7577e93f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:05.086947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:05.087779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:05.088417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:05.088816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] PATH_INFO: `/v3/users/a0414d680c0f45f5832781cbda2c5f10` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:05.090268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0414d680c0f45f5832781cbda2c5f10)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:05.092476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:05.283555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0414d680c0f45f5832781cbda2c5f10'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:05.312816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0414d680c0f45f5832781cbda2c5f10'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:05.374334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0414d680c0f45f5832781cbda2c5f10'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:05.377990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0414d680c0f45f5832781cbda2c5f10'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:05.416828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0414d680c0f45f5832781cbda2c5f10'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:05.448904 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2898/5787] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:04 2022] DELETE /identity/v3/users/a0414d680c0f45f5832781cbda2c5f10 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:05.453034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:05.453622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:05.454008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:05.492432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:05.495893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:05.520045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:05.521926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:05.707471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2890/5788] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:05.724540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a967f0e-8931-4fff-b41f-de8f18b8d9ec admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:05.754390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4610e-cb4a-4fd9-899f-840fa07b6cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:05.756260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4610e-cb4a-4fd9-899f-840fa07b6cbc service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:05.757483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4610e-cb4a-4fd9-899f-840fa07b6cbc service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:05.758949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4610e-cb4a-4fd9-899f-840fa07b6cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:05.767129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ed4610e-cb4a-4fd9-899f-840fa07b6cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:05.836556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:05.838395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:05.974597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb6e9d-5442-413a-8d97-cba6dd0625a9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:05.984691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:05.985410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:05.985687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:05.985954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:06.044418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:06.048402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:06.080522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2891/5789] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:31:06.083036 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:06.091039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4610e-cb4a-4fd9-899f-840fa07b6cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:06.098699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4610e-cb4a-4fd9-899f-840fa07b6cbc service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:06.176003 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2899/5790] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:05 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:31:07.817632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:07.820231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:07.851495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593c362-cb45-459a-97d8-9475ad26d489 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:07.875135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:07.877604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:07.877900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:07.878188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] PATH_INFO: `/v3/projects/6145bce412d24991ab5aae4d3355b8a6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:07.880218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6145bce412d24991ab5aae4d3355b8a6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:07.887487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:08.088586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6145bce412d24991ab5aae4d3355b8a6', 'request_id': 'req-3494b30d-dc70-41e6-8a26-515480972f42'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:08.112697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6145bce412d24991ab5aae4d3355b8a6', 'request_id': 'req-3494b30d-dc70-41e6-8a26-515480972f42'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:08.122006 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:08.126472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6145bce412d24991ab5aae4d3355b8a6', 'request_id': 'req-3494b30d-dc70-41e6-8a26-515480972f42'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:08.170124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] The token cache is being invalidate because project 6145bce412d24991ab5aae4d3355b8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:08.170608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:08.172142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3494b30d-dc70-41e6-8a26-515480972f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:08.181795 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2892/5791] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:07 2022] DELETE /identity/v3/projects/6145bce412d24991ab5aae4d3355b8a6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:08.186664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7e723-44a4-482c-9d33-c2605968a3a6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:08.187646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7e723-44a4-482c-9d33-c2605968a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:08.188374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7e723-44a4-482c-9d33-c2605968a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:08.245032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a2d7e723-44a4-482c-9d33-c2605968a3a6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:08.248384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2d7e723-44a4-482c-9d33-c2605968a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:08.422629 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2900/5792] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:08.433048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e0c6-2296-4a65-979f-582c6ac8d04a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:08.433370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e0c6-2296-4a65-979f-582c6ac8d04a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:08.434185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e0c6-2296-4a65-979f-582c6ac8d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:08.482687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ca99e0c6-2296-4a65-979f-582c6ac8d04a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:08.484228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca99e0c6-2296-4a65-979f-582c6ac8d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:08.506697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2893/5793] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:08.507126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7e723-44a4-482c-9d33-c2605968a3a6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:08.522557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7e723-44a4-482c-9d33-c2605968a3a6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:08.528562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:08.529228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:08.529513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:08.529787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:08.530449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:08.530751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:08.533120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:08.559376 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2901/5794] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:31:08.560905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e0c6-2296-4a65-979f-582c6ac8d04a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:08.576790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e0c6-2296-4a65-979f-582c6ac8d04a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:08.597541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:08.598112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:08.598390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:08.598660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:08.599779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:08.601927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:08.617494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:08.619256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:08.685663 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2894/5795] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:08 2022] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:08.689256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:08.765877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812a76d-639b-4e22-a2dc-4972e34052d1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:08.844324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e601-8915-4515-ba1f-b86153a01c98 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:08.889620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:08.890287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:08.890570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:08.890846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:08.898899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:08.900909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:08.933638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3945d9-9944-4aa9-9930-5e642500bf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:08.935072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3945d9-9944-4aa9-9930-5e642500bf25 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:08.935275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3945d9-9944-4aa9-9930-5e642500bf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:08.935492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3945d9-9944-4aa9-9930-5e642500bf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:08.948650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2c3945d9-9944-4aa9-9930-5e642500bf25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:08.965805 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2895/5796] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:08 2022] POST /identity/v3/users => generated 280 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:08.969917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:08.986652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbdeec-46c8-4c1c-af32-d0dcc734acf4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:08.996550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:08.997226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:08.997512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:08.997786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:08.998514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:09.003134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:09.026576 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2896/5797] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:31:09.027499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:09.049523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729da165-5de7-4b20-b079-8e739adb3775 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:09.057974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:09.059798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:09.061173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:09.061664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:09.063291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:09.066035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:09.090046 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2897/5798] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:09.091252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:09.093300 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:09.110501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b419-39a7-4987-9f10-95b266bb52c7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:09.136856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3945d9-9944-4aa9-9930-5e642500bf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:09.138887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3945d9-9944-4aa9-9930-5e642500bf25 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:09.140198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:09.140965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:09.141267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:09.141541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] PATH_INFO: `/v3/projects/c64b840d5ea3495b920cad3fc0190b9b/users/b081b6464d494b4fa28d127a65e87ed5/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:09.163144 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2902/5799] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:09.184731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64b840d5ea3495b920cad3fc0190b9b, user_id=b081b6464d494b4fa28d127a65e87ed5, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:09.188893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:09.227138 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2898/5800] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:09 2022] PUT /identity/v3/projects/c64b840d5ea3495b920cad3fc0190b9b/users/b081b6464d494b4fa28d127a65e87ed5/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:09.228484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:09.228484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:09.229121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:09.298371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] MFA Rules not processed for user `b081b6464d494b4fa28d127a65e87ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:09.299976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:09.450718 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2903/5801] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:31:09.527506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:09.529357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:09.719047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6fd1-311a-4ac0-8cfc-ae5fa981426c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:09.735205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6fe8a-6457-40ba-b42a-80597cbc1f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:09.736291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fe8a-6457-40ba-b42a-80597cbc1f40 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:09.736886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fe8a-6457-40ba-b42a-80597cbc1f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:09.737324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fe8a-6457-40ba-b42a-80597cbc1f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:09.755778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fe8a-6457-40ba-b42a-80597cbc1f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:09.758689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fe8a-6457-40ba-b42a-80597cbc1f40 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:09.784316 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2899/5802] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:12.246892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:12.248486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:12.439253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a17ab-0f64-409c-a4fb-b54fcd4bb28e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:12.457024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:12.457841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:12.458121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:12.458395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] PATH_INFO: `/v3/users/382ce87324084b459505b2edde5a7196` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:12.464567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=382ce87324084b459505b2edde5a7196)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:12.469015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:12.569274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382ce87324084b459505b2edde5a7196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:12.590303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382ce87324084b459505b2edde5a7196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:12.616752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382ce87324084b459505b2edde5a7196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:12.625444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382ce87324084b459505b2edde5a7196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:12.646651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382ce87324084b459505b2edde5a7196'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:12.648593 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:12.660402 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2904/5803] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:12 2022] DELETE /identity/v3/users/382ce87324084b459505b2edde5a7196 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:12.663153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:12.663741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:12.664003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:12.700841 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:12.750033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:12.758254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:12.870334 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2900/5804] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:12.880226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:12.881869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:12.981294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540d634-607c-4c33-91a7-39fea2d813fa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:12.985535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929d26-3aef-4957-aef3-1a4f59973510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:12.986147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929d26-3aef-4957-aef3-1a4f59973510 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:12.986420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929d26-3aef-4957-aef3-1a4f59973510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:12.986684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929d26-3aef-4957-aef3-1a4f59973510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:12.997082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33929d26-3aef-4957-aef3-1a4f59973510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:12.998628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33929d26-3aef-4957-aef3-1a4f59973510 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:13.010201 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2905/5805] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:13.703985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:13.705929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:13.728855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2964c-5de7-4812-a4bd-611c1766aa8b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:13.734459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:13.735367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:13.735640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:13.736109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] PATH_INFO: `/v3/projects/b339b367412c4294b021172c1778fa92` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:13.737735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b339b367412c4294b021172c1778fa92)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:13.740748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:13.850992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b339b367412c4294b021172c1778fa92', 'request_id': 'req-2311c219-9e4c-4b9f-90bc-0ba989e43736'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:13.862799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b339b367412c4294b021172c1778fa92', 'request_id': 'req-2311c219-9e4c-4b9f-90bc-0ba989e43736'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:13.872710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b339b367412c4294b021172c1778fa92', 'request_id': 'req-2311c219-9e4c-4b9f-90bc-0ba989e43736'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:13.902126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] The token cache is being invalidate because project b339b367412c4294b021172c1778fa92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:13.903617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:13.904647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2311c219-9e4c-4b9f-90bc-0ba989e43736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:13.923437 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2901/5806] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:13 2022] DELETE /identity/v3/projects/b339b367412c4294b021172c1778fa92 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:13.933013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab26be-1532-4c92-be72-6a143fef1464 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:13.933013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab26be-1532-4c92-be72-6a143fef1464 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:13.933013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab26be-1532-4c92-be72-6a143fef1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:13.955999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-49ab26be-1532-4c92-be72-6a143fef1464 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:13.957461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-49ab26be-1532-4c92-be72-6a143fef1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:14.053438 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2906/5807] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:14.057411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7792-a821-4eec-8b92-79dee3d3195c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.057720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7792-a821-4eec-8b92-79dee3d3195c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.058656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7792-a821-4eec-8b92-79dee3d3195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.091941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-75bf7792-a821-4eec-8b92-79dee3d3195c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:14.093682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-75bf7792-a821-4eec-8b92-79dee3d3195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:14.107405 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2902/5808] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:14.112005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab26be-1532-4c92-be72-6a143fef1464 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:14.134093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab26be-1532-4c92-be72-6a143fef1464 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:14.150518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:14.151351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.152514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.153243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.154649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:14.155175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:14.159022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:14.186072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7792-a821-4eec-8b92-79dee3d3195c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:14.187461 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2907/5809] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:31:14.199845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7792-a821-4eec-8b92-79dee3d3195c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:14.219058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:14.220691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.221016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.221298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.221961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:14.223964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:14.285495 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2903/5810] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:14 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:31:14.289649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:14.314949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5741a1-67e8-4376-b6be-9c6d84cd5a61 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:14.428575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:14.430057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.430553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.431154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.433062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:14.436396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:14.478297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:14.478908 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2908/5811] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:14 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:14.494086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c1f6-a5c8-4d25-9259-5257a146ce21 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:14.509390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:14.510378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.510657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.510921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.511571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:14.515592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:14.532818 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2904/5812] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:31:14.537162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:14.557376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1ed3-5519-4755-856e-23c54379816c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:14.571044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445096b-8e8b-49aa-b240-48db5b435909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:14.572128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445096b-8e8b-49aa-b240-48db5b435909 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.572128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445096b-8e8b-49aa-b240-48db5b435909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.572380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445096b-8e8b-49aa-b240-48db5b435909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.573716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445096b-8e8b-49aa-b240-48db5b435909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:14.575988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445096b-8e8b-49aa-b240-48db5b435909 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:14.604362 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2909/5813] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:14.608392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:14.628796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02cccb-2331-4241-969b-7ed48e3bba61 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:14.649536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:14.652958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.653332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.656569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] PATH_INFO: `/v3/projects/389455a9f03f497dbd3de8fff33c61a6/users/381d91cb18de4579b753c7bcc6a19386/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.706586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] RBAC: Authorizing `identity:create_grant(project_id=389455a9f03f497dbd3de8fff33c61a6, user_id=381d91cb18de4579b753c7bcc6a19386, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:14.711918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:14.741617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2905/5814] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:14 2022] PUT /identity/v3/projects/389455a9f03f497dbd3de8fff33c61a6/users/381d91cb18de4579b753c7bcc6a19386/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:14.753139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba14e69-877f-4b33-bf85-9fc71a6c546a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:14.753497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba14e69-877f-4b33-bf85-9fc71a6c546a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:14.753957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba14e69-877f-4b33-bf85-9fc71a6c546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:14.771673 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:14.806850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9ba14e69-877f-4b33-bf85-9fc71a6c546a None None] MFA Rules not processed for user `381d91cb18de4579b753c7bcc6a19386`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:14.808164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ba14e69-877f-4b33-bf85-9fc71a6c546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:14.927575 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2910/5815] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:14.931602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:14.973008 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:15.024263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415318-c80a-48c2-aab2-03d077ea898c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:15.031223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:15.031953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:15.032566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:15.033064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:15.034357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:15.036563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:15.072563 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2906/5816] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:14 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:15.076241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba14e69-877f-4b33-bf85-9fc71a6c546a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:15.090156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba14e69-877f-4b33-bf85-9fc71a6c546a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:15.181186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:15.182098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:15.182536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:15.183043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:15.184531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:15.187659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:15.215433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2911/5817] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:15 2022] POST /identity/v3/users => generated 308 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:15.219413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:15.230386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870efe8-05ee-4fa1-ad39-f1b850361a21 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:15.235834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:15.236525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:15.236896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:15.237264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:15.238102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:15.240115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:15.253508 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2907/5818] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:15.258091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:15.274747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d86ecc-379a-4ae2-8f7d-f1eb43e7c3de admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:15.279898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:15.280683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:15.281081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:15.281689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] PATH_INFO: `/v3/projects/f2a17cfb06294823a276fcaca8b17989/users/482a0780934c4aab80c6c39b111f3f51/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:15.324575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a17cfb06294823a276fcaca8b17989, user_id=482a0780934c4aab80c6c39b111f3f51, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:15.328486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:15.358834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:15.360688 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2912/5819] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:15 2022] PUT /identity/v3/projects/f2a17cfb06294823a276fcaca8b17989/users/482a0780934c4aab80c6c39b111f3f51/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:15.372392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720cd86-fa23-45aa-aea2-c0293508af3c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:15.515594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff78e7-ac22-474a-8971-2529cd23dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:15.519059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff78e7-ac22-474a-8971-2529cd23dbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:15.519512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff78e7-ac22-474a-8971-2529cd23dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:15.520087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff78e7-ac22-474a-8971-2529cd23dbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:15.521633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff78e7-ac22-474a-8971-2529cd23dbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:15.525375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff78e7-ac22-474a-8971-2529cd23dbfd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:15.537957 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2908/5820] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:15.541835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:15.561938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28b3a2-000f-4444-9ec9-549754673004 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:15.571433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:15.572133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:15.572648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:15.573032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] PATH_INFO: `/v3/projects/f2a17cfb06294823a276fcaca8b17989/users/482a0780934c4aab80c6c39b111f3f51/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:15.575344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a17cfb06294823a276fcaca8b17989, user_id=482a0780934c4aab80c6c39b111f3f51, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:15.578189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:15.674274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2913/5821] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:15 2022] PUT /identity/v3/projects/f2a17cfb06294823a276fcaca8b17989/users/482a0780934c4aab80c6c39b111f3f51/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:15.682524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:15.682794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:15.683064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:15.807689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] MFA Rules not processed for user `482a0780934c4aab80c6c39b111f3f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:15.812410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:15.821086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:15.823447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:15.953733 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:15.989020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342c9e3-7818-4ed8-a2a6-59e00a91d150 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:15.989685 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2909/5822] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:15 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:16.005104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:16.008363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:16.010720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:16.011485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:16.012404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:16.012824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] PATH_INFO: `/v3/users/f7b4ada54a774375b8a22e4d59d1c802` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:16.014510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b4ada54a774375b8a22e4d59d1c802)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:16.018172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:16.079341 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:16.099684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b4ada54a774375b8a22e4d59d1c802'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.115202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b4ada54a774375b8a22e4d59d1c802'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.151101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b4ada54a774375b8a22e4d59d1c802'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.152406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b4ada54a774375b8a22e4d59d1c802'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.161678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-08cf7d38-4663-4015-b077-d908469312aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b4ada54a774375b8a22e4d59d1c802'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.169726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac43d05-9277-42e6-9d0e-3ab41334aaff None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:16.171130 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2914/5823] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:15 2022] DELETE /identity/v3/users/f7b4ada54a774375b8a22e4d59d1c802 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:31:16.177446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:16.177818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:16.178373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:16.254676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:16.255727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:16.275017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:16.275679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:16.275939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:16.276218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:16.279167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:16.398319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2915/5824] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:16.419534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:16.421287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:16.435040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:16.437046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:16.454830 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2910/5825] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:16.571866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef078c-e8b1-4919-b6a7-ab3e09c856df None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:16.577085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f426d-d048-4626-b71d-f1fa3d4ff70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:16.580500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f426d-d048-4626-b71d-f1fa3d4ff70a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:16.580811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f426d-d048-4626-b71d-f1fa3d4ff70a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:16.581094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f426d-d048-4626-b71d-f1fa3d4ff70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:16.597230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f426d-d048-4626-b71d-f1fa3d4ff70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:16.597230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f426d-d048-4626-b71d-f1fa3d4ff70a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:16.607928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2916/5826] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:16.631054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:16.632886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:16.648628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17c655-be6d-408a-861d-14eace891974 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:16.653755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:16.654428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:16.654704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:16.654977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] PATH_INFO: `/v3/users/381d91cb18de4579b753c7bcc6a19386` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:16.656368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=381d91cb18de4579b753c7bcc6a19386)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:16.658437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:16.736235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381d91cb18de4579b753c7bcc6a19386'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.766924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381d91cb18de4579b753c7bcc6a19386'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.775835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381d91cb18de4579b753c7bcc6a19386'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.791850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381d91cb18de4579b753c7bcc6a19386'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.793122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381d91cb18de4579b753c7bcc6a19386'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:16.809449 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:16.836034 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2911/5827] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:16 2022] DELETE /identity/v3/users/381d91cb18de4579b753c7bcc6a19386 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:16.841563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:16.841979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:16.842453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:16.867030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:16.868389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:16.877654 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:16.906807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:16.910721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:17.019393 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2917/5828] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:17.022196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:17.028596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:17.041644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58aad2-2230-4694-9080-2e124ce3d0ba admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:17.046421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:17.047200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:17.047483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:17.047750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] PATH_INFO: `/v3/projects/197437d82bb94a46b456f4cc93fd9371` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:17.049220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197437d82bb94a46b456f4cc93fd9371)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:17.053000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:17.140599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197437d82bb94a46b456f4cc93fd9371', 'request_id': 'req-19699244-4394-40b6-8abe-93fb022e31b8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.158673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197437d82bb94a46b456f4cc93fd9371', 'request_id': 'req-19699244-4394-40b6-8abe-93fb022e31b8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.161536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e32788-a537-4495-bc60-2e30a394933f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:17.169158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197437d82bb94a46b456f4cc93fd9371', 'request_id': 'req-19699244-4394-40b6-8abe-93fb022e31b8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.197045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] The token cache is being invalidate because project 197437d82bb94a46b456f4cc93fd9371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:17.197712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.198098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.203462 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2912/5829] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:16 2022] DELETE /identity/v3/projects/197437d82bb94a46b456f4cc93fd9371 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:17.204475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:17.209384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:17.272406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750b8e4-41d6-481d-bf66-2baf5b9e2de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:17.272406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b8e4-41d6-481d-bf66-2baf5b9e2de2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:17.272406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b8e4-41d6-481d-bf66-2baf5b9e2de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:17.272406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b8e4-41d6-481d-bf66-2baf5b9e2de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:17.273473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f750b8e4-41d6-481d-bf66-2baf5b9e2de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:17.444741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699244-4394-40b6-8abe-93fb022e31b8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:17.454964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:17.457126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:17.457715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:17.458149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] PATH_INFO: `/v3/users/de30a3f15aec4649b3c6ed4db12e635b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:17.460471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750b8e4-41d6-481d-bf66-2baf5b9e2de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:17.462113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750b8e4-41d6-481d-bf66-2baf5b9e2de2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:17.462607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de30a3f15aec4649b3c6ed4db12e635b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:17.464561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:17.519569 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:17.547449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2918/5830] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:17.595057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de30a3f15aec4649b3c6ed4db12e635b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.615538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de30a3f15aec4649b3c6ed4db12e635b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.616444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de30a3f15aec4649b3c6ed4db12e635b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.625903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de30a3f15aec4649b3c6ed4db12e635b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.626957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de30a3f15aec4649b3c6ed4db12e635b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:17.659177 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2913/5831] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:17 2022] DELETE /identity/v3/users/de30a3f15aec4649b3c6ed4db12e635b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:17.705477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:17.706028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:17.706485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:17.737399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:17.739749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:17.757227 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:17.810951 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2919/5832] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:17.830303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:17.831786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:17.928805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb409-55c5-4b5d-8c42-0e5c4be8e708 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:17.935321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:17.936064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:17.936492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:17.936803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:17.948418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:17.950975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:17.969957 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2914/5833] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:31:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:31:18.433665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:18.435515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:18.466283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:18.467622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:18.614588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0781e6-5d67-41fd-b368-d2eecc4731c1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:18.621429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:18.622408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:18.622867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:18.624867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] PATH_INFO: `/v3/projects/389455a9f03f497dbd3de8fff33c61a6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:18.627115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389455a9f03f497dbd3de8fff33c61a6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:18.629782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:18.690563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fcf9c-6bdb-419c-b229-e072e1579e8c service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:18.713441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389455a9f03f497dbd3de8fff33c61a6', 'request_id': 'req-ef6770c5-df96-4433-aed9-162a1a0f8718'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:18.725177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389455a9f03f497dbd3de8fff33c61a6', 'request_id': 'req-ef6770c5-df96-4433-aed9-162a1a0f8718'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:18.734210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389455a9f03f497dbd3de8fff33c61a6', 'request_id': 'req-ef6770c5-df96-4433-aed9-162a1a0f8718'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:18.764555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] The token cache is being invalidate because project 389455a9f03f497dbd3de8fff33c61a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:18.764894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:18.766171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:18.767964 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2920/5834] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:18 2022] DELETE /identity/v3/projects/389455a9f03f497dbd3de8fff33c61a6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:31:18.773537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:18.776817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:18.789163 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:18.837360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:18.838066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:18.838285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:18.838558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] PATH_INFO: `/v3/projects/a7a16265092640da8c667690e0a8b9e3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:18.839725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a16265092640da8c667690e0a8b9e3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:18.841685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:18.886556 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:18.927957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6770c5-df96-4433-aed9-162a1a0f8718 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:18.949491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a16265092640da8c667690e0a8b9e3', 'request_id': 'req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:18.964272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a16265092640da8c667690e0a8b9e3', 'request_id': 'req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:18.979118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a16265092640da8c667690e0a8b9e3', 'request_id': 'req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.013884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] The token cache is being invalidate because project a7a16265092640da8c667690e0a8b9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:19.014268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.016297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1a077cf9-df9c-47f2-82e2-15503b0a9eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.021151 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2915/5835] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:18 2022] DELETE /identity/v3/projects/a7a16265092640da8c667690e0a8b9e3 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:19.025572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ee82-5b8a-4bd6-bf35-8f7d2b6386ba None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:19.025841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ee82-5b8a-4bd6-bf35-8f7d2b6386ba None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:19.026180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ee82-5b8a-4bd6-bf35-8f7d2b6386ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:19.061112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3ec9ee82-5b8a-4bd6-bf35-8f7d2b6386ba None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:19.064739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3ec9ee82-5b8a-4bd6-bf35-8f7d2b6386ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:19.094990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:19.095725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:19.096005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:19.096327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] PATH_INFO: `/v3/users/482a0780934c4aab80c6c39b111f3f51` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:19.097764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=482a0780934c4aab80c6c39b111f3f51)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:19.100464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:19.243507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482a0780934c4aab80c6c39b111f3f51'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.254497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2916/5836] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:31:19.256375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482a0780934c4aab80c6c39b111f3f51'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.264406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af3175-681c-4cab-bac8-967e1b384413 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:19.265003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af3175-681c-4cab-bac8-967e1b384413 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:19.265436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af3175-681c-4cab-bac8-967e1b384413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:19.276313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482a0780934c4aab80c6c39b111f3f51'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.276313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482a0780934c4aab80c6c39b111f3f51'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.288886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482a0780934c4aab80c6c39b111f3f51'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:19.310828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f8af3175-681c-4cab-bac8-967e1b384413 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:19.313296 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2921/5837] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:18 2022] DELETE /identity/v3/users/482a0780934c4aab80c6c39b111f3f51 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:19.314588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f8af3175-681c-4cab-bac8-967e1b384413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:19.409264 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2917/5838] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:19.413405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:19.444254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed59c-8fae-46c7-9182-16aad1d573bf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:19.466973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:19.467609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:19.467885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:19.468155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:19.468981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:19.469475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:19.471422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:19.506427 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2922/5839] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:31:19.508066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af3175-681c-4cab-bac8-967e1b384413 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:19.536868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af3175-681c-4cab-bac8-967e1b384413 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:19.554629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:19.555823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:19.557550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:19.558111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:19.569026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:19.573997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:19.608602 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:19.695752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2918/5840] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:19.696003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:19.719778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a683a-72b0-44b1-8782-dd26f7a88d5c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:19.852428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:19.853173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:19.853452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:19.853720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:19.854424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:19.856377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:19.893309 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:19.918092 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2923/5841] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:19 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:31:19.919670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:19.937589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c817395-88fc-4694-aa83-d2f978550aed admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:19.950055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:19.953806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:19.954424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:19.957632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:19.959107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:19.964870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:20.010314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2919/5842] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:20.018630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:20.039722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d7868-6e09-4668-9983-17ec7cc52a61 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:20.054384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:20.055055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:20.055338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:20.055617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:20.058201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:20.060500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:20.095244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:20.095466 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2924/5843] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:20.123062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37be9-7ada-43b7-8e88-d06da2c56956 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:20.138821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae64ce-1498-47b8-ba5e-4b940ac9de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:20.139713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae64ce-1498-47b8-ba5e-4b940ac9de15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:20.140218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae64ce-1498-47b8-ba5e-4b940ac9de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:20.140889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae64ce-1498-47b8-ba5e-4b940ac9de15 admin admin] PATH_INFO: `/v3/projects/8ad4de3b12714214b7ab9000aa01a88c/users/85024926270348a48ce79246381c84fa/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:20.212625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae64ce-1498-47b8-ba5e-4b940ac9de15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad4de3b12714214b7ab9000aa01a88c, user_id=85024926270348a48ce79246381c84fa, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:20.218041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae64ce-1498-47b8-ba5e-4b940ac9de15 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:20.254333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:20.257224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:20.310086 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2920/5844] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:20 2022] PUT /identity/v3/projects/8ad4de3b12714214b7ab9000aa01a88c/users/85024926270348a48ce79246381c84fa/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:20.322453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce2935-6b17-45a4-a586-93e1cf660bac None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:20.322728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce2935-6b17-45a4-a586-93e1cf660bac None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:20.323779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce2935-6b17-45a4-a586-93e1cf660bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:20.339558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a1d7-d43a-45fe-9c02-0c35b60e2c32 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:20.386383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b4ce2935-6b17-45a4-a586-93e1cf660bac None None] MFA Rules not processed for user `85024926270348a48ce79246381c84fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:20.388691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b4ce2935-6b17-45a4-a586-93e1cf660bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:20.559341 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2921/5845] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:20.564743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce2935-6b17-45a4-a586-93e1cf660bac None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:20.580803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:20.581479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:20.581756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:20.582026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] PATH_INFO: `/v3/projects/f2a17cfb06294823a276fcaca8b17989` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:20.586194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a17cfb06294823a276fcaca8b17989)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:20.588167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:20.756604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a17cfb06294823a276fcaca8b17989', 'request_id': 'req-e1b0f365-c036-44f7-8031-84310f18176c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:20.769899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce2935-6b17-45a4-a586-93e1cf660bac None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:20.771915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a17cfb06294823a276fcaca8b17989', 'request_id': 'req-e1b0f365-c036-44f7-8031-84310f18176c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:20.786881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a17cfb06294823a276fcaca8b17989', 'request_id': 'req-e1b0f365-c036-44f7-8031-84310f18176c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:20.809291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] The token cache is being invalidate because project f2a17cfb06294823a276fcaca8b17989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:20.809577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:20.813257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1b0f365-c036-44f7-8031-84310f18176c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:20.825214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2925/5846] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:20 2022] DELETE /identity/v3/projects/f2a17cfb06294823a276fcaca8b17989 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:31:20.826905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98555-cc3c-4ac2-a971-ec5e0128adab None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:20.827192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98555-cc3c-4ac2-a971-ec5e0128adab None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:20.827465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98555-cc3c-4ac2-a971-ec5e0128adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:20.838513 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:20.862453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:20.863141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:20.864272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:20.868019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:20.869131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:20.874174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:20.880701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d2a98555-cc3c-4ac2-a971-ec5e0128adab None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:20.881945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d2a98555-cc3c-4ac2-a971-ec5e0128adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:20.904891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2926/5847] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:20.909893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95797188-acbb-44dc-ad6a-09e9e06099c3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:20.910561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95797188-acbb-44dc-ad6a-09e9e06099c3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:20.911156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95797188-acbb-44dc-ad6a-09e9e06099c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:20.935633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2922/5848] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:20 2022] POST /identity/v3/projects => generated 385 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:20.939667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:20.943709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:20.977759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-95797188-acbb-44dc-ad6a-09e9e06099c3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:20.979043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-95797188-acbb-44dc-ad6a-09e9e06099c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:21.087565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eca00f-15ab-4106-b9e2-b326ff33d956 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:21.111357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:21.114137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:21.115204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:21.115692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:21.127244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:21.132836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:21.200752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2923/5849] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:20 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:21.202571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:21.226430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbee5e-efb9-4832-a951-62cc25d9fd20 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:21.229201 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2927/5850] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:31:21.232875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:21.234796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:21.239607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:21.239751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95797188-acbb-44dc-ad6a-09e9e06099c3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:21.240300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:21.242008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:21.246541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:21.275086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95797188-acbb-44dc-ad6a-09e9e06099c3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:21.278249 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2924/5851] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:21.279346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:21.293641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:21.295165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318e54-b587-461f-8d07-ce1ff0563d7f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:21.295981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:21.296459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:21.299313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:21.301745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:21.302603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:21.302872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:21.303269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:21.303641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] PATH_INFO: `/v3/projects/9296027f65cb45bbb837fed92901914b/users/f9f95ce8ffa342daa355d5488cba188a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:21.304699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:21.313466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:21.321723 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:21.327572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9296027f65cb45bbb837fed92901914b, user_id=f9f95ce8ffa342daa355d5488cba188a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:21.350838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:21.357994 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2928/5852] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:31:21.360641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:21.391194 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2925/5853] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:21 2022] PUT /identity/v3/projects/9296027f65cb45bbb837fed92901914b/users/f9f95ce8ffa342daa355d5488cba188a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:21.399757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00d0ce-bd93-4d3c-bc70-7dbbd3d7c352 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:21.413481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:21.661433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:21.662093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:21.662368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:21.662639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:21.663656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:21.665529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:21.688312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7160-de8d-41f9-98e4-0a1cbf73a7b1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:21.710767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:21.714666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:21.715814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:21.718282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:21.720677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:21.728469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:21.766816 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2926/5854] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:21.770001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:21.777597 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2929/5855] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:21 2022] POST /identity/v3/projects => generated 383 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:21.778786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:21.797538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b9525-5571-4c45-8bd7-187a227d93cc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:21.884813 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:21.998139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7591c7-31c9-4fbe-b247-3c16f8f55193 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:22.009005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192546-86e6-4e94-b345-79310f545aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:22.009722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192546-86e6-4e94-b345-79310f545aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.010001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192546-86e6-4e94-b345-79310f545aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.010276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192546-86e6-4e94-b345-79310f545aee admin admin] PATH_INFO: `/v3/projects/9296027f65cb45bbb837fed92901914b/users/f9f95ce8ffa342daa355d5488cba188a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.011787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:22.012398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.012669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.013613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.014479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:22.016711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:22.019699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c192546-86e6-4e94-b345-79310f545aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9296027f65cb45bbb837fed92901914b, user_id=f9f95ce8ffa342daa355d5488cba188a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:22.023180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c192546-86e6-4e94-b345-79310f545aee admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:22.056792 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2927/5856] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:21 2022] PUT /identity/v3/projects/9296027f65cb45bbb837fed92901914b/users/f9f95ce8ffa342daa355d5488cba188a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:22.068457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.068738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.069910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.095066 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2930/5857] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:21 2022] POST /identity/v3/users => generated 292 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:22.108790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:22.138403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305de0e-a269-4cca-bb68-dc84a407804c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:22.171357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] MFA Rules not processed for user `f9f95ce8ffa342daa355d5488cba188a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:22.182129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:22.331036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:22.331674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.331956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.332228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.332916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:22.334541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:22.386806 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2931/5858] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:31:22.395234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:22.431953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb5c2-7d11-4bb8-872b-8219a7e8cc1f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:22.446190 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2928/5859] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:31:22.447589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:22.448434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.448938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.449374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.450207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:22.452010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:22.462912 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:22.464465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:22.466458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:22.482274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2932/5860] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:22.483545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:22.498178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573fa0-2461-48ad-ae44-cfccdae2450c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:22.505246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5b88-153c-4130-8efe-adc8ef4c2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:22.506951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5b88-153c-4130-8efe-adc8ef4c2642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.507588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5b88-153c-4130-8efe-adc8ef4c2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.508173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5b88-153c-4130-8efe-adc8ef4c2642 admin admin] PATH_INFO: `/v3/projects/4ffcc979ee9e44a38cf04de6721f9376/users/8a06c0a7f0da4b76a1185fe364d57247/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.555375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5b88-153c-4130-8efe-adc8ef4c2642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffcc979ee9e44a38cf04de6721f9376, user_id=8a06c0a7f0da4b76a1185fe364d57247, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:22.567589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5b88-153c-4130-8efe-adc8ef4c2642 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:22.627739 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2933/5861] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:22 2022] PUT /identity/v3/projects/4ffcc979ee9e44a38cf04de6721f9376/users/8a06c0a7f0da4b76a1185fe364d57247/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:22.629602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ef8c-7175-4d46-b8df-985bcd509e91 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.630120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ef8c-7175-4d46-b8df-985bcd509e91 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.630402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ef8c-7175-4d46-b8df-985bcd509e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.631736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab067d4-240e-4928-aa4f-2712f740f710 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:22.709682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-42b1ef8c-7175-4d46-b8df-985bcd509e91 None None] MFA Rules not processed for user `8a06c0a7f0da4b76a1185fe364d57247`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:22.711097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-42b1ef8c-7175-4d46-b8df-985bcd509e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:22.807559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:22.808488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:22.808805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:22.809119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:22.811020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:22.842405 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:22.964267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:22.968864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:22.969037 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2934/5862] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:22.973749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ef8c-7175-4d46-b8df-985bcd509e91 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:22.993733 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2929/5863] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:23.268189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ef8c-7175-4d46-b8df-985bcd509e91 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:23.273117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:23.273752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:23.274029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:23.274304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:23.274941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:23.278954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:23.340782 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2935/5864] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:22 2022] POST /identity/v3/projects => generated 381 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:23.344728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:23.366057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268d3f-5ef5-4d17-bc48-908b22e151ec service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:23.544049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:23.544687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:23.544997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:23.545596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:23.555162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:23.557738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:23.593520 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2930/5865] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:23 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:23.594951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:23.616294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c395ce-c20b-4ca2-bd52-a12fe322e749 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:23.644809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:23.645647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:23.646019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:23.646298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:23.647103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:23.649128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:23.678416 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2936/5866] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:23.680212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:23.700467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8865b-aee3-4030-8164-a1419a50a17e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:23.729283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:23.731138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:23.731422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:23.731698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] PATH_INFO: `/v3/projects/2e399b221d0849078b5716bcb0b96d8d/users/16d21e243451494e985eb1e7727df7b2/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:23.785873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e399b221d0849078b5716bcb0b96d8d, user_id=16d21e243451494e985eb1e7727df7b2, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:23.788565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:23.827750 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2931/5867] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:23 2022] PUT /identity/v3/projects/2e399b221d0849078b5716bcb0b96d8d/users/16d21e243451494e985eb1e7727df7b2/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:23.833228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:23.844473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51c8ee-5a08-4115-b629-750fe8be1a59 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:23.924813 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:23.996964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b15b45-7089-4d19-83d4-cd403c8b70f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:23.997854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b15b45-7089-4d19-83d4-cd403c8b70f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:23.998149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b15b45-7089-4d19-83d4-cd403c8b70f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:23.998516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b15b45-7089-4d19-83d4-cd403c8b70f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:23.999772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b15b45-7089-4d19-83d4-cd403c8b70f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:24.001927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b15b45-7089-4d19-83d4-cd403c8b70f6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:24.023543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2937/5868] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:24.023778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:24.038004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8e32-f236-4e6e-b8ae-185884f7484e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:24.056794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:24.058098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:24.058673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:24.059112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] PATH_INFO: `/v3/projects/2e399b221d0849078b5716bcb0b96d8d/users/16d21e243451494e985eb1e7727df7b2/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:24.066337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e399b221d0849078b5716bcb0b96d8d, user_id=16d21e243451494e985eb1e7727df7b2, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:24.070762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:24.099392 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2932/5869] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:24 2022] PUT /identity/v3/projects/2e399b221d0849078b5716bcb0b96d8d/users/16d21e243451494e985eb1e7727df7b2/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:31:24.114322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c528e-ed11-4d1d-bb16-6625d0687ec5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:24.114639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c528e-ed11-4d1d-bb16-6625d0687ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:24.115043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c528e-ed11-4d1d-bb16-6625d0687ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:24.190128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-663c528e-ed11-4d1d-bb16-6625d0687ec5 None None] MFA Rules not processed for user `16d21e243451494e985eb1e7727df7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:24.191406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-663c528e-ed11-4d1d-bb16-6625d0687ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:24.471022 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2938/5870] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:24.481112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:24.484105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:24.538130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c528e-ed11-4d1d-bb16-6625d0687ec5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:24.670056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a19e0-a95f-4e14-8640-3eb24f96db3f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:24.677949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b576-312a-4bb1-b642-e34a91703ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:24.680071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b576-312a-4bb1-b642-e34a91703ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:24.680349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b576-312a-4bb1-b642-e34a91703ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:24.680617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b576-312a-4bb1-b642-e34a91703ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:24.711335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c528e-ed11-4d1d-bb16-6625d0687ec5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:24.725542 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:24.726253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad312c-67d9-49f6-84b1-b8e7adc0c73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:24.729210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad312c-67d9-49f6-84b1-b8e7adc0c73f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:24.730156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad312c-67d9-49f6-84b1-b8e7adc0c73f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:24.731374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad312c-67d9-49f6-84b1-b8e7adc0c73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:24.902847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b576-312a-4bb1-b642-e34a91703ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:24.907993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b576-312a-4bb1-b642-e34a91703ad0 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:24.924157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad312c-67d9-49f6-84b1-b8e7adc0c73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:24.926440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad312c-67d9-49f6-84b1-b8e7adc0c73f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:24.938075 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2933/5871] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:24.940542 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2939/5872] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:31:25.333336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:25.333633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:25.334553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:25.395179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] MFA Rules not processed for user `f0524cc60bd640ca9ae88845970eb013`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:25.398379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:25.600026 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2934/5873] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:26.592656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382575d-be69-4071-8e19-07528a307f06 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:26.593214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382575d-be69-4071-8e19-07528a307f06 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:26.594388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382575d-be69-4071-8e19-07528a307f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:26.622323 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:26.632568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0382575d-be69-4071-8e19-07528a307f06 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:26.634333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0382575d-be69-4071-8e19-07528a307f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:26.714090 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2940/5874] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:26.725640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:26.727311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:26.897292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7a383-c72a-4aba-ab78-81a5fb0e6f91 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:26.917053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:26.917053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:26.917053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:26.917053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:26.928937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:26.931847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:26.943564 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2935/5875] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:31:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:31:32.139113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:32.169817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:32.171864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:32.250239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] MFA Rules not processed for user `bd0447e656f9418da68b308f19e8e807`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:32.252942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:32.515074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2941/5876] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:33.697721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:33.699226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:33.730018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f971b-a5e0-40e6-9d87-e33093956209 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:33.739049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:33.741051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:33.741551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:33.741995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:33.753825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:33.755638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:33.781733 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2936/5877] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:34.894794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:34.896403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:35.054144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96fdf-5bb8-4d7e-88af-e452829ad846 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:35.064964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:35.065639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:35.065918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:35.070844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] PATH_INFO: `/v3/users/9af3b140e73141479d1a6e7d7b7266f2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:35.072214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af3b140e73141479d1a6e7d7b7266f2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:35.076818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:35.206467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af3b140e73141479d1a6e7d7b7266f2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:35.210346 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:35.225943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af3b140e73141479d1a6e7d7b7266f2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:35.253781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af3b140e73141479d1a6e7d7b7266f2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:35.254619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af3b140e73141479d1a6e7d7b7266f2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:35.273604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af3b140e73141479d1a6e7d7b7266f2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:35.289265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2942/5878] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:34 2022] DELETE /identity/v3/users/9af3b140e73141479d1a6e7d7b7266f2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:36.160876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:36.178306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e92f9-8042-44de-aedd-253db431f08b service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:36.307155 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:36.394820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:36.394820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:36.396068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:36.396442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] PATH_INFO: `/v3/projects/9700d334841645fca1319e2b2bfbc03b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:36.398851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9700d334841645fca1319e2b2bfbc03b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:36.404830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:36.522304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9700d334841645fca1319e2b2bfbc03b', 'request_id': 'req-d14e9faf-1353-4a45-8403-510f88e344e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:36.538231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9700d334841645fca1319e2b2bfbc03b', 'request_id': 'req-d14e9faf-1353-4a45-8403-510f88e344e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:36.547238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9700d334841645fca1319e2b2bfbc03b', 'request_id': 'req-d14e9faf-1353-4a45-8403-510f88e344e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:36.579441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] The token cache is being invalidate because project 9700d334841645fca1319e2b2bfbc03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:36.579752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:36.580585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:36.584560 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2937/5879] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:36 2022] DELETE /identity/v3/projects/9700d334841645fca1319e2b2bfbc03b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:36.588346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:36.590334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:36.624351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b15cf5-2cb7-456d-8943-4776b459dbc9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:36.848029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:36.848708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:36.849006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:36.849280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] PATH_INFO: `/v3/users/e7850bbac189450495a33daf0b0d7429` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:36.852616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7850bbac189450495a33daf0b0d7429)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:36.859615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:36.996950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7850bbac189450495a33daf0b0d7429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:37.015719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7850bbac189450495a33daf0b0d7429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:37.041209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7850bbac189450495a33daf0b0d7429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:37.042407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7850bbac189450495a33daf0b0d7429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:37.062265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-394b496d-59df-400a-9e29-ec3db43f0a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7850bbac189450495a33daf0b0d7429'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:37.077987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2943/5880] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:36 2022] DELETE /identity/v3/users/e7850bbac189450495a33daf0b0d7429 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:39.001996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:39.003432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:39.024954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e9faf-1353-4a45-8403-510f88e344e4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:39.175055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:39.176739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:39.177226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:39.177678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] PATH_INFO: `/v3/projects/9a073fbd601544e5a39dff3bf0703583` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:39.181566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a073fbd601544e5a39dff3bf0703583)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:39.183898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:39.304939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a073fbd601544e5a39dff3bf0703583', 'request_id': 'req-71d898e7-6ee4-4b77-8d35-90f50d456e37'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:39.324831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a073fbd601544e5a39dff3bf0703583', 'request_id': 'req-71d898e7-6ee4-4b77-8d35-90f50d456e37'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:39.340300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a073fbd601544e5a39dff3bf0703583', 'request_id': 'req-71d898e7-6ee4-4b77-8d35-90f50d456e37'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:39.358393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] The token cache is being invalidate because project 9a073fbd601544e5a39dff3bf0703583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:39.358667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:39.359974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-71d898e7-6ee4-4b77-8d35-90f50d456e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:39.365712 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2938/5881] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:39 2022] DELETE /identity/v3/projects/9a073fbd601544e5a39dff3bf0703583 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:39.367521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ebca0-1e49-4bb4-9a19-40bb072709c0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:39.368018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ebca0-1e49-4bb4-9a19-40bb072709c0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:39.368145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ebca0-1e49-4bb4-9a19-40bb072709c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:39.404633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-573ebca0-1e49-4bb4-9a19-40bb072709c0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:39.407363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-573ebca0-1e49-4bb4-9a19-40bb072709c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:39.414390 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:39.566818 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:39.632197 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2944/5882] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:31:39.634233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb24dc-8fe2-4ac6-9cb8-f1c25241a93a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:39.634519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb24dc-8fe2-4ac6-9cb8-f1c25241a93a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:39.634803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb24dc-8fe2-4ac6-9cb8-f1c25241a93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:39.677435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4ecb24dc-8fe2-4ac6-9cb8-f1c25241a93a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:39.679812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4ecb24dc-8fe2-4ac6-9cb8-f1c25241a93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:39.705225 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2939/5883] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:39.711991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ebca0-1e49-4bb4-9a19-40bb072709c0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:39.735819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ebca0-1e49-4bb4-9a19-40bb072709c0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:39.752407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:39.755326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:39.755828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:39.756749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:39.758742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:39.759113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:39.763977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:39.798664 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2945/5884] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:31:39.801539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb24dc-8fe2-4ac6-9cb8-f1c25241a93a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:39.823351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb24dc-8fe2-4ac6-9cb8-f1c25241a93a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:39.829579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:39.830720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:39.831008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:39.831282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:39.832121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:39.834143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:39.910088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2940/5885] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:39 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:39.911056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:39.927739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2903f-569f-4d36-a183-952cd8615b33 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:40.154984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:40.155842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:40.156154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:40.156512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:40.158032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:40.160015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:40.216696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:40.217836 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2946/5886] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:39 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:40.230616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ebd7d-ff10-4027-9a2d-b31ae1a182f9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:40.241996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:40.244094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:40.244401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:40.244678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:40.246558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:40.249637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:40.279606 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2941/5887] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:40.284780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:40.300458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd362-48dc-4a42-b483-2a1b3d9adff3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:40.312925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131df4ff-35b3-4c97-b862-0f8d995f8991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:40.314535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131df4ff-35b3-4c97-b862-0f8d995f8991 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:40.314535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131df4ff-35b3-4c97-b862-0f8d995f8991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:40.314535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131df4ff-35b3-4c97-b862-0f8d995f8991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:40.314968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131df4ff-35b3-4c97-b862-0f8d995f8991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:40.320958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131df4ff-35b3-4c97-b862-0f8d995f8991 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:40.340359 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2947/5888] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:40.345215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:40.365903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3254b-79c8-45c1-85b6-a7cbe77fb7a9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:40.388430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:40.389302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:40.389503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:40.389778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] PATH_INFO: `/v3/projects/522827f3647e4cdfa81257e8a048278b/users/05c1f10a225e4f14885bf583527e93a0/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:40.429407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522827f3647e4cdfa81257e8a048278b, user_id=05c1f10a225e4f14885bf583527e93a0, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:40.432476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:40.460607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:40.461287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:40.462303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:40.467340 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2942/5889] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:40 2022] PUT /identity/v3/projects/522827f3647e4cdfa81257e8a048278b/users/05c1f10a225e4f14885bf583527e93a0/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:40.541727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:40.543293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:40.807786 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2948/5890] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:40.844296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:40.846428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:41.040371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c38b97-b6f5-435e-ad5f-9c82d9d8d8e5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:41.051367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4d0c7-7fe8-4329-9118-730f1cc0d6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:41.052333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d0c7-7fe8-4329-9118-730f1cc0d6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:41.052759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d0c7-7fe8-4329-9118-730f1cc0d6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:41.053178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d0c7-7fe8-4329-9118-730f1cc0d6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:41.074678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4d0c7-7fe8-4329-9118-730f1cc0d6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:41.076221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4d0c7-7fe8-4329-9118-730f1cc0d6b4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:41.107501 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2943/5891] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:43.901442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:43.903237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:43.945879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ad6dc-36d5-4525-98a3-e398fe692b5f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:43.960263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:43.961395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:43.961839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:43.962316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] PATH_INFO: `/v3/users/b081b6464d494b4fa28d127a65e87ed5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:43.965369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b081b6464d494b4fa28d127a65e87ed5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:43.967602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:44.097943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b081b6464d494b4fa28d127a65e87ed5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:44.100176 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:44.113024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b081b6464d494b4fa28d127a65e87ed5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:44.158333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b081b6464d494b4fa28d127a65e87ed5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:44.165814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b081b6464d494b4fa28d127a65e87ed5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:44.192978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b081b6464d494b4fa28d127a65e87ed5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:44.228760 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2949/5892] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:43 2022] DELETE /identity/v3/users/b081b6464d494b4fa28d127a65e87ed5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:44.234114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:44.235848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:44.236138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:44.316429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:44.323417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:44.594548 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2944/5893] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:44.725214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:44.729025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:44.891265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e3b23-5c67-4533-b613-5d75e6e109bc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:44.905342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:44.906342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:44.906583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:44.906919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:44.932535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:44.936435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:44.968131 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2950/5894] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:46.614382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:46.620336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:46.680330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc8f71-e9f9-4ea1-93af-148ce817d894 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:46.713640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:46.716479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:46.718096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:46.718944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] PATH_INFO: `/v3/projects/c64b840d5ea3495b920cad3fc0190b9b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:46.729850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64b840d5ea3495b920cad3fc0190b9b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:46.737226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:46.780113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:46.783385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:46.828577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b0b0b-2b48-477d-b69f-9595787ab040 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:46.851474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eafa5e-dfa0-42b5-8080-f83f4cecbc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:46.853428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eafa5e-dfa0-42b5-8080-f83f4cecbc05 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:46.853896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eafa5e-dfa0-42b5-8080-f83f4cecbc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:46.854345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eafa5e-dfa0-42b5-8080-f83f4cecbc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:46.861611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6eafa5e-dfa0-42b5-8080-f83f4cecbc05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:46.910719 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:46.960218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64b840d5ea3495b920cad3fc0190b9b', 'request_id': 'req-17528e1f-7ca2-4f8e-8364-4a9252dea437'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:46.980075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64b840d5ea3495b920cad3fc0190b9b', 'request_id': 'req-17528e1f-7ca2-4f8e-8364-4a9252dea437'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:46.995881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64b840d5ea3495b920cad3fc0190b9b', 'request_id': 'req-17528e1f-7ca2-4f8e-8364-4a9252dea437'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:47.027269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] The token cache is being invalidate because project c64b840d5ea3495b920cad3fc0190b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:47.027565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:47.029182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17528e1f-7ca2-4f8e-8364-4a9252dea437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:47.031653 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2945/5895] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:46 2022] DELETE /identity/v3/projects/c64b840d5ea3495b920cad3fc0190b9b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:47.037851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a816f79-93df-4889-ad51-b59ff92b3b51 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:47.039009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a816f79-93df-4889-ad51-b59ff92b3b51 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:47.039444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a816f79-93df-4889-ad51-b59ff92b3b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:47.119233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3a816f79-93df-4889-ad51-b59ff92b3b51 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:47.137180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eafa5e-dfa0-42b5-8080-f83f4cecbc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:47.140229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eafa5e-dfa0-42b5-8080-f83f4cecbc05 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:47.140565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a816f79-93df-4889-ad51-b59ff92b3b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:47.161952 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2951/5896] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:31:47.342760 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2946/5897] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:47.351683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b4d5-e5da-4fda-a24f-daafc7b75da5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:47.352126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b4d5-e5da-4fda-a24f-daafc7b75da5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:47.356413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b4d5-e5da-4fda-a24f-daafc7b75da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:47.403452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9399b4d5-e5da-4fda-a24f-daafc7b75da5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:47.404829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9399b4d5-e5da-4fda-a24f-daafc7b75da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:47.423134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2952/5898] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:47.427273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a816f79-93df-4889-ad51-b59ff92b3b51 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:47.465556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a816f79-93df-4889-ad51-b59ff92b3b51 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:47.484404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:47.485089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:47.485379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:47.485655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:47.486300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:47.486597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:47.488245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:47.560547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2947/5899] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:31:47.563184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399b4d5-e5da-4fda-a24f-daafc7b75da5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:47.606064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399b4d5-e5da-4fda-a24f-daafc7b75da5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:47.635581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:47.657198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:47.671471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:47.672003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:47.673644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:47.683478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:47.801246 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2953/5900] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:47 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:47.804969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:47.823381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fcf8a-8e07-4059-ba49-e092cbfff084 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:48.125679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:48.126611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:48.127216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:48.127768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:48.128782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:48.131001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:48.204641 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2948/5901] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:47 2022] POST /identity/v3/users => generated 294 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:48.208422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:48.232723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed429e4-83cf-46bc-8867-cc38c334d40c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:48.250529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:48.255916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:48.258669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:48.259914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:48.260738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:48.268336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:48.307797 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2954/5902] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:48.312444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:48.333753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50725-c82d-4d2f-be3f-65c2948ab0f8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:48.351091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f333-ad76-490c-959a-49601c42ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:48.351939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f333-ad76-490c-959a-49601c42ba1d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:48.354926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f333-ad76-490c-959a-49601c42ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:48.355360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f333-ad76-490c-959a-49601c42ba1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:48.356156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212f333-ad76-490c-959a-49601c42ba1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:48.365402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212f333-ad76-490c-959a-49601c42ba1d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:48.409612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:48.416734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2949/5903] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:48.424600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1884a0-9478-469f-b800-29b5be938370 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:48.434171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:48.435524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:48.436043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:48.436570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] PATH_INFO: `/v3/projects/390c6cbfe5094c90ad3921c9c11a6a56/users/533f49e59b184c42ae2bd1ae65339b09/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:48.482179 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:48.495141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390c6cbfe5094c90ad3921c9c11a6a56, user_id=533f49e59b184c42ae2bd1ae65339b09, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:48.510926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:48.572799 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2955/5904] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:48 2022] PUT /identity/v3/projects/390c6cbfe5094c90ad3921c9c11a6a56/users/533f49e59b184c42ae2bd1ae65339b09/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:48.589157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:48.589511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:48.589784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:48.653885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] MFA Rules not processed for user `533f49e59b184c42ae2bd1ae65339b09`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:48.655178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:48.677910 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:48.825863 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2950/5905] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:48.832091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:49.080566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:49.088535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:49.141519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8ce39-d89f-49dc-96e6-8296698530f6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:49.172329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:49.172662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:49.172989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:49.173267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:49.173911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:49.176198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:49.245971 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2956/5906] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:48 2022] POST /identity/v3/projects => generated 387 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:49.248999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:49.269406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f2bf7-02ef-4d11-b378-3a996fb61556 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:49.330708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:49.331260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:49.331544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:49.331821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:49.333677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:49.414879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5746f4f-30d3-4e66-8bed-58ae678d7644 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:49.436976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:49.437771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:49.438265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:49.438513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:49.439364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:49.443324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:49.455198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:49.457449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:49.488302 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2951/5907] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:31:49.499282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:49.500368 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2957/5908] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:49 2022] POST /identity/v3/users => generated 300 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:49.521991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b141-72dd-4115-96cd-7f7e44eeeec9 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:49.537564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:49.538510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:49.538983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:49.539420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:49.540254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:49.542086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:49.545596 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:49.566225 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2952/5909] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:49.570451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:49.583664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e28a2-1115-4726-b5a3-ca441506dfe9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:49.601869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:49.602237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:49.602520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:49.602799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] PATH_INFO: `/v3/projects/1134b299318f4d158b5942f3b7cf6852/users/cd9d489c76c2410384ea67ee73617986/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:49.642942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1134b299318f4d158b5942f3b7cf6852, user_id=cd9d489c76c2410384ea67ee73617986, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:49.649880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:49.681395 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2958/5910] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:49 2022] PUT /identity/v3/projects/1134b299318f4d158b5942f3b7cf6852/users/cd9d489c76c2410384ea67ee73617986/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:49.685458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:49.716029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a72e7-40df-4df5-b48f-e87b1b0013fd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:49.933924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d93b-473d-47a7-87f2-076cc933c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:49.943423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d93b-473d-47a7-87f2-076cc933c45d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:49.944092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d93b-473d-47a7-87f2-076cc933c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:49.944498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d93b-473d-47a7-87f2-076cc933c45d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:49.945361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d93b-473d-47a7-87f2-076cc933c45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:49.950450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d93b-473d-47a7-87f2-076cc933c45d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:49.999226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:50.002154 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2953/5911] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:50.028352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668857-cd7c-4576-9233-60f37b092b7d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:50.055441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:50.056242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:50.056526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:50.056817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] PATH_INFO: `/v3/projects/1134b299318f4d158b5942f3b7cf6852/users/cd9d489c76c2410384ea67ee73617986/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:50.067735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1134b299318f4d158b5942f3b7cf6852, user_id=cd9d489c76c2410384ea67ee73617986, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:50.075791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:50.136941 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2959/5912] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:49 2022] PUT /identity/v3/projects/1134b299318f4d158b5942f3b7cf6852/users/cd9d489c76c2410384ea67ee73617986/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:50.266786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a1eac-0059-4496-93f0-b961d53b4305 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:50.267438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a1eac-0059-4496-93f0-b961d53b4305 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:50.267949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a1eac-0059-4496-93f0-b961d53b4305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:50.360233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fa3a1eac-0059-4496-93f0-b961d53b4305 None None] MFA Rules not processed for user `cd9d489c76c2410384ea67ee73617986`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:50.361698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fa3a1eac-0059-4496-93f0-b961d53b4305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:50.647537 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2954/5913] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:50.656096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:50.658245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:50.750661 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:50.817690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33743f74-18a7-42dd-a380-17534130c184 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:50.845328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818753c-06cd-4e9c-a6f9-0b4297a4a926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:50.846449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818753c-06cd-4e9c-a6f9-0b4297a4a926 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:50.847031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818753c-06cd-4e9c-a6f9-0b4297a4a926 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:50.847608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818753c-06cd-4e9c-a6f9-0b4297a4a926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:50.909141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818753c-06cd-4e9c-a6f9-0b4297a4a926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:50.912688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818753c-06cd-4e9c-a6f9-0b4297a4a926 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:50.939472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2960/5914] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:51.427915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a1eac-0059-4496-93f0-b961d53b4305 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:51.666562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a1eac-0059-4496-93f0-b961d53b4305 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:51.682050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:51.682850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:51.683133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:51.683486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] PATH_INFO: `/v3/users/533f49e59b184c42ae2bd1ae65339b09` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:51.685853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=533f49e59b184c42ae2bd1ae65339b09)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:51.688007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:51.744255 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:51.792506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533f49e59b184c42ae2bd1ae65339b09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:51.806820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533f49e59b184c42ae2bd1ae65339b09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:51.807607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533f49e59b184c42ae2bd1ae65339b09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:51.838624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533f49e59b184c42ae2bd1ae65339b09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:51.840752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533f49e59b184c42ae2bd1ae65339b09'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:51.875592 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2955/5915] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:51 2022] DELETE /identity/v3/users/533f49e59b184c42ae2bd1ae65339b09 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:51.877817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:51.878895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:51.878895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:51.918074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:51.922824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:52.095261 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2961/5916] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:52.119921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:52.121050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:52.290288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff887f-40db-4666-bb7f-52f1dbff35cd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:52.313109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885a59b-7747-4876-ac20-d81ad0287c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:52.319257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885a59b-7747-4876-ac20-d81ad0287c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:52.321239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885a59b-7747-4876-ac20-d81ad0287c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:52.321528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885a59b-7747-4876-ac20-d81ad0287c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:52.360079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885a59b-7747-4876-ac20-d81ad0287c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:52.361603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885a59b-7747-4876-ac20-d81ad0287c05 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:52.432586 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2956/5917] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:52.557533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:52.568355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:52.600350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0214a2-06cc-46e0-b16e-39f6ec8a3c80 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:52.627228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:52.629311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:52.629709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:52.630102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] PATH_INFO: `/v3/users/8a06c0a7f0da4b76a1185fe364d57247` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:52.636423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a06c0a7f0da4b76a1185fe364d57247)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:52.638540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:52.747568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a06c0a7f0da4b76a1185fe364d57247'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:52.767988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a06c0a7f0da4b76a1185fe364d57247'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:52.821161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a06c0a7f0da4b76a1185fe364d57247'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:52.829389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a06c0a7f0da4b76a1185fe364d57247'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:52.853154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a06c0a7f0da4b76a1185fe364d57247'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:52.866198 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2962/5918] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:52 2022] DELETE /identity/v3/users/8a06c0a7f0da4b76a1185fe364d57247 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:52.870931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:52.871412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:52.871739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:52.933148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:52.934321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:53.145138 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2957/5919] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:53.239530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:53.242176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:53.367068 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:53.408154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69e2d-386a-493a-9a94-1309cf975004 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:53.412038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:53.412692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:53.412994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:53.413245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:53.443094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:53.444836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:53.505419 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2963/5920] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:53.539876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:53.541564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:53.569130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45c0a8-27e6-48ef-b77c-4abb4d23afdd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:53.583360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:53.586217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:53.586865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:53.587356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] PATH_INFO: `/v3/projects/390c6cbfe5094c90ad3921c9c11a6a56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:53.591721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390c6cbfe5094c90ad3921c9c11a6a56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:53.600366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:53.688788 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:53.713394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390c6cbfe5094c90ad3921c9c11a6a56', 'request_id': 'req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:53.729077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390c6cbfe5094c90ad3921c9c11a6a56', 'request_id': 'req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:53.739560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390c6cbfe5094c90ad3921c9c11a6a56', 'request_id': 'req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:53.769143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] The token cache is being invalidate because project 390c6cbfe5094c90ad3921c9c11a6a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:53.769373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:53.770625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:53.778610 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2958/5921] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:53 2022] DELETE /identity/v3/projects/390c6cbfe5094c90ad3921c9c11a6a56 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:53.780116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:53.806098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46929085-4184-422b-bef7-986e6185b250 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:53.899146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:53.900042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:53.900517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:53.901052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] PATH_INFO: `/v3/users/cd9d489c76c2410384ea67ee73617986` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:53.909562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9d489c76c2410384ea67ee73617986)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:53.914084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:54.027956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9d489c76c2410384ea67ee73617986'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.048237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9d489c76c2410384ea67ee73617986'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.102482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9d489c76c2410384ea67ee73617986'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.103310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9d489c76c2410384ea67ee73617986'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.135563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9d489c76c2410384ea67ee73617986'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.161251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2964/5922] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:53 2022] DELETE /identity/v3/users/cd9d489c76c2410384ea67ee73617986 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:54.424720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:54.426629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:54.470398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b411c-f0c3-449f-99c8-dcf2f26d76b1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:54.710001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:54.710752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:54.710980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:54.711252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] PATH_INFO: `/v3/projects/4ffcc979ee9e44a38cf04de6721f9376` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:54.715445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:54.717654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:54.734088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffcc979ee9e44a38cf04de6721f9376)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:54.741862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:54.747535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4be2ca-2e8c-4d71-bad1-62dc782e027f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:54.767403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:54.768072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:54.768345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:54.768623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] PATH_INFO: `/v3/projects/1134b299318f4d158b5942f3b7cf6852` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:54.773577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1134b299318f4d158b5942f3b7cf6852)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:54.775599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:54.889279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffcc979ee9e44a38cf04de6721f9376', 'request_id': 'req-523765fb-0184-4fc3-b6db-9a4933462fd5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.914024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1134b299318f4d158b5942f3b7cf6852', 'request_id': 'req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.918727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffcc979ee9e44a38cf04de6721f9376', 'request_id': 'req-523765fb-0184-4fc3-b6db-9a4933462fd5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.932666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffcc979ee9e44a38cf04de6721f9376', 'request_id': 'req-523765fb-0184-4fc3-b6db-9a4933462fd5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.941331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1134b299318f4d158b5942f3b7cf6852', 'request_id': 'req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.953045 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:54.957129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1134b299318f4d158b5942f3b7cf6852', 'request_id': 'req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.980189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] The token cache is being invalidate because project 1134b299318f4d158b5942f3b7cf6852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:54.980189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.980849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-50dca1f4-7bf1-4f7a-a148-81ba5ed084e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.981719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] The token cache is being invalidate because project 4ffcc979ee9e44a38cf04de6721f9376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:54.982275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.986356 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2965/5923] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:54 2022] DELETE /identity/v3/projects/1134b299318f4d158b5942f3b7cf6852 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:54.986572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:54.988128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb221-cf7c-4e1c-9c6c-80b0b36d808e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:54.988679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb221-cf7c-4e1c-9c6c-80b0b36d808e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:54.989147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb221-cf7c-4e1c-9c6c-80b0b36d808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:54.990683 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2959/5924] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:54 2022] DELETE /identity/v3/projects/4ffcc979ee9e44a38cf04de6721f9376 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:54.991705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:54.995086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:55.020486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-34feb221-cf7c-4e1c-9c6c-80b0b36d808e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:55.022624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-34feb221-cf7c-4e1c-9c6c-80b0b36d808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:55.103240 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:55.112024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523765fb-0184-4fc3-b6db-9a4933462fd5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:55.169296 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2966/5925] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:55.170917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744455-da77-4544-8b94-2219618751bb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:55.171198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744455-da77-4544-8b94-2219618751bb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:55.171509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744455-da77-4544-8b94-2219618751bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:55.215916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1f744455-da77-4544-8b94-2219618751bb None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:55.217189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1f744455-da77-4544-8b94-2219618751bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:55.246138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:55.246826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:55.247115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:55.247418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] PATH_INFO: `/v3/users/16d21e243451494e985eb1e7727df7b2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:55.249842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d21e243451494e985eb1e7727df7b2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:55.254337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:55.356849 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2967/5926] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:55.373588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:55.373940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:55.374163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:55.445463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d21e243451494e985eb1e7727df7b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:55.459276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:55.461914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:55.473200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d21e243451494e985eb1e7727df7b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:55.474355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d21e243451494e985eb1e7727df7b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:55.474943 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2968/5927] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:55.478597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:55.478597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:55.505890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d21e243451494e985eb1e7727df7b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:55.507486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d21e243451494e985eb1e7727df7b2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:55.549840 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2960/5928] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:54 2022] DELETE /identity/v3/users/16d21e243451494e985eb1e7727df7b2 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:55.550711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:55.554663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:55.638545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47962511-9abb-4095-9f4b-8be8109a715a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:55.717319 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:55.736689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213b88c-d323-490e-a204-0af57861f368 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:55.743600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:55.744315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:55.746012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:55.746362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:55.747904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:55.748319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:55.751252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:55.777717 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2961/5929] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:31:55.779131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:55.810313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4cc56-b50b-44b9-a6fe-d8e3393277ce admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:55.821652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:55.823232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:55.823678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:55.824950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:55.826139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:55.829542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:55.838743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:55.840941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:55.842818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:55.843168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:55.848543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:55.852189 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:55.880846 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2962/5930] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:55 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:55.888737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:56.017611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:56.019504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:56.037219 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2969/5931] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:31:56.057611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2c8df-b3d2-46b6-8dfe-a0ea052644b7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:56.067933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:56.070619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.071117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.071593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.073958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:56.076201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:56.129920 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2963/5932] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:55 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:56.131234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:56.148446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc17da-c35c-450b-921b-f0886caef843 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:56.157560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:56.158200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.158481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.158753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.159409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:56.161659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:56.196514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2970/5933] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:56.198763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:56.233612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf15b-a6e0-4354-999d-a1b4dddccafd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:56.249501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:56.251998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.252287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.252999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.254905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:56.256560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:56.257817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:56.258438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:56.284211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a9398-6913-4092-a162-40c0eb9ede53 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:56.296160 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2964/5934] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:56.298399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:56.306103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:56.309037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.309445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.309748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] PATH_INFO: `/v3/projects/2e399b221d0849078b5716bcb0b96d8d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.314267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e399b221d0849078b5716bcb0b96d8d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:56.320293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:56.331516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d670c16-a1c2-4c58-aebb-f2627fe6a74b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:56.363213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760629-ab17-4381-a056-b467673963e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:56.363920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760629-ab17-4381-a056-b467673963e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.364201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760629-ab17-4381-a056-b467673963e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.364480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760629-ab17-4381-a056-b467673963e0 admin admin] PATH_INFO: `/v3/projects/979ba4b0fe8d4c7bbf65533d58fc30e9/users/d3acf3ef69d44ccfa8c2f368465bdacf/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.402397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59760629-ab17-4381-a056-b467673963e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979ba4b0fe8d4c7bbf65533d58fc30e9, user_id=d3acf3ef69d44ccfa8c2f368465bdacf, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:56.406216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59760629-ab17-4381-a056-b467673963e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:56.439367 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2965/5935] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:56 2022] PUT /identity/v3/projects/979ba4b0fe8d4c7bbf65533d58fc30e9/users/d3acf3ef69d44ccfa8c2f368465bdacf/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:56.458557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047757c-47b8-4de8-9445-d7398bba9077 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.458843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047757c-47b8-4de8-9445-d7398bba9077 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.459117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047757c-47b8-4de8-9445-d7398bba9077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.477948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e399b221d0849078b5716bcb0b96d8d', 'request_id': 'req-c79bb279-6e88-4da1-9045-33497b962ec7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:56.496290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e399b221d0849078b5716bcb0b96d8d', 'request_id': 'req-c79bb279-6e88-4da1-9045-33497b962ec7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:56.515305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e399b221d0849078b5716bcb0b96d8d', 'request_id': 'req-c79bb279-6e88-4da1-9045-33497b962ec7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:56.544184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0047757c-47b8-4de8-9445-d7398bba9077 None None] MFA Rules not processed for user `d3acf3ef69d44ccfa8c2f368465bdacf`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:56.545454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0047757c-47b8-4de8-9445-d7398bba9077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:56.546234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] The token cache is being invalidate because project 2e399b221d0849078b5716bcb0b96d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:31:56.547052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:56.548034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c79bb279-6e88-4da1-9045-33497b962ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:56.551039 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2971/5936] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:56 2022] DELETE /identity/v3/projects/2e399b221d0849078b5716bcb0b96d8d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:31:56.555647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.556303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.556845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.607455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:56.610493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:56.678229 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:56.796687 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2966/5938] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:56.798029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bff49-8cf2-4014-8e53-4b3c43f58e11 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.798317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bff49-8cf2-4014-8e53-4b3c43f58e11 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.798584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bff49-8cf2-4014-8e53-4b3c43f58e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.809625 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2972/5937] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:31:56.811365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:56.814086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:56.868966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc717-3c5f-4b6f-a220-39dc2b82345f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:56.884387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:56.885203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:56.885572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:56.885937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:56.886682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:56.886952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-500bff49-8cf2-4014-8e53-4b3c43f58e11 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:56.888336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-500bff49-8cf2-4014-8e53-4b3c43f58e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:56.889061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:56.943704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2967/5939] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:56.949253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bff49-8cf2-4014-8e53-4b3c43f58e11 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:56.979182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bff49-8cf2-4014-8e53-4b3c43f58e11 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.004212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.004642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.004932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.005201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:57.006081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:31:57.006432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:57.007872 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2973/5940] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:56 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:57.008114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:57.012104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:57.047956 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2968/5941] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:31:57.048509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:57.075191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d24c3-112e-432e-9973-ac91874cdfb8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.106823 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:57.232716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6130d-92ec-4405-8d4f-04119a39e99c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.244000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.247132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.247502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.248065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:57.253203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:57.258229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:57.275866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.281250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.281572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.281858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:57.282530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:57.284460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:57.311090 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2974/5942] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:57 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:57.314490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:57.358088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12117fa9-ed38-4283-b26a-a6083d32c814 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.374092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.375934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.375934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.376159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:57.378795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:57.382748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:57.392058 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2969/5943] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:57 2022] POST /identity/v3/projects => generated 383 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:57.393058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:57.412848 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2975/5944] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:57.416359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:57.471962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffcfd4-d60c-416c-b927-740c09886e69 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.638486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c12a40-d9f1-45be-9f5b-311f01efad80 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.655651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.656427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.656713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.657008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:57.657652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:57.659597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:57.699122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.701372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.701786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.702632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] PATH_INFO: `/v3/projects/fe7298cbbae549ff9ce27d2428094100/users/c6c1e40ee22f4799a4149186bd7f0821/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:57.733576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7298cbbae549ff9ce27d2428094100, user_id=c6c1e40ee22f4799a4149186bd7f0821, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:57.737255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:57.752386 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2970/5945] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:57 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:57.756417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:57.769265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2976/5946] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:57 2022] PUT /identity/v3/projects/fe7298cbbae549ff9ce27d2428094100/users/c6c1e40ee22f4799a4149186bd7f0821/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:57.772299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:57.791132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80e4c8-86f8-49d9-946e-36afed76f769 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.843946 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:57.965489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca7e7d-d91b-46da-b3b5-635993f708d7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:57.985960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.986868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.987397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.987761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:57.988744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:57.991277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:57.991548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:57.992361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:57.992633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:57.992952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.001560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:58.010751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:58.017607 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2971/5947] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:58.019945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:58.060881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2977/5948] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:58.075638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc667c-5824-460f-88f4-17e175952989 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:58.081014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:58.094509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:58.094683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.095483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.100683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.101459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:58.103153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:58.123825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ce3e8-6d0f-45c2-8ce0-c2a26f7ebc69 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:58.138231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2972/5949] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:58.140175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:58.144513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:58.148559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:58.149582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.150099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.150614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] PATH_INFO: `/v3/projects/fe7298cbbae549ff9ce27d2428094100/users/c6c1e40ee22f4799a4149186bd7f0821/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.164700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1426c-9fb6-4886-80e3-68c3c5ff1614 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:58.166380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7298cbbae549ff9ce27d2428094100, user_id=c6c1e40ee22f4799a4149186bd7f0821, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:58.169899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:58.170792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:58.171550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.171826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.172517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] PATH_INFO: `/v3/users/85024926270348a48ce79246381c84fa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.174364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=85024926270348a48ce79246381c84fa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:58.176584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:58.207188 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:58.213383 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2978/5950] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:58 2022] PUT /identity/v3/projects/fe7298cbbae549ff9ce27d2428094100/users/c6c1e40ee22f4799a4149186bd7f0821/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:58.214513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:58.306880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85024926270348a48ce79246381c84fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:58.330122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85024926270348a48ce79246381c84fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:58.331474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85024926270348a48ce79246381c84fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:58.352538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f5f53-bc5b-444a-a7bf-8e8fbe0f8212 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:58.358372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc7b28-8b15-4e90-8553-29c17e4e9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:58.359143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc7b28-8b15-4e90-8553-29c17e4e9ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.359425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc7b28-8b15-4e90-8553-29c17e4e9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.359699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc7b28-8b15-4e90-8553-29c17e4e9ffd admin admin] PATH_INFO: `/v3/projects/3e2fb249f0154d4f85b4bea399702fd4/users/3ed957dcba604e07b87e3aec99dcb690/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.371732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85024926270348a48ce79246381c84fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:58.373198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eaa18950-4f82-4cd6-a131-37fa890b9a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85024926270348a48ce79246381c84fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:31:58.408223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc7b28-8b15-4e90-8553-29c17e4e9ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2fb249f0154d4f85b4bea399702fd4, user_id=3ed957dcba604e07b87e3aec99dcb690, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:58.411973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc7b28-8b15-4e90-8553-29c17e4e9ffd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:58.437536 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2973/5951] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:31:58 2022] DELETE /identity/v3/users/85024926270348a48ce79246381c84fa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:58.440103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.440631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.441162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.444276 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2979/5952] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:58 2022] PUT /identity/v3/projects/3e2fb249f0154d4f85b4bea399702fd4/users/3ed957dcba604e07b87e3aec99dcb690/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:31:58.452969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd5722-ea2b-4ce6-a153-887c1e908258 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.453323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd5722-ea2b-4ce6-a153-887c1e908258 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.453718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd5722-ea2b-4ce6-a153-887c1e908258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.500265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-94cd5722-ea2b-4ce6-a153-887c1e908258 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:58.501569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-94cd5722-ea2b-4ce6-a153-887c1e908258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:58.505042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] MFA Rules not processed for user `c6c1e40ee22f4799a4149186bd7f0821`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:58.506792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:58.659545 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2980/5953] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:58.664552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c15666-da17-4db5-b358-326c57cdc561 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.669796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c15666-da17-4db5-b358-326c57cdc561 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.670182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c15666-da17-4db5-b358-326c57cdc561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.692102 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2974/5954] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:58.701005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:58.702757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:58.753420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-50c15666-da17-4db5-b358-326c57cdc561 None None] MFA Rules not processed for user `3ed957dcba604e07b87e3aec99dcb690`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:58.754872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-50c15666-da17-4db5-b358-326c57cdc561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:58.786552 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:58.864697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c18cdb-35a9-4cb7-a867-2c8ec5599e7e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:58.880020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:58.880020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.880354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:58.880468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:58.931495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:58.933019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:58.971659 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2975/5955] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:58.975122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:58.978688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:58.993125 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2981/5956] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:58.994569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46975bf2-42cf-4194-8451-1ede02b28ac0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:58.994776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46975bf2-42cf-4194-8451-1ede02b28ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.008870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46975bf2-42cf-4194-8451-1ede02b28ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.048363 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:59.075339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-46975bf2-42cf-4194-8451-1ede02b28ac0 None None] MFA Rules not processed for user `05c1f10a225e4f14885bf583527e93a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:31:59.076613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-46975bf2-42cf-4194-8451-1ede02b28ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:59.149555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547d3f8-d6de-4a27-8f3c-f2379a74c4f8 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.154501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.155247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.155525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.155799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.169620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:59.171765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:59.210885 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2976/5957] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:59.217405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:59.221878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:59.252985 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2982/5958] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:31:59.252985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46975bf2-42cf-4194-8451-1ede02b28ac0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:59.291435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba529-6a5d-429f-ab57-16754817a44d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.299235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46975bf2-42cf-4194-8451-1ede02b28ac0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.307081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.307410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.307702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.310582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.311383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:59.313440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:59.314368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.315290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.315744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.316189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.321390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:59.410110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2977/5959] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:31:59 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:59.410875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:59.414636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:59.463338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:59.466801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:59.490718 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2983/5960] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:59.491892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:59.516681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3643d2-4a53-4f18-9973-98261345da32 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.569974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04f84c-7995-4e33-aec0-c85697d21454 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.589692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.590341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.590616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.590884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.632918 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:59.673718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.674749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.675023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.678123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.679051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:59.684029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:59.745915 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2984/5961] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:31:59 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:31:59.747970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:59.752207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:31:59.789713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81c284-1059-43f4-9456-01935bfc743d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.802745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.803451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.803730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.804003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] PATH_INFO: `/v3/projects/8ad4de3b12714214b7ab9000aa01a88c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.805473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad4de3b12714214b7ab9000aa01a88c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:59.812402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:59.837763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:59.844710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:59.878845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2978/5962] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:31:59.880086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:59.894794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7e21-c564-4ed0-af3b-8fbb6b1f2a31 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.901223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.904238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.904699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.905126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.905981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:31:59.908596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:31:59.933326 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2979/5963] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:31:59.934736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:31:59.953415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c72c2-617f-417e-b74c-bebdc4e98f99 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:31:59.962892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:31:59.963836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:31:59.964554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:31:59.965193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] PATH_INFO: `/v3/projects/7f559192d00c49239e0c2d8a0c1c4e89/users/4b9b796e0c314366ac5d37624337f7fb/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:31:59.995970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f559192d00c49239e0c2d8a0c1c4e89, user_id=4b9b796e0c314366ac5d37624337f7fb, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:00.006753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:00.031158 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:00.043546 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2980/5964] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:31:59 2022] PUT /identity/v3/projects/7f559192d00c49239e0c2d8a0c1c4e89/users/4b9b796e0c314366ac5d37624337f7fb/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:00.044722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:00.076428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad4de3b12714214b7ab9000aa01a88c', 'request_id': 'req-f5d8257a-fb88-448d-bc9d-61eabc26aace'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.111639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad4de3b12714214b7ab9000aa01a88c', 'request_id': 'req-f5d8257a-fb88-448d-bc9d-61eabc26aace'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.170925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad4de3b12714214b7ab9000aa01a88c', 'request_id': 'req-f5d8257a-fb88-448d-bc9d-61eabc26aace'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.205729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1c04-f850-46f2-b5e5-cd7aa218053a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:00.215685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] The token cache is being invalidate because project 8ad4de3b12714214b7ab9000aa01a88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:00.215979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.226152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.230777 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2985/5965] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:59 2022] DELETE /identity/v3/projects/8ad4de3b12714214b7ab9000aa01a88c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:00.239393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:00.248186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:00.250460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:00.251011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:00.251292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:00.251561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:00.252214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:00.272962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:00.348038 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2981/5966] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:00.353210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:00.368230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:00.445412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944f29b-f497-4e53-a0e5-4f068438b6b8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:00.480303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92458d-4877-4f7a-9f6e-ec97de276c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:00.482544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92458d-4877-4f7a-9f6e-ec97de276c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:00.482769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92458d-4877-4f7a-9f6e-ec97de276c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:00.483073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92458d-4877-4f7a-9f6e-ec97de276c58 admin admin] PATH_INFO: `/v3/projects/7f559192d00c49239e0c2d8a0c1c4e89/users/4b9b796e0c314366ac5d37624337f7fb/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:00.488400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92458d-4877-4f7a-9f6e-ec97de276c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f559192d00c49239e0c2d8a0c1c4e89, user_id=4b9b796e0c314366ac5d37624337f7fb, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:00.502477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8257a-fb88-448d-bc9d-61eabc26aace admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:00.503761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92458d-4877-4f7a-9f6e-ec97de276c58 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:00.525758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:00.526949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:00.527903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:00.531844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] PATH_INFO: `/v3/users/f9f95ce8ffa342daa355d5488cba188a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:00.536684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f95ce8ffa342daa355d5488cba188a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:00.544504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:00.548755 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2982/5967] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:00 2022] PUT /identity/v3/projects/7f559192d00c49239e0c2d8a0c1c4e89/users/4b9b796e0c314366ac5d37624337f7fb/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:00.561201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:00.561201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:00.561555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:00.687827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] MFA Rules not processed for user `4b9b796e0c314366ac5d37624337f7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:00.693016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:00.701355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f95ce8ffa342daa355d5488cba188a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.715285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f95ce8ffa342daa355d5488cba188a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.729384 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=79,keystone:INSERT=5,keystone:DELETE=16 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:00.753362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f95ce8ffa342daa355d5488cba188a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.757534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f95ce8ffa342daa355d5488cba188a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.776465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f95ce8ffa342daa355d5488cba188a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:00.794518 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2986/5968] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:00 2022] DELETE /identity/v3/users/f9f95ce8ffa342daa355d5488cba188a => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:00.917969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2983/5969] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:01.043799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:01.045962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:01.155856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ad095-b853-4fa5-b4fe-52f7bf74571f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:01.159882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef817b5f-cdec-4340-8e4e-83ab988d6148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:01.160521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817b5f-cdec-4340-8e4e-83ab988d6148 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:01.160862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817b5f-cdec-4340-8e4e-83ab988d6148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:01.161139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817b5f-cdec-4340-8e4e-83ab988d6148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:01.165172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:01.167359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:01.342159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef817b5f-cdec-4340-8e4e-83ab988d6148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:01.343799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef817b5f-cdec-4340-8e4e-83ab988d6148 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:01.353302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302ad3-95e8-4249-b177-d538f2e996bb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:01.392367 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2987/5970] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:01.425218 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:01.577055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:01.578344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:01.578636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:01.578944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] PATH_INFO: `/v3/projects/9296027f65cb45bbb837fed92901914b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:01.584737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9296027f65cb45bbb837fed92901914b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:01.588677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:01.731704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9296027f65cb45bbb837fed92901914b', 'request_id': 'req-df5bf0c7-d077-45c8-9fba-c35437f9d317'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:01.743863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9296027f65cb45bbb837fed92901914b', 'request_id': 'req-df5bf0c7-d077-45c8-9fba-c35437f9d317'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:01.755606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9296027f65cb45bbb837fed92901914b', 'request_id': 'req-df5bf0c7-d077-45c8-9fba-c35437f9d317'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:01.790190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] The token cache is being invalidate because project 9296027f65cb45bbb837fed92901914b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:01.791349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:01.794200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:01.800453 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2984/5971] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:01 2022] DELETE /identity/v3/projects/9296027f65cb45bbb837fed92901914b => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:01.805850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7009-e928-4eb3-a64a-d4b7fd910043 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:01.806336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7009-e928-4eb3-a64a-d4b7fd910043 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:01.806779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7009-e928-4eb3-a64a-d4b7fd910043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:01.907230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-14ca7009-e928-4eb3-a64a-d4b7fd910043 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:01.917383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-14ca7009-e928-4eb3-a64a-d4b7fd910043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:02.212984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:02.215101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:02.234160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2988/5972] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:02.238193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0b6a-51cb-479c-9ae6-e5b214c7e224 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:02.243761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0b6a-51cb-479c-9ae6-e5b214c7e224 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:02.246403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0b6a-51cb-479c-9ae6-e5b214c7e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:02.349459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-915c0b6a-51cb-479c-9ae6-e5b214c7e224 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:02.357104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-915c0b6a-51cb-479c-9ae6-e5b214c7e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:02.391075 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2989/5973] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:02.399735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c0b6a-51cb-479c-9ae6-e5b214c7e224 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:02.429865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bf0c7-d077-45c8-9fba-c35437f9d317 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:02.440640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c0b6a-51cb-479c-9ae6-e5b214c7e224 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:02.450150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:02.451749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:02.452040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:02.453831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:02.456542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:02.459477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:02.460300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:02.460577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:02.460890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:02.461629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:02.461851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:02.465573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:02.498923 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2990/5974] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:32:02.505044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:02.538723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34ddad-31da-4b6b-b901-cd412850a4e8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:02.562242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:02.562970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:02.563253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:02.563529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:02.564167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:02.573809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:02.590107 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:02.655141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:02.657932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:02.663625 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2991/5975] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:02 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:32:02.665295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:02.675874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:02.680308 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:02.704410 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2985/5976] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:32:02.705390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:02.742810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe87ff-6004-4763-96ac-9e066a34c9dc service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:02.887195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a273ab-1051-47c4-a79f-b3af44fdd370 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:02.898482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b155cf-cf0e-4242-9681-ada580aea4f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:02.898770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b155cf-cf0e-4242-9681-ada580aea4f3 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:02.898878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b155cf-cf0e-4242-9681-ada580aea4f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:02.900559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b155cf-cf0e-4242-9681-ada580aea4f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:02.906736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-33b155cf-cf0e-4242-9681-ada580aea4f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:02.927582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:02.928259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:02.928592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:02.929562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:02.930506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:02.935282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:02.990900 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2986/5977] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:02 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:02.995989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:03.010503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9827f-0bbb-4d66-89a8-bf182492b51b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:03.018508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:03.019312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:03.019892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:03.020172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:03.020871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:03.022527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:03.044297 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2987/5978] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:03.045493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:03.072823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914b8b-2e5b-480b-8ceb-7e1c8fe6180a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:03.100430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:03.101158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:03.101435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:03.101711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:03.102360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:03.106173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:03.166374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b155cf-cf0e-4242-9681-ada580aea4f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:03.168336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b155cf-cf0e-4242-9681-ada580aea4f3 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:03.180107 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2988/5979] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:32:03.181852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:03.207625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0e8cc-a51d-4000-9d57-5e0c51764f9f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:03.218005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2992/5980] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:03.222853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:03.223573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:03.223833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:03.224107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] PATH_INFO: `/v3/projects/8dd877836ecb4d2f98dfcc47a831dead/users/7dc76f9df40a45b78e7333d29764538a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:03.263111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd877836ecb4d2f98dfcc47a831dead, user_id=7dc76f9df40a45b78e7333d29764538a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:03.270673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:03.306048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2989/5981] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:03 2022] PUT /identity/v3/projects/8dd877836ecb4d2f98dfcc47a831dead/users/7dc76f9df40a45b78e7333d29764538a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:03.320188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9049-cf7a-4450-9812-dfada75ee1e3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:03.321445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9049-cf7a-4450-9812-dfada75ee1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:03.321674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9049-cf7a-4450-9812-dfada75ee1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:03.421692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9b9c9049-cf7a-4450-9812-dfada75ee1e3 None None] MFA Rules not processed for user `7dc76f9df40a45b78e7333d29764538a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:03.423297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9b9c9049-cf7a-4450-9812-dfada75ee1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:03.459319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:03.461264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:03.599742 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2993/5982] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:03.604609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9049-cf7a-4450-9812-dfada75ee1e3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:03.657383 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:03.821979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94208-bdd3-46d1-9c53-fdae709e5d6b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:03.853585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee854787-5786-443c-acbe-d235eac35197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:03.865095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854787-5786-443c-acbe-d235eac35197 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:03.868862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854787-5786-443c-acbe-d235eac35197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:03.869152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854787-5786-443c-acbe-d235eac35197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:03.882347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ee854787-5786-443c-acbe-d235eac35197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:03.887756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9049-cf7a-4450-9812-dfada75ee1e3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:03.914828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:03.915871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:03.916345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:03.918940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:03.919968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:03.927038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:03.964496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee854787-5786-443c-acbe-d235eac35197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:03.969743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee854787-5786-443c-acbe-d235eac35197 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:04.021580 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2994/5983] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:03 2022] POST /identity/v3/projects => generated 377 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:04.032349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:04.047326 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2990/5984] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:32:04.232644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415a2e-6810-4441-a55c-2b899e66b6f6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:04.233069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415a2e-6810-4441-a55c-2b899e66b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:04.233616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415a2e-6810-4441-a55c-2b899e66b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:04.240122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547321d6-2f35-4175-9e76-303aa545e8d4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:04.247172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:04.247986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:04.252021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:04.254669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:04.256623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:04.264504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:04.307588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f5415a2e-6810-4441-a55c-2b899e66b6f6 None None] MFA Rules not processed for user `05c1f10a225e4f14885bf583527e93a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:04.314323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f5415a2e-6810-4441-a55c-2b899e66b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:04.338139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2995/5985] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:04 2022] POST /identity/v3/users => generated 295 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:04.339348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:04.360564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ef22-6dfb-4383-a386-f4d05669498e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:04.377140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:04.378640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:04.379267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:04.379753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:04.381179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:04.383806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:04.416489 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2996/5986] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:04.418143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:04.447452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329e352-621a-4c12-ab1a-a6cd3ae98f06 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:04.469363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:04.472252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:04.472804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:04.474279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] PATH_INFO: `/v3/projects/c9274f2f9e314c78934538e7dddcced1/users/ad9f53a502a041729d5dbdb0770d428b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:04.522522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9274f2f9e314c78934538e7dddcced1, user_id=ad9f53a502a041729d5dbdb0770d428b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:04.525667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:04.548001 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2997/5987] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:04 2022] PUT /identity/v3/projects/c9274f2f9e314c78934538e7dddcced1/users/ad9f53a502a041729d5dbdb0770d428b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:04.554368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:04.573161 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:04.625582 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2991/5988] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:04.628517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5415a2e-6810-4441-a55c-2b899e66b6f6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:04.668157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5415a2e-6810-4441-a55c-2b899e66b6f6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:04.724224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552464f-66a9-4585-a9cb-611f961bf1fa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:04.728850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:04.729641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:04.730086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:04.730671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:04.732829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:04.777575 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:04.960552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:04.963053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:04.980980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2998/5989] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:05.042430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637ae7-fdd8-4864-9342-aacd83166ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:05.043066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637ae7-fdd8-4864-9342-aacd83166ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:05.043341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637ae7-fdd8-4864-9342-aacd83166ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:05.043609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637ae7-fdd8-4864-9342-aacd83166ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:05.044257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637ae7-fdd8-4864-9342-aacd83166ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:05.046469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637ae7-fdd8-4864-9342-aacd83166ee7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:05.087857 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2992/5990] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:05.089038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:05.126818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe76ce0-1862-4610-97a8-76a8155b5014 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:05.147356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:05.148079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:05.148360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:05.148689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] PATH_INFO: `/v3/projects/c9274f2f9e314c78934538e7dddcced1/users/ad9f53a502a041729d5dbdb0770d428b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:05.150879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9274f2f9e314c78934538e7dddcced1, user_id=ad9f53a502a041729d5dbdb0770d428b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:05.153593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:05.179098 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 2999/5991] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:05 2022] PUT /identity/v3/projects/c9274f2f9e314c78934538e7dddcced1/users/ad9f53a502a041729d5dbdb0770d428b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:05.194571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9be8-691f-4fbe-a99b-0e142500b83f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:05.194917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9be8-691f-4fbe-a99b-0e142500b83f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:05.195106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9be8-691f-4fbe-a99b-0e142500b83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:05.274525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d64e9be8-691f-4fbe-a99b-0e142500b83f None None] MFA Rules not processed for user `ad9f53a502a041729d5dbdb0770d428b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:05.276256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d64e9be8-691f-4fbe-a99b-0e142500b83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:05.479118 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2993/5992] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:05.489645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:05.492032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:05.764368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c27f-6386-4bcb-a2a3-466c59313961 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:05.774955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:05.775858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:05.777769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:05.779474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:05.803143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:05.815385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:05.845279 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3000/5993] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:10.539458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9be8-691f-4fbe-a99b-0e142500b83f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:10.617173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:10.641002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9ed78-8384-4b3f-91af-0ea54a4de868 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:10.660596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95d418-c888-447c-983f-d5f97d9fcd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:10.664087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d418-c888-447c-983f-d5f97d9fcd3d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:10.666981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d418-c888-447c-983f-d5f97d9fcd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:10.669186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d418-c888-447c-983f-d5f97d9fcd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:10.677739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8c95d418-c888-447c-983f-d5f97d9fcd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:10.782173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9be8-691f-4fbe-a99b-0e142500b83f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:10.794313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:10.796856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:10.796856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:10.796856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] PATH_INFO: `/v3/users/7dc76f9df40a45b78e7333d29764538a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:10.798099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc76f9df40a45b78e7333d29764538a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:10.800470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:10.823512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95d418-c888-447c-983f-d5f97d9fcd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:10.826075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95d418-c888-447c-983f-d5f97d9fcd3d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:10.832022 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:10.903165 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3001/5994] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:10.917303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc76f9df40a45b78e7333d29764538a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:10.957328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc76f9df40a45b78e7333d29764538a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:10.961291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc76f9df40a45b78e7333d29764538a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:10.982066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc76f9df40a45b78e7333d29764538a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:10.982858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc76f9df40a45b78e7333d29764538a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:11.067209 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2994/5995] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:10 2022] DELETE /identity/v3/users/7dc76f9df40a45b78e7333d29764538a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:11.068697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:11.069067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:11.069358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:11.164668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:11.171244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:11.293402 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3002/5996] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:11.304021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:11.305572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:11.397320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542d21f-e118-4dac-82b0-8e01582089fe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:11.401868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:11.403432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:11.403781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:11.404662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:11.420223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:11.422503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:11.454226 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2995/5997] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:32:11.975516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:11.978272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:12.053647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab411be-5951-48f7-b124-391023c36ac9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:12.072917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:12.074018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:12.074513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:12.074978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] PATH_INFO: `/v3/projects/8dd877836ecb4d2f98dfcc47a831dead` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:12.078055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd877836ecb4d2f98dfcc47a831dead)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:12.081289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:12.163255 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:12.320359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd877836ecb4d2f98dfcc47a831dead', 'request_id': 'req-65186a7d-01d9-44d3-8245-e8c55e3136c6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.353117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd877836ecb4d2f98dfcc47a831dead', 'request_id': 'req-65186a7d-01d9-44d3-8245-e8c55e3136c6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.375989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd877836ecb4d2f98dfcc47a831dead', 'request_id': 'req-65186a7d-01d9-44d3-8245-e8c55e3136c6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.408814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] The token cache is being invalidate because project 8dd877836ecb4d2f98dfcc47a831dead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:12.408814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.408814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.408814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3003/5998] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:11 2022] DELETE /identity/v3/projects/8dd877836ecb4d2f98dfcc47a831dead => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:12.411154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:12.426525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580ddc2-bc67-4c80-8d25-bc668c6d6b4e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:12.532017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:12.533023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:12.533682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:12.534368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] PATH_INFO: `/v3/users/ad9f53a502a041729d5dbdb0770d428b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:12.536242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9f53a502a041729d5dbdb0770d428b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:12.541997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:12.660484 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:12.704695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9f53a502a041729d5dbdb0770d428b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.756172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9f53a502a041729d5dbdb0770d428b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.762121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9f53a502a041729d5dbdb0770d428b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.787927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9f53a502a041729d5dbdb0770d428b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.790136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0e470147-05eb-4304-a6ff-a1e12404471e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9f53a502a041729d5dbdb0770d428b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:12.864571 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2996/5999] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:12 2022] DELETE /identity/v3/users/ad9f53a502a041729d5dbdb0770d428b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:13.587362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:13.590079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:13.641339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65186a7d-01d9-44d3-8245-e8c55e3136c6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:14.146144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:14.148175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:14.153528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:14.154689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] PATH_INFO: `/v3/projects/c9274f2f9e314c78934538e7dddcced1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:14.157607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9274f2f9e314c78934538e7dddcced1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:14.167115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:14.378306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9274f2f9e314c78934538e7dddcced1', 'request_id': 'req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:14.400003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9274f2f9e314c78934538e7dddcced1', 'request_id': 'req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:14.420426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9274f2f9e314c78934538e7dddcced1', 'request_id': 'req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:14.442848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] The token cache is being invalidate because project c9274f2f9e314c78934538e7dddcced1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:14.445531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:14.447585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-596187a1-a01b-4d2a-a06c-5741c4a2e2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:14.454558 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3004/6000] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:13 2022] DELETE /identity/v3/projects/c9274f2f9e314c78934538e7dddcced1 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:14.456585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97db12-27a8-41ac-9330-caef710bf8fd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:14.457167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97db12-27a8-41ac-9330-caef710bf8fd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:14.457361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97db12-27a8-41ac-9330-caef710bf8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:14.500622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2f97db12-27a8-41ac-9330-caef710bf8fd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:14.504989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2f97db12-27a8-41ac-9330-caef710bf8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:14.679023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a7572-6bcf-47ca-b177-d810f2926124 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:14.680060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a7572-6bcf-47ca-b177-d810f2926124 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:14.680495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a7572-6bcf-47ca-b177-d810f2926124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:14.681245 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2997/6001] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:14.721609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7d2a7572-6bcf-47ca-b177-d810f2926124 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:14.723109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d2a7572-6bcf-47ca-b177-d810f2926124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:14.759209 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3005/6002] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:14.760472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97db12-27a8-41ac-9330-caef710bf8fd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:14.774708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97db12-27a8-41ac-9330-caef710bf8fd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:14.793278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:14.793927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:14.794210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:14.794487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:14.795950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:14.796263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:14.797997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:14.833069 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2998/6003] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:32:14.833979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a7572-6bcf-47ca-b177-d810f2926124 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:14.847739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a7572-6bcf-47ca-b177-d810f2926124 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:14.863310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:14.863945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:14.864226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:14.864495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:14.865162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:14.871045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:14.927585 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:14.939012 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3006/6004] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:14 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:14.941990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:14.959909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83e465-7fda-49b0-beeb-7d5662cf6d85 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:15.060067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:15.061005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:15.061539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:15.061924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:15.062703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:15.068703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:15.177269 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 2999/6005] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:14 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:15.181281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:15.202712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafaf8-6509-4dd5-aec8-a001af2d637f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:15.243281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:15.244246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:15.244700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:15.245619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:15.247383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:15.252131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:15.336361 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3007/6006] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:15.340531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:15.358769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2630ff-f86e-4d84-8c88-3b14d0ab4d76 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:15.376267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d24b8-36cd-483a-a15e-7be60ac418f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:15.377069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d24b8-36cd-483a-a15e-7be60ac418f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:15.377355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d24b8-36cd-483a-a15e-7be60ac418f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:15.377633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d24b8-36cd-483a-a15e-7be60ac418f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:15.378466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d24b8-36cd-483a-a15e-7be60ac418f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:15.380850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d24b8-36cd-483a-a15e-7be60ac418f5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:15.417862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3000/6007] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:15.419114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:15.434548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0d378-665a-4e70-83dc-32823587d0ad admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:15.453866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:15.454607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:15.454877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:15.455160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] PATH_INFO: `/v3/projects/e9192e23b1a04e3880b7425bc8fb3edd/users/a72595e9e2a046ba8bc12cac4b4d5d44/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:15.515211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9192e23b1a04e3880b7425bc8fb3edd, user_id=a72595e9e2a046ba8bc12cac4b4d5d44, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:15.517912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:15.564678 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3008/6008] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:15 2022] PUT /identity/v3/projects/e9192e23b1a04e3880b7425bc8fb3edd/users/a72595e9e2a046ba8bc12cac4b4d5d44/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:15.575469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520fac7-b141-4cd0-af77-e41019bc1c2a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:15.575469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520fac7-b141-4cd0-af77-e41019bc1c2a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:15.576141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520fac7-b141-4cd0-af77-e41019bc1c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:15.665294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b520fac7-b141-4cd0-af77-e41019bc1c2a None None] MFA Rules not processed for user `a72595e9e2a046ba8bc12cac4b4d5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:15.666540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b520fac7-b141-4cd0-af77-e41019bc1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:15.707288 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:15.918859 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3001/6009] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:15.920658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:16.067171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e27a5-7a6a-44e1-9d69-1d21c8eaee94 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:16.082026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:16.082829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:16.083242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:16.083629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:16.084408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:16.086619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:16.159927 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3009/6010] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:15 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:16.164539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520fac7-b141-4cd0-af77-e41019bc1c2a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:16.188797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520fac7-b141-4cd0-af77-e41019bc1c2a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:16.347461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:16.348603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:16.349435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:16.349888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:16.350728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:16.352955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:16.408439 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3002/6011] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:16 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:16.413654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:16.433908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b909bf-dadd-4cf2-9961-f1a7f2d0e125 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:16.456671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:16.457489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:16.457873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:16.458256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:16.459023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:16.461374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:16.513168 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3010/6012] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:16.518449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:16.535916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efaf16-a71e-4230-bf97-9b37c7d9a34e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:16.547312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:16.547999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:16.548274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:16.548930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] PATH_INFO: `/v3/projects/3cf2a6396de747cea25f92e43e4ab7f8/users/14bad344fe4545e896437a6f3e6a13c7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:16.569817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf2a6396de747cea25f92e43e4ab7f8, user_id=14bad344fe4545e896437a6f3e6a13c7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:16.572958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:16.613462 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3003/6013] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:16 2022] PUT /identity/v3/projects/3cf2a6396de747cea25f92e43e4ab7f8/users/14bad344fe4545e896437a6f3e6a13c7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:16.614442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:16.646982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d95fd-024f-481a-bbca-eed852a94b53 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:16.793997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eca1e-3ebe-459e-80cb-ae5bb3c6c66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:16.794793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eca1e-3ebe-459e-80cb-ae5bb3c6c66a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:16.795332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eca1e-3ebe-459e-80cb-ae5bb3c6c66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:16.795709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eca1e-3ebe-459e-80cb-ae5bb3c6c66a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:16.796931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eca1e-3ebe-459e-80cb-ae5bb3c6c66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:16.799016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eca1e-3ebe-459e-80cb-ae5bb3c6c66a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:16.831213 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3011/6014] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:32:16.835299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:16.856471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58076d4-5801-40d4-adfd-e0320553c48b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:16.880064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:16.883608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:16.883906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:16.884185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] PATH_INFO: `/v3/projects/3cf2a6396de747cea25f92e43e4ab7f8/users/14bad344fe4545e896437a6f3e6a13c7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:16.894785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf2a6396de747cea25f92e43e4ab7f8, user_id=14bad344fe4545e896437a6f3e6a13c7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:16.906212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:16.992539 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3004/6015] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:16 2022] PUT /identity/v3/projects/3cf2a6396de747cea25f92e43e4ab7f8/users/14bad344fe4545e896437a6f3e6a13c7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:16.993429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a3ac-5f1f-4741-b69f-44e0c997353e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:16.995280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a3ac-5f1f-4741-b69f-44e0c997353e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:16.995280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a3ac-5f1f-4741-b69f-44e0c997353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:17.069203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c3e4a3ac-5f1f-4741-b69f-44e0c997353e None None] MFA Rules not processed for user `14bad344fe4545e896437a6f3e6a13c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:17.070475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c3e4a3ac-5f1f-4741-b69f-44e0c997353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:17.122385 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:17.224946 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3012/6016] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:17.245965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:17.247933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:17.495792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb745-92bf-40e3-9d3a-3d2fdf92dbb2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:17.503015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6ad08-9972-4a0c-a7ef-e6fd8aa17a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:17.515186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ad08-9972-4a0c-a7ef-e6fd8aa17a8a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:17.518675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ad08-9972-4a0c-a7ef-e6fd8aa17a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:17.519059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ad08-9972-4a0c-a7ef-e6fd8aa17a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:17.531534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6ad08-9972-4a0c-a7ef-e6fd8aa17a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:17.533404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6ad08-9972-4a0c-a7ef-e6fd8aa17a8a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:17.545117 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3005/6017] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:19.742744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a3ac-5f1f-4741-b69f-44e0c997353e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:19.894089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a3ac-5f1f-4741-b69f-44e0c997353e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:19.911922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:19.912723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:19.913147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:19.913514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] PATH_INFO: `/v3/users/a72595e9e2a046ba8bc12cac4b4d5d44` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:19.916715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72595e9e2a046ba8bc12cac4b4d5d44)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:19.919194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:20.027567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72595e9e2a046ba8bc12cac4b4d5d44'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:20.056706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72595e9e2a046ba8bc12cac4b4d5d44'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:20.087814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72595e9e2a046ba8bc12cac4b4d5d44'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:20.088954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72595e9e2a046ba8bc12cac4b4d5d44'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:20.101732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72595e9e2a046ba8bc12cac4b4d5d44'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:20.126850 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3013/6018] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:19 2022] DELETE /identity/v3/users/a72595e9e2a046ba8bc12cac4b4d5d44 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:20.128730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:20.129238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:20.130159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:20.142137 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:20.155362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:20.158202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:20.260598 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3006/6019] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:20.268508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:20.270322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:20.342657 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:20.371428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b5fef-a785-45d3-940d-cd6989a27109 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:20.376139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:20.376847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:20.377132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:20.377528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:20.388612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:20.401278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:20.416558 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3014/6020] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:20.870724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:20.872876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:20.926146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001af4f-a21d-4fb1-a232-29a3feb7da8f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:20.945409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:20.946207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:20.946566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:20.946914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] PATH_INFO: `/v3/projects/e9192e23b1a04e3880b7425bc8fb3edd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:20.948256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9192e23b1a04e3880b7425bc8fb3edd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:20.950329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:21.050553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9192e23b1a04e3880b7425bc8fb3edd', 'request_id': 'req-a8e91621-66ae-4b93-a298-4a10f03f8f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.066760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9192e23b1a04e3880b7425bc8fb3edd', 'request_id': 'req-a8e91621-66ae-4b93-a298-4a10f03f8f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.074283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9192e23b1a04e3880b7425bc8fb3edd', 'request_id': 'req-a8e91621-66ae-4b93-a298-4a10f03f8f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.087968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] The token cache is being invalidate because project e9192e23b1a04e3880b7425bc8fb3edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:21.088262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.088961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.092836 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3007/6021] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:20 2022] DELETE /identity/v3/projects/e9192e23b1a04e3880b7425bc8fb3edd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:21.095693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:21.109181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b99f6-a5db-43a4-8979-5f58f4490672 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:21.196655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:21.197469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:21.197750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:21.198027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] PATH_INFO: `/v3/users/14bad344fe4545e896437a6f3e6a13c7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:21.203411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bad344fe4545e896437a6f3e6a13c7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:21.205635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:21.315424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bad344fe4545e896437a6f3e6a13c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.328950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bad344fe4545e896437a6f3e6a13c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.370828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bad344fe4545e896437a6f3e6a13c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.373247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bad344fe4545e896437a6f3e6a13c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.404798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bad344fe4545e896437a6f3e6a13c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:21.416253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3015/6022] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:21 2022] DELETE /identity/v3/users/14bad344fe4545e896437a6f3e6a13c7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:21.841941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:21.843415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:21.861750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91621-66ae-4b93-a298-4a10f03f8f99 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:22.029513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:22.030222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.030568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.030839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] PATH_INFO: `/v3/users/3ed957dcba604e07b87e3aec99dcb690` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.031983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed957dcba604e07b87e3aec99dcb690)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:22.050168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:22.114126 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:22.168499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:22.170977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:22.210819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed957dcba604e07b87e3aec99dcb690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.235680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadebd05-fe09-4a45-a469-a1506f6de0bd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:22.236254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed957dcba604e07b87e3aec99dcb690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.238514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed957dcba604e07b87e3aec99dcb690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.261609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:22.262300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed957dcba604e07b87e3aec99dcb690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.262454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.262629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.262923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] PATH_INFO: `/v3/projects/3cf2a6396de747cea25f92e43e4ab7f8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.263337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5c441032-e521-46f7-abe0-6a3341bab220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed957dcba604e07b87e3aec99dcb690'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.264114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf2a6396de747cea25f92e43e4ab7f8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:22.266546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:22.332983 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3008/6023] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:21 2022] DELETE /identity/v3/users/3ed957dcba604e07b87e3aec99dcb690 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:22.334714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b339-38c5-41ec-9297-fd36212ca103 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.337118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b339-38c5-41ec-9297-fd36212ca103 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.339525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b339-38c5-41ec-9297-fd36212ca103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.399815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf2a6396de747cea25f92e43e4ab7f8', 'request_id': 'req-88b0166c-f3b4-44f1-92de-fc8f946975a5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.404542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-afd2b339-38c5-41ec-9297-fd36212ca103 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:22.406728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-afd2b339-38c5-41ec-9297-fd36212ca103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:22.437297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf2a6396de747cea25f92e43e4ab7f8', 'request_id': 'req-88b0166c-f3b4-44f1-92de-fc8f946975a5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.441564 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:22.456872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf2a6396de747cea25f92e43e4ab7f8', 'request_id': 'req-88b0166c-f3b4-44f1-92de-fc8f946975a5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.510133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] The token cache is being invalidate because project 3cf2a6396de747cea25f92e43e4ab7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:22.510476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.517811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.533517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3009/6025] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:22.535513 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3016/6025] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:22 2022] DELETE /identity/v3/projects/3cf2a6396de747cea25f92e43e4ab7f8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:22.537229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5f07-3ecb-4439-ae85-d97772db06dd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.537612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5f07-3ecb-4439-ae85-d97772db06dd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.537993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5f07-3ecb-4439-ae85-d97772db06dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.542834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:22.546121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:22.569566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2e5e5f07-3ecb-4439-ae85-d97772db06dd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:22.576578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e5e5f07-3ecb-4439-ae85-d97772db06dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:22.609778 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3010/6026] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:22.611836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.614503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.614927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.717205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0166c-f3b4-44f1-92de-fc8f946975a5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:22.719734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:22.721814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:22.723067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:22.724298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.724831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.725314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.739974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:22.741839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:22.755137 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3011/6027] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:22.756179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:22.759821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:22.776253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3017/6028] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:22.777684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:22.787293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2952-fef2-423e-90a3-a3450f6153d9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:22.797694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:22.798672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.798961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.799231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] PATH_INFO: `/v3/users/d3acf3ef69d44ccfa8c2f368465bdacf` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.799977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa08da-79ae-4020-abe9-a6fae328ce01 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:22.803288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3acf3ef69d44ccfa8c2f368465bdacf)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:22.809807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:22.811339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:22.813732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.814989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.816498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.818199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:22.819830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:22.822891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:22.847976 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3018/6029] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:32:22.856405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:22.898209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3acf3ef69d44ccfa8c2f368465bdacf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.902258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ecbc-3237-4b1b-b4ac-588ab854bab5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:22.917071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:22.917999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:22.918508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:22.920399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3acf3ef69d44ccfa8c2f368465bdacf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.921095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:22.921591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3acf3ef69d44ccfa8c2f368465bdacf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.924758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:22.930778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:22.940112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3acf3ef69d44ccfa8c2f368465bdacf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.941726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10789369-300b-440d-8ed8-4422c24dc9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3acf3ef69d44ccfa8c2f368465bdacf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:22.995346 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3012/6030] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:22 2022] DELETE /identity/v3/users/d3acf3ef69d44ccfa8c2f368465bdacf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:23.012161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b7872-26b8-4395-9965-aad45d20b67c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.012492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b7872-26b8-4395-9965-aad45d20b67c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.012789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b7872-26b8-4395-9965-aad45d20b67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.030928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3019/6031] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:22 2022] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:23.030928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:23.035297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.063124 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:23.082034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f51b7872-26b8-4395-9965-aad45d20b67c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:23.099313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f51b7872-26b8-4395-9965-aad45d20b67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.252266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463c06-6731-4c54-940d-b0be2cb07e5c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:23.264568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:23.264995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.265485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.265627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.266269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:23.269907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:23.320508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3020/6032] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:23 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:23.323652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:23.327949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.337347 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3013/6033] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:23.342513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b7872-26b8-4395-9965-aad45d20b67c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:23.379550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168a452-e823-4c7a-9f52-8d9845baed29 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:23.391265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b7872-26b8-4395-9965-aad45d20b67c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:23.398414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:23.399798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.400665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.401587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] PATH_INFO: `/v3/projects/3e2fb249f0154d4f85b4bea399702fd4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.404405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:23.407230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2fb249f0154d4f85b4bea399702fd4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:23.408185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.408670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.409572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.411436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:23.412843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:23.415960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:23.447645 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3014/6034] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:23.448565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:23.455992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.510010 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:23.531063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2fb249f0154d4f85b4bea399702fd4', 'request_id': 'req-cc210eb3-7848-4a15-8bf7-6cd31b55511d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.548597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2fb249f0154d4f85b4bea399702fd4', 'request_id': 'req-cc210eb3-7848-4a15-8bf7-6cd31b55511d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.569124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2fb249f0154d4f85b4bea399702fd4', 'request_id': 'req-cc210eb3-7848-4a15-8bf7-6cd31b55511d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.583530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611896-fe1d-47be-81c5-4027c05816d7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:23.596000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] The token cache is being invalidate because project 3e2fb249f0154d4f85b4bea399702fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:23.596417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.597193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.605146 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3021/6035] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:23 2022] DELETE /identity/v3/projects/3e2fb249f0154d4f85b4bea399702fd4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:23.606012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:23.607514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.689852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:23.691005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.692156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.696172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.701708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.737865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210eb3-7848-4a15-8bf7-6cd31b55511d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:23.742617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:23.744317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:23.744485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:23.745304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.745587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.746283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.747100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:23.749318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:23.764719 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3022/6036] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:23.765834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:23.768188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.768930 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3015/6037] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:23.769963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:23.783700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c946-7f37-4abc-b484-19b20d2d2db9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:23.788600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f4b01-8910-4bbb-9a58-08d23475d664 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:23.792114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:23.792952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.793174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.793450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] PATH_INFO: `/v3/users/4b9b796e0c314366ac5d37624337f7fb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.795431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9b796e0c314366ac5d37624337f7fb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:23.797100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:23.807819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abae5a4-a3ee-4a67-a4b7-8b52bd6b8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:23.808580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abae5a4-a3ee-4a67-a4b7-8b52bd6b8618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.808791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abae5a4-a3ee-4a67-a4b7-8b52bd6b8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.809051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abae5a4-a3ee-4a67-a4b7-8b52bd6b8618 admin admin] PATH_INFO: `/v3/projects/388025679ad7434385d4dffe506d57d8/users/63e902b67ba449a2ba797341c66a82a2/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.838982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abae5a4-a3ee-4a67-a4b7-8b52bd6b8618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388025679ad7434385d4dffe506d57d8, user_id=63e902b67ba449a2ba797341c66a82a2, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:23.841834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abae5a4-a3ee-4a67-a4b7-8b52bd6b8618 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:23.871856 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3016/6038] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:23 2022] PUT /identity/v3/projects/388025679ad7434385d4dffe506d57d8/users/63e902b67ba449a2ba797341c66a82a2/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:23.878637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9b796e0c314366ac5d37624337f7fb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.884555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90b24-1bcf-4213-a435-1855d839102a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:23.885189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90b24-1bcf-4213-a435-1855d839102a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:23.885750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90b24-1bcf-4213-a435-1855d839102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:23.892542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9b796e0c314366ac5d37624337f7fb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.918692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9b796e0c314366ac5d37624337f7fb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.919795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9b796e0c314366ac5d37624337f7fb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.934448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9b796e0c314366ac5d37624337f7fb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:23.938779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e3d90b24-1bcf-4213-a435-1855d839102a None None] MFA Rules not processed for user `63e902b67ba449a2ba797341c66a82a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:23.940514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e3d90b24-1bcf-4213-a435-1855d839102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:23.949129 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3023/6039] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:23 2022] DELETE /identity/v3/users/4b9b796e0c314366ac5d37624337f7fb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:23.970114 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:24.035686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:24.035860 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3017/6040] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:24.037258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:24.146816 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:24.200638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436e6f-a0c5-4f83-a49a-f962bae7f693 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:24.206199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:24.206933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:24.207273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:24.207613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:24.208666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:24.210875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:24.263097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d90b24-1bcf-4213-a435-1855d839102a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:24.278306 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3024/6041] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:24 2022] POST /identity/v3/projects => generated 395 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:24.357706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d90b24-1bcf-4213-a435-1855d839102a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:24.430333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:24.431122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:24.431640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:24.431847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:24.432674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:24.435173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:24.480836 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3018/6042] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:24 2022] POST /identity/v3/users => generated 304 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:24.481093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:24.493627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e298ef9-85c7-41d3-8638-5079dd000502 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:24.510348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:24.511254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:24.511665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:24.512029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:24.515682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:24.531553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:24.598190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3025/6043] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:24.602367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:24.613713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7344c0-1f8a-4069-97a7-a3013cc7d3c6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:24.619574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:24.625327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:24.644453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:24.645347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:24.645717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:24.646088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] PATH_INFO: `/v3/projects/821bc2e2f23e450586badf1913316685/users/d8d34cb2217f4bc9a12fc88326901788/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:24.678387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7178-2ef3-46a9-924d-2458dd5d7863 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:24.688549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:24.689242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:24.689521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:24.689794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] PATH_INFO: `/v3/projects/7f559192d00c49239e0c2d8a0c1c4e89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:24.691095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821bc2e2f23e450586badf1913316685, user_id=d8d34cb2217f4bc9a12fc88326901788, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:24.693797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:24.696874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f559192d00c49239e0c2d8a0c1c4e89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:24.698819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:24.718439 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3019/6044] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:24 2022] PUT /identity/v3/projects/821bc2e2f23e450586badf1913316685/users/d8d34cb2217f4bc9a12fc88326901788/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:24.722160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:24.789748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f559192d00c49239e0c2d8a0c1c4e89', 'request_id': 'req-339e8071-525f-4cd1-9e45-2b45ed1e4f40'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:24.804448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f559192d00c49239e0c2d8a0c1c4e89', 'request_id': 'req-339e8071-525f-4cd1-9e45-2b45ed1e4f40'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:24.827525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f559192d00c49239e0c2d8a0c1c4e89', 'request_id': 'req-339e8071-525f-4cd1-9e45-2b45ed1e4f40'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:24.846970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] The token cache is being invalidate because project 7f559192d00c49239e0c2d8a0c1c4e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:24.847627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:24.853363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:24.857281 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3026/6045] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:24 2022] DELETE /identity/v3/projects/7f559192d00c49239e0c2d8a0c1c4e89 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:24.857789 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:24.864453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:24.870809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:24.962052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aadd43-d3d3-4587-8001-5f99aa2aca07 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:25.183344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8071-525f-4cd1-9e45-2b45ed1e4f40 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:25.216215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:25.218694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.221258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.221601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] PATH_INFO: `/v3/projects/979ba4b0fe8d4c7bbf65533d58fc30e9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.227427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=979ba4b0fe8d4c7bbf65533d58fc30e9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:25.232217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:25.252830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23d42-c10a-4dd3-9def-0bfa00c8151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:25.256024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23d42-c10a-4dd3-9def-0bfa00c8151e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.256338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23d42-c10a-4dd3-9def-0bfa00c8151e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.256611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23d42-c10a-4dd3-9def-0bfa00c8151e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.257338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23d42-c10a-4dd3-9def-0bfa00c8151e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:25.262271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23d42-c10a-4dd3-9def-0bfa00c8151e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:25.289177 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3020/6046] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:32:25.291478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.292526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.293151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.325884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:25.327387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:25.354056 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3021/6047] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:25.357713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:25.359957 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:25.362474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:25.386072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49369c3f-efe0-4cd9-804a-1bd4982b441f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:25.398231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979ba4b0fe8d4c7bbf65533d58fc30e9', 'request_id': 'req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.415995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979ba4b0fe8d4c7bbf65533d58fc30e9', 'request_id': 'req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.429114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979ba4b0fe8d4c7bbf65533d58fc30e9', 'request_id': 'req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.450420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] The token cache is being invalidate because project 979ba4b0fe8d4c7bbf65533d58fc30e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:25.450708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.451411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1ed5e0-c98e-4bf9-8775-a0dcd4dca11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.453247 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3027/6048] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:24 2022] DELETE /identity/v3/projects/979ba4b0fe8d4c7bbf65533d58fc30e9 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:25.454461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae7232-ddbc-4229-982b-f30a941a429f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.454745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae7232-ddbc-4229-982b-f30a941a429f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.455014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae7232-ddbc-4229-982b-f30a941a429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.493824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-09ae7232-ddbc-4229-982b-f30a941a429f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:25.495336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-09ae7232-ddbc-4229-982b-f30a941a429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:25.510588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:25.511326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.511900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.512293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] PATH_INFO: `/v3/projects/821bc2e2f23e450586badf1913316685/users/d8d34cb2217f4bc9a12fc88326901788/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.515588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=821bc2e2f23e450586badf1913316685, user_id=d8d34cb2217f4bc9a12fc88326901788, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:25.518625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:25.531546 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3022/6049] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:25 2022] PUT /identity/v3/projects/821bc2e2f23e450586badf1913316685/users/d8d34cb2217f4bc9a12fc88326901788/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:25.532475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:25.543035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:25.566321 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3028/6050] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:25.576359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae7232-ddbc-4229-982b-f30a941a429f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:25.587857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae7232-ddbc-4229-982b-f30a941a429f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:25.692737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8005c59-11e9-46b9-b843-e366dec56757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:25.693532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005c59-11e9-46b9-b843-e366dec56757 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.693823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005c59-11e9-46b9-b843-e366dec56757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.694158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005c59-11e9-46b9-b843-e366dec56757 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.694826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005c59-11e9-46b9-b843-e366dec56757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:25.695136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005c59-11e9-46b9-b843-e366dec56757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:25.696829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005c59-11e9-46b9-b843-e366dec56757 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:25.712918 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3029/6051] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:32:25.714407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.714692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.714973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.740193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247cf2-b470-460a-bc2a-920051fdcd9e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:25.754999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:25.755668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.757518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.757786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] PATH_INFO: `/v3/users/c6c1e40ee22f4799a4149186bd7f0821` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.764677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c1e40ee22f4799a4149186bd7f0821)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:25.766647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:25.778211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] MFA Rules not processed for user `d8d34cb2217f4bc9a12fc88326901788`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:25.781880 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:25.783218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:25.863924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c1e40ee22f4799a4149186bd7f0821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.875911 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:25.877079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c1e40ee22f4799a4149186bd7f0821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.878304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c1e40ee22f4799a4149186bd7f0821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.895044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c1e40ee22f4799a4149186bd7f0821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.896129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c1e40ee22f4799a4149186bd7f0821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:25.924101 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3030/6052] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:25.924101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:25.924691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:25.941769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339486bd-8d5a-41b2-ba3c-7a284a81a0eb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:25.946496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3023/6053] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:25 2022] DELETE /identity/v3/users/c6c1e40ee22f4799a4149186bd7f0821 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:25.947502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:25.947828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:25.948848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:25.948991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:25.949412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:25.949967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:25.951009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:25.954222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:26.010557 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3031/6054] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:25 2022] POST /identity/v3/projects => generated 409 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:26.012590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:26.095330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47826711-eb2e-4dad-88d0-2f18e668a94c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:26.120662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a5e7d-0523-43f0-a013-7df9439e722a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:26.174636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:26.175465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.175976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.176546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.177736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:26.181107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:26.224888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42523ed3-c929-41b7-bfeb-853da16596b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:26.225867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523ed3-c929-41b7-bfeb-853da16596b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.229081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523ed3-c929-41b7-bfeb-853da16596b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.229628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523ed3-c929-41b7-bfeb-853da16596b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.237349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-42523ed3-c929-41b7-bfeb-853da16596b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:26.261249 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3032/6055] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:26 2022] POST /identity/v3/users => generated 305 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:26.265657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:26.280442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af11f-829a-4549-afeb-5fdbad34d43b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:26.287197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:26.288114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.288488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.288941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.289726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:26.292430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:26.318088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3033/6056] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:32:26.322300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:26.355441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc422c-3645-4270-8c07-e2cf244ec9a1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:26.364088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:26.365541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.366479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.366981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.367919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:26.370580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:26.392633 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3034/6057] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:26.397049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:26.416571 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:26.439783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42523ed3-c929-41b7-bfeb-853da16596b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:26.441543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42523ed3-c929-41b7-bfeb-853da16596b2 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:26.444563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e6ce-8910-40e0-99d3-c402be6389ed admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:26.461389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:26.462081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.466923 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3024/6058] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:26.467280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.467280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] PATH_INFO: `/v3/projects/60a161af868d4d158972e133a8e776ba/users/0b7699b47d1c4b87bd218659d851a69a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.522979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a161af868d4d158972e133a8e776ba, user_id=0b7699b47d1c4b87bd218659d851a69a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:26.529733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:26.580878 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3035/6059] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:26 2022] PUT /identity/v3/projects/60a161af868d4d158972e133a8e776ba/users/0b7699b47d1c4b87bd218659d851a69a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:26.582628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3783c5-ddd1-4589-8435-0f52524f9f00 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.582962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3783c5-ddd1-4589-8435-0f52524f9f00 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.583313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3783c5-ddd1-4589-8435-0f52524f9f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.653775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2c3783c5-ddd1-4589-8435-0f52524f9f00 None None] MFA Rules not processed for user `0b7699b47d1c4b87bd218659d851a69a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:26.655391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c3783c5-ddd1-4589-8435-0f52524f9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:26.733947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:26.737375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:26.813537 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3025/6060] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:26.818319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3783c5-ddd1-4589-8435-0f52524f9f00 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:26.943536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed38d8-b2ac-41d6-8ce6-16d4068b8e0a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:26.948823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:26.949474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.949749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.950017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] PATH_INFO: `/v3/projects/fe7298cbbae549ff9ce27d2428094100` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.951398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7298cbbae549ff9ce27d2428094100)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:26.953557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:26.958053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3783c5-ddd1-4589-8435-0f52524f9f00 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:26.961865 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:26.963376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:26.964207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:26.964698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:26.965230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:26.966139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:26.981522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.035701 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3026/6061] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:26 2022] POST /identity/v3/projects => generated 409 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:27.037214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.048403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7298cbbae549ff9ce27d2428094100', 'request_id': 'req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:27.058005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7298cbbae549ff9ce27d2428094100', 'request_id': 'req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:27.069059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7298cbbae549ff9ce27d2428094100', 'request_id': 'req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:27.121397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] The token cache is being invalidate because project fe7298cbbae549ff9ce27d2428094100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:27.121770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:27.125392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9bb4553-1b7d-4c5c-acd8-0db64d739d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:27.127464 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3036/6062] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:26 2022] DELETE /identity/v3/projects/fe7298cbbae549ff9ce27d2428094100 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:27.132589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa167073-c541-45a6-afec-3d1e93257a26 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.133066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa167073-c541-45a6-afec-3d1e93257a26 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.133481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa167073-c541-45a6-afec-3d1e93257a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.174187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a7f7d-df1d-4f39-b54e-621e38049f90 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.179211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.179834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.180114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.180526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.181194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.183117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.183412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-aa167073-c541-45a6-afec-3d1e93257a26 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:27.187306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aa167073-c541-45a6-afec-3d1e93257a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:27.209002 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:27.210490 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3037/6063] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:27.219057 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3027/6064] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:27 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:32:27.219298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67989171-409c-452f-abcd-d8318474cd05 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.219583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67989171-409c-452f-abcd-d8318474cd05 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.219840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.220035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67989171-409c-452f-abcd-d8318474cd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.222297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:27.235194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a329f5-918a-400d-b6f5-28094ae5c375 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.245490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.252480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.252793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.253067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.253749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.255813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.272492 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3028/6065] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:27.273365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.277218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-67989171-409c-452f-abcd-d8318474cd05 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:27.278664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-67989171-409c-452f-abcd-d8318474cd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:27.287934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495207b2-c435-40dc-853d-b36c88d8d103 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.299706 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3038/6066] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:27.303569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67989171-409c-452f-abcd-d8318474cd05 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.316094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.318524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.318815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.319097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] PATH_INFO: `/v3/projects/49a8052b232f49fda53bebce52be4708/users/964b7098054443eeaba78775397a6291/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.331254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67989171-409c-452f-abcd-d8318474cd05 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.338789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.340949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.341337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.349603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.350551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:27.350913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.355540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.360122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a8052b232f49fda53bebce52be4708, user_id=964b7098054443eeaba78775397a6291, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.362863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.370984 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3039/6067] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:32:27.375425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.388712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ae09-8827-4c22-be3f-6667253038bb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.395564 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3029/6068] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:27 2022] PUT /identity/v3/projects/49a8052b232f49fda53bebce52be4708/users/964b7098054443eeaba78775397a6291/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:27.400073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.520363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453ad45-4b12-4e79-9459-9efb8570d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.521129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453ad45-4b12-4e79-9459-9efb8570d23a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.521420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453ad45-4b12-4e79-9459-9efb8570d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.521692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453ad45-4b12-4e79-9459-9efb8570d23a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.522316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453ad45-4b12-4e79-9459-9efb8570d23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.524419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453ad45-4b12-4e79-9459-9efb8570d23a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.534872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949bc27-570a-4da3-8000-634d4d8d5335 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.540993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.541830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.542350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.543046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.543869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.545908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.559257 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3040/6069] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:27 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:27.560482 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3030/6070] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:27.563431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.564291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa10e-d122-4f64-b9c9-580be43dcee6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.564731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa10e-d122-4f64-b9c9-580be43dcee6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.565140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa10e-d122-4f64-b9c9-580be43dcee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.577329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1f251-abc4-4e72-9333-12f70b03f90c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.588882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-847fa10e-d122-4f64-b9c9-580be43dcee6 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:27.591009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-847fa10e-d122-4f64-b9c9-580be43dcee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:27.653542 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:27.660125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.662101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.662497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.663580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.664419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.666975 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3041/6071] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:27.667965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fa10e-d122-4f64-b9c9-580be43dcee6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.675348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.684011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fa10e-d122-4f64-b9c9-580be43dcee6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.691904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.692901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.693338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.693606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] PATH_INFO: `/v3/projects/49a8052b232f49fda53bebce52be4708/users/964b7098054443eeaba78775397a6291/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.696094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a8052b232f49fda53bebce52be4708, user_id=964b7098054443eeaba78775397a6291, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.698833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.709109 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3031/6072] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:27 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:27.711057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.718238 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3042/6073] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:27 2022] PUT /identity/v3/projects/49a8052b232f49fda53bebce52be4708/users/964b7098054443eeaba78775397a6291/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:27.720524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:27.723436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.788305 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:27.810240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236eaa-b1d4-442e-9725-244fb7434619 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.815944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f52e-be64-47d5-854c-4979072c1bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.816753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f52e-be64-47d5-854c-4979072c1bae admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.817058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f52e-be64-47d5-854c-4979072c1bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.817330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f52e-be64-47d5-854c-4979072c1bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.817995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f52e-be64-47d5-854c-4979072c1bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.819711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f52e-be64-47d5-854c-4979072c1bae admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:27.821706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8dba-ab90-49bf-b443-c9dfd6c0180c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.832363 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3043/6074] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:27.833899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b62bc-5d61-48df-9a24-2b744c063ad0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.834442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b62bc-5d61-48df-9a24-2b744c063ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.834722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b62bc-5d61-48df-9a24-2b744c063ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.866977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c98b62bc-5d61-48df-9a24-2b744c063ad0 None None] MFA Rules not processed for user `964b7098054443eeaba78775397a6291`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:27.868550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c98b62bc-5d61-48df-9a24-2b744c063ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:27.899070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:27.900050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:27.900546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:27.901038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:27.960612 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3044/6075] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:27.961932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b62bc-5d61-48df-9a24-2b744c063ad0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:27.993578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b62bc-5d61-48df-9a24-2b744c063ad0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:27.995544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:27.997316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:28.001528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:28.002746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.004108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.004402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.005723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:28.007533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3032/6076] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:32:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:28.008290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:28.016271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:28.019823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:28.059674 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3045/6077] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:28.071116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:28.097272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b330-3695-4605-a904-6ae1a49856e3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:28.104981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a4ebe-8ba3-433f-99cd-efbb6fcbf460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:28.105977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a4ebe-8ba3-433f-99cd-efbb6fcbf460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.106347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a4ebe-8ba3-433f-99cd-efbb6fcbf460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.106843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a4ebe-8ba3-433f-99cd-efbb6fcbf460 admin admin] PATH_INFO: `/v3/projects/733c772be3394dc98abd7d2f740ec890/users/de660ed43ffe4456aae3ac3262602b9e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.144992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a4ebe-8ba3-433f-99cd-efbb6fcbf460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733c772be3394dc98abd7d2f740ec890, user_id=de660ed43ffe4456aae3ac3262602b9e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:28.148829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10323912-3901-4d0f-a462-c82fd22288ad service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:28.154333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:28.155989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.156359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.156554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a4ebe-8ba3-433f-99cd-efbb6fcbf460 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:28.156831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.172093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:28.174148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:28.184571 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3046/6078] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:28 2022] PUT /identity/v3/projects/733c772be3394dc98abd7d2f740ec890/users/de660ed43ffe4456aae3ac3262602b9e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:28.189637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.190129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.190989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.191427 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3033/6079] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:28.250583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:28.253157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:28.300748 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:28.350354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3047/6080] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:28.367489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:28.367871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:28.449543 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:28.493803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd043-b2ed-40cc-bf15-fcb13d24d047 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:28.545037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:28.546796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:28.630255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:28.631210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.631210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.631431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.656051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:28.659260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:28.679991 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3034/6081] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:28.680732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:28.705349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1199c07-e997-4f0e-800b-44a9878752c9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:28.745538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9263f4-d629-4b07-9a00-dee8adf026f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:28.746273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9263f4-d629-4b07-9a00-dee8adf026f1 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.747058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9263f4-d629-4b07-9a00-dee8adf026f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.747427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9263f4-d629-4b07-9a00-dee8adf026f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.750067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2b9263f4-d629-4b07-9a00-dee8adf026f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:28.774626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9263f4-d629-4b07-9a00-dee8adf026f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:28.776168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9263f4-d629-4b07-9a00-dee8adf026f1 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:28.832672 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3048/6082] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:28.833092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905230c-c8a5-4be1-83e4-68048b39f4a8 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:28.836358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc11c9-fb7b-42c9-b6d0-2ba2f4b0fc59 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.836648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc11c9-fb7b-42c9-b6d0-2ba2f4b0fc59 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.836992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc11c9-fb7b-42c9-b6d0-2ba2f4b0fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.841521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:28.843277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:28.845931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:28.850883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:28.854017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:28.900889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8abc11c9-fb7b-42c9-b6d0-2ba2f4b0fc59 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:28.902116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8abc11c9-fb7b-42c9-b6d0-2ba2f4b0fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:28.999739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:29.001354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:29.015380 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3035/6083] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:29.070919 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3049/6084] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:29.086799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:29.227761 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:29.260974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf223f7-7231-4ac9-9493-9328c7c7653f service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:29.283784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7acd83-2539-4d23-888c-dcc2f705cd3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:29.288690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7acd83-2539-4d23-888c-dcc2f705cd3e service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:29.289091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7acd83-2539-4d23-888c-dcc2f705cd3e service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:29.289373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7acd83-2539-4d23-888c-dcc2f705cd3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:29.312674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7acd83-2539-4d23-888c-dcc2f705cd3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:29.315308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7acd83-2539-4d23-888c-dcc2f705cd3e service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:29.338388 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3036/6085] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:32:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:29.503766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc11c9-fb7b-42c9-b6d0-2ba2f4b0fc59 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:29.537034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc11c9-fb7b-42c9-b6d0-2ba2f4b0fc59 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:29.554201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:29.557729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:29.558264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:29.558745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:29.563230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:29.700519 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:29.711058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:29.713092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:29.737101 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3050/6086] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:29.969882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3327ed-1c14-4e99-ba31-f89372d8395d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:29.970166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3327ed-1c14-4e99-ba31-f89372d8395d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:29.970776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3327ed-1c14-4e99-ba31-f89372d8395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:29.994707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1d3327ed-1c14-4e99-ba31-f89372d8395d None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:29.997608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1d3327ed-1c14-4e99-ba31-f89372d8395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:30.026524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:30.033385 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3037/6087] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:30.046187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7f690-4eec-40ab-a433-29f38b691670 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:30.052430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:30.053285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:30.053837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:30.054279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:30.071981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:30.074169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:30.092232 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3051/6088] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:32:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:32:30.351648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56cd1-6916-4ab5-bc09-464dda39a9f3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:30.352150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56cd1-6916-4ab5-bc09-464dda39a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:30.352269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56cd1-6916-4ab5-bc09-464dda39a9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:30.409562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1bb56cd1-6916-4ab5-bc09-464dda39a9f3 None None] MFA Rules not processed for user `de660ed43ffe4456aae3ac3262602b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:30.412633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1bb56cd1-6916-4ab5-bc09-464dda39a9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:30.527364 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3038/6089] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:30.537971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:30.539627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:30.578073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0ca56-8912-4e8b-a90c-967afc968c56 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:30.595483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e70d77-7656-427e-a657-e50fffd077b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:30.598148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70d77-7656-427e-a657-e50fffd077b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:30.600218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70d77-7656-427e-a657-e50fffd077b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:30.602404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70d77-7656-427e-a657-e50fffd077b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:30.633648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70d77-7656-427e-a657-e50fffd077b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:30.640537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70d77-7656-427e-a657-e50fffd077b6 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:30.666891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3052/6090] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:32.756790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56cd1-6916-4ab5-bc09-464dda39a9f3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:32.783947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56cd1-6916-4ab5-bc09-464dda39a9f3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:32.799230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:32.799941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:32.800199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:32.800473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:32.806192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:32.827481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:32.829485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:32.843799 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3039/6091] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:33.481411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f66e0-4326-4bc6-9a15-a20f29bfa6ef None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:33.482492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f66e0-4326-4bc6-9a15-a20f29bfa6ef None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:33.482947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f66e0-4326-4bc6-9a15-a20f29bfa6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:33.506581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9c9f66e0-4326-4bc6-9a15-a20f29bfa6ef None None] MFA Rules not processed for user `de660ed43ffe4456aae3ac3262602b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:33.508502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9c9f66e0-4326-4bc6-9a15-a20f29bfa6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:33.517425 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3053/6092] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:34.715233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:34.719822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:34.868211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31515ba-6fe8-4279-91d9-0f1f642266bc service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:34.891900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:34.893151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:34.893442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:34.893717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:34.897173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:34.924545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:34.930818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:34.958762 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3040/6093] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:35.238506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:35.239075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:35.239522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:35.294880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:35.296379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:35.337486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:35.347274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3054/6094] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:35.360078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b872d4-5ac1-4ea4-953d-18ff484d834f service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:35.369386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6205173-91ae-46b8-abce-cda6eb4b29a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:35.373264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205173-91ae-46b8-abce-cda6eb4b29a7 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:35.374029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205173-91ae-46b8-abce-cda6eb4b29a7 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:35.374533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205173-91ae-46b8-abce-cda6eb4b29a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:35.391069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6205173-91ae-46b8-abce-cda6eb4b29a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:35.393186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6205173-91ae-46b8-abce-cda6eb4b29a7 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:35.412239 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3041/6095] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:32:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:32:41.065341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:41.068321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:41.118299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1506997-4f05-45f1-992c-1f660df11b76 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:41.171477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:41.173279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:41.174053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:41.174917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:41.178232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:41.220202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:41.222012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:41.255674 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3055/6096] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:43.189447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c2743-d275-442b-88ca-c23c2a0858a3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:43.190055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c2743-d275-442b-88ca-c23c2a0858a3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:43.190055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c2743-d275-442b-88ca-c23c2a0858a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:43.242846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c39c2743-d275-442b-88ca-c23c2a0858a3 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:43.244445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c39c2743-d275-442b-88ca-c23c2a0858a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:43.260381 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3042/6097] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:43.275868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:43.306218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c9aff-1efa-4c89-93a2-858fbcace46d service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:43.317509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f706b1-80b8-4e26-81ee-037f56a85342 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:43.318360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f706b1-80b8-4e26-81ee-037f56a85342 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:43.318820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f706b1-80b8-4e26-81ee-037f56a85342 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:43.319253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f706b1-80b8-4e26-81ee-037f56a85342 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:43.341769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f706b1-80b8-4e26-81ee-037f56a85342 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:43.344113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f706b1-80b8-4e26-81ee-037f56a85342 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:43.371883 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3056/6098] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:32:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:43.565031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c2743-d275-442b-88ca-c23c2a0858a3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:43.586726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c2743-d275-442b-88ca-c23c2a0858a3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:43.617132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfde5e4-1eed-4a91-8449-382a6d2cc792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:43.617805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde5e4-1eed-4a91-8449-382a6d2cc792 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:43.618089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde5e4-1eed-4a91-8449-382a6d2cc792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:43.618364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde5e4-1eed-4a91-8449-382a6d2cc792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:43.627331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2bfde5e4-1eed-4a91-8449-382a6d2cc792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:43.727353 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:43.783557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2077b-5e7f-42a0-bc62-e56c36e2220c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:43.784209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2077b-5e7f-42a0-bc62-e56c36e2220c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:43.784714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2077b-5e7f-42a0-bc62-e56c36e2220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:43.833224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-24e2077b-5e7f-42a0-bc62-e56c36e2220c None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:43.843030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-24e2077b-5e7f-42a0-bc62-e56c36e2220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:43.884137 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3057/6099] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 21 01:32:43.929917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfde5e4-1eed-4a91-8449-382a6d2cc792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:43.931342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfde5e4-1eed-4a91-8449-382a6d2cc792 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:43.934435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2077b-5e7f-42a0-bc62-e56c36e2220c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:43.972349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2077b-5e7f-42a0-bc62-e56c36e2220c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:44.001934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:44.002654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:44.003209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:44.006452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:44.035832 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3043/6100] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:44.080369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:44.087860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:44.116111 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3058/6101] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:32:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:32:44.876138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a67a89-7def-4917-8fb5-23167289c077 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:44.876751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a67a89-7def-4917-8fb5-23167289c077 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:44.876751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a67a89-7def-4917-8fb5-23167289c077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:44.941309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-78a67a89-7def-4917-8fb5-23167289c077 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:44.951215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-78a67a89-7def-4917-8fb5-23167289c077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:44.978400 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3044/6102] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:45.003258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:45.022902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ce81a-9827-4696-9e55-2ca48860078b service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:45.045052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a67a89-7def-4917-8fb5-23167289c077 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:45.052481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f023cd0-2f05-45cc-ac46-26e0f0365ba3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:45.053181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f023cd0-2f05-45cc-ac46-26e0f0365ba3 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:45.053429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f023cd0-2f05-45cc-ac46-26e0f0365ba3 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:45.053693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f023cd0-2f05-45cc-ac46-26e0f0365ba3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:45.071465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a67a89-7def-4917-8fb5-23167289c077 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:45.076699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f023cd0-2f05-45cc-ac46-26e0f0365ba3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:45.078705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f023cd0-2f05-45cc-ac46-26e0f0365ba3 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:45.089639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:45.094651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:45.096028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:45.096320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] PATH_INFO: `/v3/users/0b7699b47d1c4b87bd218659d851a69a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:45.098976 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3059/6103] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:32:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:45.100999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7699b47d1c4b87bd218659d851a69a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:45.112027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:45.215699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7699b47d1c4b87bd218659d851a69a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.234813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7699b47d1c4b87bd218659d851a69a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.235799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7699b47d1c4b87bd218659d851a69a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.262128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7699b47d1c4b87bd218659d851a69a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.263207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7699b47d1c4b87bd218659d851a69a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.301146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3045/6104] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:45 2022] DELETE /identity/v3/users/0b7699b47d1c4b87bd218659d851a69a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:45.305506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:45.309497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:45.311412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:45.351481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:45.353462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:45.516566 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3060/6105] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:45.526677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:45.528286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:45.626642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:45.632075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:45.677468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8d3f7-632b-42de-89ce-aaf6364c1c9e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:45.697100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:45.703875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:45.704620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:45.705521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] PATH_INFO: `/v3/users/aa5eb68dbbb34d1b9bc4ec9ebac6ff08` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:45.708162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5eb68dbbb34d1b9bc4ec9ebac6ff08)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:45.710135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89595ef-40c2-4283-b808-53292caaf758 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:45.712217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:45.716837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fc22c-07b3-428e-ace7-99c1a3ff4e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:45.717616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fc22c-07b3-428e-ace7-99c1a3ff4e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:45.718068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fc22c-07b3-428e-ace7-99c1a3ff4e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:45.718382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fc22c-07b3-428e-ace7-99c1a3ff4e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:45.736437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fc22c-07b3-428e-ace7-99c1a3ff4e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:45.738139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fc22c-07b3-428e-ace7-99c1a3ff4e74 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:45.759868 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3046/6106] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:45.912801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.920164 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:45.931975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.956198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.957454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.967039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:45.975339 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3061/6107] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:45 2022] DELETE /identity/v3/users/aa5eb68dbbb34d1b9bc4ec9ebac6ff08 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:45.979897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940c69-d075-4a51-946a-36f1906af517 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:45.981055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940c69-d075-4a51-946a-36f1906af517 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:45.982045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940c69-d075-4a51-946a-36f1906af517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:46.023999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-63940c69-d075-4a51-946a-36f1906af517 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:46.025474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63940c69-d075-4a51-946a-36f1906af517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:46.070762 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:46.203585 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3047/6108] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:46.287419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:46.289331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:46.637277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58f3eb-63c9-4855-bfa6-d07f2ea75680 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:46.652477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:46.655664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:46.656467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:46.658330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:46.662488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940c69-d075-4a51-946a-36f1906af517 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:46.665508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63940c69-d075-4a51-946a-36f1906af517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:46.691505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940c69-d075-4a51-946a-36f1906af517 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:46.720281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:46.721018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:46.721309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:46.721582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] PATH_INFO: `/v3/projects/60a161af868d4d158972e133a8e776ba` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:46.723076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:46.725585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a161af868d4d158972e133a8e776ba)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:46.726628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:46.727567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:46.789700 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3062/6109] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:32:46.980242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a161af868d4d158972e133a8e776ba', 'request_id': 'req-5e362bfd-8302-4d9f-993d-be53039af398'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.003878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a161af868d4d158972e133a8e776ba', 'request_id': 'req-5e362bfd-8302-4d9f-993d-be53039af398'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.012272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a161af868d4d158972e133a8e776ba', 'request_id': 'req-5e362bfd-8302-4d9f-993d-be53039af398'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.044950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] The token cache is being invalidate because project 60a161af868d4d158972e133a8e776ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:47.045726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.046652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.051793 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3048/6110] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:46 2022] DELETE /identity/v3/projects/60a161af868d4d158972e133a8e776ba => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:47.056386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:47.080074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fdd64-9ed7-438e-9acd-81c8ccb0bd34 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:47.331088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:47.335117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:47.337326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:47.339310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] PATH_INFO: `/v3/users/964b7098054443eeaba78775397a6291` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:47.342801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:47.344503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:47.344996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=964b7098054443eeaba78775397a6291)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:47.355882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:47.389968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e362bfd-8302-4d9f-993d-be53039af398 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:47.410747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:47.411821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:47.412074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:47.412352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] PATH_INFO: `/v3/projects/7111e801da7a46f99a04f9a6d4a59312` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:47.416565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7111e801da7a46f99a04f9a6d4a59312)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:47.433322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:47.520629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964b7098054443eeaba78775397a6291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.534288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964b7098054443eeaba78775397a6291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.587996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964b7098054443eeaba78775397a6291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.589031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7111e801da7a46f99a04f9a6d4a59312', 'request_id': 'req-fe1539d5-6d9d-45c1-818c-a0d79836b98a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.592221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964b7098054443eeaba78775397a6291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.599491 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:47.606723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7111e801da7a46f99a04f9a6d4a59312', 'request_id': 'req-fe1539d5-6d9d-45c1-818c-a0d79836b98a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.616002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7111e801da7a46f99a04f9a6d4a59312', 'request_id': 'req-fe1539d5-6d9d-45c1-818c-a0d79836b98a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.621096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a91f85f0-aeca-4b00-8509-022e718bc79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964b7098054443eeaba78775397a6291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.639871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3063/6111] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:47 2022] DELETE /identity/v3/users/964b7098054443eeaba78775397a6291 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:47.644997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] The token cache is being invalidate because project 7111e801da7a46f99a04f9a6d4a59312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:47.645301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.645995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe1539d5-6d9d-45c1-818c-a0d79836b98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:47.647567 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3049/6112] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:47 2022] DELETE /identity/v3/projects/7111e801da7a46f99a04f9a6d4a59312 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:47.657926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf8ed-1640-4609-95de-503248161230 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:47.660026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf8ed-1640-4609-95de-503248161230 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:47.661539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf8ed-1640-4609-95de-503248161230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:47.770767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-26dbf8ed-1640-4609-95de-503248161230 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:47.772058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-26dbf8ed-1640-4609-95de-503248161230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:47.962671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d3dd-b733-48cc-9b0a-0a6f8d6968c6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:47.962958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d3dd-b733-48cc-9b0a-0a6f8d6968c6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:47.963298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d3dd-b733-48cc-9b0a-0a6f8d6968c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:47.967491 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3064/6113] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:47.996974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8a44d3dd-b733-48cc-9b0a-0a6f8d6968c6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:47.999819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8a44d3dd-b733-48cc-9b0a-0a6f8d6968c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:48.020037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbf8ed-1640-4609-95de-503248161230 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:48.028344 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3050/6114] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:48.033226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbf8ed-1640-4609-95de-503248161230 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:48.049701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:48.051211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.051674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.052115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:48.053025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:48.053492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:48.056520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:48.096425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44d3dd-b733-48cc-9b0a-0a6f8d6968c6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:48.103591 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3065/6115] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:32:48.112521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44d3dd-b733-48cc-9b0a-0a6f8d6968c6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:48.125300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:48.126259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.126724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.127364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:48.128178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:48.134927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:48.273364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:48.282157 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3051/6116] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:48 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:48.290213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee7534-d7bd-4402-847b-798fa33096a3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:48.493429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:48.495531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:48.505430 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:48.514583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:48.514583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.515345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.515345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:48.515784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:48.533851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:48.534120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6525f-f714-4348-ba66-2f48c7a7e5a8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:48.553020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:48.553763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.554050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.554331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] PATH_INFO: `/v3/projects/49a8052b232f49fda53bebce52be4708` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:48.555743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a8052b232f49fda53bebce52be4708)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:48.557993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:48.595858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3066/6117] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:48 2022] POST /identity/v3/users => generated 287 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:32:48.597192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:48.632715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c79a8-1f0a-41f0-a18a-ce3e3e126f3a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:48.645791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:48.648534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.650341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.651173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:48.654939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:48.662758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:48.680273 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3067/6118] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:48.686147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:48.717223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c7c22-c081-4f12-9e90-c45eb9cc5f58 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:48.734395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a8052b232f49fda53bebce52be4708', 'request_id': 'req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:48.753383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a8052b232f49fda53bebce52be4708', 'request_id': 'req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:48.778929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a8052b232f49fda53bebce52be4708', 'request_id': 'req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:48.837559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] The token cache is being invalidate because project 49a8052b232f49fda53bebce52be4708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:48.837865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:48.838919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7faccc0d-0faa-4bcd-be0d-26b8f09b1a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:48.846932 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3052/6119] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:48 2022] DELETE /identity/v3/projects/49a8052b232f49fda53bebce52be4708 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:48.849001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916bdd-2db7-4155-a902-e5cdf1510e88 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.849338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916bdd-2db7-4155-a902-e5cdf1510e88 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.849587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916bdd-2db7-4155-a902-e5cdf1510e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:48.934518 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:48.946147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-65916bdd-2db7-4155-a902-e5cdf1510e88 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:48.952728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:48.953868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.954293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.954671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:48.956004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-65916bdd-2db7-4155-a902-e5cdf1510e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:48.957364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:48.963211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:48.981526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3053/6120] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:48.990258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39801d-1a48-4038-abf8-6d7c5d36c19d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:48.991045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39801d-1a48-4038-abf8-6d7c5d36c19d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:48.991508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39801d-1a48-4038-abf8-6d7c5d36c19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:49.010155 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3068/6121] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:49.019997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:49.026525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:49.050980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7c39801d-1a48-4038-abf8-6d7c5d36c19d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:49.053031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c39801d-1a48-4038-abf8-6d7c5d36c19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:49.059193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf567-1cfc-44e5-9acf-a3a5862ad194 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:49.072887 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3054/6122] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:49.077698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39801d-1a48-4038-abf8-6d7c5d36c19d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:49.089793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af85a-13fc-48c1-b69e-bd048ae9f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:49.090581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af85a-13fc-48c1-b69e-bd048ae9f969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:49.091401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af85a-13fc-48c1-b69e-bd048ae9f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:49.091746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af85a-13fc-48c1-b69e-bd048ae9f969 admin admin] PATH_INFO: `/v3/projects/6d1b3e7181814594b611ccd258364084/users/2be6987e355045b4b02c543fea7b1540/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:49.108420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39801d-1a48-4038-abf8-6d7c5d36c19d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:49.119430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:49.121844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:49.125907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:49.127376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:49.129352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:49.129850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:49.131751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:49.158155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af85a-13fc-48c1-b69e-bd048ae9f969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1b3e7181814594b611ccd258364084, user_id=2be6987e355045b4b02c543fea7b1540, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:49.161042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af85a-13fc-48c1-b69e-bd048ae9f969 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:49.173204 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3055/6123] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:32:49.174388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:49.213376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74467fbd-3335-4c0b-8134-ca1a388e6f43 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:49.224820 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3069/6124] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:49 2022] PUT /identity/v3/projects/6d1b3e7181814594b611ccd258364084/users/2be6987e355045b4b02c543fea7b1540/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:49.233721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:49.234149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:49.234524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:49.473997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] MFA Rules not processed for user `2be6987e355045b4b02c543fea7b1540`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:49.475680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:49.554946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:49.555938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:49.556218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:49.556489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:49.561505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:49.569026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:49.631705 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3056/6125] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:49 2022] POST /identity/v3/projects => generated 383 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:49.636843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:49.663987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3070/6126] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:49.665124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:49.668382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:49.815732 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:49.881812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1bf29-431c-4c44-ac75-a28172835dfe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:49.884806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f5e5-e081-44dc-855c-136e7c3098ae None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:49.901055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:49.903797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:49.904946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:49.905149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:49.905812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:49.914976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:50.005003 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3057/6127] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:49 2022] POST /identity/v3/users => generated 292 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:50.005998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:50.040517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de562f-9f05-46b7-ab74-6b82cd42b124 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:50.048215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:50.048864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:50.049144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:50.049418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:50.050115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:50.051700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:50.054977 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:50.069070 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3058/6128] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:50.070321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:50.095729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:50.096499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:50.096642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:50.096935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:50.106877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ee7c7-fb41-4e4c-ac91-95d660eff750 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:50.114931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:50.115976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:50.116445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:50.116921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:50.117770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:50.119596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:50.155656 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3059/6129] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:32:50.157007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:50.169723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3efc45-0036-4446-ad5c-aece133bea12 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:50.176159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f1e4b-5a6f-4728-bc09-86011905d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:50.177176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f1e4b-5a6f-4728-bc09-86011905d608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:50.177654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f1e4b-5a6f-4728-bc09-86011905d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:50.178099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f1e4b-5a6f-4728-bc09-86011905d608 admin admin] PATH_INFO: `/v3/projects/3168ef33276a431694b371e3e6f46cf0/users/fba2d405c8a5415f96758c1e1e033ecf/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:50.196417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f1e4b-5a6f-4728-bc09-86011905d608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3168ef33276a431694b371e3e6f46cf0, user_id=fba2d405c8a5415f96758c1e1e033ecf, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:50.200131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f1e4b-5a6f-4728-bc09-86011905d608 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:50.222428 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3060/6130] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:50 2022] PUT /identity/v3/projects/3168ef33276a431694b371e3e6f46cf0/users/fba2d405c8a5415f96758c1e1e033ecf/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:50.233772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:50.234337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:50.234947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:50.266853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:50.268500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:50.312118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3071/6131] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:50.344226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] MFA Rules not processed for user `fba2d405c8a5415f96758c1e1e033ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:50.346387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:50.659938 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3061/6132] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:50.672631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:50.674151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:50.926303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825d558-d1a8-432c-a152-0fa54a10604f service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:50.982400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:50.984035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:51.085820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c49ee-1abc-477e-bccd-1d0650a6d051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:51.086675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c49ee-1abc-477e-bccd-1d0650a6d051 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:51.087224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c49ee-1abc-477e-bccd-1d0650a6d051 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:51.087457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c49ee-1abc-477e-bccd-1d0650a6d051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:51.121380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c49ee-1abc-477e-bccd-1d0650a6d051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:51.123735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c49ee-1abc-477e-bccd-1d0650a6d051 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:51.164189 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3072/6133] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:51.207417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6c80d-a41d-4fee-9551-3407808fdcdb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:51.223367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:51.224269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:51.224851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:51.225410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] PATH_INFO: `/v3/users/63e902b67ba449a2ba797341c66a82a2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:51.231687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e902b67ba449a2ba797341c66a82a2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:51.234344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:51.309426 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:51.406566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e902b67ba449a2ba797341c66a82a2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:51.458438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e902b67ba449a2ba797341c66a82a2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:51.460160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e902b67ba449a2ba797341c66a82a2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:51.509800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e902b67ba449a2ba797341c66a82a2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:51.514826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e902b67ba449a2ba797341c66a82a2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:51.620526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3062/6134] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:50 2022] DELETE /identity/v3/users/63e902b67ba449a2ba797341c66a82a2 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:51.625605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:51.626293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:51.626857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:51.674470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:51.675868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:51.811304 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:51.874435 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3073/6135] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:51.884093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:51.885690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:52.013678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f960e-eed8-4e47-8531-95a9fe05015e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:52.025613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:52.026860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:52.026860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:52.027085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:52.046734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:52.050686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:52.082157 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3063/6136] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:52.438269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:52.439938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:52.473129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b0bd2-399d-40de-908f-e49ec8f68b84 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:52.478096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:52.479303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:52.479583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:52.479852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] PATH_INFO: `/v3/projects/388025679ad7434385d4dffe506d57d8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:52.481046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] RBAC: Authorizing `identity:delete_project(project_id=388025679ad7434385d4dffe506d57d8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:52.483971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:52.555088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388025679ad7434385d4dffe506d57d8', 'request_id': 'req-3746f730-c337-44b5-88c9-48f7dd43181f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.564133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388025679ad7434385d4dffe506d57d8', 'request_id': 'req-3746f730-c337-44b5-88c9-48f7dd43181f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.580739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388025679ad7434385d4dffe506d57d8', 'request_id': 'req-3746f730-c337-44b5-88c9-48f7dd43181f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.613896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] The token cache is being invalidate because project 388025679ad7434385d4dffe506d57d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:52.613896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.613896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.613896 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3074/6137] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:52 2022] DELETE /identity/v3/projects/388025679ad7434385d4dffe506d57d8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:52.614288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:52.624427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088569e-7e94-4135-b47e-5e8aa6f8d65d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:52.721161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:52.722673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:52.723155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:52.723532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] PATH_INFO: `/v3/users/d8d34cb2217f4bc9a12fc88326901788` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:52.725098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d34cb2217f4bc9a12fc88326901788)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:52.727259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:52.786299 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:52.794113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d34cb2217f4bc9a12fc88326901788'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.807945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d34cb2217f4bc9a12fc88326901788'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.808605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d34cb2217f4bc9a12fc88326901788'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.817055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d34cb2217f4bc9a12fc88326901788'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.817902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-aced1dd3-d7ef-4489-8c92-6e27cf72dfd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d34cb2217f4bc9a12fc88326901788'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:52.840044 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3064/6138] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:52 2022] DELETE /identity/v3/users/d8d34cb2217f4bc9a12fc88326901788 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:53.227839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:53.230026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:53.295360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746f730-c337-44b5-88c9-48f7dd43181f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:53.442039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:53.443670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:53.444929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:53.447314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] PATH_INFO: `/v3/projects/821bc2e2f23e450586badf1913316685` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:53.449043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=821bc2e2f23e450586badf1913316685)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:53.454589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:53.559077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821bc2e2f23e450586badf1913316685', 'request_id': 'req-d33ec1aa-6567-4eee-9371-34f24f1362fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:53.570661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821bc2e2f23e450586badf1913316685', 'request_id': 'req-d33ec1aa-6567-4eee-9371-34f24f1362fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:53.578859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821bc2e2f23e450586badf1913316685', 'request_id': 'req-d33ec1aa-6567-4eee-9371-34f24f1362fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:53.605837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] The token cache is being invalidate because project 821bc2e2f23e450586badf1913316685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:53.606322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:53.607239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:53.612396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3075/6139] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:53 2022] DELETE /identity/v3/projects/821bc2e2f23e450586badf1913316685 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:53.615504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd923-ed51-41ab-b672-59b92e026457 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:53.616343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd923-ed51-41ab-b672-59b92e026457 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:53.616789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd923-ed51-41ab-b672-59b92e026457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:53.646238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f56cd923-ed51-41ab-b672-59b92e026457 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:53.647667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f56cd923-ed51-41ab-b672-59b92e026457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:53.739408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:53.740983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:53.746556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3065/6140] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:53.754218 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:53.755598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5bab-3b5c-4598-8e1a-2887bce47c34 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:53.757008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5bab-3b5c-4598-8e1a-2887bce47c34 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:53.757585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5bab-3b5c-4598-8e1a-2887bce47c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:53.782807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e8bf5bab-3b5c-4598-8e1a-2887bce47c34 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:53.784324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e8bf5bab-3b5c-4598-8e1a-2887bce47c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:53.793195 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3066/6141] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:53.798105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf5bab-3b5c-4598-8e1a-2887bce47c34 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:53.821626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf5bab-3b5c-4598-8e1a-2887bce47c34 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:53.831971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:53.832603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:53.832902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:53.833169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:53.833839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:53.834139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:53.835782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:53.852347 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3067/6142] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:32:53.853480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:53.858785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec1aa-6567-4eee-9371-34f24f1362fd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:53.865300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:53.865542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12afbec-1ce2-4b12-b661-207040c7a727 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:53.865946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:53.866297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:53.866727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:53.869773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:53.872315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:53.873564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:53.874017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:53.874577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:53.875355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:53.877438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:53.918016 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3068/6143] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:53 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:53.922708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:53.925175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:53.946804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:53.948530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:53.959813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3076/6144] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:53.960684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:53.972411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950840d5-959c-4eb7-b538-a5c82afd2138 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:53.998909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59641d2-4042-4057-a176-a870cac4eef8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:54.005149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:54.005936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.006363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.006704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] PATH_INFO: `/v3/users/2be6987e355045b4b02c543fea7b1540` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.008075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be6987e355045b4b02c543fea7b1540)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:54.010128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:54.037630 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:54.038750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:54.039290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.039559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.039836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.040494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:54.042491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:54.073933 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3077/6145] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:53 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:54.074212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be6987e355045b4b02c543fea7b1540'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:54.076328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:54.082009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be6987e355045b4b02c543fea7b1540'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:54.082758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be6987e355045b4b02c543fea7b1540'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:54.090010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fb6d-b024-4a89-976a-8b2bad238316 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:54.091865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be6987e355045b4b02c543fea7b1540'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:54.092822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e5b4c55e-5881-4960-81f9-8788dfaa7e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be6987e355045b4b02c543fea7b1540'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:54.096572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:54.097537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.097818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.098674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.099340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:54.101006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:54.112644 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3078/6146] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:32:54.116464 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3069/6147] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:32:53 2022] DELETE /identity/v3/users/2be6987e355045b4b02c543fea7b1540 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:54.117151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:54.119025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:54.120801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.121101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.121377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.137505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ea512-5166-42b3-8602-c9a0addbf94f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:54.144892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:54.146161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:54.161162 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:54.205276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:54.205922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.206197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.206489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.207107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:54.207736 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3070/6148] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:54.209176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:54.218307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:54.219772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:54.224361 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3079/6149] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:32:54.225788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:54.235951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ad914-bd78-4f5c-9a98-e3d7281a6ad9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:54.241098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed8a2c-314e-4ece-9fa1-774ea9191cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:54.241750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed8a2c-314e-4ece-9fa1-774ea9191cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.242031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed8a2c-314e-4ece-9fa1-774ea9191cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.242313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed8a2c-314e-4ece-9fa1-774ea9191cd5 admin admin] PATH_INFO: `/v3/projects/93e907ca837e4683bdde125bf6765a56/users/9d603f82e1234a71aafc17e99a9f0c4e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.258074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed8a2c-314e-4ece-9fa1-774ea9191cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e907ca837e4683bdde125bf6765a56, user_id=9d603f82e1234a71aafc17e99a9f0c4e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:54.260700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed8a2c-314e-4ece-9fa1-774ea9191cd5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:54.275550 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3080/6150] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:54 2022] PUT /identity/v3/projects/93e907ca837e4683bdde125bf6765a56/users/9d603f82e1234a71aafc17e99a9f0c4e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:54.284645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1d1e-07f2-418f-8010-cb773a69732c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:54.287588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f5d6-a397-4c35-9db9-8eadcb3cfb42 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.287884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f5d6-a397-4c35-9db9-8eadcb3cfb42 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.288157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f5d6-a397-4c35-9db9-8eadcb3cfb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.315784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9307f5d6-a397-4c35-9db9-8eadcb3cfb42 None None] MFA Rules not processed for user `9d603f82e1234a71aafc17e99a9f0c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:54.317017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9307f5d6-a397-4c35-9db9-8eadcb3cfb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:54.336068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74614f-3bf2-4d03-a401-b91f1fc417d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:54.336683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74614f-3bf2-4d03-a401-b91f1fc417d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.337174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74614f-3bf2-4d03-a401-b91f1fc417d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.337390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74614f-3bf2-4d03-a401-b91f1fc417d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.344095 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:54.384113 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3081/6151] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:32:54.397477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307f5d6-a397-4c35-9db9-8eadcb3cfb42 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:54.410683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307f5d6-a397-4c35-9db9-8eadcb3cfb42 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:54.415057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:54.415729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:54.415960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:54.416192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:54.426948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:54.427511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74614f-3bf2-4d03-a401-b91f1fc417d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:54.428382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:54.429143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74614f-3bf2-4d03-a401-b91f1fc417d9 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:54.439093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3082/6152] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:32:54.443359 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3071/6153] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:32:55.248252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:55.251197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:55.290094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570257bb-b545-40a4-8331-b5f9f7147acf service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:55.302737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:55.303410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:55.303679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:55.303950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] PATH_INFO: `/v3/projects/6d1b3e7181814594b611ccd258364084` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:55.313804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1b3e7181814594b611ccd258364084)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:55.315765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:55.452965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1b3e7181814594b611ccd258364084', 'request_id': 'req-fead85a8-56a8-4da2-9a22-bc6d1270bf95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:55.461665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1b3e7181814594b611ccd258364084', 'request_id': 'req-fead85a8-56a8-4da2-9a22-bc6d1270bf95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:55.476668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1b3e7181814594b611ccd258364084', 'request_id': 'req-fead85a8-56a8-4da2-9a22-bc6d1270bf95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:55.478902 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:55.502271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] The token cache is being invalidate because project 6d1b3e7181814594b611ccd258364084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:32:55.502577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:55.503223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fead85a8-56a8-4da2-9a22-bc6d1270bf95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:32:55.505218 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3083/6154] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:55 2022] DELETE /identity/v3/projects/6d1b3e7181814594b611ccd258364084 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:32:55.510297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388040-80c1-4e12-a849-d64876533f5b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:55.510826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388040-80c1-4e12-a849-d64876533f5b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:55.510826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388040-80c1-4e12-a849-d64876533f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:55.585911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d388040-80c1-4e12-a849-d64876533f5b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:55.587223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d388040-80c1-4e12-a849-d64876533f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:55.700503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333848b4-6c2f-4882-a7a6-c00bfab6a63f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:55.701251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333848b4-6c2f-4882-a7a6-c00bfab6a63f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:55.701734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333848b4-6c2f-4882-a7a6-c00bfab6a63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:55.705092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3072/6155] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:55.780897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-333848b4-6c2f-4882-a7a6-c00bfab6a63f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:55.788437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-333848b4-6c2f-4882-a7a6-c00bfab6a63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:55.832594 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3084/6156] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:55.838028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388040-80c1-4e12-a849-d64876533f5b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:55.860852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388040-80c1-4e12-a849-d64876533f5b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:55.869775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:55.870501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:55.870786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:55.871065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:55.874695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:32:55.875080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:55.877369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:55.915947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3073/6157] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:32:55.917498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333848b4-6c2f-4882-a7a6-c00bfab6a63f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:55.935218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333848b4-6c2f-4882-a7a6-c00bfab6a63f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:55.942721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:55.943384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:55.943665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:55.943934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:55.944714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:55.947107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:56.001501 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3085/6158] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:32:55 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:56.003143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:56.022371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0139df-756e-48d9-bdfe-ea2a27de6a6d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:56.251058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:56.251854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:56.254656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:56.256422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:56.258495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:56.262023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:56.319694 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3074/6159] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:32:56 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:32:56.320383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:56.335615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1e7c-95bd-44af-9d8b-e68af8d859b2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:56.344544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:56.345569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:56.346039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:56.348305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:56.349236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:56.352248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:56.367357 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3086/6160] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:56.371377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:56.389611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e327d2-c879-467a-85f1-aea59c8fd678 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:56.413092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd86ddb-a7b0-44cd-b04c-f248e5bd28e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:56.413764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86ddb-a7b0-44cd-b04c-f248e5bd28e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:56.414101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86ddb-a7b0-44cd-b04c-f248e5bd28e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:56.414581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86ddb-a7b0-44cd-b04c-f248e5bd28e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:56.415320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd86ddb-a7b0-44cd-b04c-f248e5bd28e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:56.417157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd86ddb-a7b0-44cd-b04c-f248e5bd28e7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:56.450060 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3075/6161] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:32:56.459173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:56.476500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4279aa-361c-468d-851f-790f83493af4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:56.490132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:56.490132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:56.490528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:56.490528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] PATH_INFO: `/v3/projects/910d1339e7a24cfd863d2c04610a7b1b/users/521136ba1dcc454292aaa65a23b2be68/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:56.542385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910d1339e7a24cfd863d2c04610a7b1b, user_id=521136ba1dcc454292aaa65a23b2be68, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:56.552169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:56.584135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3087/6162] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:32:56 2022] PUT /identity/v3/projects/910d1339e7a24cfd863d2c04610a7b1b/users/521136ba1dcc454292aaa65a23b2be68/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:32:56.594202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375914f-1a21-457b-b911-52cf5338674c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:56.594762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375914f-1a21-457b-b911-52cf5338674c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:56.597038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375914f-1a21-457b-b911-52cf5338674c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:56.642539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2375914f-1a21-457b-b911-52cf5338674c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:32:56.644085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2375914f-1a21-457b-b911-52cf5338674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:56.662402 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:56.869125 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3076/6163] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:32:56.889783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:32:56.892003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:32:57.013837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb0314-fadc-400d-988d-09a60383d210 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:32:57.022869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:32:57.023622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:32:57.023812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:32:57.024067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:32:57.039546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:32:57.042587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:32:57.071934 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3088/6164] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:04.162673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a389cd-266c-4c77-b288-4c499ddc342e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:04.163640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a389cd-266c-4c77-b288-4c499ddc342e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:04.164097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a389cd-266c-4c77-b288-4c499ddc342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:04.248050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-89a389cd-266c-4c77-b288-4c499ddc342e None None] MFA Rules not processed for user `de660ed43ffe4456aae3ac3262602b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:04.253620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-89a389cd-266c-4c77-b288-4c499ddc342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:04.481158 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3077/6165] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:05.809094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:05.827921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26951234-e496-4717-a05c-a8943cd8cefd service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:05.849130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:05.850207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:05.850671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:05.851135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:05.853291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:05.888453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:05.891033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:05.919197 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3089/6166] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:07.509253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:07.510271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:07.510712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:07.546412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:07.548965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:07.665558 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3078/6167] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:07.675182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:07.677510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:07.683844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:07.686687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:07.754949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e81a0-d910-4891-961b-f1732964ab1a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:07.801663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:07.806720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:07.807035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:07.807314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] PATH_INFO: `/v3/users/fba2d405c8a5415f96758c1e1e033ecf` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:07.810763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba2d405c8a5415f96758c1e1e033ecf)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:07.812821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:07.992184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba2d405c8a5415f96758c1e1e033ecf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:08.003004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37ae4d-cfdf-4fd3-af06-6e2547e83e30 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:08.019210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba2d405c8a5415f96758c1e1e033ecf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:08.019929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba2d405c8a5415f96758c1e1e033ecf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:08.021641 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:08.021888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:08.022566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:08.022842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:08.023119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:08.036191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:08.043120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba2d405c8a5415f96758c1e1e033ecf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:08.047652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5682648-fd37-4f5d-bf9f-28a567095e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba2d405c8a5415f96758c1e1e033ecf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:08.080835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:08.084020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:08.091741 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3079/6168] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:33:07 2022] DELETE /identity/v3/users/fba2d405c8a5415f96758c1e1e033ecf => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:08.096304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:08.096937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:08.097631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:08.130272 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3090/6169] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:33:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:08.142572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:08.143814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:08.323123 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3080/6170] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:33:08.402575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:08.405023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:08.446952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2573dc-f2db-4769-9ebb-450b14224f57 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:08.465461 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:08.629794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5b481-5acd-46ec-9cad-2342980762ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:08.632303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b481-5acd-46ec-9cad-2342980762ea service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:08.632608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b481-5acd-46ec-9cad-2342980762ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:08.636595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b481-5acd-46ec-9cad-2342980762ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:08.702253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5b481-5acd-46ec-9cad-2342980762ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:08.703757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5b481-5acd-46ec-9cad-2342980762ea service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:08.746862 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3091/6171] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:10.784966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:10.786457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:10.828288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f380fe-c7d8-4bdf-a3da-83688417844b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:10.859998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:10.861538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:10.861823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:10.862092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] PATH_INFO: `/v3/projects/3168ef33276a431694b371e3e6f46cf0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:10.866666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3168ef33276a431694b371e3e6f46cf0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:10.885040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:10.995991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3168ef33276a431694b371e3e6f46cf0', 'request_id': 'req-60e011c9-38be-4c11-b02e-573f29afc914'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:11.033259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3168ef33276a431694b371e3e6f46cf0', 'request_id': 'req-60e011c9-38be-4c11-b02e-573f29afc914'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:11.049675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3168ef33276a431694b371e3e6f46cf0', 'request_id': 'req-60e011c9-38be-4c11-b02e-573f29afc914'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:11.082194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] The token cache is being invalidate because project 3168ef33276a431694b371e3e6f46cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:33:11.082494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:11.084913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60e011c9-38be-4c11-b02e-573f29afc914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:11.092229 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3081/6172] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:33:10 2022] DELETE /identity/v3/projects/3168ef33276a431694b371e3e6f46cf0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:11.092957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12dcad-a60c-4f77-b1ac-8164bb375149 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.093436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12dcad-a60c-4f77-b1ac-8164bb375149 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.093627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12dcad-a60c-4f77-b1ac-8164bb375149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.153285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6f12dcad-a60c-4f77-b1ac-8164bb375149 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:11.162843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f12dcad-a60c-4f77-b1ac-8164bb375149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:11.278288 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3092/6173] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:11.280505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86932-cff9-4fce-92aa-4b53e03555ed None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.281023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86932-cff9-4fce-92aa-4b53e03555ed None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.281456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86932-cff9-4fce-92aa-4b53e03555ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.307735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bef86932-cff9-4fce-92aa-4b53e03555ed None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:11.309889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bef86932-cff9-4fce-92aa-4b53e03555ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:11.324528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3082/6174] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:11.324727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12dcad-a60c-4f77-b1ac-8164bb375149 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:11.335822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12dcad-a60c-4f77-b1ac-8164bb375149 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:11.341432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:11.342711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.343256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.343690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.344493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:33:11.345134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:11.347092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:11.375533 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3093/6175] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:33:11.379785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86932-cff9-4fce-92aa-4b53e03555ed None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:11.394093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86932-cff9-4fce-92aa-4b53e03555ed None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:11.402558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:11.403584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.404183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.404632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.405675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:11.407962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:11.455751 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3083/6176] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:33:11 2022] POST /identity/v3/projects => generated 361 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:11.456159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:11.468391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde92754-2ee6-4f2f-a2cd-e8da63783667 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:11.633275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:11.634243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.634880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.635309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.636270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:11.639309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:11.682338 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3094/6177] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:33:11 2022] POST /identity/v3/users => generated 281 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:33:11.686545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:11.704121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06da37-dce1-4c6d-a862-27e640f67e1e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:11.718386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:11.719047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.719327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.719646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.720355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:11.723197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:11.754770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:11.756152 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3084/6178] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:11.770047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f215-4962-4f2d-9415-685e8b8d41a2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:11.791914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff45e90-b869-4335-b077-b8cb69710129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:11.792608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e90-b869-4335-b077-b8cb69710129 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.797337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e90-b869-4335-b077-b8cb69710129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.797667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e90-b869-4335-b077-b8cb69710129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.800640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff45e90-b869-4335-b077-b8cb69710129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:11.808471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff45e90-b869-4335-b077-b8cb69710129 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:11.854563 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3095/6179] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:33:11.859327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:11.879709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774b0c-0d9f-4968-aa32-9af4b14e003b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:11.888624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:11.889268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.889545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.889819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] PATH_INFO: `/v3/projects/4cec7d82e5a44d138c4dee3a9451c23b/users/7680692a673a43499dbca36d3b0f9015/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:11.923905 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:11.928008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cec7d82e5a44d138c4dee3a9451c23b, user_id=7680692a673a43499dbca36d3b0f9015, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:11.931453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:11.962144 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3085/6180] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:33:11 2022] PUT /identity/v3/projects/4cec7d82e5a44d138c4dee3a9451c23b/users/7680692a673a43499dbca36d3b0f9015/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:11.975352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5af6f-b9e0-4e55-8870-5ab2bd042a1f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:11.976066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5af6f-b9e0-4e55-8870-5ab2bd042a1f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:11.977887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5af6f-b9e0-4e55-8870-5ab2bd042a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:12.066783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7dc5af6f-b9e0-4e55-8870-5ab2bd042a1f None None] MFA Rules not processed for user `7680692a673a43499dbca36d3b0f9015`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:12.067466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7dc5af6f-b9e0-4e55-8870-5ab2bd042a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:12.080044 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:12.251917 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3096/6181] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:12.326441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:12.328182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:12.462651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6ed3-04d2-4521-9d34-04e27537b812 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:12.471092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:12.472143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:12.472143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:12.472143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:12.493241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:12.494620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:12.524745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:12.525319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:12.525979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:12.534252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3086/6182] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:12.552838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:12.581815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] MFA Rules not processed for user `521136ba1dcc454292aaa65a23b2be68`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:12.585553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:12.685243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0412e2e-460c-41bd-b22f-435322fc3b51 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:12.727953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:12.728653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:12.748137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:12.748500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] PATH_INFO: `/v3/users/7680692a673a43499dbca36d3b0f9015` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:12.756255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7680692a673a43499dbca36d3b0f9015)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:12.758436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:12.773708 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3097/6183] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:12.783349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:12.784698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:12.877102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7680692a673a43499dbca36d3b0f9015'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:12.895043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7680692a673a43499dbca36d3b0f9015'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:12.895657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7680692a673a43499dbca36d3b0f9015'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:12.908242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7680692a673a43499dbca36d3b0f9015'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:12.909326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-83b4352d-1882-4655-87e1-8bee98772bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7680692a673a43499dbca36d3b0f9015'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:12.958796 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3087/6184] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:33:12 2022] DELETE /identity/v3/users/7680692a673a43499dbca36d3b0f9015 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:33:12.963275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:12.963910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:12.964358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:12.971694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc665a-1b1c-4529-b2a4-a88e87bf85a8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:13.046298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:13.048635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:13.080322 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:13.088246 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:13.184486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfd4cd-818d-4ce8-8077-6b4dd2ecb5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:13.185724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfd4cd-818d-4ce8-8077-6b4dd2ecb5bb service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:13.190766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfd4cd-818d-4ce8-8077-6b4dd2ecb5bb service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:13.191244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfd4cd-818d-4ce8-8077-6b4dd2ecb5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:13.195149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ecbfd4cd-818d-4ce8-8077-6b4dd2ecb5bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:13.241532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3088/6185] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:13.343834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfd4cd-818d-4ce8-8077-6b4dd2ecb5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:13.346804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfd4cd-818d-4ce8-8077-6b4dd2ecb5bb service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:13.371073 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3098/6186] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:33:13.416162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:13.418132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:13.570938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b50c0-424b-4384-8ea2-ddfb5c765bc9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:13.583987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:13.584256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:13.585152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:13.585437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:13.611338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:13.612847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:13.645180 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3089/6187] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:14.916153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fba8c-0e3d-4d13-9b26-bbbbbba34f1b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:14.917127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fba8c-0e3d-4d13-9b26-bbbbbba34f1b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:14.917871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fba8c-0e3d-4d13-9b26-bbbbbba34f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:14.952960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3d7fba8c-0e3d-4d13-9b26-bbbbbba34f1b None None] MFA Rules not processed for user `521136ba1dcc454292aaa65a23b2be68`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:14.958633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d7fba8c-0e3d-4d13-9b26-bbbbbba34f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:14.978451 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3099/6188] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:15.271885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:15.274268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:15.300219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63170dd-a070-45a5-a766-322130888699 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:15.306933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:15.308058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:15.309286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:15.310156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] PATH_INFO: `/v3/projects/4cec7d82e5a44d138c4dee3a9451c23b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:15.313482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cec7d82e5a44d138c4dee3a9451c23b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:15.315468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:15.396315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cec7d82e5a44d138c4dee3a9451c23b', 'request_id': 'req-b0a84212-b835-4e21-a7d6-f0d89860757f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:15.407957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cec7d82e5a44d138c4dee3a9451c23b', 'request_id': 'req-b0a84212-b835-4e21-a7d6-f0d89860757f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:15.418596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cec7d82e5a44d138c4dee3a9451c23b', 'request_id': 'req-b0a84212-b835-4e21-a7d6-f0d89860757f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:15.468116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] The token cache is being invalidate because project 4cec7d82e5a44d138c4dee3a9451c23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:33:15.468857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:15.469780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0a84212-b835-4e21-a7d6-f0d89860757f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:15.475550 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3090/6189] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:33:15 2022] DELETE /identity/v3/projects/4cec7d82e5a44d138c4dee3a9451c23b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:15.480291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458dc71-735e-4132-b0a0-0d94305788f4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:15.480574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458dc71-735e-4132-b0a0-0d94305788f4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:15.481264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458dc71-735e-4132-b0a0-0d94305788f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:15.553969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a458dc71-735e-4132-b0a0-0d94305788f4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:15.562277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a458dc71-735e-4132-b0a0-0d94305788f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:15.738631 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3100/6190] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:15.748561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5230-54ca-49c4-a57d-67b1a0f33df2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:15.749125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5230-54ca-49c4-a57d-67b1a0f33df2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:15.749407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5230-54ca-49c4-a57d-67b1a0f33df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:15.783940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ad6c5230-54ca-49c4-a57d-67b1a0f33df2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:15.785391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ad6c5230-54ca-49c4-a57d-67b1a0f33df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:15.800863 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3091/6191] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:15.802566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458dc71-735e-4132-b0a0-0d94305788f4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:15.819191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458dc71-735e-4132-b0a0-0d94305788f4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:15.835457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:15.836643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:15.837320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:15.837835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:15.838932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:33:15.840831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:15.850898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:15.880442 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3101/6192] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:33:15.885631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c5230-54ca-49c4-a57d-67b1a0f33df2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:15.899990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c5230-54ca-49c4-a57d-67b1a0f33df2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:15.926298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:15.929291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:15.929649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:15.929960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:15.930707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:15.939716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:16.000999 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3092/6193] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:33:15 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:16.004830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:16.027298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90968346-90ef-4af4-84cf-810df0ca3f0c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:16.150174 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:16.171212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:16.172328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:16.172671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:16.173045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:16.173755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:16.175817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:16.224696 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3102/6194] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:33:16 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:16.229043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:16.259117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bc2ed-ed7f-42a1-b244-e287e1566aaa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:16.271681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:16.273504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:16.274116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:16.274349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:16.275336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:16.279065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:16.287413 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:16.312310 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3093/6195] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:16.316593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:16.331157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d03aa5-df64-4839-9a37-6c0be4294c67 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:16.359013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee439ab6-2ec9-474e-99a6-8c86e433a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:16.359949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee439ab6-2ec9-474e-99a6-8c86e433a85d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:16.360395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee439ab6-2ec9-474e-99a6-8c86e433a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:16.360867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee439ab6-2ec9-474e-99a6-8c86e433a85d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:16.361685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee439ab6-2ec9-474e-99a6-8c86e433a85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:16.363640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee439ab6-2ec9-474e-99a6-8c86e433a85d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:16.402998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:16.414514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3103/6196] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:16.416360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229912e-29a2-41b8-a053-2f6c64958b8a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:16.437594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:16.439068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:16.444082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:16.444605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] PATH_INFO: `/v3/projects/d2931812ddae43f49bfe7332d9d861e1/users/c274a0f62fc64f80ac6be67798ee80df/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:16.486108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2931812ddae43f49bfe7332d9d861e1, user_id=c274a0f62fc64f80ac6be67798ee80df, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:16.489188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:16.530082 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3094/6197] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:33:16 2022] PUT /identity/v3/projects/d2931812ddae43f49bfe7332d9d861e1/users/c274a0f62fc64f80ac6be67798ee80df/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:33:16.531543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:16.532103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:16.532468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:16.607118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] MFA Rules not processed for user `c274a0f62fc64f80ac6be67798ee80df`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:16.608714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:16.744684 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3104/6198] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:16.757526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:16.760375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:17.013954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6aa2b-a173-4ef8-865a-4ee323a9159b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:17.031133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:17.031783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:17.032071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:17.032338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:17.069776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:17.071268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:17.096924 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3095/6199] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:17.127591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:17.130267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:17.305045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41926-2f4b-4253-b430-f912f9b26950 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:17.319650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:17.321805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:17.323360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:17.324809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] PATH_INFO: `/v3/users/bd0447e656f9418da68b308f19e8e807` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:17.329609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0447e656f9418da68b308f19e8e807)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:17.359264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:17.511326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0447e656f9418da68b308f19e8e807'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:17.531447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0447e656f9418da68b308f19e8e807'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:17.540736 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:17.560948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0447e656f9418da68b308f19e8e807'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:17.563027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0447e656f9418da68b308f19e8e807'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:17.597028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c431cb81-ff47-4c50-8a81-541b7b3d3a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0447e656f9418da68b308f19e8e807'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:17.627423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3105/6200] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:33:17 2022] DELETE /identity/v3/users/bd0447e656f9418da68b308f19e8e807 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:18.252526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:18.270751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40dc37-65c5-4e98-8bc6-0d09a9852622 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:18.420259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:18.421152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:18.421357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:18.422167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] PATH_INFO: `/v3/projects/0514462a9a1b45ac9b7b3285fd0bf6af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:18.424920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0514462a9a1b45ac9b7b3285fd0bf6af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:18.427259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:18.585791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0514462a9a1b45ac9b7b3285fd0bf6af', 'request_id': 'req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:18.609381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0514462a9a1b45ac9b7b3285fd0bf6af', 'request_id': 'req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:18.625285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0514462a9a1b45ac9b7b3285fd0bf6af', 'request_id': 'req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:18.643682 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:18.658835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] The token cache is being invalidate because project 0514462a9a1b45ac9b7b3285fd0bf6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:33:18.659552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:18.660784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c9cdb9-8526-409e-bb6d-869c33ab2fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:18.670693 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3096/6201] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:33:18 2022] DELETE /identity/v3/projects/0514462a9a1b45ac9b7b3285fd0bf6af => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:18.673506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494fc34-af24-442a-bb8c-883c68ef3b6b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:18.674533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494fc34-af24-442a-bb8c-883c68ef3b6b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:18.674533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494fc34-af24-442a-bb8c-883c68ef3b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:18.720699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1494fc34-af24-442a-bb8c-883c68ef3b6b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:18.722324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1494fc34-af24-442a-bb8c-883c68ef3b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:18.914720 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3106/6202] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:33:18.924882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69080c97-66fa-4b99-9cb2-0dc070506c29 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:18.925091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69080c97-66fa-4b99-9cb2-0dc070506c29 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:18.925355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69080c97-66fa-4b99-9cb2-0dc070506c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:18.970937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-69080c97-66fa-4b99-9cb2-0dc070506c29 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:18.978302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-69080c97-66fa-4b99-9cb2-0dc070506c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:19.006342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494fc34-af24-442a-bb8c-883c68ef3b6b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:19.019354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3097/6203] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:19.039079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494fc34-af24-442a-bb8c-883c68ef3b6b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:19.094116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:19.096065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:19.105599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:19.106811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:19.110052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:33:19.110370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:19.112164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:19.197817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3107/6204] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:33:19.202605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69080c97-66fa-4b99-9cb2-0dc070506c29 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:19.218595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69080c97-66fa-4b99-9cb2-0dc070506c29 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:19.233008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:19.233964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:19.234412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:19.234956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:19.236567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:19.240749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:19.329926 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3098/6205] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:33:19 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:19.334262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:19.348353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a018f6-bb36-46ca-af6d-fe69cba75a3f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:19.502962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:19.503493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:19.503688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:19.503952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:19.508184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:19.514049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:19.587378 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3108/6206] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:33:19 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:19.592426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:19.604968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c365a3e-0a36-4464-80dc-7bfc4924ff14 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:19.622933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:19.623832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:19.625188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:19.625881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:19.627459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:19.629418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:19.651083 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3099/6207] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:19.654981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:19.667815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79cdf-31fb-4891-94d8-3a1e84cdf015 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:19.674565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820c3be-1ce6-4dce-a89a-4532f3dfd9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:19.675295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c3be-1ce6-4dce-a89a-4532f3dfd9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:19.675639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c3be-1ce6-4dce-a89a-4532f3dfd9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:19.675975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c3be-1ce6-4dce-a89a-4532f3dfd9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:19.676784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820c3be-1ce6-4dce-a89a-4532f3dfd9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:19.678533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820c3be-1ce6-4dce-a89a-4532f3dfd9a6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:19.713509 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3109/6208] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:19.718394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:19.730193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93effa72-1f00-4667-8dc2-071021995499 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:19.742895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:19.744857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:19.745305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:19.745806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] PATH_INFO: `/v3/projects/455488ff7064493a91bb38fc683bd233/users/27a75d14c8494952a4577bff44f15f99/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:19.769587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] RBAC: Authorizing `identity:create_grant(project_id=455488ff7064493a91bb38fc683bd233, user_id=27a75d14c8494952a4577bff44f15f99, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:19.773057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:19.799333 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3100/6209] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:33:19 2022] PUT /identity/v3/projects/455488ff7064493a91bb38fc683bd233/users/27a75d14c8494952a4577bff44f15f99/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:19.804803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002b10-00e6-4cc1-afbf-c40c1c45cbea None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:19.805685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002b10-00e6-4cc1-afbf-c40c1c45cbea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:19.806526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002b10-00e6-4cc1-afbf-c40c1c45cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:19.829459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1a002b10-00e6-4cc1-afbf-c40c1c45cbea None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:19.831759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1a002b10-00e6-4cc1-afbf-c40c1c45cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:19.919355 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:19.991996 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3110/6210] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:33:20.015589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:20.018367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:20.276677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4237e-ebae-4d95-bbc8-4bdbf23d603e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:20.289194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:20.289903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:20.293903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:20.294179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:20.325939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:20.331007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:20.364621 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3101/6211] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:28.516450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:28.517101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:28.517247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:28.550323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] MFA Rules not processed for user `05c1f10a225e4f14885bf583527e93a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:28.554388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:28.678819 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3111/6212] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:30.344954 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:31.146476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:31.151239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:31.322209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd35a0-b581-4356-b039-5461d931d8ef service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:31.329835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef81db-4813-436d-b76d-1de640016f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:31.330630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef81db-4813-436d-b76d-1de640016f16 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:31.331121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef81db-4813-436d-b76d-1de640016f16 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:31.331607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef81db-4813-436d-b76d-1de640016f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:31.333789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2fef81db-4813-436d-b76d-1de640016f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:31.350373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef81db-4813-436d-b76d-1de640016f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:31.351961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef81db-4813-436d-b76d-1de640016f16 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:31.366884 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3102/6213] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:32.900843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:32.903286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:32.954999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf72ad3-14aa-4f7f-8d8d-d07dc196348a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:32.974449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:32.981730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:32.984632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:32.987256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] PATH_INFO: `/v3/users/9d603f82e1234a71aafc17e99a9f0c4e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:32.991962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d603f82e1234a71aafc17e99a9f0c4e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:33.003502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:33.163896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d603f82e1234a71aafc17e99a9f0c4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:33.192336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d603f82e1234a71aafc17e99a9f0c4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:33.263084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d603f82e1234a71aafc17e99a9f0c4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:33.267759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d603f82e1234a71aafc17e99a9f0c4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:33.282649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d603f82e1234a71aafc17e99a9f0c4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:33.293051 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3112/6214] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:33:32 2022] DELETE /identity/v3/users/9d603f82e1234a71aafc17e99a9f0c4e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:33.298276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a603-6df8-4de6-8f76-739bcce1cd9c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:33.298783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a603-6df8-4de6-8f76-739bcce1cd9c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:33.298908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a603-6df8-4de6-8f76-739bcce1cd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:33.341933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-60f3a603-6df8-4de6-8f76-739bcce1cd9c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:33.343261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-60f3a603-6df8-4de6-8f76-739bcce1cd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:33.517573 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3103/6215] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:33.571857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:33.575944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:33.803316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa7113-f1bb-4346-baa8-e601a190616c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:33.817687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:33.818546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:33.819345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:33.819578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:33.854158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:33.856116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:33.877387 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3113/6216] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:35.318948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:35.319529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:35.320091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:35.364158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:35.366131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:35.481768 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3104/6217] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:33:35.494814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:35.496788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:35.522219 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:35.599603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:35.602085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:35.646045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab62983-9441-488d-80d4-c968e085d283 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:35.677107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:35.678579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:35.680270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:35.680901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] PATH_INFO: `/v3/projects/93e907ca837e4683bdde125bf6765a56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:35.684637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e907ca837e4683bdde125bf6765a56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:35.687644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:35.752816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71de3-9bcf-42e3-aff6-40adadf9b8a5 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:35.768379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eb739-7178-481f-b4ae-081dee34ccd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:35.769433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb739-7178-481f-b4ae-081dee34ccd0 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:35.772349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb739-7178-481f-b4ae-081dee34ccd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:35.772803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb739-7178-481f-b4ae-081dee34ccd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:35.788276 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:35.795520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eb739-7178-481f-b4ae-081dee34ccd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:35.799205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eb739-7178-481f-b4ae-081dee34ccd0 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:35.810197 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3114/6218] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:35.897498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e907ca837e4683bdde125bf6765a56', 'request_id': 'req-50cc8486-7e29-4f7a-83fe-55453e14cec8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:35.931740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e907ca837e4683bdde125bf6765a56', 'request_id': 'req-50cc8486-7e29-4f7a-83fe-55453e14cec8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:35.959681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e907ca837e4683bdde125bf6765a56', 'request_id': 'req-50cc8486-7e29-4f7a-83fe-55453e14cec8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:36.014702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] The token cache is being invalidate because project 93e907ca837e4683bdde125bf6765a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:33:36.016438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:36.018685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-50cc8486-7e29-4f7a-83fe-55453e14cec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:36.025793 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3105/6219] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:33:35 2022] DELETE /identity/v3/projects/93e907ca837e4683bdde125bf6765a56 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:33:36.031154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63bc2-8e95-49ed-a353-79491aacf06f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:36.031432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63bc2-8e95-49ed-a353-79491aacf06f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:36.031947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63bc2-8e95-49ed-a353-79491aacf06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:36.169922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-22f63bc2-8e95-49ed-a353-79491aacf06f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:36.171500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-22f63bc2-8e95-49ed-a353-79491aacf06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:36.459200 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3115/6220] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:36.460596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84771349-8ebc-431b-8217-e38510e5ecc1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:36.461272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84771349-8ebc-431b-8217-e38510e5ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:36.461750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84771349-8ebc-431b-8217-e38510e5ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:36.501566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-84771349-8ebc-431b-8217-e38510e5ecc1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:36.506877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-84771349-8ebc-431b-8217-e38510e5ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:36.525661 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3106/6221] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:33:36.530617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63bc2-8e95-49ed-a353-79491aacf06f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:36.547583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63bc2-8e95-49ed-a353-79491aacf06f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:36.565896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:36.566681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:36.571070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:36.571374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:36.572217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:33:36.572526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:36.574355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:36.633657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3116/6222] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:33:36.638704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84771349-8ebc-431b-8217-e38510e5ecc1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:36.651243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84771349-8ebc-431b-8217-e38510e5ecc1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:36.665987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:36.679249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:36.679751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:36.681070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:36.683923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:36.693690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:36.786524 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3107/6223] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:33:36 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:36.787393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:36.808953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731e74a-0e26-4cda-8e9b-871e828289d2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:37.002235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:37.002235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:37.002235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:37.002235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:37.002876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:37.009275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:37.217604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:37.221262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3117/6224] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:33:36 2022] POST /identity/v3/users => generated 289 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:37.237342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373614-f5e6-42ec-b7ff-11f1bd8dcfe0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:37.254286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e692-e807-42d5-a9cc-c8ad237fc951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:37.261395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e692-e807-42d5-a9cc-c8ad237fc951 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:37.263859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e692-e807-42d5-a9cc-c8ad237fc951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:37.267094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e692-e807-42d5-a9cc-c8ad237fc951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:37.279271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248e692-e807-42d5-a9cc-c8ad237fc951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:37.290925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248e692-e807-42d5-a9cc-c8ad237fc951 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:37.352388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:37.352820 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3108/6225] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:37.369409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ab9a7-d5b4-4f54-9968-a784ee0be844 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:37.384365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:37.385452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:37.386276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:37.391154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:37.391920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:37.396022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:37.418315 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:37.420207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df32e6-446a-4993-87c6-a6fac2017a3b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:37.422936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df32e6-446a-4993-87c6-a6fac2017a3b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:37.424998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df32e6-446a-4993-87c6-a6fac2017a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:37.425817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3118/6226] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:33:37.429939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:37.454852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d3367-8c6f-4504-9de5-8f6f83186699 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:37.462837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49680116-ef5e-422e-a4c2-62d30d0a8cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:37.463569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680116-ef5e-422e-a4c2-62d30d0a8cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:37.463802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680116-ef5e-422e-a4c2-62d30d0a8cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:37.464085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680116-ef5e-422e-a4c2-62d30d0a8cb9 admin admin] PATH_INFO: `/v3/projects/f6ac0dac7b2f4686b38c9bdce65ce5ef/users/5ebe8332f6c14525a3eb586ca9096392/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:37.503559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49680116-ef5e-422e-a4c2-62d30d0a8cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ac0dac7b2f4686b38c9bdce65ce5ef, user_id=5ebe8332f6c14525a3eb586ca9096392, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:37.506056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-32df32e6-446a-4993-87c6-a6fac2017a3b None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:37.506589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49680116-ef5e-422e-a4c2-62d30d0a8cb9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:37.509664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-32df32e6-446a-4993-87c6-a6fac2017a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:37.546871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3119/6227] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:33:37 2022] PUT /identity/v3/projects/f6ac0dac7b2f4686b38c9bdce65ce5ef/users/5ebe8332f6c14525a3eb586ca9096392/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:37.548592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:37.548921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:37.549194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:37.613403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] MFA Rules not processed for user `5ebe8332f6c14525a3eb586ca9096392`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:37.614661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:37.760332 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3109/6228] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:37.776007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6058d6-224e-42a7-8135-9df1adc0c459 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:37.776356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6058d6-224e-42a7-8135-9df1adc0c459 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:37.778840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6058d6-224e-42a7-8135-9df1adc0c459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:37.801485 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3120/6229] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:37.822575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7c6058d6-224e-42a7-8135-9df1adc0c459 None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:37.824915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c6058d6-224e-42a7-8135-9df1adc0c459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:37.854306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:37.856361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:37.993634 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3110/6230] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:38.018137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc11674-6cf1-4828-8f81-e845e4790428 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:38.022825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:38.023597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:38.023974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:38.024355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:38.058338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:38.059928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:38.074918 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3121/6231] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:33:38.102046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6058d6-224e-42a7-8135-9df1adc0c459 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:38.141092 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:38.222521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6058d6-224e-42a7-8135-9df1adc0c459 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:38.240393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:38.247251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:38.248470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:38.249667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] PATH_INFO: `/v3/users/5ebe8332f6c14525a3eb586ca9096392` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:38.253098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebe8332f6c14525a3eb586ca9096392)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:38.259245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:38.291636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:38.294890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:38.402363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebe8332f6c14525a3eb586ca9096392'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:38.424952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebe8332f6c14525a3eb586ca9096392'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:38.426527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebe8332f6c14525a3eb586ca9096392'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:38.427430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05620df-0e14-4ead-89b8-8c077adcace2 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:38.436097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f741d-427d-49d6-97ef-ef7a30e104ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:38.436926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f741d-427d-49d6-97ef-ef7a30e104ee service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:38.437316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f741d-427d-49d6-97ef-ef7a30e104ee service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:38.437683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f741d-427d-49d6-97ef-ef7a30e104ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:38.439833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-828f741d-427d-49d6-97ef-ef7a30e104ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:38.448633 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:38.465623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f741d-427d-49d6-97ef-ef7a30e104ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:38.466304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebe8332f6c14525a3eb586ca9096392'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:38.468251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebe8332f6c14525a3eb586ca9096392'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:38.470493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f741d-427d-49d6-97ef-ef7a30e104ee service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:38.521828 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3122/6232] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:38.546644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:38.549636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:38.550216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:38.557014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3111/6233] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:33:38 2022] DELETE /identity/v3/users/5ebe8332f6c14525a3eb586ca9096392 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:38.585019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:38.592421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:38.734284 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3123/6234] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:38.767558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:38.769686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:38.989437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f77f-4010-48e7-b3b0-2bd6161254b7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:39.010200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b2320-2565-4b7c-b7ed-6f0d1b97fe2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:39.010860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2320-2565-4b7c-b7ed-6f0d1b97fe2a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:39.011159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2320-2565-4b7c-b7ed-6f0d1b97fe2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:39.011698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2320-2565-4b7c-b7ed-6f0d1b97fe2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:39.070751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b2320-2565-4b7c-b7ed-6f0d1b97fe2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:39.075867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b2320-2565-4b7c-b7ed-6f0d1b97fe2a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:39.154463 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3112/6235] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:40.364240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:40.365726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:40.397430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f7f9-ef9c-4e6d-9468-d2a08b848803 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:40.435117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:40.437991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:40.438802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:40.439086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] PATH_INFO: `/v3/projects/f6ac0dac7b2f4686b38c9bdce65ce5ef` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:40.451316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ac0dac7b2f4686b38c9bdce65ce5ef)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:40.463118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:40.668165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ac0dac7b2f4686b38c9bdce65ce5ef', 'request_id': 'req-55c32bda-a738-4a15-b081-f4d2563566f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:40.683779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ac0dac7b2f4686b38c9bdce65ce5ef', 'request_id': 'req-55c32bda-a738-4a15-b081-f4d2563566f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:40.702179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ac0dac7b2f4686b38c9bdce65ce5ef', 'request_id': 'req-55c32bda-a738-4a15-b081-f4d2563566f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:40.732488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] The token cache is being invalidate because project f6ac0dac7b2f4686b38c9bdce65ce5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:33:40.732836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:40.736947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-55c32bda-a738-4a15-b081-f4d2563566f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:40.747094 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3124/6236] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:33:40 2022] DELETE /identity/v3/projects/f6ac0dac7b2f4686b38c9bdce65ce5ef => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:40.748964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e3277-ced0-49ba-9bcd-ee5fc459263a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:40.749500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e3277-ced0-49ba-9bcd-ee5fc459263a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:40.749500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e3277-ced0-49ba-9bcd-ee5fc459263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:40.803879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-010e3277-ced0-49ba-9bcd-ee5fc459263a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:40.805157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-010e3277-ced0-49ba-9bcd-ee5fc459263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:40.881099 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:40.976951 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3113/6237] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:40.978683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972781c-24c2-4918-b3ed-66abef78ab35 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:40.979558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972781c-24c2-4918-b3ed-66abef78ab35 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:40.979902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972781c-24c2-4918-b3ed-66abef78ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:41.022013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2972781c-24c2-4918-b3ed-66abef78ab35 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:41.025978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2972781c-24c2-4918-b3ed-66abef78ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:41.062412 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3125/6238] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:41.063877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e3277-ced0-49ba-9bcd-ee5fc459263a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:41.078488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e3277-ced0-49ba-9bcd-ee5fc459263a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:41.094261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:41.094922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:41.095206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:41.095466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:41.096122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:33:41.105123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:41.123533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:41.204964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972781c-24c2-4918-b3ed-66abef78ab35 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:41.225958 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3114/6239] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:33:41.237494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972781c-24c2-4918-b3ed-66abef78ab35 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:41.296241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:41.296241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:41.296241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:41.296241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:41.309135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:41.330587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:41.511310 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3126/6240] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:33:41 2022] POST /identity/v3/projects => generated 373 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:41.513173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:41.528556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787854d4-3bbd-4e5e-9ef4-e3e373ac0bb0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:41.879757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:41.886592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:41.889202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:41.890694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:41.892999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:41.898090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:41.997842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:42.004135 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3115/6241] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:33:41 2022] POST /identity/v3/users => generated 287 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:42.016427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716611e0-d871-4bb9-99b2-45636ab5c49e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:42.069411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:42.070628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:42.071263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:42.072610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:42.073992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:42.075964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:42.119335 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3127/6242] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:42.123907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:42.156334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0138f-91e6-4d4e-952a-e25104d6d229 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:42.203352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ccf1a-d564-4444-92aa-f32df948ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:42.203993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ccf1a-d564-4444-92aa-f32df948ba2b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:42.204258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ccf1a-d564-4444-92aa-f32df948ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:42.205037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ccf1a-d564-4444-92aa-f32df948ba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:42.207659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ccf1a-d564-4444-92aa-f32df948ba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:42.215636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ccf1a-d564-4444-92aa-f32df948ba2b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:42.264329 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3116/6243] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:42.268461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:42.284973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81c3d4-0145-4dec-851e-8cc4222a6058 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:42.346607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:42.352019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:42.352308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:42.352592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] PATH_INFO: `/v3/projects/8d228b4fc28a41cd8cee1feab0e3010b/users/b40a2af07bac46738c262791c0f65f14/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:42.477125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d228b4fc28a41cd8cee1feab0e3010b, user_id=b40a2af07bac46738c262791c0f65f14, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:42.497161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:42.539228 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3128/6244] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:33:42 2022] PUT /identity/v3/projects/8d228b4fc28a41cd8cee1feab0e3010b/users/b40a2af07bac46738c262791c0f65f14/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:33:42.542614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929d12-afcf-41b6-b82f-77051bcb30bf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:42.542932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929d12-afcf-41b6-b82f-77051bcb30bf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:42.543187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929d12-afcf-41b6-b82f-77051bcb30bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:42.735744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ea929d12-afcf-41b6-b82f-77051bcb30bf None None] MFA Rules not processed for user `b40a2af07bac46738c262791c0f65f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:42.747584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ea929d12-afcf-41b6-b82f-77051bcb30bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:43.081151 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3117/6245] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:43.158610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:43.161970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:43.205978 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:43.378178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362842-8e18-4e53-8c14-29703e19846d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:43.416451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64108df-1392-4eb6-85fb-a536a115a292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:43.417048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64108df-1392-4eb6-85fb-a536a115a292 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:43.417436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64108df-1392-4eb6-85fb-a536a115a292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:43.417715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64108df-1392-4eb6-85fb-a536a115a292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:43.472028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64108df-1392-4eb6-85fb-a536a115a292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:43.473850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64108df-1392-4eb6-85fb-a536a115a292 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:43.512605 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3129/6246] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:45.009781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929d12-afcf-41b6-b82f-77051bcb30bf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:45.148475 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:45.317736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929d12-afcf-41b6-b82f-77051bcb30bf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:45.349485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:45.353456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:45.356491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:45.357149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] PATH_INFO: `/v3/users/b40a2af07bac46738c262791c0f65f14` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:45.364172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40a2af07bac46738c262791c0f65f14)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:45.374314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:45.570092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40a2af07bac46738c262791c0f65f14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:45.588058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40a2af07bac46738c262791c0f65f14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:45.588999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40a2af07bac46738c262791c0f65f14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:45.598960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40a2af07bac46738c262791c0f65f14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:45.600232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40a2af07bac46738c262791c0f65f14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:45.645073 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3118/6247] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:33:45 2022] DELETE /identity/v3/users/b40a2af07bac46738c262791c0f65f14 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:45.646257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:45.646783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:45.646783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:45.741037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:45.748541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:45.941713 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3130/6248] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:45.951014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:45.952539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:46.301875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50ba7-142a-4fea-aae2-fa1a42c04dc2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:46.332112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71ccef-d855-470e-8b68-dd159b1ce687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:46.338628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ccef-d855-470e-8b68-dd159b1ce687 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:46.341843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ccef-d855-470e-8b68-dd159b1ce687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:46.346738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ccef-d855-470e-8b68-dd159b1ce687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:46.399352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71ccef-d855-470e-8b68-dd159b1ce687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:46.406330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71ccef-d855-470e-8b68-dd159b1ce687 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:46.475179 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3119/6249] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:47.534109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:47.541918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:47.603990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391f65f-fd71-4881-ae19-02211371a1f4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:47.618021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:47.618609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:47.619140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:47.619676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] PATH_INFO: `/v3/projects/8d228b4fc28a41cd8cee1feab0e3010b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:47.629556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d228b4fc28a41cd8cee1feab0e3010b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:47.631618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:47.771035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d228b4fc28a41cd8cee1feab0e3010b', 'request_id': 'req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:47.782567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d228b4fc28a41cd8cee1feab0e3010b', 'request_id': 'req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:47.822469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d228b4fc28a41cd8cee1feab0e3010b', 'request_id': 'req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:47.869983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] The token cache is being invalidate because project 8d228b4fc28a41cd8cee1feab0e3010b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:33:47.871106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:47.873007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7b88c4db-6ba7-4446-b2e1-92f390f2b2d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:33:47.876364 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3131/6250] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:33:47 2022] DELETE /identity/v3/projects/8d228b4fc28a41cd8cee1feab0e3010b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:47.881526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6d60-64fd-483b-b020-ed5e05b92a1c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:47.882702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6d60-64fd-483b-b020-ed5e05b92a1c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:47.883251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6d60-64fd-483b-b020-ed5e05b92a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:47.947342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a0fe6d60-64fd-483b-b020-ed5e05b92a1c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:47.948900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0fe6d60-64fd-483b-b020-ed5e05b92a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:48.121271 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:48.184272 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3120/6251] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:48.186460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabc92-25a1-4e67-9e49-f639741dc02a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:48.187225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabc92-25a1-4e67-9e49-f639741dc02a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:48.187607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabc92-25a1-4e67-9e49-f639741dc02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:48.249335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-53dabc92-25a1-4e67-9e49-f639741dc02a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:48.255841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-53dabc92-25a1-4e67-9e49-f639741dc02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:48.277864 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3132/6252] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:48.282415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe6d60-64fd-483b-b020-ed5e05b92a1c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:48.292614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe6d60-64fd-483b-b020-ed5e05b92a1c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:48.306941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:48.307952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:48.308420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:48.308949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:48.309840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:33:48.310326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:48.318207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:48.380480 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3121/6253] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:33:48.384572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dabc92-25a1-4e67-9e49-f639741dc02a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:48.399676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dabc92-25a1-4e67-9e49-f639741dc02a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:48.419843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:48.420828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:48.423144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:48.423144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:48.423144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:48.424059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:48.522411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:48.525710 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3133/6254] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:33:48 2022] POST /identity/v3/projects => generated 359 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:48.539987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f352ea-55c4-4349-9805-81898f40198c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:48.806822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:48.809721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:48.810440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:48.812910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:48.814883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:48.826616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:48.924460 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3122/6255] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:33:48 2022] POST /identity/v3/users => generated 280 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:33:48.925771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:48.966467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eed846-6bcb-4bfd-927e-922607c6be87 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:48.991373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:48.992510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:48.992827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:48.993105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:48.994042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:49.003393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:49.023027 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:49.063464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:49.067054 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3134/6256] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:33:49.086138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5622a-1c2e-469e-9463-aeed458fedf0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:49.116963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262127e-ed40-49e2-8973-b7a518838213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:49.117902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262127e-ed40-49e2-8973-b7a518838213 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:49.118359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262127e-ed40-49e2-8973-b7a518838213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:49.118923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262127e-ed40-49e2-8973-b7a518838213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:49.120267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262127e-ed40-49e2-8973-b7a518838213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:49.130779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262127e-ed40-49e2-8973-b7a518838213 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:49.184607 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3123/6257] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:33:49.190788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:49.209973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ea8a-ca87-4fef-8777-233936021225 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:49.233157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:49.234171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:49.239832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:49.240114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] PATH_INFO: `/v3/projects/eb1187aecbd3497c956af5fbc56faca0/users/b1011ffc3e6045cb88a5fa9d50cb2308/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:49.324812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1187aecbd3497c956af5fbc56faca0, user_id=b1011ffc3e6045cb88a5fa9d50cb2308, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:49.332031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:49.407723 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3135/6258] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:33:49 2022] PUT /identity/v3/projects/eb1187aecbd3497c956af5fbc56faca0/users/b1011ffc3e6045cb88a5fa9d50cb2308/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:33:49.449566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:49.450069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:49.450197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:49.567954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] MFA Rules not processed for user `b1011ffc3e6045cb88a5fa9d50cb2308`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:49.569227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:49.836174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3124/6259] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:33:49.847358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:49.849271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:50.137670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20bc9-61a8-4d4b-b1b8-0f7df1aa419b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:50.151001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802478c-6eb1-48bc-8b66-f0a17563109c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:50.152587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802478c-6eb1-48bc-8b66-f0a17563109c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:50.153859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802478c-6eb1-48bc-8b66-f0a17563109c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:50.154406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802478c-6eb1-48bc-8b66-f0a17563109c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:50.180267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802478c-6eb1-48bc-8b66-f0a17563109c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:50.181995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802478c-6eb1-48bc-8b66-f0a17563109c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:50.215730 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3136/6260] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:33:54.891154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:33:54.892854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:54.990911 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:55.106094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822aa6-56f5-41c5-a0d5-9b412f7b1fb3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:33:55.122948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cce81-a347-4d9a-9b5c-cd76dac7f4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:33:55.123929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cce81-a347-4d9a-9b5c-cd76dac7f4e9 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:55.124351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cce81-a347-4d9a-9b5c-cd76dac7f4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:55.142041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cce81-a347-4d9a-9b5c-cd76dac7f4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:55.148047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-166cce81-a347-4d9a-9b5c-cd76dac7f4e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:55.447419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cce81-a347-4d9a-9b5c-cd76dac7f4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:33:55.457185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cce81-a347-4d9a-9b5c-cd76dac7f4e9 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:33:55.556499 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3125/6261] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:33:56.084993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:33:56.085681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:33:56.085681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:33:56.157932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] MFA Rules not processed for user `521136ba1dcc454292aaa65a23b2be68`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:33:56.159183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:33:56.499173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3137/6262] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:34:05.553055 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=40 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:06.463634 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=61,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:11.002974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:11.003504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:11.003504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:11.058557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:11.059808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:11.192005 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3126/6263] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:12.236094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:12.237718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:12.262636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30097f-bd86-411f-950e-448fc8a569ee None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:12.266926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:12.267741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:12.269475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:12.269994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:12.274997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:12.301932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:12.304403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:12.322769 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3138/6264] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:13.630986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:13.632529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:13.900220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200fc56-b427-4a0d-a963-4a6326052a12 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:13.925067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4101f-c9e7-4c0d-bf09-dbad153ee9d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:13.925728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4101f-c9e7-4c0d-bf09-dbad153ee9d0 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:13.926015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4101f-c9e7-4c0d-bf09-dbad153ee9d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:13.926292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4101f-c9e7-4c0d-bf09-dbad153ee9d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:13.931426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-91a4101f-c9e7-4c0d-bf09-dbad153ee9d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:13.989045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4101f-c9e7-4c0d-bf09-dbad153ee9d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:13.990699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4101f-c9e7-4c0d-bf09-dbad153ee9d0 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:14.046595 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3127/6265] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:14.071540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:14.075018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:14.159353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548306-354d-4229-a60b-14ff9b9f13df service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:14.184379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10e5cb-2152-47ae-981d-67b70a9b1bdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:14.185195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e5cb-2152-47ae-981d-67b70a9b1bdf service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:14.188355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e5cb-2152-47ae-981d-67b70a9b1bdf service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:14.188645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e5cb-2152-47ae-981d-67b70a9b1bdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:14.191036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1f10e5cb-2152-47ae-981d-67b70a9b1bdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:14.208418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c20fc-5ef6-4ef6-8e48-ea714f96252f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:14.208850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c20fc-5ef6-4ef6-8e48-ea714f96252f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:14.209095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c20fc-5ef6-4ef6-8e48-ea714f96252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:14.266307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10e5cb-2152-47ae-981d-67b70a9b1bdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:14.268194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10e5cb-2152-47ae-981d-67b70a9b1bdf service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:14.270129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c24c20fc-5ef6-4ef6-8e48-ea714f96252f None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:14.271437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c24c20fc-5ef6-4ef6-8e48-ea714f96252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:14.307892 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3139/6266] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:34:14.312456 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3128/6267] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:16.921016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34585a3-ba90-4a09-bb50-14b1b6b1c778 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:16.922117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34585a3-ba90-4a09-bb50-14b1b6b1c778 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:16.925543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34585a3-ba90-4a09-bb50-14b1b6b1c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:16.989426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d34585a3-ba90-4a09-bb50-14b1b6b1c778 None None] MFA Rules not processed for user `61445b694d0c484c99648ec99f21a34a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:16.991005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d34585a3-ba90-4a09-bb50-14b1b6b1c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:17.030013 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3140/6268] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:20.219749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c20fc-5ef6-4ef6-8e48-ea714f96252f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:20.454289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c20fc-5ef6-4ef6-8e48-ea714f96252f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:20.503413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:20.504138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:20.504449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:20.504728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] PATH_INFO: `/v3/users/b1011ffc3e6045cb88a5fa9d50cb2308` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:20.506006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1011ffc3e6045cb88a5fa9d50cb2308)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:20.508035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:20.597813 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:20.632650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1011ffc3e6045cb88a5fa9d50cb2308'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:20.650137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1011ffc3e6045cb88a5fa9d50cb2308'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:20.662641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1011ffc3e6045cb88a5fa9d50cb2308'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:20.695314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1011ffc3e6045cb88a5fa9d50cb2308'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:20.697217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1011ffc3e6045cb88a5fa9d50cb2308'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:20.774495 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3129/6269] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:34:20 2022] DELETE /identity/v3/users/b1011ffc3e6045cb88a5fa9d50cb2308 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:20.779837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:20.780716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:20.781415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:20.824571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:20.826124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:20.913166 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3141/6270] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:20.923570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:20.925089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:21.120032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79119c-298f-4323-b65f-8e8a558018f8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:21.130131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12704b1-df0a-40e0-b565-80ddd818b880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:21.130649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12704b1-df0a-40e0-b565-80ddd818b880 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:21.140949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12704b1-df0a-40e0-b565-80ddd818b880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:21.140949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12704b1-df0a-40e0-b565-80ddd818b880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:21.168801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12704b1-df0a-40e0-b565-80ddd818b880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:21.174393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12704b1-df0a-40e0-b565-80ddd818b880 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:21.236235 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3130/6271] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:22.371187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:22.373297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:22.393093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daed1a-7bfb-4379-8dcf-406b902ad532 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:22.404172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:22.405313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:22.405797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:22.406893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] PATH_INFO: `/v3/projects/eb1187aecbd3497c956af5fbc56faca0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:22.408860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1187aecbd3497c956af5fbc56faca0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:22.411368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:22.501082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1187aecbd3497c956af5fbc56faca0', 'request_id': 'req-924eeaff-2343-4deb-bf0f-1d9306c9d173'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:22.512003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1187aecbd3497c956af5fbc56faca0', 'request_id': 'req-924eeaff-2343-4deb-bf0f-1d9306c9d173'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:22.519707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1187aecbd3497c956af5fbc56faca0', 'request_id': 'req-924eeaff-2343-4deb-bf0f-1d9306c9d173'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:22.560410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] The token cache is being invalidate because project eb1187aecbd3497c956af5fbc56faca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:34:22.562013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:22.563499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-924eeaff-2343-4deb-bf0f-1d9306c9d173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:22.567817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3142/6272] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:34:22 2022] DELETE /identity/v3/projects/eb1187aecbd3497c956af5fbc56faca0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:22.572828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d1d9c-1608-4958-a808-7b66d0973ffe None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:22.576028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d1d9c-1608-4958-a808-7b66d0973ffe None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:22.578508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d1d9c-1608-4958-a808-7b66d0973ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:22.615747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7e3d1d9c-1608-4958-a808-7b66d0973ffe None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:22.617636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7e3d1d9c-1608-4958-a808-7b66d0973ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:22.784539 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3131/6273] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:34:22.787634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d837ef3-be08-4fe4-b6ce-105a2d8e04ed None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:22.787918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d837ef3-be08-4fe4-b6ce-105a2d8e04ed None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:22.788193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d837ef3-be08-4fe4-b6ce-105a2d8e04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:22.831042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5d837ef3-be08-4fe4-b6ce-105a2d8e04ed None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:22.832789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5d837ef3-be08-4fe4-b6ce-105a2d8e04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:22.846904 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3143/6274] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:22.850983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d1d9c-1608-4958-a808-7b66d0973ffe None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:22.876009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d1d9c-1608-4958-a808-7b66d0973ffe None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:22.891748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:22.892384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:22.892667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:22.892992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:22.893958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:34:22.893958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:22.895538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:22.927723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d837ef3-be08-4fe4-b6ce-105a2d8e04ed None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:22.934455 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3132/6275] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:34:22.938738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d837ef3-be08-4fe4-b6ce-105a2d8e04ed None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:22.948433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:22.949107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:22.949567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:22.949850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:22.950495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:22.955207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:23.013374 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3144/6276] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:22 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:23.017806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:23.032468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d2dc8-6dec-4f21-8d1f-e00c71f686d2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:23.098360 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:23.146423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:23.147081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:23.155239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:23.155575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:23.156225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:23.158275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:23.202600 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3133/6277] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:23 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:34:23.206580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:23.221285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27668875-9220-447f-85be-4e40397c69cf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:23.227788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:23.228536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:23.228836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:23.229119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:23.229782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:23.238798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:23.270186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:23.276643 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3145/6278] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:34:23.288881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063334-66ab-4666-9a42-e8353c41b025 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:23.304725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0250e-0ac1-482f-af33-06be1b5ffdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:23.320109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0250e-0ac1-482f-af33-06be1b5ffdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:23.320466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0250e-0ac1-482f-af33-06be1b5ffdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:23.320868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0250e-0ac1-482f-af33-06be1b5ffdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:23.321579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0250e-0ac1-482f-af33-06be1b5ffdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:23.323317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0250e-0ac1-482f-af33-06be1b5ffdb5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:23.361846 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3134/6279] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:23.365841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:23.379988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de595-1f8a-479d-88be-cf6939247c16 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:23.394192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:23.394892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:23.396209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:23.396499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] PATH_INFO: `/v3/projects/d4674aa49f94452e86836e93da116ad4/users/c80181e6d7df40bba3630905dbac9d2d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:23.418990 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:23.441003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4674aa49f94452e86836e93da116ad4, user_id=c80181e6d7df40bba3630905dbac9d2d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:23.454091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:23.498801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f928-2ab6-42cd-88d6-0280116781f2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:23.499174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f928-2ab6-42cd-88d6-0280116781f2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:23.499366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f928-2ab6-42cd-88d6-0280116781f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:23.502278 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3146/6280] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:23 2022] PUT /identity/v3/projects/d4674aa49f94452e86836e93da116ad4/users/c80181e6d7df40bba3630905dbac9d2d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:23.586177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a9a8f928-2ab6-42cd-88d6-0280116781f2 None None] MFA Rules not processed for user `c80181e6d7df40bba3630905dbac9d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:23.588225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a9a8f928-2ab6-42cd-88d6-0280116781f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:23.717527 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3135/6281] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:23.721656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:23.815185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312a560-1e21-4f9d-9b4b-6a96916fd439 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:23.820893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:23.821788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:23.822123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:23.822404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:23.823176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:23.825097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:23.891815 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3147/6282] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:23 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:23.895998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f928-2ab6-42cd-88d6-0280116781f2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:23.922010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f928-2ab6-42cd-88d6-0280116781f2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:24.065361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:24.065990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:24.066273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:24.066547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:24.067193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:24.073436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:24.226413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3136/6283] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:23 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:24.227596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:24.262326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078ed8-2a6f-4ca0-a3c9-3f71181e6fd2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:24.287497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:24.288293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:24.288569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:24.289983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:24.291268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:24.296265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:24.313017 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3148/6284] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:24.318093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:24.332492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532818ce-d83f-417a-a6ba-eaa82c0f8ab2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:24.338089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:24.338921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:24.339482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:24.339769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] PATH_INFO: `/v3/projects/dabe8ea372ed4a92bb65d9ef5ec6f7ab/users/c9ca9cd21177404c823b21d1fea42b83/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:24.384708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabe8ea372ed4a92bb65d9ef5ec6f7ab, user_id=c9ca9cd21177404c823b21d1fea42b83, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:24.398461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:24.426140 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3137/6285] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:24 2022] PUT /identity/v3/projects/dabe8ea372ed4a92bb65d9ef5ec6f7ab/users/c9ca9cd21177404c823b21d1fea42b83/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:24.431284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:24.460826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f6fb-5d62-4d73-aad5-96e966b8ecc2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:24.632175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940cd5c-a1cf-4a68-b04c-1972415f6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:24.633917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940cd5c-a1cf-4a68-b04c-1972415f6c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:24.634219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940cd5c-a1cf-4a68-b04c-1972415f6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:24.634494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940cd5c-a1cf-4a68-b04c-1972415f6c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:24.635257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940cd5c-a1cf-4a68-b04c-1972415f6c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:24.639878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940cd5c-a1cf-4a68-b04c-1972415f6c5f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:24.664146 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3149/6286] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:24.666315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:24.702313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56a4fd-291e-4860-aeba-74e1a9df5de4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:24.720084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:24.720806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:24.722249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:24.722532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] PATH_INFO: `/v3/projects/dabe8ea372ed4a92bb65d9ef5ec6f7ab/users/c9ca9cd21177404c823b21d1fea42b83/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:24.726412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabe8ea372ed4a92bb65d9ef5ec6f7ab, user_id=c9ca9cd21177404c823b21d1fea42b83, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:24.731139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:24.746662 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:24.760802 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3138/6287] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:24 2022] PUT /identity/v3/projects/dabe8ea372ed4a92bb65d9ef5ec6f7ab/users/c9ca9cd21177404c823b21d1fea42b83/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:24.772438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:24.772728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:24.774030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:24.841609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] MFA Rules not processed for user `c9ca9cd21177404c823b21d1fea42b83`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:24.845849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:24.976113 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:25.109895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3150/6288] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:25.137886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:25.139696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:25.354447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7e92-b4ba-4d4d-b0fe-c78ed53c2813 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:25.367603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:25.371043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:25.371417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:25.371718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:25.409695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:25.420364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:25.458551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:25.460553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:25.474402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3139/6289] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:25.654758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe897e-54c7-49bb-b56b-db23283e6a88 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:25.662196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:25.662854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:25.664341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:25.664626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] PATH_INFO: `/v3/users/c274a0f62fc64f80ac6be67798ee80df` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:25.668259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c274a0f62fc64f80ac6be67798ee80df)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:25.680856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:25.694619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:25.715453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cecdd-0222-4196-81cb-ec4daf8bd6b1 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:25.731082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd5ea-64c0-41d8-9c87-104542f3e3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:25.731722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd5ea-64c0-41d8-9c87-104542f3e3fe service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:25.732002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd5ea-64c0-41d8-9c87-104542f3e3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:25.732277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd5ea-64c0-41d8-9c87-104542f3e3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:25.818654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c274a0f62fc64f80ac6be67798ee80df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:25.845353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c274a0f62fc64f80ac6be67798ee80df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:25.893112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c274a0f62fc64f80ac6be67798ee80df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:25.898404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd5ea-64c0-41d8-9c87-104542f3e3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:25.899077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c274a0f62fc64f80ac6be67798ee80df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:25.899936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd5ea-64c0-41d8-9c87-104542f3e3fe service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:25.923023 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3140/6290] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:25.932257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c274a0f62fc64f80ac6be67798ee80df'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:25.960404 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3151/6291] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:34:25 2022] DELETE /identity/v3/users/c274a0f62fc64f80ac6be67798ee80df => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:34:25.965577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:25.965919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:25.966289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:26.019944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:26.024994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:26.278724 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3141/6292] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:34:26.289314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:26.291075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:26.503443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167451a-7702-4463-afc5-5f5a3e87660f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:26.513188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59e7b1-480b-4534-924a-fa50b17ff454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:26.513914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59e7b1-480b-4534-924a-fa50b17ff454 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:26.514189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59e7b1-480b-4534-924a-fa50b17ff454 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:26.514455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59e7b1-480b-4534-924a-fa50b17ff454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:26.541564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59e7b1-480b-4534-924a-fa50b17ff454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:26.543100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59e7b1-480b-4534-924a-fa50b17ff454 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:26.569829 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3152/6293] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:27.407020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:27.408903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:27.451405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee35e48-8c8f-4b83-88f0-0d6abdd965a0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:27.465215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:27.466048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:27.469090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:27.469765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] PATH_INFO: `/v3/projects/d2931812ddae43f49bfe7332d9d861e1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:27.474611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2931812ddae43f49bfe7332d9d861e1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:27.482155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:27.605914 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:27.634542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2931812ddae43f49bfe7332d9d861e1', 'request_id': 'req-43a1810b-0979-4645-bd57-6c840fbb0fe9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:27.655589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2931812ddae43f49bfe7332d9d861e1', 'request_id': 'req-43a1810b-0979-4645-bd57-6c840fbb0fe9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:27.671226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2931812ddae43f49bfe7332d9d861e1', 'request_id': 'req-43a1810b-0979-4645-bd57-6c840fbb0fe9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:27.702776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] The token cache is being invalidate because project d2931812ddae43f49bfe7332d9d861e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:34:27.703113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:27.703872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43a1810b-0979-4645-bd57-6c840fbb0fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:27.705631 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3142/6294] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:34:27 2022] DELETE /identity/v3/projects/d2931812ddae43f49bfe7332d9d861e1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:27.710678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da9fa-9df5-4014-8c83-453018b6966d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:27.711648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da9fa-9df5-4014-8c83-453018b6966d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:27.712054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da9fa-9df5-4014-8c83-453018b6966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:27.727496 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:27.761580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6a6da9fa-9df5-4014-8c83-453018b6966d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:27.768523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6a6da9fa-9df5-4014-8c83-453018b6966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:27.928268 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3153/6295] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:27.929293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a23c-add9-47f8-a588-e09a43d098a4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:27.929827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a23c-add9-47f8-a588-e09a43d098a4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:27.930312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a23c-add9-47f8-a588-e09a43d098a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:27.977224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f480a23c-add9-47f8-a588-e09a43d098a4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:27.987956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f480a23c-add9-47f8-a588-e09a43d098a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:28.011766 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3143/6296] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:28.017106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da9fa-9df5-4014-8c83-453018b6966d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:28.036262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da9fa-9df5-4014-8c83-453018b6966d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:28.062461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:28.063243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:28.070291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:28.070579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:28.071307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:34:28.071622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:28.073364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:28.113564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3154/6297] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:34:28.117702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480a23c-add9-47f8-a588-e09a43d098a4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:28.133460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480a23c-add9-47f8-a588-e09a43d098a4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:28.143672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:28.144262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:28.144547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:28.145000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:28.145670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:28.148684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:28.218755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:28.219835 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3144/6298] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:28 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:28.242139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a32ac-3a7e-4ce0-9446-0d13842c5088 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:28.437035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:28.437667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:28.437950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:28.438231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:28.438860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:28.446212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:28.562130 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3155/6299] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:28 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:34:28.566061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:28.579028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620259-8e8e-494e-b7cc-1b02ac02d7db admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:28.595204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:28.596116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:28.596633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:28.597074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:28.597938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:28.602657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:28.632565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3145/6300] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:28.636575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:28.673515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6135c4-ec58-462d-8df2-2976fd5f7ffa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:28.689438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5918593-00c9-496a-bb12-259f645421c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:28.690089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5918593-00c9-496a-bb12-259f645421c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:28.690372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5918593-00c9-496a-bb12-259f645421c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:28.690649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5918593-00c9-496a-bb12-259f645421c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:28.691608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5918593-00c9-496a-bb12-259f645421c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:28.693327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5918593-00c9-496a-bb12-259f645421c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:28.720834 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3156/6301] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:28.724687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:28.749553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab59f-b27a-47db-897a-061c5b4cb7ed admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:28.768137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:28.769125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:28.769410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:28.769690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] PATH_INFO: `/v3/projects/5277f6e2766340489a48f564963a5cb4/users/b22431e142c9473c92412051b1b5eeca/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:28.804946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5277f6e2766340489a48f564963a5cb4, user_id=b22431e142c9473c92412051b1b5eeca, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:28.809055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:28.872270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8357e-1942-4dcd-a023-e402c97e652e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:28.872563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8357e-1942-4dcd-a023-e402c97e652e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:28.872989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8357e-1942-4dcd-a023-e402c97e652e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:28.873320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3146/6302] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:28 2022] PUT /identity/v3/projects/5277f6e2766340489a48f564963a5cb4/users/b22431e142c9473c92412051b1b5eeca/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:28.930206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3fb8357e-1942-4dcd-a023-e402c97e652e None None] MFA Rules not processed for user `b22431e142c9473c92412051b1b5eeca`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:28.933086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3fb8357e-1942-4dcd-a023-e402c97e652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:29.104810 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:29.215890 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3157/6303] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:34:29.220588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:29.406230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fef56-126a-4ed6-9969-59410b69281b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:29.415032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:29.416919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:29.417415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:29.417989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:29.418697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:29.423449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:29.519664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8357e-1942-4dcd-a023-e402c97e652e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:29.527512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3147/6304] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:29 2022] POST /identity/v3/projects => generated 385 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:29.539001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8357e-1942-4dcd-a023-e402c97e652e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:29.755495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:29.757077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:29.757406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:29.758665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:29.760072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:29.762640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:29.811541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:29.820398 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3158/6305] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:29 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:29.834565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954cf7e-2845-414b-9210-cc6f4b324001 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:29.882453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:29.885905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:29.888212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:29.896333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:29.897510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:29.899334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:29.945774 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3148/6306] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:29.946520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:29.963442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e72df-4e42-4716-973a-55c19242ef03 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:29.974267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea577cd5-85d7-4d78-ad5a-6d998746f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:29.979015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea577cd5-85d7-4d78-ad5a-6d998746f1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:29.979444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea577cd5-85d7-4d78-ad5a-6d998746f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:29.979851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea577cd5-85d7-4d78-ad5a-6d998746f1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:29.980643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea577cd5-85d7-4d78-ad5a-6d998746f1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:29.983224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea577cd5-85d7-4d78-ad5a-6d998746f1a6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:30.019547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:30.019758 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3159/6307] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:30.033626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a14201-05c6-45ca-a201-ee3a0d9ac830 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:30.048499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:30.049505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:30.049961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:30.050410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] PATH_INFO: `/v3/projects/0a6bbdff94ae4e33a3e6b04ebc7bb9d9/users/9265e5333bc1435880a04034c32909de/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:30.085875 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:30.093772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6bbdff94ae4e33a3e6b04ebc7bb9d9, user_id=9265e5333bc1435880a04034c32909de, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:30.096480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:30.129157 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3149/6308] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:30 2022] PUT /identity/v3/projects/0a6bbdff94ae4e33a3e6b04ebc7bb9d9/users/9265e5333bc1435880a04034c32909de/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:30.138921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3e526-d33b-4772-8729-cc637ed0b340 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:30.139430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3e526-d33b-4772-8729-cc637ed0b340 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:30.139764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3e526-d33b-4772-8729-cc637ed0b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:30.200206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8ac3e526-d33b-4772-8729-cc637ed0b340 None None] MFA Rules not processed for user `9265e5333bc1435880a04034c32909de`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:30.202339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8ac3e526-d33b-4772-8729-cc637ed0b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:30.362272 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3160/6309] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:30.366847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:30.512062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f59e-99be-4258-be02-04d43c7a185f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:30.522223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:30.522864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:30.523147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:30.523423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:30.524062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:30.526742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:30.577749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3150/6310] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:30 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:34:30.582259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3e526-d33b-4772-8729-cc637ed0b340 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:30.618720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3e526-d33b-4772-8729-cc637ed0b340 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:30.685924 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:30.733526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:30.734953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:30.735239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:30.735511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:30.736175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:30.755817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:30.820634 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3161/6311] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:30 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:30.824050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:30.854975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674a0a3-d978-4f0d-ad8b-7f6a5e31b868 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:30.861532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:30.862495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:30.863206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:30.863495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:30.864249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:30.873642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:30.913889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:30.914121 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3151/6312] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:30.937086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5458f5-385c-46fc-b745-22df88fd454e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:30.952217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:30.957432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:30.957784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:30.958705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] PATH_INFO: `/v3/projects/2d2bae7da2aa45f7b34d8e3b022de9a1/users/561d8a016df74c90a374ceab8489b076/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:30.995504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2bae7da2aa45f7b34d8e3b022de9a1, user_id=561d8a016df74c90a374ceab8489b076, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:30.998418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:31.025325 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3162/6313] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:30 2022] PUT /identity/v3/projects/2d2bae7da2aa45f7b34d8e3b022de9a1/users/561d8a016df74c90a374ceab8489b076/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:31.029211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:31.043735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085c980-3944-4f82-8de0-d8de1934021e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:31.182600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a60f5-e0ef-40eb-a671-0f6f236c06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:31.183502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a60f5-e0ef-40eb-a671-0f6f236c06a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:31.183787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a60f5-e0ef-40eb-a671-0f6f236c06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:31.184072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a60f5-e0ef-40eb-a671-0f6f236c06a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:31.185367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a60f5-e0ef-40eb-a671-0f6f236c06a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:31.190920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a60f5-e0ef-40eb-a671-0f6f236c06a4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:31.215308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:31.215893 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3152/6314] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:31.231505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c408b1-bf23-4dce-b449-45b08a2a2969 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:31.246456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:31.247148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:31.247425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:31.247698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] PATH_INFO: `/v3/projects/2d2bae7da2aa45f7b34d8e3b022de9a1/users/561d8a016df74c90a374ceab8489b076/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:31.249966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2bae7da2aa45f7b34d8e3b022de9a1, user_id=561d8a016df74c90a374ceab8489b076, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:31.252621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:31.281666 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3163/6315] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:31 2022] PUT /identity/v3/projects/2d2bae7da2aa45f7b34d8e3b022de9a1/users/561d8a016df74c90a374ceab8489b076/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:31.293105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0cd32-2587-4dd1-8527-c14312bed372 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:31.293475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0cd32-2587-4dd1-8527-c14312bed372 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:31.293827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0cd32-2587-4dd1-8527-c14312bed372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:31.360030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-66c0cd32-2587-4dd1-8527-c14312bed372 None None] MFA Rules not processed for user `561d8a016df74c90a374ceab8489b076`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:31.361951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66c0cd32-2587-4dd1-8527-c14312bed372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:31.431344 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:31.463724 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3153/6316] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:31.479116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:31.482348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:31.658109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c347d-641d-4c2a-b4c3-d01c592a8535 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:31.668691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:31.669700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:31.669979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:31.670251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:31.802353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:31.804361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:31.826207 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3164/6317] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:33.302409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:33.302877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:33.302949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:33.353521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:33.353521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:33.551596 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3154/6318] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:33.561364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:33.563623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:33.685797 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:33.766256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd0027-13f0-4ef9-9017-f860d74bad3e service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:33.778314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:33.779102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:33.779676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:33.780149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:33.800812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:33.807783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:33.886669 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3165/6319] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:34:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:34.984744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:34.985805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:35.008100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615683b4-07a8-4cfc-ace6-01f8125a4999 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:35.019326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:35.020467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:35.021126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:35.021601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:35.197812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:35.198967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:35.216970 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3155/6320] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:36.534608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:36.553775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c540c9-9ccd-45ae-9bf1-e8f2cb94b96a service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:36.580410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:36.585492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:36.589150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:36.590054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:36.633543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:36.643411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:36.677300 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3166/6321] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:40.715948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:40.718152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:40.926848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:40.929010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:40.958590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5509641-d395-4955-ad5c-dc2c02a0b584 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:40.980325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f16f1-7313-4178-89de-04ccf08d22d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:40.981285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f16f1-7313-4178-89de-04ccf08d22d7 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:40.981932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f16f1-7313-4178-89de-04ccf08d22d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:40.982341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f16f1-7313-4178-89de-04ccf08d22d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:40.994620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-945f16f1-7313-4178-89de-04ccf08d22d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:41.032363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f16f1-7313-4178-89de-04ccf08d22d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:41.035253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f16f1-7313-4178-89de-04ccf08d22d7 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:41.075340 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3156/6322] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:41.103295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149229-c98f-4b96-9940-e575cb6d8bc6 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:41.113414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:41.114385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:41.114930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:41.115410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] PATH_INFO: `/v3/users/de660ed43ffe4456aae3ac3262602b9e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:41.118755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de660ed43ffe4456aae3ac3262602b9e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:41.125861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:41.273140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de660ed43ffe4456aae3ac3262602b9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:41.292582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de660ed43ffe4456aae3ac3262602b9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:41.320373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de660ed43ffe4456aae3ac3262602b9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:41.323403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de660ed43ffe4456aae3ac3262602b9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:41.340784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de660ed43ffe4456aae3ac3262602b9e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:41.362724 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3167/6323] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:34:40 2022] DELETE /identity/v3/users/de660ed43ffe4456aae3ac3262602b9e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:41.941532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:41.942092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:41.942843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:42.015077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:42.016345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:42.068175 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:42.081851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:42.083552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:42.148057 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:42.247170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf7dc-d2cf-4c68-be2c-62b52984628a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:42.260893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ab2a1-945e-45e9-9ea4-23aed6240791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:42.263895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab2a1-945e-45e9-9ea4-23aed6240791 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:42.265133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab2a1-945e-45e9-9ea4-23aed6240791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:42.265562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab2a1-945e-45e9-9ea4-23aed6240791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:42.289059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-899ab2a1-945e-45e9-9ea4-23aed6240791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:42.301367 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3157/6324] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:42.318143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:42.319774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:42.644434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd0dc-5fd8-4f14-8a09-7c728b3df354 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:42.647193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ab2a1-945e-45e9-9ea4-23aed6240791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:42.651190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ab2a1-945e-45e9-9ea4-23aed6240791 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:42.652066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:42.653443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:42.657540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:42.657972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] PATH_INFO: `/v3/projects/733c772be3394dc98abd7d2f740ec890` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:42.659634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] RBAC: Authorizing `identity:delete_project(project_id=733c772be3394dc98abd7d2f740ec890)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:42.661705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:42.700091 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3168/6325] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:42.831169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733c772be3394dc98abd7d2f740ec890', 'request_id': 'req-56e7f565-a179-4a6f-ab01-07cdb54e438d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:42.854716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733c772be3394dc98abd7d2f740ec890', 'request_id': 'req-56e7f565-a179-4a6f-ab01-07cdb54e438d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:42.865950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733c772be3394dc98abd7d2f740ec890', 'request_id': 'req-56e7f565-a179-4a6f-ab01-07cdb54e438d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:42.884374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] The token cache is being invalidate because project 733c772be3394dc98abd7d2f740ec890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:34:42.884693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:42.886425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56e7f565-a179-4a6f-ab01-07cdb54e438d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:42.892433 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3158/6326] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:34:42 2022] DELETE /identity/v3/projects/733c772be3394dc98abd7d2f740ec890 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:42.894667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00654f4a-4020-45f5-9f33-36ed34d0270a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:42.900633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00654f4a-4020-45f5-9f33-36ed34d0270a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:42.901087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00654f4a-4020-45f5-9f33-36ed34d0270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:42.970082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-00654f4a-4020-45f5-9f33-36ed34d0270a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:42.971436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00654f4a-4020-45f5-9f33-36ed34d0270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:43.154701 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3169/6327] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:43.166363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d4e5-31aa-494e-8aac-e86d1ad20057 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:43.167274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d4e5-31aa-494e-8aac-e86d1ad20057 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:43.167749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d4e5-31aa-494e-8aac-e86d1ad20057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:43.211363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-44b9d4e5-31aa-494e-8aac-e86d1ad20057 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:43.213158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-44b9d4e5-31aa-494e-8aac-e86d1ad20057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:43.275211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00654f4a-4020-45f5-9f33-36ed34d0270a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:43.279568 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3159/6328] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:43.294412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00654f4a-4020-45f5-9f33-36ed34d0270a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:43.346104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:43.349066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:43.349581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:43.350033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:43.352280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:34:43.355226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:43.360245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:43.419021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9d4e5-31aa-494e-8aac-e86d1ad20057 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:43.420934 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3170/6329] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:34:43.458258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9d4e5-31aa-494e-8aac-e86d1ad20057 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:43.468220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:43.469107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:43.469448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:43.469780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:43.470494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:43.472838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:43.539790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:43.540310 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3160/6330] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:43 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:43.571936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf30e2-91ab-43f4-aed8-f402f0455ff2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:43.792539 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:43.858415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:43.864141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:43.864557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:43.864860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:43.865550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:43.870616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:43.992135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:44.014551 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3171/6331] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:43 2022] POST /identity/v3/users => generated 289 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:44.030528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9c8b6-ccb6-4163-ae33-c9e22c070b54 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:44.061449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:44.065767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:44.067237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:44.067652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:44.076852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:44.079135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:44.125174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3161/6332] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:44.156147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:44.199367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101aa0-d8e4-4de1-afbf-1de70bce2661 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:44.223714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:44.225572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:44.229372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:44.231052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:44.232527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:44.246416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:44.329611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:44.334709 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3172/6333] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:44.358568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb196-3c2e-4b8b-9f1b-228301a6b604 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:44.412497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5480a-e037-4e56-bf87-522acca501ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:44.413227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5480a-e037-4e56-bf87-522acca501ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:44.413512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5480a-e037-4e56-bf87-522acca501ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:44.413794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5480a-e037-4e56-bf87-522acca501ff admin admin] PATH_INFO: `/v3/projects/76d56e2bfa63474bb0446ab2083ef4b8/users/8a3e2c3763a5402bae24f2d672733ff6/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:44.425798 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:44.476094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:44.479081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:44.492078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5480a-e037-4e56-bf87-522acca501ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d56e2bfa63474bb0446ab2083ef4b8, user_id=8a3e2c3763a5402bae24f2d672733ff6, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:44.497419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5480a-e037-4e56-bf87-522acca501ff admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:44.551889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de35a05-34b2-4753-bc3b-70d58bc5622c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:44.566642 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3162/6334] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:44 2022] PUT /identity/v3/projects/76d56e2bfa63474bb0446ab2083ef4b8/users/8a3e2c3763a5402bae24f2d672733ff6/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:44.584384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:44.584670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:44.585006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:44.674377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] MFA Rules not processed for user `8a3e2c3763a5402bae24f2d672733ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:44.675649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:44.704911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:44.705676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:44.705842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:44.706129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] PATH_INFO: `/v3/users/f0524cc60bd640ca9ae88845970eb013` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:44.708103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0524cc60bd640ca9ae88845970eb013)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:44.714694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:44.916473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0524cc60bd640ca9ae88845970eb013'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:44.923170 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3163/6335] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:34:44.956244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0524cc60bd640ca9ae88845970eb013'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:44.969226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:44.973567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0524cc60bd640ca9ae88845970eb013'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:44.976290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0524cc60bd640ca9ae88845970eb013'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:44.976609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:44.992819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0524cc60bd640ca9ae88845970eb013'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:45.006137 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3173/6336] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:34:44 2022] DELETE /identity/v3/users/f0524cc60bd640ca9ae88845970eb013 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:45.186752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0040dd-3572-4137-8d2d-d875ec750fd6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:45.391622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738f879-c7cf-4f1c-9dac-7073067f69af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:45.393474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738f879-c7cf-4f1c-9dac-7073067f69af service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:45.393474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738f879-c7cf-4f1c-9dac-7073067f69af service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:45.393474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738f879-c7cf-4f1c-9dac-7073067f69af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:45.401967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9738f879-c7cf-4f1c-9dac-7073067f69af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:45.617351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:45.622282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:45.642997 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:45.677828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738f879-c7cf-4f1c-9dac-7073067f69af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:45.680511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738f879-c7cf-4f1c-9dac-7073067f69af service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:45.708345 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3164/6337] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:45.809646 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:45.847737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81ec70-560c-4c62-ad7d-3b7c33e20317 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:45.872482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:45.877804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:45.878085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:45.881412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] PATH_INFO: `/v3/projects/c92a6cc6152c46bb982b30251f7aad18` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:45.894960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92a6cc6152c46bb982b30251f7aad18)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:45.904226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:46.038462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92a6cc6152c46bb982b30251f7aad18', 'request_id': 'req-7350927e-c02e-4377-9544-38dfc336706a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:46.047046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92a6cc6152c46bb982b30251f7aad18', 'request_id': 'req-7350927e-c02e-4377-9544-38dfc336706a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:46.061999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92a6cc6152c46bb982b30251f7aad18', 'request_id': 'req-7350927e-c02e-4377-9544-38dfc336706a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:46.111751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] The token cache is being invalidate because project c92a6cc6152c46bb982b30251f7aad18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:34:46.112355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:46.116336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7350927e-c02e-4377-9544-38dfc336706a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:46.123413 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3174/6338] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:34:45 2022] DELETE /identity/v3/projects/c92a6cc6152c46bb982b30251f7aad18 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:34:46.129307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f890-46e4-401c-a843-e24dd7d49c87 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:46.129601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f890-46e4-401c-a843-e24dd7d49c87 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:46.129906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f890-46e4-401c-a843-e24dd7d49c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:46.151301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b7c9f890-46e4-401c-a843-e24dd7d49c87 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:46.152507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7c9f890-46e4-401c-a843-e24dd7d49c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:46.258336 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3165/6339] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:46.289935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a84cd-d8b1-4092-b657-ff5523803584 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:46.290252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a84cd-d8b1-4092-b657-ff5523803584 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:46.291406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a84cd-d8b1-4092-b657-ff5523803584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:46.344731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-502a84cd-d8b1-4092-b657-ff5523803584 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:46.351315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-502a84cd-d8b1-4092-b657-ff5523803584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:46.402713 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3175/6340] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:46.410793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9f890-46e4-401c-a843-e24dd7d49c87 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:46.456203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9f890-46e4-401c-a843-e24dd7d49c87 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:46.496365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:46.500281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:46.501075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:46.501639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:46.503832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:34:46.504281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:46.506242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:46.523991 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3166/6341] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:34:46.528288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a84cd-d8b1-4092-b657-ff5523803584 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:46.538664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a84cd-d8b1-4092-b657-ff5523803584 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:46.553072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:46.553815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:46.554097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:46.554368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:46.555003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:46.561609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:46.619902 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3176/6342] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:46 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:46.623011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:46.666780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a3ed-c4a3-499c-80fe-898edd73ed37 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:46.849912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:46.850532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:46.850814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:46.851086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:46.851714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:46.853987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:46.929030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3167/6343] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:46 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:46.932467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:46.944549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e6974-9e0b-48ee-aab1-60c76117eeb0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:46.967164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:46.968179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:46.968635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:46.969101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:46.969938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:46.971730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:46.988952 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3177/6344] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:34:46.993231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:47.010454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d5ab0-9dab-4883-8a19-a6d0304feae4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:47.021968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af50b23-9778-4ba5-ba13-406ab8d9fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:47.022732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af50b23-9778-4ba5-ba13-406ab8d9fcfd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:47.023113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af50b23-9778-4ba5-ba13-406ab8d9fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:47.023634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af50b23-9778-4ba5-ba13-406ab8d9fcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:47.024366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af50b23-9778-4ba5-ba13-406ab8d9fcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:47.026358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af50b23-9778-4ba5-ba13-406ab8d9fcfd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:47.059892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:47.060464 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3168/6345] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:47.072508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786165e-c885-4b6a-8062-75e5c17c0ff5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:47.089148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:47.089928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:47.090273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:47.090716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] PATH_INFO: `/v3/projects/7dfc30c18e4d4e77b1d4f74d93bfea72/users/635af5d1326c411cadd6b2c1eac70f96/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:47.125701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfc30c18e4d4e77b1d4f74d93bfea72, user_id=635af5d1326c411cadd6b2c1eac70f96, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:47.128664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:47.168333 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3178/6346] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:47 2022] PUT /identity/v3/projects/7dfc30c18e4d4e77b1d4f74d93bfea72/users/635af5d1326c411cadd6b2c1eac70f96/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:47.171440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:47.171440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:47.171440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:47.243560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] MFA Rules not processed for user `635af5d1326c411cadd6b2c1eac70f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:47.246562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:47.444700 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:47.513328 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3169/6347] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:47.537602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:47.539474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:47.693199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7601fce-1bb4-4cc8-b449-4765852fc9e4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:47.707042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0320-2388-494a-9e62-a739834eeb6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:47.707674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0320-2388-494a-9e62-a739834eeb6a service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:47.708627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0320-2388-494a-9e62-a739834eeb6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:47.708949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0320-2388-494a-9e62-a739834eeb6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:47.744751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0320-2388-494a-9e62-a739834eeb6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:47.751682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0320-2388-494a-9e62-a739834eeb6a service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:47.778162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3179/6348] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:34:51.162611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:51.164360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:51.410165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707b557-26c3-450a-a59d-10703cfd2550 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:51.427235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:51.428531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:51.428980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:51.429382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] PATH_INFO: `/v3/users/b22431e142c9473c92412051b1b5eeca` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:51.433800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22431e142c9473c92412051b1b5eeca)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:51.436048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:51.617350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22431e142c9473c92412051b1b5eeca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:51.634960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22431e142c9473c92412051b1b5eeca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:51.639168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22431e142c9473c92412051b1b5eeca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:51.665968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22431e142c9473c92412051b1b5eeca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:51.668331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22431e142c9473c92412051b1b5eeca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:51.741127 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3170/6349] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:34:51 2022] DELETE /identity/v3/users/b22431e142c9473c92412051b1b5eeca => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:51.743615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:51.744072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:51.744072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:51.785333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:51.786900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:51.818913 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:51.991972 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3180/6350] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:52.001930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:52.004173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:52.181794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6853265-92d0-4987-9b68-2acbf03de450 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:52.193095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:52.196057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:52.197926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:52.198225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:52.224513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:52.228109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:52.260663 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3171/6351] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:34:52.845572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:52.847747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:52.868945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad34fa-a669-49e5-97e0-a5709364d163 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:52.875952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:52.877322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:52.877605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:52.878123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] PATH_INFO: `/v3/projects/5277f6e2766340489a48f564963a5cb4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:52.879723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5277f6e2766340489a48f564963a5cb4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:52.883587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:52.955777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5277f6e2766340489a48f564963a5cb4', 'request_id': 'req-bb8a9709-bc6e-46be-a07f-aee63134fc01'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:52.985328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5277f6e2766340489a48f564963a5cb4', 'request_id': 'req-bb8a9709-bc6e-46be-a07f-aee63134fc01'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:52.994145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5277f6e2766340489a48f564963a5cb4', 'request_id': 'req-bb8a9709-bc6e-46be-a07f-aee63134fc01'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.014046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] The token cache is being invalidate because project 5277f6e2766340489a48f564963a5cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:34:53.014240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.014951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.017133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3181/6352] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:34:52 2022] DELETE /identity/v3/projects/5277f6e2766340489a48f564963a5cb4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:53.021348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:53.027086 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:53.052310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029b38-ecaa-4ae7-9d88-b4c061514f12 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:53.243180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:53.244531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:53.244840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:53.245115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] PATH_INFO: `/v3/users/9265e5333bc1435880a04034c32909de` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:53.246340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9265e5333bc1435880a04034c32909de)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:53.248305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:53.375034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9265e5333bc1435880a04034c32909de'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.396242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9265e5333bc1435880a04034c32909de'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.397354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9265e5333bc1435880a04034c32909de'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.408920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9265e5333bc1435880a04034c32909de'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.409857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9265e5333bc1435880a04034c32909de'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:53.468987 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3172/6353] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:34:53 2022] DELETE /identity/v3/users/9265e5333bc1435880a04034c32909de => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:53.849535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:53.851396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:53.890339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9709-bc6e-46be-a07f-aee63134fc01 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:54.045864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:54.046552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:54.046943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:54.047264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] PATH_INFO: `/v3/projects/0a6bbdff94ae4e33a3e6b04ebc7bb9d9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:54.048449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6bbdff94ae4e33a3e6b04ebc7bb9d9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:54.070861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:54.226808 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:54.241413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6bbdff94ae4e33a3e6b04ebc7bb9d9', 'request_id': 'req-cdae338f-e7fd-4719-a052-99e6cff51250'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.263585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6bbdff94ae4e33a3e6b04ebc7bb9d9', 'request_id': 'req-cdae338f-e7fd-4719-a052-99e6cff51250'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.277004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6bbdff94ae4e33a3e6b04ebc7bb9d9', 'request_id': 'req-cdae338f-e7fd-4719-a052-99e6cff51250'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.320571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] The token cache is being invalidate because project 0a6bbdff94ae4e33a3e6b04ebc7bb9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:34:54.326143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.328299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.333004 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3182/6354] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:34:53 2022] DELETE /identity/v3/projects/0a6bbdff94ae4e33a3e6b04ebc7bb9d9 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:54.337576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:54.341372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:54.373315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfce51-309d-4758-8e46-3f7b2cacd768 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:54.585195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:54.586772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:54.586934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:54.587365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] PATH_INFO: `/v3/users/561d8a016df74c90a374ceab8489b076` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:54.588900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561d8a016df74c90a374ceab8489b076)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:54.596120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:54.668108 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:54.726174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561d8a016df74c90a374ceab8489b076'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.736674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561d8a016df74c90a374ceab8489b076'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.737594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561d8a016df74c90a374ceab8489b076'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.749818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561d8a016df74c90a374ceab8489b076'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.750423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b28d196-3b16-4816-8f4f-a398e9a9fb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561d8a016df74c90a374ceab8489b076'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:54.776292 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3173/6355] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:34:54 2022] DELETE /identity/v3/users/561d8a016df74c90a374ceab8489b076 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:55.125219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:55.148565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:55.165744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae338f-e7fd-4719-a052-99e6cff51250 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:55.245757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:55.246408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:55.247297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:55.247297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] PATH_INFO: `/v3/projects/2d2bae7da2aa45f7b34d8e3b022de9a1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:55.248198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2bae7da2aa45f7b34d8e3b022de9a1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:55.250752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:55.327777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2bae7da2aa45f7b34d8e3b022de9a1', 'request_id': 'req-45279062-3bbe-433a-a3cc-8747771d1af5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:55.335530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2bae7da2aa45f7b34d8e3b022de9a1', 'request_id': 'req-45279062-3bbe-433a-a3cc-8747771d1af5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:55.343655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2bae7da2aa45f7b34d8e3b022de9a1', 'request_id': 'req-45279062-3bbe-433a-a3cc-8747771d1af5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:55.385213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] The token cache is being invalidate because project 2d2bae7da2aa45f7b34d8e3b022de9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:34:55.385520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:55.388647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-45279062-3bbe-433a-a3cc-8747771d1af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:34:55.390519 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3183/6356] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:34:55 2022] DELETE /identity/v3/projects/2d2bae7da2aa45f7b34d8e3b022de9a1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:34:55.398201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e1e9-86e2-4971-a671-eca4aa56f1fc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:55.398201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e1e9-86e2-4971-a671-eca4aa56f1fc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:55.399682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e1e9-86e2-4971-a671-eca4aa56f1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:55.427847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b7a2e1e9-86e2-4971-a671-eca4aa56f1fc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:55.429420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7a2e1e9-86e2-4971-a671-eca4aa56f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:55.512444 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3174/6357] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:55.522703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c1b3b-a429-4135-9218-03f3ef017efb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:55.523210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c1b3b-a429-4135-9218-03f3ef017efb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:55.523375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c1b3b-a429-4135-9218-03f3ef017efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:55.553064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2d5c1b3b-a429-4135-9218-03f3ef017efb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:55.557818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2d5c1b3b-a429-4135-9218-03f3ef017efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:55.568057 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3184/6358] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:55.575114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e1e9-86e2-4971-a671-eca4aa56f1fc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:55.597452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e1e9-86e2-4971-a671-eca4aa56f1fc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:55.610798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:55.613023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:55.615648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:55.615997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:55.616595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:34:55.616934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:55.618721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:55.673577 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3175/6359] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:34:55.677988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c1b3b-a429-4135-9218-03f3ef017efb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:55.698374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c1b3b-a429-4135-9218-03f3ef017efb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:55.754960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:55.757927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:55.758212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:55.759990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:55.760685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:55.764904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:55.888109 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3185/6360] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:34:55 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:55.890977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:55.908503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4859b-0254-4017-9409-354658d69c1e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:56.089369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:56.089963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:56.090247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:56.090526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:56.091188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:56.102209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:56.162205 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3176/6361] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:34:55 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:34:56.163510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:56.183331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0fab-1e4e-44f7-8445-bbe6fcb3302f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:56.204081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:56.204757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:56.205066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:56.207542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:56.210996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:56.215979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:56.246770 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3186/6362] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:56.248039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:56.265586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35835bf-8a6b-4017-acaa-92648dd7dd27 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:56.284878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356cedc-24ea-42cf-a30f-f14a320e53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:56.285535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cedc-24ea-42cf-a30f-f14a320e53c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:56.285814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cedc-24ea-42cf-a30f-f14a320e53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:56.286087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cedc-24ea-42cf-a30f-f14a320e53c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:56.286754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356cedc-24ea-42cf-a30f-f14a320e53c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:56.288476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356cedc-24ea-42cf-a30f-f14a320e53c7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:56.312936 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3177/6363] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:34:56.318101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:56.329111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbfa20-f18c-4793-829b-574477f10ce9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:56.346947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:56.347872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:56.348732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:56.349121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] PATH_INFO: `/v3/projects/52739e88eb3f414b98ca34a11eeecacb/users/3ae8058d78f9499db2a6feb0d0c2c71c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:56.375329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=52739e88eb3f414b98ca34a11eeecacb, user_id=3ae8058d78f9499db2a6feb0d0c2c71c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:56.394291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:56.438719 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:56.474073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839430-c7bd-4c57-a943-f902288af12c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:56.476334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839430-c7bd-4c57-a943-f902288af12c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:56.476595 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3187/6364] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:34:56 2022] PUT /identity/v3/projects/52739e88eb3f414b98ca34a11eeecacb/users/3ae8058d78f9499db2a6feb0d0c2c71c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:34:56.476974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839430-c7bd-4c57-a943-f902288af12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:56.510795 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:56.561830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-09839430-c7bd-4c57-a943-f902288af12c None None] MFA Rules not processed for user `3ae8058d78f9499db2a6feb0d0c2c71c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:34:56.563527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-09839430-c7bd-4c57-a943-f902288af12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:56.727367 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3178/6365] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:34:56.739684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:34:56.741645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:34:56.870625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690f0e-e3e6-4b32-87db-4e1abbf14dec admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:34:56.880759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:34:56.881622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:34:56.881962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:34:56.882301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:34:56.906214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:34:56.907785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:34:56.930052 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3188/6366] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:34:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:35:01.465947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09839430-c7bd-4c57-a943-f902288af12c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:01.465947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-09839430-c7bd-4c57-a943-f902288af12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:01.650474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09839430-c7bd-4c57-a943-f902288af12c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:01.657976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b8183-7a4b-497d-a42c-8679b37c0b92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:01.658911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8183-7a4b-497d-a42c-8679b37c0b92 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:01.669383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8183-7a4b-497d-a42c-8679b37c0b92 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:01.669921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8183-7a4b-497d-a42c-8679b37c0b92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:01.672221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-076b8183-7a4b-497d-a42c-8679b37c0b92 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:01.764422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b8183-7a4b-497d-a42c-8679b37c0b92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:01.766338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b8183-7a4b-497d-a42c-8679b37c0b92 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:01.783169 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3179/6367] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:35:04.713018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:04.851319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4dfa-d714-45ec-b77b-b1ff6eae8670 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:04.864378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:04.865176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:04.875590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:04.875590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] PATH_INFO: `/v3/users/3ae8058d78f9499db2a6feb0d0c2c71c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:04.876733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae8058d78f9499db2a6feb0d0c2c71c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:04.878957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:05.017539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae8058d78f9499db2a6feb0d0c2c71c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:05.037996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae8058d78f9499db2a6feb0d0c2c71c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:05.065859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae8058d78f9499db2a6feb0d0c2c71c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:05.066601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae8058d78f9499db2a6feb0d0c2c71c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:05.091815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae8058d78f9499db2a6feb0d0c2c71c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:05.107368 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3189/6368] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:35:04 2022] DELETE /identity/v3/users/3ae8058d78f9499db2a6feb0d0c2c71c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:35:05.117456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:05.118092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:05.118092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:05.192274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:05.201984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:05.329942 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:05.453533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3180/6369] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:05.470181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:05.471672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:05.551074 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:05.639627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803f5db-bb40-4928-8cfd-01a49e3b82ac admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:05.645894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667d939-497f-43dd-9cc7-c0bd42a1e2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:05.646962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667d939-497f-43dd-9cc7-c0bd42a1e2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:05.647464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667d939-497f-43dd-9cc7-c0bd42a1e2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:05.647958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667d939-497f-43dd-9cc7-c0bd42a1e2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:05.674927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667d939-497f-43dd-9cc7-c0bd42a1e2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:05.676553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667d939-497f-43dd-9cc7-c0bd42a1e2c1 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:05.702941 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3190/6370] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:06.269638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:06.271159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:06.291758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02571bcb-e549-414c-a36d-01a377937c8d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:06.308234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:06.308940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:06.309301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:06.310231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] PATH_INFO: `/v3/users/521136ba1dcc454292aaa65a23b2be68` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:06.313896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521136ba1dcc454292aaa65a23b2be68)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:06.315887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:06.431036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:06.431854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:06.432366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:06.446494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521136ba1dcc454292aaa65a23b2be68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:06.469463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:06.472404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:06.483083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521136ba1dcc454292aaa65a23b2be68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:06.484122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521136ba1dcc454292aaa65a23b2be68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:06.502625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521136ba1dcc454292aaa65a23b2be68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:06.503657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521136ba1dcc454292aaa65a23b2be68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:06.537820 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3181/6371] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:35:06 2022] DELETE /identity/v3/users/521136ba1dcc454292aaa65a23b2be68 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:06.539023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:06.545995 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3191/6372] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:06.546120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:06.864552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb8fa4-7458-4ae8-b862-9c8dd76dd295 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:06.883049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:06.883939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:06.884715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:06.885115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] PATH_INFO: `/v3/projects/52739e88eb3f414b98ca34a11eeecacb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:06.888337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52739e88eb3f414b98ca34a11eeecacb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:06.891279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:07.027309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52739e88eb3f414b98ca34a11eeecacb', 'request_id': 'req-04c747a2-04ca-4063-b8ef-3ca39f06e950'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.032527 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:07.067633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52739e88eb3f414b98ca34a11eeecacb', 'request_id': 'req-04c747a2-04ca-4063-b8ef-3ca39f06e950'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.075916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52739e88eb3f414b98ca34a11eeecacb', 'request_id': 'req-04c747a2-04ca-4063-b8ef-3ca39f06e950'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.084512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:07.086788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:07.097417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] The token cache is being invalidate because project 52739e88eb3f414b98ca34a11eeecacb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:35:07.097706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.100360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-04c747a2-04ca-4063-b8ef-3ca39f06e950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.104673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068245c-71f9-4b40-bff4-9e21661604d0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:07.107198 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3182/6373] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:35:06 2022] DELETE /identity/v3/projects/52739e88eb3f414b98ca34a11eeecacb => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:07.112255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db77c0-ce6b-4a8f-a58c-0a782b1fda73 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:07.112542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db77c0-ce6b-4a8f-a58c-0a782b1fda73 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:07.112842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db77c0-ce6b-4a8f-a58c-0a782b1fda73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:07.178075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-88db77c0-ce6b-4a8f-a58c-0a782b1fda73 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:07.179914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-88db77c0-ce6b-4a8f-a58c-0a782b1fda73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:07.345066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:07.350332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:07.350704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:07.350990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] PATH_INFO: `/v3/projects/910d1339e7a24cfd863d2c04610a7b1b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:07.353043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910d1339e7a24cfd863d2c04610a7b1b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:07.364997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:07.469342 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3183/6374] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:07.485018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910d1339e7a24cfd863d2c04610a7b1b', 'request_id': 'req-3302e1ae-7dac-476f-ac19-ba80a7faa192'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.497823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910d1339e7a24cfd863d2c04610a7b1b', 'request_id': 'req-3302e1ae-7dac-476f-ac19-ba80a7faa192'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.498211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cc10-eb27-4741-b3e8-d82de37aa428 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:07.499804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cc10-eb27-4741-b3e8-d82de37aa428 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:07.501376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cc10-eb27-4741-b3e8-d82de37aa428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:07.504799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910d1339e7a24cfd863d2c04610a7b1b', 'request_id': 'req-3302e1ae-7dac-476f-ac19-ba80a7faa192'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.518147 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:07.526470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] The token cache is being invalidate because project 910d1339e7a24cfd863d2c04610a7b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:35:07.526949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.528439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3302e1ae-7dac-476f-ac19-ba80a7faa192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:07.534409 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3192/6375] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:35:07 2022] DELETE /identity/v3/projects/910d1339e7a24cfd863d2c04610a7b1b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:07.553153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009974d9-8d1c-4392-be04-76fdd0ddace2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:07.553658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009974d9-8d1c-4392-be04-76fdd0ddace2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:07.554322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009974d9-8d1c-4392-be04-76fdd0ddace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:07.564597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8e39cc10-eb27-4741-b3e8-d82de37aa428 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:07.565877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8e39cc10-eb27-4741-b3e8-d82de37aa428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:07.602896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-009974d9-8d1c-4392-be04-76fdd0ddace2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:07.604876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-009974d9-8d1c-4392-be04-76fdd0ddace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:07.742634 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3184/6376] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:07.747691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39cc10-eb27-4741-b3e8-d82de37aa428 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:07.760163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39cc10-eb27-4741-b3e8-d82de37aa428 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:07.776805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:07.777465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:07.778030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:07.778030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:07.782361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:35:07.782699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:07.786014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:07.812645 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3193/6377] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:07.821675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05452-2c87-494c-b301-f15a6f6ff0eb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:07.822033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05452-2c87-494c-b301-f15a6f6ff0eb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:07.824144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05452-2c87-494c-b301-f15a6f6ff0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:07.827908 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3185/6378] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:35:07.832116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:07.855096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c819c7-e6cf-4748-9f55-47b4e2985670 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:07.873551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:07.874502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:07.874953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:07.875422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:07.876399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:07.878550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:07.895182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4de05452-2c87-494c-b301-f15a6f6ff0eb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:07.896984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4de05452-2c87-494c-b301-f15a6f6ff0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:07.907193 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3194/6379] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:07.911758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05452-2c87-494c-b301-f15a6f6ff0eb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:07.965749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3186/6380] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:35:07 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:35:07.969760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05452-2c87-494c-b301-f15a6f6ff0eb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:07.970089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.075306 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:08.103726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.104607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.104941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.105288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.106031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:35:08.106402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.108210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.110897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdffc-705f-4829-b66d-ff52ee512c7f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.123944 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3195/6381] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:35:08.125422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.126299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.126888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.127329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.128780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.129094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.131397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.152543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e52636-0126-49a4-8ca5-0a0ce0b89b17 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.163329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.164501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.165084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.165721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.166486 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3187/6382] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:35:07 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:35:08.166683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.169039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.170573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.183615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a6ae1-994f-449d-864f-dcf8313c9d72 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.189706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.190775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.191309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.192372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.194580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.196877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.211109 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3188/6383] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:35:08.215310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.217350 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3196/6384] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:35:08 2022] POST /identity/v3/projects => generated 389 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:35:08.219494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.231410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc9117-969b-4438-a7a8-dde80ea3ba6b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.330136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf94fa1-e42f-44ae-b60a-b56350caf051 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.340996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.341619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.341899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.342168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.342794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.351173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.367540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.368221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.368493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.368778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.369501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.373593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.376528 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:08.394241 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3197/6385] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:35:08 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:35:08.397205 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3189/6386] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:35:08.408492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.408587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.420004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58f25a-6688-4e6a-8cee-c46edf4f08f9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.423098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a76a9-4d43-4381-9fa8-87f1efe2e6a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.430911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99483f-1095-49e9-975b-fec35675b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.431661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99483f-1095-49e9-975b-fec35675b1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.431936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99483f-1095-49e9-975b-fec35675b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.432209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99483f-1095-49e9-975b-fec35675b1a9 admin admin] PATH_INFO: `/v3/projects/72eb711885a04bb5a0b95f96cf6499fc/users/746be74e8821482a95244251f82babd3/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.434364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.434976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.435247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.435512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.436148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.438165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.464304 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3190/6387] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:35:08.468510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.474278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99483f-1095-49e9-975b-fec35675b1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72eb711885a04bb5a0b95f96cf6499fc, user_id=746be74e8821482a95244251f82babd3, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.479339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99483f-1095-49e9-975b-fec35675b1a9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.490084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2fd7-46ec-49b0-9463-220c1210ddc3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.501160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3198/6388] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:35:08 2022] PUT /identity/v3/projects/72eb711885a04bb5a0b95f96cf6499fc/users/746be74e8821482a95244251f82babd3/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:35:08.506200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.506830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.507107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.507375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.508586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.509777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.511812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.512177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.512507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.536909 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3191/6389] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:35:08.538337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.559060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] MFA Rules not processed for user `746be74e8821482a95244251f82babd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:08.560802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:08.579978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9941e-a652-430f-b309-35ffb0d38b62 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.724507 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3199/6390] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:08.725658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.727123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:08.744503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.745253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.745528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.745801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] PATH_INFO: `/v3/projects/1a83ba47ffad4cb4a82638934e637155/users/0c6bcee78c3148b5a6caa34678b1cc10/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.805439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a83ba47ffad4cb4a82638934e637155, user_id=0c6bcee78c3148b5a6caa34678b1cc10, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.808125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.813680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d721-046a-425a-b375-a2b736f97f11 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.819126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9306f48-573d-4922-86f1-807c49652757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.820210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306f48-573d-4922-86f1-807c49652757 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.820919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306f48-573d-4922-86f1-807c49652757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.821800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306f48-573d-4922-86f1-807c49652757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.834563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9306f48-573d-4922-86f1-807c49652757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:08.836850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9306f48-573d-4922-86f1-807c49652757 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:08.838644 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3192/6391] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:35:08 2022] PUT /identity/v3/projects/1a83ba47ffad4cb4a82638934e637155/users/0c6bcee78c3148b5a6caa34678b1cc10/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:35:08.839776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:08.842799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:08.867800 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3200/6392] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:35:08.869478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.869938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.870213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.887445 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:08.917537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:08.919329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:08.981107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394285c-ae83-4964-9745-08eacb34b65e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:08.987693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:08.988971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:08.989349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:08.989713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:08.991738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:09.008216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:09.010600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:09.037490 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3193/6393] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:09.132917 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3201/6394] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:09.154781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:09.156712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:09.293562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4f2d-3b20-4f82-b07d-f57eae0f7881 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:09.298800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d2079-ed2c-4431-9ca8-597bd75d1b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:09.310857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d2079-ed2c-4431-9ca8-597bd75d1b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:09.311199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d2079-ed2c-4431-9ca8-597bd75d1b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:09.311451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d2079-ed2c-4431-9ca8-597bd75d1b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:09.338622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d2079-ed2c-4431-9ca8-597bd75d1b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:09.340255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d2079-ed2c-4431-9ca8-597bd75d1b07 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:09.354361 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3194/6395] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:19.106872 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=2,keystone:SELECT=97 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:19.347737 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=53 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:19.584812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:19.587773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:19.647322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c65342-4028-4d47-bdd3-43f4d6943c6b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:19.681033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:19.681817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:19.682261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:19.682539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:19.687932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:19.754642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:19.768118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:19.801812 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3202/6396] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:21.018987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627014fa-ae90-495b-a5ed-57a663e6c914 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:21.019496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627014fa-ae90-495b-a5ed-57a663e6c914 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:21.019570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627014fa-ae90-495b-a5ed-57a663e6c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:21.051362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-627014fa-ae90-495b-a5ed-57a663e6c914 None None] MFA Rules not processed for user `0c6bcee78c3148b5a6caa34678b1cc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:21.053329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-627014fa-ae90-495b-a5ed-57a663e6c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:21.149049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:21.150688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:21.176174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d7d5-ba58-45f8-a430-e538758c2b5e service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:21.189026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:21.191037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:21.191437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:21.191808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] PATH_INFO: `/v3/users/635af5d1326c411cadd6b2c1eac70f96` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:21.193243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=635af5d1326c411cadd6b2c1eac70f96)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:21.195592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:21.226524 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3195/6397] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:21.237593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:21.237877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:21.238148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:21.272366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] MFA Rules not processed for user `0c6bcee78c3148b5a6caa34678b1cc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:21.274365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:21.284311 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3196/6398] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:21.295593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:21.296999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:21.303280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635af5d1326c411cadd6b2c1eac70f96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:21.319602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635af5d1326c411cadd6b2c1eac70f96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:21.340312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635af5d1326c411cadd6b2c1eac70f96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:21.341355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635af5d1326c411cadd6b2c1eac70f96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:21.360346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-306acf24-ad71-4693-b4ee-3b44e78fe215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635af5d1326c411cadd6b2c1eac70f96'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:21.373784 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3203/6399] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:35:21 2022] DELETE /identity/v3/users/635af5d1326c411cadd6b2c1eac70f96 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:21.375375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:21.378750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:21.379208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:21.421307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:21.424721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:21.544114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dacdbc-da8d-4b9c-91a2-f0eb5f3ed952 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:21.612340 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3204/6400] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:21.628465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:21.640717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:21.757775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:21.758330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:21.758630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:21.758902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:21.766446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:21.793579 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:21.844346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbe1ee-4419-4f1e-9b8a-8373aec55d6b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:21.857537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1de84-4a65-4f51-bd2f-a19e2bb83cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:21.858290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de84-4a65-4f51-bd2f-a19e2bb83cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:21.858574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de84-4a65-4f51-bd2f-a19e2bb83cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:21.858948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de84-4a65-4f51-bd2f-a19e2bb83cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:21.882393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de84-4a65-4f51-bd2f-a19e2bb83cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:21.883942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de84-4a65-4f51-bd2f-a19e2bb83cd1 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:21.925761 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3205/6401] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:21.927269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82241bb-f642-4575-9f28-aa72f4fe5f74 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:21.927552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82241bb-f642-4575-9f28-aa72f4fe5f74 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:21.927823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82241bb-f642-4575-9f28-aa72f4fe5f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:21.938948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:21.944311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:21.960957 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:21.993796 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3197/6402] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:35:22.016948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a82241bb-f642-4575-9f28-aa72f4fe5f74 None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:22.018204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a82241bb-f642-4575-9f28-aa72f4fe5f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:22.247284 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3206/6403] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:23.372441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:23.374276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:23.390702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82241bb-f642-4575-9f28-aa72f4fe5f74 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:23.416124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82241bb-f642-4575-9f28-aa72f4fe5f74 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:23.421467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73ed9-212a-4952-9f38-54540e683182 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:23.428589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:23.436300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:23.439343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:23.440215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:23.443264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:23.444185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:23.447450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:23.449346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:23.450207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] PATH_INFO: `/v3/projects/7dfc30c18e4d4e77b1d4f74d93bfea72` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:23.457936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfc30c18e4d4e77b1d4f74d93bfea72)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:23.484753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:23.506152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:23.511844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:23.566715 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3207/6404] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:23.651594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfc30c18e4d4e77b1d4f74d93bfea72', 'request_id': 'req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:23.668894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfc30c18e4d4e77b1d4f74d93bfea72', 'request_id': 'req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:23.678371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfc30c18e4d4e77b1d4f74d93bfea72', 'request_id': 'req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:23.704906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] The token cache is being invalidate because project 7dfc30c18e4d4e77b1d4f74d93bfea72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:35:23.705358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:23.708151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e3da5c7e-c2b4-46af-a9d2-c82a61960aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:23.721445 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3198/6405] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:35:23 2022] DELETE /identity/v3/projects/7dfc30c18e4d4e77b1d4f74d93bfea72 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:27.632228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:27.634793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:27.672138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8b40-488a-4001-adfe-f3ba383175f1 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:27.944149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:27.945492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:27.945965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:27.946399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] PATH_INFO: `/v3/users/746be74e8821482a95244251f82babd3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:27.955470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746be74e8821482a95244251f82babd3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:27.957577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:28.162234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746be74e8821482a95244251f82babd3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:28.202782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746be74e8821482a95244251f82babd3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:28.253455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746be74e8821482a95244251f82babd3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:28.254726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746be74e8821482a95244251f82babd3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:28.269677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746be74e8821482a95244251f82babd3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:28.294670 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3208/6406] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:35:27 2022] DELETE /identity/v3/users/746be74e8821482a95244251f82babd3 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:28.299023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:28.299584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:28.299584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:28.358848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:28.360162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:28.523006 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3199/6407] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:28.546506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:28.548187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:28.583884 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:28.695864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075850b-b0c3-4145-b4e4-e18775b212f5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:28.700195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eed0e3-b5df-4409-8b86-7adf8d59f02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:28.701044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eed0e3-b5df-4409-8b86-7adf8d59f02b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:28.701327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eed0e3-b5df-4409-8b86-7adf8d59f02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:28.704008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eed0e3-b5df-4409-8b86-7adf8d59f02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:28.739554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eed0e3-b5df-4409-8b86-7adf8d59f02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:28.746681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eed0e3-b5df-4409-8b86-7adf8d59f02b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:28.789985 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3209/6408] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:31.172914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:31.187613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:31.231894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539249c1-ca5e-4475-b3ac-af74d86b85b9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:31.249315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:31.250049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:31.250332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:31.250609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] PATH_INFO: `/v3/projects/72eb711885a04bb5a0b95f96cf6499fc` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:31.252068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72eb711885a04bb5a0b95f96cf6499fc)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:31.257614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:31.343906 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:31.374952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72eb711885a04bb5a0b95f96cf6499fc', 'request_id': 'req-220408d4-1281-4f2b-998a-7050748181c6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:31.386427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72eb711885a04bb5a0b95f96cf6499fc', 'request_id': 'req-220408d4-1281-4f2b-998a-7050748181c6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:31.409626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72eb711885a04bb5a0b95f96cf6499fc', 'request_id': 'req-220408d4-1281-4f2b-998a-7050748181c6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:31.454188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] The token cache is being invalidate because project 72eb711885a04bb5a0b95f96cf6499fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:35:31.454482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:31.455234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-220408d4-1281-4f2b-998a-7050748181c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:35:31.457543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3200/6409] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:35:31 2022] DELETE /identity/v3/projects/72eb711885a04bb5a0b95f96cf6499fc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:31.462416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ccbd3-70d9-4ebb-9c27-dc44aaf59d6e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:31.462991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ccbd3-70d9-4ebb-9c27-dc44aaf59d6e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:31.462991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ccbd3-70d9-4ebb-9c27-dc44aaf59d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:31.508062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c15ccbd3-70d9-4ebb-9c27-dc44aaf59d6e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:31.509344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c15ccbd3-70d9-4ebb-9c27-dc44aaf59d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:31.660354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3210/6410] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:35:31.668887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22071-52b9-4ce8-a4a1-52e39d114d68 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:31.669339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22071-52b9-4ce8-a4a1-52e39d114d68 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:31.669778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22071-52b9-4ce8-a4a1-52e39d114d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:31.712119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8ec22071-52b9-4ce8-a4a1-52e39d114d68 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:31.713567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ec22071-52b9-4ce8-a4a1-52e39d114d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:31.740880 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3201/6411] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:31.745700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ccbd3-70d9-4ebb-9c27-dc44aaf59d6e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:31.757099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ccbd3-70d9-4ebb-9c27-dc44aaf59d6e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:31.774378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:31.775306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:31.775743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:31.776180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:31.777033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:35:31.777495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:31.779431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:31.807728 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3211/6412] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:35:31.813271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec22071-52b9-4ce8-a4a1-52e39d114d68 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:31.825776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec22071-52b9-4ce8-a4a1-52e39d114d68 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:31.841178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:31.841820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:31.842098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:31.842368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:31.843018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:31.844948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:31.911304 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3202/6413] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:35:31 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:35:31.915813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:31.926326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efbb78-bdcf-4e41-b88a-fdef956ca6f8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:32.035592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:32.037397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:32.037727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:32.037968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:32.038754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:32.042029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:32.120010 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3212/6414] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:35:31 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:35:32.121053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:32.151798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763cd6c-1fb2-47f3-a276-fc18a47bd5a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:32.161784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:32.162435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:32.162770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:32.162998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:32.163863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:32.165850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:32.205496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3203/6415] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:35:32.209629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:32.234169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f422a2-c6b0-4d67-bd18-25d20b1d2fdd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:32.265724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b49f10-232a-45d7-a00a-6675cc18e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:32.266365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49f10-232a-45d7-a00a-6675cc18e8db admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:32.266645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49f10-232a-45d7-a00a-6675cc18e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:32.266920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49f10-232a-45d7-a00a-6675cc18e8db admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:32.267590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b49f10-232a-45d7-a00a-6675cc18e8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:32.269247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b49f10-232a-45d7-a00a-6675cc18e8db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:32.291408 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3213/6416] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:35:32.295768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:32.319578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7941b4-205d-4015-9c59-c13488de7cda admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:32.329632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:32.330344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:32.330628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:32.330900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] PATH_INFO: `/v3/projects/7d335494e7c246b997ecf3e6dff60d90/users/e5638a27c020490c903b31fc229f530e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:32.364368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d335494e7c246b997ecf3e6dff60d90, user_id=e5638a27c020490c903b31fc229f530e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:32.367489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:32.398822 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3204/6417] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:35:32 2022] PUT /identity/v3/projects/7d335494e7c246b997ecf3e6dff60d90/users/e5638a27c020490c903b31fc229f530e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:32.403711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfd58-be37-4a9f-ba23-8f4d22cc1578 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:32.404000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfd58-be37-4a9f-ba23-8f4d22cc1578 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:32.404274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfd58-be37-4a9f-ba23-8f4d22cc1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:32.433757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b98dfd58-be37-4a9f-ba23-8f4d22cc1578 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:32.434988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b98dfd58-be37-4a9f-ba23-8f4d22cc1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:32.508809 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:32.649546 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3214/6418] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:32.673616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:32.675401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:32.852426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64169182-c6ce-43bf-8894-067366956883 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:32.856657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:32.857503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:32.857963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:32.858400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:32.877319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:32.878873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:32.907174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3205/6419] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:35:42.627413 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=17 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:42.894999 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:47.514744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248766-ce67-488f-97a9-914ac92ee3bd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:47.515262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248766-ce67-488f-97a9-914ac92ee3bd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:47.515472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248766-ce67-488f-97a9-914ac92ee3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:47.574733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c8248766-ce67-488f-97a9-914ac92ee3bd None None] MFA Rules not processed for user `e5638a27c020490c903b31fc229f530e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:47.579971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c8248766-ce67-488f-97a9-914ac92ee3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:47.803084 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3215/6420] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:47.807774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:47.819691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b415709-6ab3-472b-8a96-19c12e8a1771 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:47.826470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:47.827341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:47.827838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:47.828285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:47.829327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:47.831793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:47.894302 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3206/6421] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:35:47 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:35:47.895110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248766-ce67-488f-97a9-914ac92ee3bd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:47.914119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248766-ce67-488f-97a9-914ac92ee3bd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:48.089979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:48.090746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:48.091125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:48.093114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:48.094816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:48.098800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:48.134983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:48.148756 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3216/6422] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:35:47 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:35:48.150262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5acbc-0bbd-4c30-9a91-66c7611206d3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:48.158652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:48.160359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:48.160856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:48.161272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:48.162353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:48.164234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:48.200238 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3207/6423] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:35:48.205089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:48.232899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef4e4d-3fb4-4e2d-b8c3-90047adf0bc6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:48.246163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:48.246866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:48.247147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:48.247418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] PATH_INFO: `/v3/projects/89a0e9b909d74062b7a3d39494d58af8/users/ba7ceb52ca634f4f97567f0520121212/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:48.277160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a0e9b909d74062b7a3d39494d58af8, user_id=ba7ceb52ca634f4f97567f0520121212, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:48.279902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:48.309851 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3217/6424] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:35:48 2022] PUT /identity/v3/projects/89a0e9b909d74062b7a3d39494d58af8/users/ba7ceb52ca634f4f97567f0520121212/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:48.313811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:48.326780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302dd98-3af0-4ed6-8d07-dbde3c27926c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:48.437321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be2993-a43c-4f92-b5a4-05c11e8d8be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:48.438195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2993-a43c-4f92-b5a4-05c11e8d8be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:48.438195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2993-a43c-4f92-b5a4-05c11e8d8be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:48.438504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2993-a43c-4f92-b5a4-05c11e8d8be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:48.439121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be2993-a43c-4f92-b5a4-05c11e8d8be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:48.440737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be2993-a43c-4f92-b5a4-05c11e8d8be5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:48.462689 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3208/6425] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:35:48.467036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:48.511729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03802c-f17e-4baa-81ad-f740a7365d9b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:35:48.523981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f432c-39e6-487e-848b-efc71e0626ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:35:48.533057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f432c-39e6-487e-848b-efc71e0626ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:48.533750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f432c-39e6-487e-848b-efc71e0626ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:48.535256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f432c-39e6-487e-848b-efc71e0626ab admin admin] PATH_INFO: `/v3/projects/89a0e9b909d74062b7a3d39494d58af8/users/ba7ceb52ca634f4f97567f0520121212/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:48.544433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f432c-39e6-487e-848b-efc71e0626ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a0e9b909d74062b7a3d39494d58af8, user_id=ba7ceb52ca634f4f97567f0520121212, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:35:48.548505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f432c-39e6-487e-848b-efc71e0626ab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:35:48.575684 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3218/6426] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:35:48 2022] PUT /identity/v3/projects/89a0e9b909d74062b7a3d39494d58af8/users/ba7ceb52ca634f4f97567f0520121212/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:35:50.221911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:50.222408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:50.222883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:50.264918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] MFA Rules not processed for user `05c1f10a225e4f14885bf583527e93a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:50.266191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:50.389054 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3209/6427] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:58.565578 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=80,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:59.491047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:35:59.491576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:35:59.492004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:35:59.587109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] MFA Rules not processed for user `ba7ceb52ca634f4f97567f0520121212`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:35:59.588378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:35:59.817188 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3219/6428] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:35:59.929621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:35:59.931064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:00.064415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:00.065942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:00.069709 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:00.082744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a83dad-f67a-4d96-a6d7-db8d965dbafb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:00.089323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:00.090200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:00.090641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:00.091063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] PATH_INFO: `/v3/users/c80181e6d7df40bba3630905dbac9d2d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:00.092594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80181e6d7df40bba3630905dbac9d2d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:00.095664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:00.179859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80181e6d7df40bba3630905dbac9d2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:00.191381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80181e6d7df40bba3630905dbac9d2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:00.193206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80181e6d7df40bba3630905dbac9d2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:00.216339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80181e6d7df40bba3630905dbac9d2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:00.218976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19272dab-a58e-49ad-8e30-feed6833efcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80181e6d7df40bba3630905dbac9d2d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:00.279141 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3210/6429] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:35:59 2022] DELETE /identity/v3/users/c80181e6d7df40bba3630905dbac9d2d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:00.283341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:00.283969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:00.284434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:00.293969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2076a8-a91c-42f0-bfab-b8813528ef54 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:00.349060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:00.350877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:00.463839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b012-1182-459d-b326-d7ed3094fad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:00.464474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b012-1182-459d-b326-d7ed3094fad5 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:00.464954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b012-1182-459d-b326-d7ed3094fad5 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:00.465083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b012-1182-459d-b326-d7ed3094fad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:00.470451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b840b012-1182-459d-b326-d7ed3094fad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:00.517980 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:00.519279 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3211/6430] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:00.633833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:00.635268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:00.655378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b012-1182-459d-b326-d7ed3094fad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:00.657062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b012-1182-459d-b326-d7ed3094fad5 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:00.685686 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3220/6431] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:36:00.889162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79b6a-3334-4f7e-a666-394dfe7ac208 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:00.901732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:00.902511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:00.902839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:00.903163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:00.959080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:00.960944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:00.994707 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3212/6432] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:36:01.207455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:01.207766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:01.208048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:01.286991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:01.287357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:01.288924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:01.297826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:01.298484 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:01.433423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3221/6433] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:01.516412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aeb3e-820e-484d-9f58-c43e553f181e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:01.530751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:01.531659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:01.531993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:01.532328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:01.539395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:01.592172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:01.593923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:01.616647 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3213/6434] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:36:02.050116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:02.051609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:02.074958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9245-9b3c-48be-9c18-7b177a05766f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:02.087996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:02.088980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:02.089403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:02.089856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] PATH_INFO: `/v3/projects/d4674aa49f94452e86836e93da116ad4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:02.092294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4674aa49f94452e86836e93da116ad4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:02.097903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:02.253139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4674aa49f94452e86836e93da116ad4', 'request_id': 'req-c9783799-50bc-420b-9984-f68bb52d9b2f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.263444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4674aa49f94452e86836e93da116ad4', 'request_id': 'req-c9783799-50bc-420b-9984-f68bb52d9b2f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.270830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4674aa49f94452e86836e93da116ad4', 'request_id': 'req-c9783799-50bc-420b-9984-f68bb52d9b2f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.301343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] The token cache is being invalidate because project d4674aa49f94452e86836e93da116ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:02.301933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.302820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.305376 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3222/6435] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:02 2022] DELETE /identity/v3/projects/d4674aa49f94452e86836e93da116ad4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:02.309124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:02.325148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1b426-c6dc-492d-9616-89325783f906 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:02.502457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:02.503371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:02.503746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:02.504019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] PATH_INFO: `/v3/users/c9ca9cd21177404c823b21d1fea42b83` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:02.505522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ca9cd21177404c823b21d1fea42b83)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:02.507789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:02.592075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ca9cd21177404c823b21d1fea42b83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.607684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ca9cd21177404c823b21d1fea42b83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.608757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ca9cd21177404c823b21d1fea42b83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.629254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ca9cd21177404c823b21d1fea42b83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.630710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-696eca2d-a302-41fb-ac9b-359d6598988a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ca9cd21177404c823b21d1fea42b83'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:02.676563 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3214/6436] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:02 2022] DELETE /identity/v3/users/c9ca9cd21177404c823b21d1fea42b83 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:03.741923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:03.744654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:03.791035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9783799-50bc-420b-9984-f68bb52d9b2f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:03.922705 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:03.960414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:03.961108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:03.961561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:03.961990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] PATH_INFO: `/v3/projects/dabe8ea372ed4a92bb65d9ef5ec6f7ab` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:03.965391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabe8ea372ed4a92bb65d9ef5ec6f7ab)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:03.968830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:04.115183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabe8ea372ed4a92bb65d9ef5ec6f7ab', 'request_id': 'req-5d092c6c-2f92-49aa-af89-b4d06c1f3725'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:04.128224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabe8ea372ed4a92bb65d9ef5ec6f7ab', 'request_id': 'req-5d092c6c-2f92-49aa-af89-b4d06c1f3725'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:04.146081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabe8ea372ed4a92bb65d9ef5ec6f7ab', 'request_id': 'req-5d092c6c-2f92-49aa-af89-b4d06c1f3725'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:04.170813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] The token cache is being invalidate because project dabe8ea372ed4a92bb65d9ef5ec6f7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:04.171150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:04.173223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5d092c6c-2f92-49aa-af89-b4d06c1f3725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:04.176305 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3223/6437] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:03 2022] DELETE /identity/v3/projects/dabe8ea372ed4a92bb65d9ef5ec6f7ab => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:04.196227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b7cd-49fa-4e4e-9f7a-39ef4d64a7bb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:04.196227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b7cd-49fa-4e4e-9f7a-39ef4d64a7bb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:04.196227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b7cd-49fa-4e4e-9f7a-39ef4d64a7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:04.226449 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:04.287282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7460b7cd-49fa-4e4e-9f7a-39ef4d64a7bb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:04.290054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7460b7cd-49fa-4e4e-9f7a-39ef4d64a7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:04.455231 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3215/6438] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:04.463558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d89c-07d8-42ad-8e57-84159497f94a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:04.464123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d89c-07d8-42ad-8e57-84159497f94a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:04.464406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d89c-07d8-42ad-8e57-84159497f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:04.509363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-de68d89c-07d8-42ad-8e57-84159497f94a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:04.510606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-de68d89c-07d8-42ad-8e57-84159497f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:04.546665 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3224/6439] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:04.547019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460b7cd-49fa-4e4e-9f7a-39ef4d64a7bb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:04.563885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460b7cd-49fa-4e4e-9f7a-39ef4d64a7bb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:04.586677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:04.587586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:04.590784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:04.593384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:04.594303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:04.607030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:04.616073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:04.656913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3216/6440] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:36:04.661597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68d89c-07d8-42ad-8e57-84159497f94a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:04.677159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68d89c-07d8-42ad-8e57-84159497f94a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:04.701950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:04.702815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:04.703117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:04.703436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:04.704546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:04.706748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:04.778791 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3225/6441] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:04 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:04.783109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:04.814989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547185c3-e51f-4126-a223-2af53b1835f9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:04.964550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:04.965274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:04.965727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:04.966003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:04.966672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:04.969772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:05.006705 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3217/6442] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:04 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:05.011749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:05.040282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020f77a-426f-49dd-b851-01f88328c82f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:05.067787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:05.072906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:05.073431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:05.075427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:05.076476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:05.088462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:05.135560 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3226/6443] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:05.137568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:05.154798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eb61d-4ca7-4b2a-81ce-6b4f0a3a49c1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:05.179990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037086-dd9b-44a5-9eec-0c63432070ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:05.180931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037086-dd9b-44a5-9eec-0c63432070ae admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:05.181649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037086-dd9b-44a5-9eec-0c63432070ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:05.182175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037086-dd9b-44a5-9eec-0c63432070ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:05.183713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037086-dd9b-44a5-9eec-0c63432070ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:05.185629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037086-dd9b-44a5-9eec-0c63432070ae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:05.223061 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3218/6444] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:05.228220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:05.244445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c205-fd6a-4b03-8302-106751f1027b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:05.268150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:05.269356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:05.269859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:05.270410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] PATH_INFO: `/v3/projects/e5f061be91cf41fcaafa0b1cdfdff539/users/3ef9eb2bdcdc46e39ec1feba7b251df7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:05.335439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f061be91cf41fcaafa0b1cdfdff539, user_id=3ef9eb2bdcdc46e39ec1feba7b251df7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:05.341869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:05.383473 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3227/6445] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:05 2022] PUT /identity/v3/projects/e5f061be91cf41fcaafa0b1cdfdff539/users/3ef9eb2bdcdc46e39ec1feba7b251df7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:05.398285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c445-c220-4c11-b1a1-e02a85affaf1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:05.398814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c445-c220-4c11-b1a1-e02a85affaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:05.399205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c445-c220-4c11-b1a1-e02a85affaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:05.502231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fe92c445-c220-4c11-b1a1-e02a85affaf1 None None] MFA Rules not processed for user `3ef9eb2bdcdc46e39ec1feba7b251df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:05.507500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe92c445-c220-4c11-b1a1-e02a85affaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:05.717025 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:05.761377 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3219/6446] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:05.765510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:05.884322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f8d90-d2e5-460b-8ee0-c3afea7c34b1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:05.891040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:05.891711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:05.891989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:05.892275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:05.893544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:05.895851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:05.925341 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:05.951160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3228/6447] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:05 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:05.956637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c445-c220-4c11-b1a1-e02a85affaf1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:05.973435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c445-c220-4c11-b1a1-e02a85affaf1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:06.096754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:06.097926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:06.098406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:06.098923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:06.101191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:06.108134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:06.157254 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3220/6448] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:05 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:36:06.161976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:06.204448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b86da-c793-4104-89f1-34b1530abda3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:06.245381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:06.252328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:06.252830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:06.253252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:06.267201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:06.270240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:06.331155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:06.351970 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3229/6449] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:06.353424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20170-a383-4507-9fba-a166d5b4eccd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:06.368748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:06.369827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:06.370350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:06.370808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] PATH_INFO: `/v3/projects/f8ce8a48f627468db70707bb8420b061/users/48012220a0544d0ea052d6db4987df43/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:06.441106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ce8a48f627468db70707bb8420b061, user_id=48012220a0544d0ea052d6db4987df43, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:06.444391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:06.511996 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3221/6450] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:06 2022] PUT /identity/v3/projects/f8ce8a48f627468db70707bb8420b061/users/48012220a0544d0ea052d6db4987df43/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:06.513614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:06.533465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec26cce-fded-4610-99e5-76ab52852cb8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:06.746877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf993a4-1720-4e46-b555-1c93604d3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:06.747631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf993a4-1720-4e46-b555-1c93604d3650 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:06.748104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf993a4-1720-4e46-b555-1c93604d3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:06.748593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf993a4-1720-4e46-b555-1c93604d3650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:06.749397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf993a4-1720-4e46-b555-1c93604d3650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:06.751321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf993a4-1720-4e46-b555-1c93604d3650 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:06.786348 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3230/6451] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:36:06.791713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:06.818652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469fa0-8d39-4cfe-b607-05a99421c61f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:06.832057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:06.832749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:06.833058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:06.833333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] PATH_INFO: `/v3/projects/f8ce8a48f627468db70707bb8420b061/users/48012220a0544d0ea052d6db4987df43/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:06.838016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ce8a48f627468db70707bb8420b061, user_id=48012220a0544d0ea052d6db4987df43, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:06.847139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:06.881125 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3222/6452] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:06 2022] PUT /identity/v3/projects/f8ce8a48f627468db70707bb8420b061/users/48012220a0544d0ea052d6db4987df43/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:06.884518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1124-5582-4ac3-a673-5dcdc9a5f203 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:06.885066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1124-5582-4ac3-a673-5dcdc9a5f203 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:06.885178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1124-5582-4ac3-a673-5dcdc9a5f203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:06.945794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-476a1124-5582-4ac3-a673-5dcdc9a5f203 None None] MFA Rules not processed for user `48012220a0544d0ea052d6db4987df43`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:06.954148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-476a1124-5582-4ac3-a673-5dcdc9a5f203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:07.155733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3231/6453] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:07.180222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:07.182070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:07.286012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab85e6e-86f4-4262-8eab-04201d4e3386 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:07.296549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:07.297308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:07.297590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:07.297884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:07.322544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:07.324014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:07.351623 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3223/6454] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:07.475635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1124-5582-4ac3-a673-5dcdc9a5f203 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:07.497962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1124-5582-4ac3-a673-5dcdc9a5f203 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:07.505619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:07.506789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:07.507689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:07.509324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:07.697166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:07.699158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:07.722279 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3232/6455] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:12.896341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:12.899819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:12.975600 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:13.011005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026482-d808-48f8-b8d8-0c6fe908e7a8 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:13.018383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f84800-72b9-4929-b05a-59e8e6ce4fc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:13.019382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84800-72b9-4929-b05a-59e8e6ce4fc7 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:13.019806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84800-72b9-4929-b05a-59e8e6ce4fc7 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:13.020252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84800-72b9-4929-b05a-59e8e6ce4fc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:13.022620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-84f84800-72b9-4929-b05a-59e8e6ce4fc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:13.064241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f84800-72b9-4929-b05a-59e8e6ce4fc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:13.067193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f84800-72b9-4929-b05a-59e8e6ce4fc7 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:13.100176 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3224/6456] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:15.934013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:15.935642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:15.943124 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:16.148066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3a9f-e3bd-4a37-a17a-3e10d79f35f4 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:16.160633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:16.162062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:16.163168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:16.163615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] PATH_INFO: `/v3/users/8a3e2c3763a5402bae24f2d672733ff6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:16.166566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3e2c3763a5402bae24f2d672733ff6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:16.171995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:16.299598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3e2c3763a5402bae24f2d672733ff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:16.317415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3e2c3763a5402bae24f2d672733ff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:16.334783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3e2c3763a5402bae24f2d672733ff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:16.336261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3e2c3763a5402bae24f2d672733ff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:16.344677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3e2c3763a5402bae24f2d672733ff6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:16.384847 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3233/6457] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:15 2022] DELETE /identity/v3/users/8a3e2c3763a5402bae24f2d672733ff6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:16.386188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:16.387002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:16.387272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:16.446097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:16.447641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:16.594543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3225/6458] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:16.622136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:16.624271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:16.792744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574bb06-0c05-4530-b585-17012da1e614 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:16.802066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:16.804034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:16.804528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:16.805048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:16.816141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:16.818007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:16.832446 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3234/6459] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:18.554570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:18.557794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:18.591183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e454edf-dc0d-40bc-a55c-b48c2942db22 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:18.600513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:18.603398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:18.603785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:18.604148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] PATH_INFO: `/v3/projects/76d56e2bfa63474bb0446ab2083ef4b8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:18.606837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d56e2bfa63474bb0446ab2083ef4b8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:18.617441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:18.710983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d56e2bfa63474bb0446ab2083ef4b8', 'request_id': 'req-c937e074-1bb0-4161-97fc-0de8f5a5b481'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:18.727657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d56e2bfa63474bb0446ab2083ef4b8', 'request_id': 'req-c937e074-1bb0-4161-97fc-0de8f5a5b481'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:18.742454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d56e2bfa63474bb0446ab2083ef4b8', 'request_id': 'req-c937e074-1bb0-4161-97fc-0de8f5a5b481'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:18.765573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] The token cache is being invalidate because project 76d56e2bfa63474bb0446ab2083ef4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:18.765862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:18.766685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:18.770487 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3226/6460] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:18 2022] DELETE /identity/v3/projects/76d56e2bfa63474bb0446ab2083ef4b8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:20.669874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:20.676677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:20.697171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4223-7965-4ae8-a39e-9cb6541a7aad service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:20.739045 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:20.794284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:20.794922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:20.795909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:20.795909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] PATH_INFO: `/v3/users/e5638a27c020490c903b31fc229f530e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:20.797775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5638a27c020490c903b31fc229f530e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:20.801756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:20.907811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5638a27c020490c903b31fc229f530e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:20.925646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5638a27c020490c903b31fc229f530e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:20.940910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5638a27c020490c903b31fc229f530e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:20.941840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5638a27c020490c903b31fc229f530e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:20.950444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5638a27c020490c903b31fc229f530e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:20.959237 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3235/6461] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:20 2022] DELETE /identity/v3/users/e5638a27c020490c903b31fc229f530e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:21.231772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:21.233087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:21.259104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e074-1bb0-4161-97fc-0de8f5a5b481 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:21.376649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:21.377569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:21.378000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:21.378430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] PATH_INFO: `/v3/projects/7d335494e7c246b997ecf3e6dff60d90` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:21.380422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d335494e7c246b997ecf3e6dff60d90)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:21.383148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:21.385664 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:21.510190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d335494e7c246b997ecf3e6dff60d90', 'request_id': 'req-b8603a00-b8b5-4521-b2b5-0da58b981ca5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.522436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d335494e7c246b997ecf3e6dff60d90', 'request_id': 'req-b8603a00-b8b5-4521-b2b5-0da58b981ca5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.539702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d335494e7c246b997ecf3e6dff60d90', 'request_id': 'req-b8603a00-b8b5-4521-b2b5-0da58b981ca5'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.560819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] The token cache is being invalidate because project 7d335494e7c246b997ecf3e6dff60d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:21.560819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.560819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.563770 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3227/6462] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:21 2022] DELETE /identity/v3/projects/7d335494e7c246b997ecf3e6dff60d90 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:21.564838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:21.566291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:21.586488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8d48-7cfd-4f43-bda2-1fdbfbf9b37a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:21.710327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:21.711164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:21.711651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:21.711933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] PATH_INFO: `/v3/users/ba7ceb52ca634f4f97567f0520121212` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:21.713850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7ceb52ca634f4f97567f0520121212)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:21.716007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:21.824090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7ceb52ca634f4f97567f0520121212'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.825954 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:21.841438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7ceb52ca634f4f97567f0520121212'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.866869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7ceb52ca634f4f97567f0520121212'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.867830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7ceb52ca634f4f97567f0520121212'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.889960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7ceb52ca634f4f97567f0520121212'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:21.901178 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3236/6463] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:21 2022] DELETE /identity/v3/users/ba7ceb52ca634f4f97567f0520121212 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:22.305583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:22.307070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:22.343883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8603a00-b8b5-4521-b2b5-0da58b981ca5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:22.403589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:22.405169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:22.442661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:22.443815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:22.446228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:22.446683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] PATH_INFO: `/v3/users/0c6bcee78c3148b5a6caa34678b1cc10` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:22.451073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6bcee78c3148b5a6caa34678b1cc10)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:22.453067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:22.511386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6bcee78c3148b5a6caa34678b1cc10'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.523638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6bcee78c3148b5a6caa34678b1cc10'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.524554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6bcee78c3148b5a6caa34678b1cc10'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.526510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606181-dbc7-4ad2-8fd1-131233f1ee63 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:22.531962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:22.532596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:22.532902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:22.533172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] PATH_INFO: `/v3/projects/89a0e9b909d74062b7a3d39494d58af8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:22.533352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6bcee78c3148b5a6caa34678b1cc10'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.534103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6bcee78c3148b5a6caa34678b1cc10'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.534458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a0e9b909d74062b7a3d39494d58af8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:22.536471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:22.564738 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3228/6464] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:22 2022] DELETE /identity/v3/users/0c6bcee78c3148b5a6caa34678b1cc10 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:22.617126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a0e9b909d74062b7a3d39494d58af8', 'request_id': 'req-5402840f-e901-48dc-b4da-a6bd8081460b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.625859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a0e9b909d74062b7a3d39494d58af8', 'request_id': 'req-5402840f-e901-48dc-b4da-a6bd8081460b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.635222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a0e9b909d74062b7a3d39494d58af8', 'request_id': 'req-5402840f-e901-48dc-b4da-a6bd8081460b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.657391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] The token cache is being invalidate because project 89a0e9b909d74062b7a3d39494d58af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:22.658438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.659653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:22.678692 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3237/6465] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:22 2022] DELETE /identity/v3/projects/89a0e9b909d74062b7a3d39494d58af8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:22.823751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:22.825928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:22.840610 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:22.926346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc3f4d-1464-4212-8b18-6ba33840ec0b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:22.993130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:22.995422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:23.020939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.021693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.022014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.022370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] PATH_INFO: `/v3/projects/1a83ba47ffad4cb4a82638934e637155` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.024888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a83ba47ffad4cb4a82638934e637155)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.026949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.149224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a83ba47ffad4cb4a82638934e637155', 'request_id': 'req-e4bb247c-68c7-4aa0-96df-727d511d4a3f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.163182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a83ba47ffad4cb4a82638934e637155', 'request_id': 'req-e4bb247c-68c7-4aa0-96df-727d511d4a3f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.172465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a83ba47ffad4cb4a82638934e637155', 'request_id': 'req-e4bb247c-68c7-4aa0-96df-727d511d4a3f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.173310 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:23.187794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] The token cache is being invalidate because project 1a83ba47ffad4cb4a82638934e637155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:23.188407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.189568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e4bb247c-68c7-4aa0-96df-727d511d4a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.189694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402840f-e901-48dc-b4da-a6bd8081460b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.199537 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3229/6466] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:22 2022] DELETE /identity/v3/projects/1a83ba47ffad4cb4a82638934e637155 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:23.201407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5d747-c67b-4a8f-9200-66267a410f51 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.201908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5d747-c67b-4a8f-9200-66267a410f51 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.202358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5d747-c67b-4a8f-9200-66267a410f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.223522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-07f5d747-c67b-4a8f-9200-66267a410f51 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:23.225267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-07f5d747-c67b-4a8f-9200-66267a410f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:23.265748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.266485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.266987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.267325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] PATH_INFO: `/v3/users/3ef9eb2bdcdc46e39ec1feba7b251df7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.268545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef9eb2bdcdc46e39ec1feba7b251df7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.270603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.273447 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:23.304575 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3230/6467] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:23.306037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacab9e-ca62-452e-bfda-206ffad94f27 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.306680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacab9e-ca62-452e-bfda-206ffad94f27 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.306680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacab9e-ca62-452e-bfda-206ffad94f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.323574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef9eb2bdcdc46e39ec1feba7b251df7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.328662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3cacab9e-ca62-452e-bfda-206ffad94f27 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:23.329892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3cacab9e-ca62-452e-bfda-206ffad94f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:23.342493 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3231/6468] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:23.343481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacab9e-ca62-452e-bfda-206ffad94f27 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:23.345080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef9eb2bdcdc46e39ec1feba7b251df7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.354191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacab9e-ca62-452e-bfda-206ffad94f27 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.359814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.360570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.360968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.361332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.362737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:23.363201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.365433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.378616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef9eb2bdcdc46e39ec1feba7b251df7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.379563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef9eb2bdcdc46e39ec1feba7b251df7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.384780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3232/6469] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:23.390655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:23.400269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f169302-49f0-4fc4-bc11-43ec37953633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef9eb2bdcdc46e39ec1feba7b251df7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:23.413620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce41c1-ae2c-44cd-9f30-170b3ba79576 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.420642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.421503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.421788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.422061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.422664 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3238/6470] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:22 2022] DELETE /identity/v3/users/3ef9eb2bdcdc46e39ec1feba7b251df7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:23.422784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.425867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.427133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.427680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.427996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.465080 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3233/6471] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:23 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:23.468675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:23.471273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:23.491166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:23.493378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:23.584706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615cb5-6c1f-459f-8829-8e98c3259192 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.592496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.593193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.593428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.593704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.594384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.596201 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3239/6472] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:23.596662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.618651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:23.620309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:23.631160 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3234/6473] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:23 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:36:23.635096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:23.653172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fb8b-31c0-42d5-aaf1-bee432770f38 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.678591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.679420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.679767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.680102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.680839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.681437 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:23.683371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.704019 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3235/6474] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:23.706823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:23.720486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f25828-8a78-4a79-950f-b097cf2ae082 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.727058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.727966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.728309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.728643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.729623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.731438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.749635 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3236/6475] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:23.754119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:23.761980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cd50b-72a6-4e50-a9e5-81c96f9a1d2b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.766187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8db4e-be70-4233-aa39-a52c616f813c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.767055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8db4e-be70-4233-aa39-a52c616f813c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.767477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8db4e-be70-4233-aa39-a52c616f813c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.767896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8db4e-be70-4233-aa39-a52c616f813c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.768204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68003d-aad6-412d-8c0c-c5ae6fe8b4d0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:23.774241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:23.775156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.775521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.775884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] PATH_INFO: `/v3/projects/290c8849026f4c73ae5afb45243301ed/users/e9fc462c45eb43179e9cf1d0a67d7a6e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.778779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8db4e-be70-4233-aa39-a52c616f813c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.780233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8db4e-be70-4233-aa39-a52c616f813c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.791172 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3240/6476] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:23.797939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290c8849026f4c73ae5afb45243301ed, user_id=e9fc462c45eb43179e9cf1d0a67d7a6e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:23.800754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:23.829149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3237/6477] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:23 2022] PUT /identity/v3/projects/290c8849026f4c73ae5afb45243301ed/users/e9fc462c45eb43179e9cf1d0a67d7a6e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:23.830066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:23.830372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:23.830651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:23.899873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] MFA Rules not processed for user `e9fc462c45eb43179e9cf1d0a67d7a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:23.902416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:24.000081 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3241/6478] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:24.023230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:24.025770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:24.089512 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:24.148531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db0d39-1aa4-4d95-bcdb-b98b384b3e92 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:24.154656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:24.155265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:24.155539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:24.155808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:24.160406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:24.162279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:24.169918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:24.171416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:24.183349 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3238/6479] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:24.253967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeea53-2668-4717-9580-d3b04081e33b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:24.259620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:24.260322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:24.260563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:24.260875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] PATH_INFO: `/v3/projects/e5f061be91cf41fcaafa0b1cdfdff539` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:24.262841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f061be91cf41fcaafa0b1cdfdff539)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:24.265158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:24.335506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f061be91cf41fcaafa0b1cdfdff539', 'request_id': 'req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.342957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f061be91cf41fcaafa0b1cdfdff539', 'request_id': 'req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.347198 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:24.353459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f061be91cf41fcaafa0b1cdfdff539', 'request_id': 'req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.376760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] The token cache is being invalidate because project e5f061be91cf41fcaafa0b1cdfdff539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:24.377368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.378320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.380193 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3242/6480] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:24 2022] DELETE /identity/v3/projects/e5f061be91cf41fcaafa0b1cdfdff539 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:24.385202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:24.398151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcbb85-deba-4e11-85c3-5d0d42e4e472 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:24.484702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:24.485553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:24.486041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:24.486156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] PATH_INFO: `/v3/users/48012220a0544d0ea052d6db4987df43` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:24.488527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48012220a0544d0ea052d6db4987df43)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:24.492518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:24.610165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48012220a0544d0ea052d6db4987df43'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.623755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48012220a0544d0ea052d6db4987df43'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.626882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48012220a0544d0ea052d6db4987df43'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.652650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48012220a0544d0ea052d6db4987df43'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.655672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c5ed7844-1be8-4e2b-8460-d886b860f625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48012220a0544d0ea052d6db4987df43'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:24.726415 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3239/6481] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:24 2022] DELETE /identity/v3/users/48012220a0544d0ea052d6db4987df43 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:25.222495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:25.225065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:25.247506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8215-cc20-4ab4-a75d-9ca8006ba637 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:25.310338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:25.310998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.311300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.311572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] PATH_INFO: `/v3/projects/f8ce8a48f627468db70707bb8420b061` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.312730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ce8a48f627468db70707bb8420b061)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:25.314669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:25.362466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ce8a48f627468db70707bb8420b061', 'request_id': 'req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:25.368688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ce8a48f627468db70707bb8420b061', 'request_id': 'req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:25.374411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ce8a48f627468db70707bb8420b061', 'request_id': 'req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:25.388944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] The token cache is being invalidate because project f8ce8a48f627468db70707bb8420b061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:25.389235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:25.389847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cf928587-13d1-4a86-b3d6-4bf0ac5be4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:25.391855 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3243/6482] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:25 2022] DELETE /identity/v3/projects/f8ce8a48f627468db70707bb8420b061 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:25.396521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7cfb9-018b-459f-b3f7-93245f2e3184 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.397403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7cfb9-018b-459f-b3f7-93245f2e3184 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.397761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7cfb9-018b-459f-b3f7-93245f2e3184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.418973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4de7cfb9-018b-459f-b3f7-93245f2e3184 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:25.420186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4de7cfb9-018b-459f-b3f7-93245f2e3184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:25.464578 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:25.493820 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3240/6483] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:25.502184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21bfc4-2c60-4448-b794-7f220fb2c629 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.502467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21bfc4-2c60-4448-b794-7f220fb2c629 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.502741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21bfc4-2c60-4448-b794-7f220fb2c629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.525284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9a21bfc4-2c60-4448-b794-7f220fb2c629 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:25.526531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a21bfc4-2c60-4448-b794-7f220fb2c629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:25.535843 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3244/6484] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:25.540740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7cfb9-018b-459f-b3f7-93245f2e3184 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:25.553026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7cfb9-018b-459f-b3f7-93245f2e3184 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:25.559912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:25.560547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.560863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.561137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.561798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:25.562104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:25.563718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:25.580800 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3241/6485] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:25.581774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21bfc4-2c60-4448-b794-7f220fb2c629 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:25.592702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21bfc4-2c60-4448-b794-7f220fb2c629 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:25.598004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:25.598620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.598901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.599354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.600189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:25.603647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:25.635621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3245/6486] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:25 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:25.639905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:25.652982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c212475-a18d-4410-8ad5-59a897f12050 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:25.714860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:25.715421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.715694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.715961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.716613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:25.718574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:25.742006 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3242/6487] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:25 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:25.746740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:25.757794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b669f-afac-43fa-9576-8d2ea4be0e64 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:25.762853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:25.763474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.763749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.764022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.764692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:25.766353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:25.777262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3246/6488] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:25.781651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:25.794279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3925f-8025-42f4-900a-2793b1e8ab47 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:25.800124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02759cf8-ce54-4c5c-9f48-18502db99b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:25.800731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759cf8-ce54-4c5c-9f48-18502db99b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.801050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759cf8-ce54-4c5c-9f48-18502db99b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.801310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759cf8-ce54-4c5c-9f48-18502db99b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.801961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02759cf8-ce54-4c5c-9f48-18502db99b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:25.804138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02759cf8-ce54-4c5c-9f48-18502db99b44 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:25.815381 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3243/6489] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:25.819914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:25.830489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aaf17-11ec-4bbe-a144-f498f8f4c551 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:25.835875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:25.836527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.836827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.837107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] PATH_INFO: `/v3/projects/a2d740eb4349470f9067f40b2ba97b5a/users/a89fac11fe6c44f6b44ea51d67589a3c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.852463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d740eb4349470f9067f40b2ba97b5a, user_id=a89fac11fe6c44f6b44ea51d67589a3c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:25.855202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:25.871358 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3247/6490] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:25 2022] PUT /identity/v3/projects/a2d740eb4349470f9067f40b2ba97b5a/users/a89fac11fe6c44f6b44ea51d67589a3c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:25.882420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a259-a7e4-4528-b940-606809f6c9f4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:25.882708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a259-a7e4-4528-b940-606809f6c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:25.883291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a259-a7e4-4528-b940-606809f6c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:25.919704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6233a259-a7e4-4528-b940-606809f6c9f4 None None] MFA Rules not processed for user `a89fac11fe6c44f6b44ea51d67589a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:25.920965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6233a259-a7e4-4528-b940-606809f6c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:25.989702 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3244/6491] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:25.994606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.009548 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:26.063838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f7fd-8866-47ab-886e-05d556f85523 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.064367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f7fd-8866-47ab-886e-05d556f85523 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.065658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f7fd-8866-47ab-886e-05d556f85523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.097058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137cfd3-4618-4ee6-b39c-c1363159478e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.102274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.102895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.103321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.103599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.104380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bd34f7fd-8866-47ab-886e-05d556f85523 None None] MFA Rules not processed for user `27a75d14c8494952a4577bff44f15f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:26.104502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.105954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bd34f7fd-8866-47ab-886e-05d556f85523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:26.106518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:26.155370 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3248/6492] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:25 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:36:26.158351 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:26.159835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.201638 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3245/6493] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:26.249988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c4d0e-c1ac-4665-9d40-cdaa1f380f8c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.255295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.256197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.256629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.258999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.259798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.262580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:26.291523 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3249/6494] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:26 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:26.296603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34f7fd-8866-47ab-886e-05d556f85523 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.309425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34f7fd-8866-47ab-886e-05d556f85523 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.316373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.317204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.317545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.317941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.318793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.320510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:26.335883 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3246/6495] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:26.337391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.353062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eec7a7-e42e-4e3a-9834-f1a2e5107aa4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.359684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.363695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.363984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.364263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] PATH_INFO: `/v3/projects/0b28bf64c83347a09595e990f3369e22/users/77c34255630949c5892ab8345c2452a7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.382161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28bf64c83347a09595e990f3369e22, user_id=77c34255630949c5892ab8345c2452a7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.384977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:26.408056 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3250/6496] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:26 2022] PUT /identity/v3/projects/0b28bf64c83347a09595e990f3369e22/users/77c34255630949c5892ab8345c2452a7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:26.411250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.425055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49a441-2776-4991-b61c-8aa150fe0f14 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.502005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ed18f-d96f-4ca7-b2ba-80d99371461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.502637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed18f-d96f-4ca7-b2ba-80d99371461e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.502875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed18f-d96f-4ca7-b2ba-80d99371461e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.503134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed18f-d96f-4ca7-b2ba-80d99371461e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.503992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ed18f-d96f-4ca7-b2ba-80d99371461e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.505771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ed18f-d96f-4ca7-b2ba-80d99371461e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:26.516956 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3247/6497] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:36:26.521026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.532229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad041d-6985-44f1-a930-d34dfac0b26b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.538804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.539534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.539817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.540191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] PATH_INFO: `/v3/projects/0b28bf64c83347a09595e990f3369e22/users/77c34255630949c5892ab8345c2452a7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.542573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28bf64c83347a09595e990f3369e22, user_id=77c34255630949c5892ab8345c2452a7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.545528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:26.564819 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3251/6498] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:26 2022] PUT /identity/v3/projects/0b28bf64c83347a09595e990f3369e22/users/77c34255630949c5892ab8345c2452a7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:26.569323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4da4-3a68-4bfb-93eb-e946c9900089 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.569651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4da4-3a68-4bfb-93eb-e946c9900089 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.569885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4da4-3a68-4bfb-93eb-e946c9900089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.600133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-68bf4da4-3a68-4bfb-93eb-e946c9900089 None None] MFA Rules not processed for user `77c34255630949c5892ab8345c2452a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:26.601423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68bf4da4-3a68-4bfb-93eb-e946c9900089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:26.674216 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3248/6499] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:26.686886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.689058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:26.750549 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:26.756471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae84ba-438d-4a28-b1d2-2bcc6b836efe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.761969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e11f7a-03c7-477c-84d6-4760d78eca4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.763161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e11f7a-03c7-477c-84d6-4760d78eca4b service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.763311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e11f7a-03c7-477c-84d6-4760d78eca4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.763701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e11f7a-03c7-477c-84d6-4760d78eca4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.774565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e11f7a-03c7-477c-84d6-4760d78eca4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.776010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e11f7a-03c7-477c-84d6-4760d78eca4b service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:26.787202 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3252/6500] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:26.872262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4da4-3a68-4bfb-93eb-e946c9900089 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:26.892441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4da4-3a68-4bfb-93eb-e946c9900089 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:26.900052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:26.906520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:26.906790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:26.907071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:26.977488 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:26.991295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:26.997572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:27.010574 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3249/6501] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:27.434308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:27.435444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:27.436065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:27.478744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:27.480176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:27.568807 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3253/6502] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:27.638372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:27.640309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:27.778243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b4a0-f6ef-412e-b23a-94f15c97524d service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:27.783287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924b133-c6f9-484e-acdb-5cfd36fdac23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:27.783922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924b133-c6f9-484e-acdb-5cfd36fdac23 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:27.784201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924b133-c6f9-484e-acdb-5cfd36fdac23 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:27.784602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924b133-c6f9-484e-acdb-5cfd36fdac23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:27.798123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924b133-c6f9-484e-acdb-5cfd36fdac23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:27.800022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924b133-c6f9-484e-acdb-5cfd36fdac23 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:27.812792 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3250/6503] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:35.810899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:35.812364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:35.890534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddaefe-373e-40fe-b814-f66424653ac7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:35.895249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:35.895964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:35.896364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:35.896644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] PATH_INFO: `/v3/users/e9fc462c45eb43179e9cf1d0a67d7a6e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:35.897869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9fc462c45eb43179e9cf1d0a67d7a6e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:35.902220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:35.987186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9fc462c45eb43179e9cf1d0a67d7a6e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:36.001187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9fc462c45eb43179e9cf1d0a67d7a6e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:36.038219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9fc462c45eb43179e9cf1d0a67d7a6e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:36.039123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9fc462c45eb43179e9cf1d0a67d7a6e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:36.060434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9fc462c45eb43179e9cf1d0a67d7a6e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:36.070553 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3254/6504] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:35 2022] DELETE /identity/v3/users/e9fc462c45eb43179e9cf1d0a67d7a6e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:36.074719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:36.075306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:36.075306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:36.121107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:36.123224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:36.245473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3251/6505] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:36.255757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:36.257356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:36.269327 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:36.370513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dd68c-bf41-47f1-bb83-0008731b9b7a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:36.375034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbee98-e94d-4393-a0e8-cd3b98ad5756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:36.376004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbee98-e94d-4393-a0e8-cd3b98ad5756 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:36.376700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbee98-e94d-4393-a0e8-cd3b98ad5756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:36.377236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbee98-e94d-4393-a0e8-cd3b98ad5756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:36.390289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbee98-e94d-4393-a0e8-cd3b98ad5756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:36.392369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbee98-e94d-4393-a0e8-cd3b98ad5756 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:36.405224 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3255/6506] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:36.933555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:36.935424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:36.965423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ff2b4-78c8-47bb-840c-c29d28b043e3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:37.010737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:37.011873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.012160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.012436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] PATH_INFO: `/v3/projects/290c8849026f4c73ae5afb45243301ed` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.015060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290c8849026f4c73ae5afb45243301ed)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:37.016974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:37.124556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290c8849026f4c73ae5afb45243301ed', 'request_id': 'req-67cfb658-2904-41f1-80d9-dc53d9e71ce9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:37.154145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290c8849026f4c73ae5afb45243301ed', 'request_id': 'req-67cfb658-2904-41f1-80d9-dc53d9e71ce9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:37.164351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290c8849026f4c73ae5afb45243301ed', 'request_id': 'req-67cfb658-2904-41f1-80d9-dc53d9e71ce9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:37.178729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] The token cache is being invalidate because project 290c8849026f4c73ae5afb45243301ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:37.179089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:37.179882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67cfb658-2904-41f1-80d9-dc53d9e71ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:37.181932 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3252/6507] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:36 2022] DELETE /identity/v3/projects/290c8849026f4c73ae5afb45243301ed => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:37.188177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a13e9-70d7-4d49-95b4-219332e5f7ab None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.188733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a13e9-70d7-4d49-95b4-219332e5f7ab None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.189248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a13e9-70d7-4d49-95b4-219332e5f7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.212894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-725a13e9-70d7-4d49-95b4-219332e5f7ab None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:37.213111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-725a13e9-70d7-4d49-95b4-219332e5f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:37.322234 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3256/6508] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:37.329893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb03347-bcb8-4401-a760-d47624079f29 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.330185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb03347-bcb8-4401-a760-d47624079f29 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.330455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb03347-bcb8-4401-a760-d47624079f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.340444 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:37.360552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4bb03347-bcb8-4401-a760-d47624079f29 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:37.362028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4bb03347-bcb8-4401-a760-d47624079f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:37.378430 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3253/6509] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:37.382920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a13e9-70d7-4d49-95b4-219332e5f7ab None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:37.401388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a13e9-70d7-4d49-95b4-219332e5f7ab None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:37.408391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:37.409219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.409487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.409597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.410665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:37.410978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:37.413064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:37.443492 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3257/6510] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:37.447702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb03347-bcb8-4401-a760-d47624079f29 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:37.464997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb03347-bcb8-4401-a760-d47624079f29 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:37.471452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:37.472382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.472913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.473951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.474935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:37.478036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:37.542671 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3254/6511] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:37 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:37.546907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:37.561265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff00b8-2dca-4207-a9a9-d4aa30856194 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:37.651991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:37.653357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.653838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.654186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.655085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:37.657025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:37.698089 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3258/6512] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:37 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:37.701357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:37.722600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e3296-979a-40f7-b016-e6b7065a65e6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:37.731163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:37.731791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.732103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.733453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.733453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:37.735071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:37.757221 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3255/6513] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:37.758827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:37.770598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb457c6-4461-4da4-825e-5d3a4f3bf1fd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:37.775989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4171536-b1b8-4fe6-a8d3-da8b4ff3cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:37.776609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171536-b1b8-4fe6-a8d3-da8b4ff3cfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.776921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171536-b1b8-4fe6-a8d3-da8b4ff3cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.777197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171536-b1b8-4fe6-a8d3-da8b4ff3cfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.777879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4171536-b1b8-4fe6-a8d3-da8b4ff3cfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:37.779595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4171536-b1b8-4fe6-a8d3-da8b4ff3cfe8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:37.800827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:37.801069 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3259/6514] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:37.812789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116bbd4-a37d-4c59-82da-b2a6d7aea4ca admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:37.824078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:37.825243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.826591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.826591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] PATH_INFO: `/v3/projects/6c92ff45bfe0424cbe85956831a5318a/users/ec222727f5d246ceb061a2132aed6ec5/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.847970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c92ff45bfe0424cbe85956831a5318a, user_id=ec222727f5d246ceb061a2132aed6ec5, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:37.850955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:37.890585 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3256/6515] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:37 2022] PUT /identity/v3/projects/6c92ff45bfe0424cbe85956831a5318a/users/ec222727f5d246ceb061a2132aed6ec5/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:37.909651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e925-66a1-460d-ac8d-134d0138a5b5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:37.909927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e925-66a1-460d-ac8d-134d0138a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:37.910206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e925-66a1-460d-ac8d-134d0138a5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:37.959172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d3b8e925-66a1-460d-ac8d-134d0138a5b5 None None] MFA Rules not processed for user `ec222727f5d246ceb061a2132aed6ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:37.960818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d3b8e925-66a1-460d-ac8d-134d0138a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:37.968041 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:38.075194 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3260/6516] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:38.076241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:38.238547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc880-9b31-408e-86af-0c8da8b1dd6d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:38.254519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:38.255319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:38.255620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:38.255835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:38.256470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:38.258464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:38.360981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8e925-66a1-460d-ac8d-134d0138a5b5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:38.368813 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3257/6517] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:38 2022] POST /identity/v3/projects => generated 377 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:38.374378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8e925-66a1-460d-ac8d-134d0138a5b5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:38.478555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:38.479540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:38.479966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:38.480395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:38.481391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:38.483766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:38.555080 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3261/6518] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:38 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:36:38.559857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:38.593359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee6d5-f678-44b1-b004-336cd9db8f23 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:38.600043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:38.600665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:38.600992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:38.601273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:38.605518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:38.607177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:38.639243 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3258/6519] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:38.643196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:38.656294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d87a-9210-420d-b9b2-385476797c59 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:38.678191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:38.679685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:38.679986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:38.681784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] PATH_INFO: `/v3/projects/3550d4ba254a4c249d31a2a0a315e96a/users/8238c231b54e4c018911ca71b6dd1262/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:38.716118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3550d4ba254a4c249d31a2a0a315e96a, user_id=8238c231b54e4c018911ca71b6dd1262, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:38.724196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:38.760915 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3262/6520] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:38 2022] PUT /identity/v3/projects/3550d4ba254a4c249d31a2a0a315e96a/users/8238c231b54e4c018911ca71b6dd1262/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:38.764694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:38.777112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e7553-1e94-413c-994e-1da21937db35 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:38.924184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80593fc-47a2-4f73-b39b-9c87afd4b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:38.924863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80593fc-47a2-4f73-b39b-9c87afd4b6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:38.925135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80593fc-47a2-4f73-b39b-9c87afd4b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:38.925418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80593fc-47a2-4f73-b39b-9c87afd4b6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:38.926205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80593fc-47a2-4f73-b39b-9c87afd4b6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:38.928333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80593fc-47a2-4f73-b39b-9c87afd4b6a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:38.945226 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3259/6521] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:38.954398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:38.996810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e8d8-cb33-4043-be3b-21c5cb5ae30a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:39.019106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:39.022369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.023261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.023791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] PATH_INFO: `/v3/projects/3550d4ba254a4c249d31a2a0a315e96a/users/8238c231b54e4c018911ca71b6dd1262/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.028986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3550d4ba254a4c249d31a2a0a315e96a, user_id=8238c231b54e4c018911ca71b6dd1262, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:39.041083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:39.076075 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3263/6522] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:38 2022] PUT /identity/v3/projects/3550d4ba254a4c249d31a2a0a315e96a/users/8238c231b54e4c018911ca71b6dd1262/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:39.086950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6e8e-bc2e-4094-b680-b66c93b68889 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.087238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6e8e-bc2e-4094-b680-b66c93b68889 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.087493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6e8e-bc2e-4094-b680-b66c93b68889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.113803 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:39.126142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d9ca6e8e-bc2e-4094-b680-b66c93b68889 None None] MFA Rules not processed for user `8238c231b54e4c018911ca71b6dd1262`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:39.129994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d9ca6e8e-bc2e-4094-b680-b66c93b68889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:39.234259 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3260/6523] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:39.240093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:39.252463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b608ce-bd9f-4339-aca7-aa4e49d85e55 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:39.259444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:39.260061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.260344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.260617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.261437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:39.263175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:39.310801 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3264/6524] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:36:39 2022] POST /identity/v3/domains => generated 245 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:39.318738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6e8e-bc2e-4094-b680-b66c93b68889 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:39.335731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6e8e-bc2e-4094-b680-b66c93b68889 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:39.426743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:39.427447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.427447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.428036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.428650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:39.430764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:39.512592 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3261/6525] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:39 2022] POST /identity/v3/projects => generated 410 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:39.513833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:39.525974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55864-01b8-49a3-8639-2ee10b3d46eb tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:39.607000 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:39.632362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:39.633077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.633430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.633764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.634485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:39.636601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:39.671152 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3265/6526] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:39 2022] POST /identity/v3/users => generated 348 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:39.675718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:39.701187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14dc1-c495-4bed-8129-71a217e2155b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:39.718603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190513e0-1f9e-478f-a01b-f1e0009dda19 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:39.719462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190513e0-1f9e-478f-a01b-f1e0009dda19 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.719741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190513e0-1f9e-478f-a01b-f1e0009dda19 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.720009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190513e0-1f9e-478f-a01b-f1e0009dda19 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.720720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190513e0-1f9e-478f-a01b-f1e0009dda19 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:39.722383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190513e0-1f9e-478f-a01b-f1e0009dda19 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:39.746471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3262/6527] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:39.751843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:39.768021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae591c-aab1-4a4c-8a59-f4bae151461b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:39.776009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43ae8-9ab1-452c-849e-43b8cc98ca9f tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:39.777587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43ae8-9ab1-452c-849e-43b8cc98ca9f tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.778228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43ae8-9ab1-452c-849e-43b8cc98ca9f tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.779090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43ae8-9ab1-452c-849e-43b8cc98ca9f tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/projects/66a8d45634d5495b9452b26071ddeb7c/users/2838bf07e34e454e98cb7d7f726bf780/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.803543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43ae8-9ab1-452c-849e-43b8cc98ca9f tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66a8d45634d5495b9452b26071ddeb7c, user_id=2838bf07e34e454e98cb7d7f726bf780, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:39.806524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43ae8-9ab1-452c-849e-43b8cc98ca9f tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:39.824691 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3266/6528] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:39 2022] PUT /identity/v3/projects/66a8d45634d5495b9452b26071ddeb7c/users/2838bf07e34e454e98cb7d7f726bf780/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:39.829333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b71da-d93c-4c05-8905-4029dde7c03a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:39.829609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b71da-d93c-4c05-8905-4029dde7c03a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:39.829891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b71da-d93c-4c05-8905-4029dde7c03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:39.979020 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:40.058873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7e9b71da-d93c-4c05-8905-4029dde7c03a None None] MFA Rules not processed for user `2838bf07e34e454e98cb7d7f726bf780`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:40.060153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7e9b71da-d93c-4c05-8905-4029dde7c03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:40.118668 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3263/6529] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:40.135129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9cdae-410d-4b7d-b630-79d0c8ba4e28 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:40.138464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9cdae-410d-4b7d-b630-79d0c8ba4e28 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:40.138938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9cdae-410d-4b7d-b630-79d0c8ba4e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:40.173817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-abb9cdae-410d-4b7d-b630-79d0c8ba4e28 None None] MFA Rules not processed for user `2838bf07e34e454e98cb7d7f726bf780`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:40.175335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-abb9cdae-410d-4b7d-b630-79d0c8ba4e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:40.187827 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3267/6530] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:40.193854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b71da-d93c-4c05-8905-4029dde7c03a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:40.211252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b71da-d93c-4c05-8905-4029dde7c03a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:40.224251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2838bf07e34e454e98cb7d7f726bf780', 'user_domain_id': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'system_scope': None, 'project_id': '66a8d45634d5495b9452b26071ddeb7c', 'project_domain_id': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:40.225189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:40.225478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:40.228808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:40.240591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:40.242899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:40.260812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3264/6531] 10.222.0.46 () {56 vars in 1284 bytes} [Sun Aug 21 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:40.262831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9cdae-410d-4b7d-b630-79d0c8ba4e28 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:40.437997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9cdae-410d-4b7d-b630-79d0c8ba4e28 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:40.444673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:40.446048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:40.446582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:40.447058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/users/2838bf07e34e454e98cb7d7f726bf780` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:40.448629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2838bf07e34e454e98cb7d7f726bf780)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:40.450973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:40.564174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2838bf07e34e454e98cb7d7f726bf780'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:40.578541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2838bf07e34e454e98cb7d7f726bf780'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:40.595549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2838bf07e34e454e98cb7d7f726bf780'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:40.596495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2838bf07e34e454e98cb7d7f726bf780'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:40.605735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2838bf07e34e454e98cb7d7f726bf780'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:40.616564 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3268/6532] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:40 2022] DELETE /identity/v3/users/2838bf07e34e454e98cb7d7f726bf780 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:40.621696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:40.648847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1c5a8-b508-40f9-9bc4-2565aabe883e tempest-test_project-1906530427 tempest-user-1839178989] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:40.834144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:40.835028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:40.835437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:40.835737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/projects/66a8d45634d5495b9452b26071ddeb7c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:40.838229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66a8d45634d5495b9452b26071ddeb7c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:40.842161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:41.012129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a8d45634d5495b9452b26071ddeb7c', 'request_id': 'req-5040b51b-5f64-4c21-afde-7b21087cc1e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.048201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a8d45634d5495b9452b26071ddeb7c', 'request_id': 'req-5040b51b-5f64-4c21-afde-7b21087cc1e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.074910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a8d45634d5495b9452b26071ddeb7c', 'request_id': 'req-5040b51b-5f64-4c21-afde-7b21087cc1e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.117344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] The token cache is being invalidate because project 66a8d45634d5495b9452b26071ddeb7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:41.117636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.120635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.124190 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3265/6533] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:40 2022] DELETE /identity/v3/projects/66a8d45634d5495b9452b26071ddeb7c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:41.128532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:41.130528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:41.155219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37faa-f2db-4af1-ba2f-5131b6bd0d7b tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:41.218954 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:41.355730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:41.356387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:41.356674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:41.356974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/domains/ce5ca3e9fa1f4068ac40b8706fffe01b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:41.359143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ce5ca3e9fa1f4068ac40b8706fffe01b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:41.360907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:41.404881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.406430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.487312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.488221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.491391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3269/6534] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:36:41 2022] PATCH /identity/v3/domains/ce5ca3e9fa1f4068ac40b8706fffe01b => generated 246 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:41.495476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:41.497098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:41.520614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040b51b-5f64-4c21-afde-7b21087cc1e8 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:41.589455 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:41.605421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8238c231b54e4c018911ca71b6dd1262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3550d4ba254a4c249d31a2a0a315e96a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:41.606431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:41.606925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:41.607426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] PATH_INFO: `/v3/domains/ce5ca3e9fa1f4068ac40b8706fffe01b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:41.623893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ce5ca3e9fa1f4068ac40b8706fffe01b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:41.626265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:41.676904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.683713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.757617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'request_id': 'req-e8979dc8-94f8-441b-af36-99489adc0a79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.771488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'request_id': 'req-e8979dc8-94f8-441b-af36-99489adc0a79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.779985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'request_id': 'req-e8979dc8-94f8-441b-af36-99489adc0a79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.818607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] The token cache is being invalidate because project ce5ca3e9fa1f4068ac40b8706fffe01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:41.820073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.821940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.839919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'request_id': 'req-e8979dc8-94f8-441b-af36-99489adc0a79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.840669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'request_id': 'req-e8979dc8-94f8-441b-af36-99489adc0a79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.841386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e8979dc8-94f8-441b-af36-99489adc0a79 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ce5ca3e9fa1f4068ac40b8706fffe01b', 'request_id': 'req-e8979dc8-94f8-441b-af36-99489adc0a79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:41.856228 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3266/6535] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:36:41 2022] DELETE /identity/v3/domains/ce5ca3e9fa1f4068ac40b8706fffe01b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:41.857480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:41.859068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:41.941724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb1f15-07a5-443e-b479-52c4efdef409 tempest-TestDefaultProjectId-1049893748 tempest-TestDefaultProjectId-1049893748-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:42.054029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:42.054965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:42.055736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:42.055736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] PATH_INFO: `/v3/users/ec222727f5d246ceb061a2132aed6ec5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:42.057193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec222727f5d246ceb061a2132aed6ec5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:42.059358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:42.184669 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:42.218670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec222727f5d246ceb061a2132aed6ec5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:42.255305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec222727f5d246ceb061a2132aed6ec5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:42.285589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec222727f5d246ceb061a2132aed6ec5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:42.286860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec222727f5d246ceb061a2132aed6ec5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:42.305753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec222727f5d246ceb061a2132aed6ec5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:42.323923 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3270/6536] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:41 2022] DELETE /identity/v3/users/ec222727f5d246ceb061a2132aed6ec5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:42.333753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:42.334505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:42.334979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:42.398451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:42.399854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:42.523066 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3267/6537] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:42.529061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:42.530506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:42.698697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e234e8f-3c25-430a-b7aa-dfa7962b84ba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:42.708161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:42.708699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:42.709044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:42.709461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:42.723915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:42.725575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:42.754465 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3271/6538] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:43.200704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:43.203250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:43.218607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230bb6e-4033-4e8a-864c-0acae983b517 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:43.224823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:43.225497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:43.225783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:43.226089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] PATH_INFO: `/v3/projects/6c92ff45bfe0424cbe85956831a5318a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:43.227331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c92ff45bfe0424cbe85956831a5318a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:43.229332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:43.262996 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:43.306906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c92ff45bfe0424cbe85956831a5318a', 'request_id': 'req-1e8a48f8-6980-42dc-9233-c08113997a1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.315719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c92ff45bfe0424cbe85956831a5318a', 'request_id': 'req-1e8a48f8-6980-42dc-9233-c08113997a1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.322655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c92ff45bfe0424cbe85956831a5318a', 'request_id': 'req-1e8a48f8-6980-42dc-9233-c08113997a1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.336102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] The token cache is being invalidate because project 6c92ff45bfe0424cbe85956831a5318a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:43.336423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.337225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.338816 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3268/6539] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:43 2022] DELETE /identity/v3/projects/6c92ff45bfe0424cbe85956831a5318a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:43.343153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:43.354888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da104fa-299c-4140-ae48-006a060db7b2 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:43.417224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:43.418492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:43.419006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:43.419477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] PATH_INFO: `/v3/users/8238c231b54e4c018911ca71b6dd1262` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:43.420961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8238c231b54e4c018911ca71b6dd1262)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:43.422875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:43.500506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8238c231b54e4c018911ca71b6dd1262'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.522735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8238c231b54e4c018911ca71b6dd1262'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.528420 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:43.539075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8238c231b54e4c018911ca71b6dd1262'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.540235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8238c231b54e4c018911ca71b6dd1262'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.549120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c0d26ebb-30a8-4320-a3c1-94b2a1cb1725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8238c231b54e4c018911ca71b6dd1262'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:43.555918 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3272/6540] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:43 2022] DELETE /identity/v3/users/8238c231b54e4c018911ca71b6dd1262 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:43.902748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:43.904434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:43.921265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a48f8-6980-42dc-9233-c08113997a1e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:43.996392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:43.997092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:43.997371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:43.998353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] PATH_INFO: `/v3/projects/3550d4ba254a4c249d31a2a0a315e96a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:43.998797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3550d4ba254a4c249d31a2a0a315e96a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.000810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.071540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3550d4ba254a4c249d31a2a0a315e96a', 'request_id': 'req-26167634-3e88-4886-8a73-0369d898b90e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:44.082626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3550d4ba254a4c249d31a2a0a315e96a', 'request_id': 'req-26167634-3e88-4886-8a73-0369d898b90e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:44.093605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3550d4ba254a4c249d31a2a0a315e96a', 'request_id': 'req-26167634-3e88-4886-8a73-0369d898b90e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:44.109032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] The token cache is being invalidate because project 3550d4ba254a4c249d31a2a0a315e96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:44.109330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:44.110001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26167634-3e88-4886-8a73-0369d898b90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:44.111795 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3269/6541] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:43 2022] DELETE /identity/v3/projects/3550d4ba254a4c249d31a2a0a315e96a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:44.117111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7e64-858b-4650-a691-281ce2fced7d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.117994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7e64-858b-4650-a691-281ce2fced7d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.118350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7e64-858b-4650-a691-281ce2fced7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.145445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b59c7e64-858b-4650-a691-281ce2fced7d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:44.146707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b59c7e64-858b-4650-a691-281ce2fced7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:44.210205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3273/6542] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:44.218416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9b02-9226-4d9e-a24a-ae4b9d86a328 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.218933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9b02-9226-4d9e-a24a-ae4b9d86a328 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.218933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9b02-9226-4d9e-a24a-ae4b9d86a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.239642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-baca9b02-9226-4d9e-a24a-ae4b9d86a328 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:44.240887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-baca9b02-9226-4d9e-a24a-ae4b9d86a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:44.249906 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3270/6543] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:44.254132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7e64-858b-4650-a691-281ce2fced7d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.264879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7e64-858b-4650-a691-281ce2fced7d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.270611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.271310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.271809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.272201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.273004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:44.273306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.274975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.288805 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3274/6544] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:44.293068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9b02-9226-4d9e-a24a-ae4b9d86a328 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.305209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9b02-9226-4d9e-a24a-ae4b9d86a328 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.309968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.310587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.310869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.311137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.311773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.313709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.356609 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3271/6545] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:44 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:44.360553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.372428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620336b-c5ca-4187-be64-945db0491415 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.440168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.440890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.441189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.441459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.442448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.444338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.471286 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3275/6546] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:44 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:44.476849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.485457 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:44.492504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3215ff-403d-46c5-80e1-267b92100659 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.499905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.500744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.501373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.502062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.502832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.504853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.529674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.532829 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3272/6547] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:44.549505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e8b78-97d9-4f55-82d6-7f6acb591eac admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.554965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c0e81-0d15-403d-9a94-9f6ebd5eda02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.555731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c0e81-0d15-403d-9a94-9f6ebd5eda02 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.556042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c0e81-0d15-403d-9a94-9f6ebd5eda02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.556394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c0e81-0d15-403d-9a94-9f6ebd5eda02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.557327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c0e81-0d15-403d-9a94-9f6ebd5eda02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.559452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c0e81-0d15-403d-9a94-9f6ebd5eda02 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.576227 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3276/6548] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:44.580842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.593092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cdc3-11da-4c07-b1c1-0e7542dc290c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.597691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.598680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.599016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.599476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] PATH_INFO: `/v3/projects/3ed326bc7b1541c19819667b351cca21/users/1c306161edef4ce597ee1b5e81188291/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.620076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed326bc7b1541c19819667b351cca21, user_id=1c306161edef4ce597ee1b5e81188291, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.622830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.639148 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3273/6549] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:44 2022] PUT /identity/v3/projects/3ed326bc7b1541c19819667b351cca21/users/1c306161edef4ce597ee1b5e81188291/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:44.649820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd9c55-889f-4bc4-a53a-7093abf95719 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.650174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd9c55-889f-4bc4-a53a-7093abf95719 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.650456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd9c55-889f-4bc4-a53a-7093abf95719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.680554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a6bd9c55-889f-4bc4-a53a-7093abf95719 None None] MFA Rules not processed for user `1c306161edef4ce597ee1b5e81188291`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:44.681768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6bd9c55-889f-4bc4-a53a-7093abf95719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:44.712954 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:44.751582 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3277/6550] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:44.757193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.826977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24750b-4e62-4bae-a333-16188e2d9b08 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.831923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.832541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.832843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.833116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.833975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.835911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.872371 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3274/6551] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:44 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:44.876358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd9c55-889f-4bc4-a53a-7093abf95719 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:44.888572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd9c55-889f-4bc4-a53a-7093abf95719 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:44.956936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:44.957973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:44.958283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:44.958725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:44.959700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:44.962626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:44.997447 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3278/6552] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:44 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:44.999436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.013109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699b29-66f1-4568-b6e8-da0f91f47aef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.019349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.020142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.020623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.021151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.021936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.025039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.043260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.044611 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3275/6553] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:45.056556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a687a-4550-4f92-ace2-e5d6aaf3e94f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.062043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.062718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.062996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.063268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] PATH_INFO: `/v3/projects/453a9737b50b44a28485a4c88d2cbcd5/users/92efc5cef8e641848f56571c4d144d08/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.083339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] RBAC: Authorizing `identity:create_grant(project_id=453a9737b50b44a28485a4c88d2cbcd5, user_id=92efc5cef8e641848f56571c4d144d08, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.086213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.101983 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3279/6554] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:45 2022] PUT /identity/v3/projects/453a9737b50b44a28485a4c88d2cbcd5/users/92efc5cef8e641848f56571c4d144d08/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:45.106139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.117728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44cc7-3cf7-4200-9a75-575e42a3404b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.187810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25880902-29bd-47ca-a4c7-7a1594386f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.188424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880902-29bd-47ca-a4c7-7a1594386f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.188706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880902-29bd-47ca-a4c7-7a1594386f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.189016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880902-29bd-47ca-a4c7-7a1594386f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.189659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25880902-29bd-47ca-a4c7-7a1594386f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.191250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25880902-29bd-47ca-a4c7-7a1594386f55 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.203208 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3276/6555] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:45.207541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.218886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed31ab-907e-45e6-ba01-f3bfd58a747a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.223811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.224620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.225115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.225396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] PATH_INFO: `/v3/projects/453a9737b50b44a28485a4c88d2cbcd5/users/92efc5cef8e641848f56571c4d144d08/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.227418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453a9737b50b44a28485a4c88d2cbcd5, user_id=92efc5cef8e641848f56571c4d144d08, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.230242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.241846 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3280/6556] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:45 2022] PUT /identity/v3/projects/453a9737b50b44a28485a4c88d2cbcd5/users/92efc5cef8e641848f56571c4d144d08/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:45.252524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432fa0-6df7-466f-a26e-8b28df54eea1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.253124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432fa0-6df7-466f-a26e-8b28df54eea1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.253124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432fa0-6df7-466f-a26e-8b28df54eea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.283421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d8432fa0-6df7-466f-a26e-8b28df54eea1 None None] MFA Rules not processed for user `92efc5cef8e641848f56571c4d144d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:45.284738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d8432fa0-6df7-466f-a26e-8b28df54eea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:45.327569 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:45.372203 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3277/6557] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:45.377428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.389231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5935ee-e477-44f2-9798-6b6d7e1719d7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.393961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92efc5cef8e641848f56571c4d144d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '453a9737b50b44a28485a4c88d2cbcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.394566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.394851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.395130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.396319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.399040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.434433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3281/6558] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:45 2022] POST /identity/v3/projects => generated 357 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:45.438928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432fa0-6df7-466f-a26e-8b28df54eea1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.448948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432fa0-6df7-466f-a26e-8b28df54eea1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.510044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92efc5cef8e641848f56571c4d144d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '453a9737b50b44a28485a4c88d2cbcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.510594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.510872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.511147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.511790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.513698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.544903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3278/6559] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:45 2022] POST /identity/v3/users => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:45.549579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.561542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d452b-b7e1-4963-849b-da399c18b06d tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.567442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d72264-890b-4eba-9b7e-1c62d728cda2 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92efc5cef8e641848f56571c4d144d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '453a9737b50b44a28485a4c88d2cbcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.568252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d72264-890b-4eba-9b7e-1c62d728cda2 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.568532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d72264-890b-4eba-9b7e-1c62d728cda2 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.568842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d72264-890b-4eba-9b7e-1c62d728cda2 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.569576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d72264-890b-4eba-9b7e-1c62d728cda2 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:45.569878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d72264-890b-4eba-9b7e-1c62d728cda2 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.571939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d72264-890b-4eba-9b7e-1c62d728cda2 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.601988 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3282/6560] 10.222.0.46 () {58 vars in 1157 bytes} [Sun Aug 21 01:36:45 2022] GET /identity/v3/users?domain_id=default => generated 7152 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:45.606887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.618654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857feb-195d-4f8d-876a-0e6b319b22ee tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.624270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92efc5cef8e641848f56571c4d144d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '453a9737b50b44a28485a4c88d2cbcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.625091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.625373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.625649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] PATH_INFO: `/v3/users/8307764e68f34227ae5d377211245463` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.641593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorizing `identity:update_user(user_id=8307764e68f34227ae5d377211245463)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.643656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.677151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8307764e68f34227ae5d377211245463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.690028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invalidating the token cache because user 8307764e68f34227ae5d377211245463 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:45.690430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.691529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.694087 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3279/6561] 10.222.0.46 () {60 vars in 1244 bytes} [Sun Aug 21 01:36:45 2022] PATCH /identity/v3/users/8307764e68f34227ae5d377211245463 => generated 488 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:45.699004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.699285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.699555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.719548 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.auth.plugins.core [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] User is disabled: 8307764e68f34227ae5d377211245463: AssertionError: User is disabled: 8307764e68f34227ae5d377211245463 Aug 21 01:36:45.730672 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.server.flask.application [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.46: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 21 01:36:45.732210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3283/6562] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 34 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 21 01:36:45.736538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.738332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:45.753004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011697-5643-43c6-bf60-2a4cd5c1c9af tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.758007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92efc5cef8e641848f56571c4d144d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '453a9737b50b44a28485a4c88d2cbcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.758653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.758937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.759215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] PATH_INFO: `/v3/users/8307764e68f34227ae5d377211245463` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.778035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8307764e68f34227ae5d377211245463)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.780165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:45.828616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8307764e68f34227ae5d377211245463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.837716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8307764e68f34227ae5d377211245463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.838411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8307764e68f34227ae5d377211245463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.840582 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:45.846563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8307764e68f34227ae5d377211245463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.847726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8307764e68f34227ae5d377211245463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:45.866934 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3280/6563] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:45 2022] DELETE /identity/v3/users/8307764e68f34227ae5d377211245463 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:45.871218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:45.873168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:45.922890 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:45.946623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799c50b-dade-4d38-96b4-8a603c9890f6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:45.952025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92efc5cef8e641848f56571c4d144d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '453a9737b50b44a28485a4c88d2cbcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:45.952691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:45.953025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:45.953297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] PATH_INFO: `/v3/projects/8882531da65f4280bf2f06fa91174551` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:45.954491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8882531da65f4280bf2f06fa91174551)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:45.956471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:46.024380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8882531da65f4280bf2f06fa91174551', 'request_id': 'req-e05ada78-a887-4286-a057-0feeae2c1bbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.032793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8882531da65f4280bf2f06fa91174551', 'request_id': 'req-e05ada78-a887-4286-a057-0feeae2c1bbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.040958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8882531da65f4280bf2f06fa91174551', 'request_id': 'req-e05ada78-a887-4286-a057-0feeae2c1bbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.062881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] The token cache is being invalidate because project 8882531da65f4280bf2f06fa91174551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:46.063359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.064469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.067603 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3284/6564] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:45 2022] DELETE /identity/v3/projects/8882531da65f4280bf2f06fa91174551 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:46.075140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:46.090614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388552b-f513-46d7-a017-0a5a79f2e4e7 tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:46.166529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f21293-22fe-4c2c-b6ed-3f40fc9cfebc tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92efc5cef8e641848f56571c4d144d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '453a9737b50b44a28485a4c88d2cbcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:46.167393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21293-22fe-4c2c-b6ed-3f40fc9cfebc tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:46.167741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21293-22fe-4c2c-b6ed-3f40fc9cfebc tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:46.168086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21293-22fe-4c2c-b6ed-3f40fc9cfebc tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:46.168833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f21293-22fe-4c2c-b6ed-3f40fc9cfebc tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:46.170881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f21293-22fe-4c2c-b6ed-3f40fc9cfebc tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-47f21293-22fe-4c2c-b6ed-3f40fc9cfebc tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Could not find domain: 66c4adc3bb844ccbb0ba6132491de14c.: keystone.exception.DomainNotFound: Could not find domain: 66c4adc3bb844ccbb0ba6132491de14c. Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 66c4adc3bb844ccbb0ba6132491de14c. Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:36:46.186958 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 21 01:36:46.188064 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:36:46.189155 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:36:46.190174 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:36:46.190174 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 66c4adc3bb844ccbb0ba6132491de14c. Aug 21 01:36:46.190174 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:36:46.190174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3281/6565] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:46 2022] POST /identity/v3/users => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:36:46.195041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:46.196886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:46.276590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ada78-a887-4286-a057-0feeae2c1bbf tempest-UsersNegativeTest-739128896 tempest-UsersNegativeTest-739128896-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:46.281514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:46.282283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:46.282561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:46.282876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] PATH_INFO: `/v3/users/1c306161edef4ce597ee1b5e81188291` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:46.284083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c306161edef4ce597ee1b5e81188291)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:46.286397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:46.343650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c306161edef4ce597ee1b5e81188291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.354594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c306161edef4ce597ee1b5e81188291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.376366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c306161edef4ce597ee1b5e81188291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.377111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c306161edef4ce597ee1b5e81188291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.383294 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:46.386031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c306161edef4ce597ee1b5e81188291'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.396864 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3285/6566] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:46 2022] DELETE /identity/v3/users/1c306161edef4ce597ee1b5e81188291 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:46.399431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:46.400210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:46.400642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:46.423454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:46.424782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:46.495184 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3282/6567] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:46.506986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:46.508860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:46.592402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7f8a-db24-45cd-8503-b4f6185c1ceb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:46.596340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:46.597076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:46.597352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:46.597632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:46.607741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:46.609403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:46.620168 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3286/6568] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:46.912086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:46.913732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:46.928370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcd376-9e5d-44f9-b994-6f18743bcd45 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:46.933341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:46.934096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:46.934469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:46.934837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] PATH_INFO: `/v3/projects/3ed326bc7b1541c19819667b351cca21` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:46.936222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed326bc7b1541c19819667b351cca21)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:46.938684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:46.991238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed326bc7b1541c19819667b351cca21', 'request_id': 'req-b5fc1a60-787f-4503-be99-bf16289968c4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:46.999684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed326bc7b1541c19819667b351cca21', 'request_id': 'req-b5fc1a60-787f-4503-be99-bf16289968c4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.005896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed326bc7b1541c19819667b351cca21', 'request_id': 'req-b5fc1a60-787f-4503-be99-bf16289968c4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.007805 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:47.019379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] The token cache is being invalidate because project 3ed326bc7b1541c19819667b351cca21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:47.019773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.020866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.022560 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3283/6569] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:46 2022] DELETE /identity/v3/projects/3ed326bc7b1541c19819667b351cca21 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:47.026637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:47.037288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28b27a-3ec4-44f1-99bb-1df580a60f6f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:47.105969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:47.106584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:47.106860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:47.107131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] PATH_INFO: `/v3/users/92efc5cef8e641848f56571c4d144d08` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:47.108262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=92efc5cef8e641848f56571c4d144d08)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:47.110245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:47.158268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92efc5cef8e641848f56571c4d144d08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.167908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92efc5cef8e641848f56571c4d144d08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.182503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92efc5cef8e641848f56571c4d144d08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.183262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92efc5cef8e641848f56571c4d144d08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.191634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92efc5cef8e641848f56571c4d144d08'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.198832 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3287/6570] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:47 2022] DELETE /identity/v3/users/92efc5cef8e641848f56571c4d144d08 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:47.514319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:47.518706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:47.519080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:47.521551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:47.543295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc1a60-787f-4503-be99-bf16289968c4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:47.544142 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:47.594762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc2147-cb25-49c4-a122-9692d69209bb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:47.599270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd781c3-de99-46ae-8cba-abe2058dfa49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:47.600137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd781c3-de99-46ae-8cba-abe2058dfa49 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:47.600598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd781c3-de99-46ae-8cba-abe2058dfa49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:47.601075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd781c3-de99-46ae-8cba-abe2058dfa49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:47.603282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5bd781c3-de99-46ae-8cba-abe2058dfa49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:47.631196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:47.631890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:47.632244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:47.632521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] PATH_INFO: `/v3/projects/453a9737b50b44a28485a4c88d2cbcd5` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:47.633739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453a9737b50b44a28485a4c88d2cbcd5)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:47.635683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:47.694857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd781c3-de99-46ae-8cba-abe2058dfa49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:47.696893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd781c3-de99-46ae-8cba-abe2058dfa49 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:47.702800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453a9737b50b44a28485a4c88d2cbcd5', 'request_id': 'req-c90f44f2-ba83-4994-bb27-621ea8b70ca8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.713859 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3288/6571] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:36:47.721222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453a9737b50b44a28485a4c88d2cbcd5', 'request_id': 'req-c90f44f2-ba83-4994-bb27-621ea8b70ca8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.731604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453a9737b50b44a28485a4c88d2cbcd5', 'request_id': 'req-c90f44f2-ba83-4994-bb27-621ea8b70ca8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.745647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] The token cache is being invalidate because project 453a9737b50b44a28485a4c88d2cbcd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:47.746135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.747117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c90f44f2-ba83-4994-bb27-621ea8b70ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:47.749622 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3284/6572] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:47 2022] DELETE /identity/v3/projects/453a9737b50b44a28485a4c88d2cbcd5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:47.763914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99323764-dbef-43dd-ada4-171ee2382849 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:47.764416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99323764-dbef-43dd-ada4-171ee2382849 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:47.764800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99323764-dbef-43dd-ada4-171ee2382849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:47.801747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-99323764-dbef-43dd-ada4-171ee2382849 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:47.803001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-99323764-dbef-43dd-ada4-171ee2382849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:47.871136 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3289/6573] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:47.964021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167245-7482-4590-97e5-979cc1d46c6c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:47.964428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167245-7482-4590-97e5-979cc1d46c6c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:47.964754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167245-7482-4590-97e5-979cc1d46c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:47.988006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-04167245-7482-4590-97e5-979cc1d46c6c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:47.989356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-04167245-7482-4590-97e5-979cc1d46c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:47.997800 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3285/6574] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:48.002396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99323764-dbef-43dd-ada4-171ee2382849 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:48.013902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99323764-dbef-43dd-ada4-171ee2382849 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:48.018994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:48.019992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.020250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.020523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.021219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:48.021719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:48.023398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:48.037543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3290/6575] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:48.042396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04167245-7482-4590-97e5-979cc1d46c6c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:48.052783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04167245-7482-4590-97e5-979cc1d46c6c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:48.059819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:48.060528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.060868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.061188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.061864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:48.063795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:48.102697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3286/6576] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:48 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:48.106893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:48.120527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaa93a-37de-4928-8d1c-5b4118eefff6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:48.187497 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:48.209452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:48.210206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.210494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.210851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.211369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:48.213295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:48.240530 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3291/6577] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:48 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:48.244303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:48.257251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407da19f-e445-472f-8a57-a6574082e440 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:48.262865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:48.263694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.264102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.264467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.265592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:48.267316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:48.281894 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3287/6578] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:48.286520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:48.301869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed3c95-a4e0-4acf-9e01-eea87537376a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:48.308961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:48.310036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.310835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.311453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] PATH_INFO: `/v3/projects/c688c914b3b2409dbe48dfeb267358f2/users/3bf1f1c86f944ff7b029b6b9c73c6e33/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.332303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c688c914b3b2409dbe48dfeb267358f2, user_id=3bf1f1c86f944ff7b029b6b9c73c6e33, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:48.335957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:48.361655 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3292/6579] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:48 2022] PUT /identity/v3/projects/c688c914b3b2409dbe48dfeb267358f2/users/3bf1f1c86f944ff7b029b6b9c73c6e33/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:48.367409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:48.384403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc45e7-b2a1-44e5-8bbf-5aad813d2373 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:48.473910 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:48.517986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa837f-99a5-4144-8ec7-b265f68d6590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:48.518612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa837f-99a5-4144-8ec7-b265f68d6590 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.518895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa837f-99a5-4144-8ec7-b265f68d6590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.519173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa837f-99a5-4144-8ec7-b265f68d6590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.519815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa837f-99a5-4144-8ec7-b265f68d6590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:48.527999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa837f-99a5-4144-8ec7-b265f68d6590 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:48.554349 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3288/6580] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:48.555829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:48.571081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13624166-3aeb-4f11-8ca3-50c50e70889b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:48.586264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:48.586977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.587251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.587522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] PATH_INFO: `/v3/projects/c688c914b3b2409dbe48dfeb267358f2/users/3bf1f1c86f944ff7b029b6b9c73c6e33/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.592214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c688c914b3b2409dbe48dfeb267358f2, user_id=3bf1f1c86f944ff7b029b6b9c73c6e33, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:48.595120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:48.626355 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3293/6581] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:48 2022] PUT /identity/v3/projects/c688c914b3b2409dbe48dfeb267358f2/users/3bf1f1c86f944ff7b029b6b9c73c6e33/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:48.628658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6bd1-d744-48f0-b49e-27194465fcfb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:48.629094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6bd1-d744-48f0-b49e-27194465fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:48.629674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6bd1-d744-48f0-b49e-27194465fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:48.694279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dd6c6bd1-d744-48f0-b49e-27194465fcfb None None] MFA Rules not processed for user `3bf1f1c86f944ff7b029b6b9c73c6e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:48.695912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dd6c6bd1-d744-48f0-b49e-27194465fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:48.888971 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3289/6582] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:48.893635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:49.020062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a0bd-b431-4480-8d17-b2fac79b58b3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:49.042959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:49.043458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:49.043746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:49.044000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:49.044802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:49.061868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:49.151464 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3294/6583] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:48 2022] POST /identity/v3/projects => generated 379 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:49.155496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c6bd1-d744-48f0-b49e-27194465fcfb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:49.180925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c6bd1-d744-48f0-b49e-27194465fcfb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:49.328570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:49.329251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:49.329533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:49.329807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:49.330449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:49.332648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:49.364697 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3290/6584] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:49 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:49.368393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:49.380258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8976c4-c1ca-4912-b3da-cce08103fae0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:49.385578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:49.386876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:49.387212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:49.387491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:49.388152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:49.390259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:49.407296 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3295/6585] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:49.410960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:49.422310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be08c-7f0c-4d40-8ad7-ab431d07c3d7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:49.427630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c53f2-72e1-4936-936c-5200b303f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:49.428257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c53f2-72e1-4936-936c-5200b303f93c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:49.428538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c53f2-72e1-4936-936c-5200b303f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:49.428851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c53f2-72e1-4936-936c-5200b303f93c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:49.429506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c53f2-72e1-4936-936c-5200b303f93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:49.431118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c53f2-72e1-4936-936c-5200b303f93c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:49.443642 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3291/6586] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:49.447275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:49.459194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2131-5085-4989-9d1c-637c4caa98b0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:49.465446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:49.466493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:49.467697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:49.468077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] PATH_INFO: `/v3/projects/1cb1ea23b03e4e268f1dfb56d0c49e6e/users/5d89dc67233e40a79b373cb26517467e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:49.489465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb1ea23b03e4e268f1dfb56d0c49e6e, user_id=5d89dc67233e40a79b373cb26517467e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:49.492947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:49.523929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3296/6587] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:49 2022] PUT /identity/v3/projects/1cb1ea23b03e4e268f1dfb56d0c49e6e/users/5d89dc67233e40a79b373cb26517467e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:49.534014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:49.534525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:49.534609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:49.605443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] MFA Rules not processed for user `5d89dc67233e40a79b373cb26517467e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:49.606832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:49.691839 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:49.758293 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3292/6588] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:49.770671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:49.773193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:49.864475 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:49.881752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c96a15-0ef1-4c92-ae6c-151c83f943da admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:49.890954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:49.893523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:49.894193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:49.894705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:50.013744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:50.015501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:50.031004 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3297/6589] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:36:50.410036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:50.411769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:50.489936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7814e-dd75-4774-aa36-a96d517cdd22 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:50.493654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097bbcd-c56d-4e99-9fcc-a3cac98c5742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:50.494266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097bbcd-c56d-4e99-9fcc-a3cac98c5742 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:50.494547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097bbcd-c56d-4e99-9fcc-a3cac98c5742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:50.494824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097bbcd-c56d-4e99-9fcc-a3cac98c5742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:50.496588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4097bbcd-c56d-4e99-9fcc-a3cac98c5742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:50.596911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097bbcd-c56d-4e99-9fcc-a3cac98c5742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:50.598359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097bbcd-c56d-4e99-9fcc-a3cac98c5742 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:50.612690 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3293/6590] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:50.902201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:50.992705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc7ba-27c2-4703-b997-c8dea4c1f069 service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:51.001611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:51.002315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:51.002626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:51.002880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] PATH_INFO: `/v3/users/3bf1f1c86f944ff7b029b6b9c73c6e33` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:51.004021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf1f1c86f944ff7b029b6b9c73c6e33)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:51.006431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:51.097380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf1f1c86f944ff7b029b6b9c73c6e33'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:51.109269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf1f1c86f944ff7b029b6b9c73c6e33'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:51.127477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf1f1c86f944ff7b029b6b9c73c6e33'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:51.128573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf1f1c86f944ff7b029b6b9c73c6e33'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:51.138834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf1f1c86f944ff7b029b6b9c73c6e33'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:51.147639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3298/6591] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:50 2022] DELETE /identity/v3/users/3bf1f1c86f944ff7b029b6b9c73c6e33 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:51.152263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:51.152649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:51.153050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:51.176282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:51.178265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:51.249397 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3294/6592] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:51.259261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:51.260931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:51.299370 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:51.385055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b29526-a49f-4740-bbbe-462975977a4b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:51.394392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:51.395588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:51.396057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:51.396563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:51.411385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:51.413109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:51.428802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3299/6593] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:51.913670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:51.915909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:51.968652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b78051-90d0-4442-9b13-3f8757d8fe98 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:51.979596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:51.980254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:51.980709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:51.981010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] PATH_INFO: `/v3/projects/c688c914b3b2409dbe48dfeb267358f2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:51.982141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c688c914b3b2409dbe48dfeb267358f2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:51.984536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:51.998302 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:52.048102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c688c914b3b2409dbe48dfeb267358f2', 'request_id': 'req-709a0ad1-b6d7-41d6-b18d-a760523b4b41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.079818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c688c914b3b2409dbe48dfeb267358f2', 'request_id': 'req-709a0ad1-b6d7-41d6-b18d-a760523b4b41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.097878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c688c914b3b2409dbe48dfeb267358f2', 'request_id': 'req-709a0ad1-b6d7-41d6-b18d-a760523b4b41'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.116432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] The token cache is being invalidate because project c688c914b3b2409dbe48dfeb267358f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:52.117278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.118072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.120556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3295/6594] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:51 2022] DELETE /identity/v3/projects/c688c914b3b2409dbe48dfeb267358f2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:52.123889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:52.135795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832642e5-32f4-47bd-9ec8-e14a8359fe5b service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:52.273467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:52.274216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:52.274495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:52.274783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] PATH_INFO: `/v3/users/5d89dc67233e40a79b373cb26517467e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:52.282622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d89dc67233e40a79b373cb26517467e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:52.284922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:52.374370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d89dc67233e40a79b373cb26517467e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.391078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d89dc67233e40a79b373cb26517467e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.429079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d89dc67233e40a79b373cb26517467e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.430319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d89dc67233e40a79b373cb26517467e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.442814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b5573c91-0246-4c2d-ab01-a9700e0ae067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d89dc67233e40a79b373cb26517467e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.450410 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3300/6595] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:52 2022] DELETE /identity/v3/users/5d89dc67233e40a79b373cb26517467e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:52.547314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:52.549586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:52.593415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a0ad1-b6d7-41d6-b18d-a760523b4b41 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:52.774436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:52.775519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:52.776018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:52.776504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] PATH_INFO: `/v3/users/a89fac11fe6c44f6b44ea51d67589a3c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:52.778080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89fac11fe6c44f6b44ea51d67589a3c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:52.780567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:52.868170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89fac11fe6c44f6b44ea51d67589a3c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.881137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89fac11fe6c44f6b44ea51d67589a3c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.881137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89fac11fe6c44f6b44ea51d67589a3c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.891180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89fac11fe6c44f6b44ea51d67589a3c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.891978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a51bd487-7ca2-4c65-a465-0047ff5632d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89fac11fe6c44f6b44ea51d67589a3c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:52.922250 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3296/6596] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:52 2022] DELETE /identity/v3/users/a89fac11fe6c44f6b44ea51d67589a3c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:52.927061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:52.927639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:52.928364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:52.992208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:52.993734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:53.051646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:53.052019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:53.052362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:53.070303 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:53.094306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:53.095561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:53.126931 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3301/6597] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:53.138441 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:53.200412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:53.202334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:53.243061 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3297/6598] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:53.258002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:53.259949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:53.360751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a47ba-e424-46e3-82b1-032b91f50918 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:53.375756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:53.376904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:53.377344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:53.377692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:53.378564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7398f95-3a20-4408-93da-84d051ec1521 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:53.386625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883a61f-2c78-4d05-9a35-5cc7257129d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:53.387618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a61f-2c78-4d05-9a35-5cc7257129d0 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:53.389026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a61f-2c78-4d05-9a35-5cc7257129d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:53.389555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a61f-2c78-4d05-9a35-5cc7257129d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:53.398672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:53.400301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:53.409664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a61f-2c78-4d05-9a35-5cc7257129d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:53.415129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a61f-2c78-4d05-9a35-5cc7257129d0 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:53.429543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3302/6599] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:36:53.456140 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3298/6600] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:36:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:53.597749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:53.599441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:53.631580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26fff2-f85a-4239-9c52-b2c9cae32d2c service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:53.652903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:53.653609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:53.653795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:53.654063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] PATH_INFO: `/v3/projects/1cb1ea23b03e4e268f1dfb56d0c49e6e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:53.657010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb1ea23b03e4e268f1dfb56d0c49e6e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:53.659177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:53.780621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb1ea23b03e4e268f1dfb56d0c49e6e', 'request_id': 'req-ce3c0528-626b-430f-9cea-43db431208c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:53.789029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb1ea23b03e4e268f1dfb56d0c49e6e', 'request_id': 'req-ce3c0528-626b-430f-9cea-43db431208c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:53.799737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb1ea23b03e4e268f1dfb56d0c49e6e', 'request_id': 'req-ce3c0528-626b-430f-9cea-43db431208c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:53.819851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] The token cache is being invalidate because project 1cb1ea23b03e4e268f1dfb56d0c49e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:53.820639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:53.822720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce3c0528-626b-430f-9cea-43db431208c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:53.836308 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3303/6601] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:53 2022] DELETE /identity/v3/projects/1cb1ea23b03e4e268f1dfb56d0c49e6e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:53.836650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2034eb-477f-4074-a698-ca3e3b62b6dd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:53.837107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2034eb-477f-4074-a698-ca3e3b62b6dd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:53.837459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2034eb-477f-4074-a698-ca3e3b62b6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:53.899208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cc2034eb-477f-4074-a698-ca3e3b62b6dd None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:53.912804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cc2034eb-477f-4074-a698-ca3e3b62b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:54.040758 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3299/6602] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:54.049036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.049324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.049598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.084485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:54.085807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:54.101243 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3304/6603] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:54.102750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2034eb-477f-4074-a698-ca3e3b62b6dd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.146764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2034eb-477f-4074-a698-ca3e3b62b6dd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.188046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.189842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.190394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.191474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.193243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:54.193692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.196501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.217702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.220056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:54.220876 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3300/6604] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:54.226782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.254752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77208efc-dae9-4e4b-a554-e73c440afc50 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.261741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5cb59-5cc6-44d7-b809-85b90d5413c1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.267913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.268585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.268968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.269158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] PATH_INFO: `/v3/projects/a2d740eb4349470f9067f40b2ba97b5a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.270561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d740eb4349470f9067f40b2ba97b5a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.272684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.275156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.277681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.277681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.277681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.277681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.279226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.332750 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3301/6605] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:54 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:54.337474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.381307 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:54.410163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d740eb4349470f9067f40b2ba97b5a', 'request_id': 'req-1078e1bc-afc3-4962-8ecb-238c6992dddc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.414279 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:54.424397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d740eb4349470f9067f40b2ba97b5a', 'request_id': 'req-1078e1bc-afc3-4962-8ecb-238c6992dddc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.447264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d740eb4349470f9067f40b2ba97b5a', 'request_id': 'req-1078e1bc-afc3-4962-8ecb-238c6992dddc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.474877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704016ed-e61d-41f9-bf49-6048d2d65ebd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.483313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] The token cache is being invalidate because project a2d740eb4349470f9067f40b2ba97b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:54.483624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.484679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.488210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3305/6606] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:54 2022] DELETE /identity/v3/projects/a2d740eb4349470f9067f40b2ba97b5a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:54.492984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.495884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:54.633131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.633758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.634033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.634299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.634926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.641670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.695886 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3302/6607] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:54 2022] POST /identity/v3/users => generated 295 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:54.696977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.698980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:54.714194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971621-b2bf-494a-9460-3357a3ccaee4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.720341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.721208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.721490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.721768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.722430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.724907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.735671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078e1bc-afc3-4962-8ecb-238c6992dddc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.740284 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3303/6608] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:54.744260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.755586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.757124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.757412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.757686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] PATH_INFO: `/v3/users/77c34255630949c5892ab8345c2452a7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.758550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd103ac5-4090-4766-8e63-63627557f822 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.763856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.764514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.764814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.765093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.765427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c34255630949c5892ab8345c2452a7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.765823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.767985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.771295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.789327 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3304/6609] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:54.790695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:54.803395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0dc05-fefe-41fc-9ab8-8f899330b776 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:54.809321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3920c-5b7a-49e8-a70a-0836e95432ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:54.810030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3920c-5b7a-49e8-a70a-0836e95432ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.810457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3920c-5b7a-49e8-a70a-0836e95432ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.810743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3920c-5b7a-49e8-a70a-0836e95432ce admin admin] PATH_INFO: `/v3/projects/ccc07e349e774da08b889b118374235f/users/d1dd37c2421a4a609ba4778b51d9742e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.831052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3920c-5b7a-49e8-a70a-0836e95432ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc07e349e774da08b889b118374235f, user_id=d1dd37c2421a4a609ba4778b51d9742e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:54.834519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3920c-5b7a-49e8-a70a-0836e95432ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:54.860380 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3305/6610] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:54 2022] PUT /identity/v3/projects/ccc07e349e774da08b889b118374235f/users/d1dd37c2421a4a609ba4778b51d9742e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:54.876693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998963b-5244-4700-a5b6-3fecb942d6ec None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:54.877187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998963b-5244-4700-a5b6-3fecb942d6ec None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:54.877416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998963b-5244-4700-a5b6-3fecb942d6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:54.920735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c34255630949c5892ab8345c2452a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.940374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c34255630949c5892ab8345c2452a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.954960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2998963b-5244-4700-a5b6-3fecb942d6ec None None] MFA Rules not processed for user `d1dd37c2421a4a609ba4778b51d9742e`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:54.959432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2998963b-5244-4700-a5b6-3fecb942d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:54.981820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c34255630949c5892ab8345c2452a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:54.984037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c34255630949c5892ab8345c2452a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:55.001451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c34255630949c5892ab8345c2452a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:55.017947 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3306/6611] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:54 2022] DELETE /identity/v3/users/77c34255630949c5892ab8345c2452a7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:55.291369 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:55.296660 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3306/6612] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:55.301346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:55.302817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:55.511440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2561-0d5d-4812-9721-0922efdcf64b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:55.556747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:55.557308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:55.557645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:55.557820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:55.558585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:55.562055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:55.599643 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:55.681872 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3307/6613] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:55 2022] POST /identity/v3/projects => generated 391 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:36:55.687095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998963b-5244-4700-a5b6-3fecb942d6ec None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:55.808383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:55.810532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:55.865708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998963b-5244-4700-a5b6-3fecb942d6ec None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:55.965335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa61a-13d1-41a0-8a7f-ee2a851d3b63 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:55.973161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:55.973952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:55.974466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:55.974606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] PATH_INFO: `/v3/projects/0b28bf64c83347a09595e990f3369e22` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:55.976583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b28bf64c83347a09595e990f3369e22)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:55.980650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.030332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:56.031034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.031762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.032037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.032711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:56.034684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.069284 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3307/6614] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:55 2022] POST /identity/v3/users => generated 302 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:56.071091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.090382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b28bf64c83347a09595e990f3369e22', 'request_id': 'req-8fcbff59-d9b1-48ca-a229-bf734acaebf6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:56.113570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826739e-002d-4d50-9862-aa7bc2c7d356 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:56.117857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b28bf64c83347a09595e990f3369e22', 'request_id': 'req-8fcbff59-d9b1-48ca-a229-bf734acaebf6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:56.138865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b28bf64c83347a09595e990f3369e22', 'request_id': 'req-8fcbff59-d9b1-48ca-a229-bf734acaebf6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:56.167575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] The token cache is being invalidate because project 0b28bf64c83347a09595e990f3369e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:36:56.167984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:56.170809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8fcbff59-d9b1-48ca-a229-bf734acaebf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:36:56.175741 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3308/6615] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:36:55 2022] DELETE /identity/v3/projects/0b28bf64c83347a09595e990f3369e22 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:56.181882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae8cb3-2a70-43a2-9d44-5453395ce624 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.182210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae8cb3-2a70-43a2-9d44-5453395ce624 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.182996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae8cb3-2a70-43a2-9d44-5453395ce624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.214391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:56.215039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.215315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.215590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.216302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:56.217956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.233778 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3308/6616] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:56.234813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.235069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6bae8cb3-2a70-43a2-9d44-5453395ce624 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:56.236321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6bae8cb3-2a70-43a2-9d44-5453395ce624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:56.236708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:56.252381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf8d1-905d-433e-b2a0-2ea1209b0383 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:56.258841 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3309/6617] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:56.266824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4115ce4-f772-4b74-bcc6-70744b27f3e1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.267109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4115ce4-f772-4b74-bcc6-70744b27f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.267385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4115ce4-f772-4b74-bcc6-70744b27f3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.269636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:56.270517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.270855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.271131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] PATH_INFO: `/v3/projects/64177b16520b4b0b98a373fedcd8436d/users/296c372bf8224006b9391834409ab7e9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.289006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64177b16520b4b0b98a373fedcd8436d, user_id=296c372bf8224006b9391834409ab7e9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:56.292257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.304239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a4115ce4-f772-4b74-bcc6-70744b27f3e1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:56.305723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a4115ce4-f772-4b74-bcc6-70744b27f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:56.318952 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3309/6618] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:56 2022] PUT /identity/v3/projects/64177b16520b4b0b98a373fedcd8436d/users/296c372bf8224006b9391834409ab7e9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:56.323927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.336640 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:56.399455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a661710-c466-4689-84dc-3aa0b29762c0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:56.405856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:56.406659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.407145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.407520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.409449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:56.411932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.440241 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3310/6619] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:56.442118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.456754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde755d8-6ab4-4c01-8c11-18a926b10109 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:56.462214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:56.462883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.463160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.463490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] PATH_INFO: `/v3/projects/64177b16520b4b0b98a373fedcd8436d/users/296c372bf8224006b9391834409ab7e9/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.465951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64177b16520b4b0b98a373fedcd8436d, user_id=296c372bf8224006b9391834409ab7e9, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:56.471749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.487534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3311/6620] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:56 2022] PUT /identity/v3/projects/64177b16520b4b0b98a373fedcd8436d/users/296c372bf8224006b9391834409ab7e9/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:56.490013 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3310/6621] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:56.495537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.503175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.503904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.504314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.537109 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:56.569319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] MFA Rules not processed for user `296c372bf8224006b9391834409ab7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:56.571180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:56.661272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91e4c3-a00c-456f-a73c-a1ce4dd482e4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:56.678493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:56.679292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.679573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.679957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.680632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:36:56.680960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:56.686811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.716155 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3312/6622] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:36:56.718067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.738157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed1e5b-bde3-4d2d-82c6-2e8c5f3abd3f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:56.748403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:56.749154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:56.749435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:56.749951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:56.750685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:56.754087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:56.759623 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3311/6623] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:56.761030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.762733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:56.854746 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3313/6624] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:56 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:56.861691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:56.962017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f9c03-d7c4-4d23-9628-0e0f66377480 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:57.021259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d9270-3dc1-4f8e-9837-d527414e9c15 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:57.033566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:57.034190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:57.034470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:57.034884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:57.035374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:57.042652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:57.063487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:57.064112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:57.064390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:57.064667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:57.065895 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:57.089664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3314/6625] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:56 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:36:57.094174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:57.122210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe505-7cbd-4ac4-905d-805120e30a5c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:57.148157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:57.148827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:57.149109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:57.149380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:57.150040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:57.152352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:57.173664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3315/6626] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:57.177346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:57.205095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584592e-bedc-487d-a0ac-87c6f74b4000 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:57.227481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:57.228980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:57.230615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f4c25-7239-466a-b39f-49e14b124fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:57.231257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f4c25-7239-466a-b39f-49e14b124fed admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:57.231541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f4c25-7239-466a-b39f-49e14b124fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:57.231807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f4c25-7239-466a-b39f-49e14b124fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:57.232672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f4c25-7239-466a-b39f-49e14b124fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:57.234739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f4c25-7239-466a-b39f-49e14b124fed admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:57.235702 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:57.245309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3312/6627] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:57.250383 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3316/6628] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:57.255061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:57.290552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d420d-5bed-4420-b7c2-32ef7f131ab0 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:57.311492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:57.312277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:57.312620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:57.313000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] PATH_INFO: `/v3/projects/21ea67c3cf804fdc80cda151603e7974/users/764da07c3122405e866e660412919696/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:57.342955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ea67c3cf804fdc80cda151603e7974, user_id=764da07c3122405e866e660412919696, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:57.350295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:57.388220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3313/6629] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:57 2022] PUT /identity/v3/projects/21ea67c3cf804fdc80cda151603e7974/users/764da07c3122405e866e660412919696/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:36:57.389230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db1b4-48b3-4658-9efd-e4e043252814 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:57.389686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db1b4-48b3-4658-9efd-e4e043252814 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:57.389855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db1b4-48b3-4658-9efd-e4e043252814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:57.447976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-eb0db1b4-48b3-4658-9efd-e4e043252814 None None] MFA Rules not processed for user `764da07c3122405e866e660412919696`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:57.449891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb0db1b4-48b3-4658-9efd-e4e043252814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:57.593682 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3317/6630] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:36:57.599301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:57.776881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34647e3a-d616-4984-9c60-99789c6b04ef admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:57.795172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:57.795819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:57.796100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:57.796375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:57.797046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:57.799045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:57.880838 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3314/6631] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:36:57 2022] POST /identity/v3/projects => generated 379 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:57.893139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0db1b4-48b3-4658-9efd-e4e043252814 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:57.910048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0db1b4-48b3-4658-9efd-e4e043252814 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:58.051797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:58.052522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:58.053238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:58.053558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:58.054207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:58.059511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:58.112321 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3318/6632] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:36:57 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:36:58.117131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:58.135283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a1c5-b3eb-4ab6-beb6-a6ab56dd01a3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:58.150134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:58.151108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:58.151695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:58.152185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:58.153273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:58.155889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:58.206100 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3315/6633] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:58.209924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:58.227734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ae9a4-86a9-4e52-adc7-48e5f213c9e3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:58.243883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:58.244637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:58.244942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:58.245253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] PATH_INFO: `/v3/projects/6e341cb6d0bc441db925b96eb0bba11f/users/40ad6646bccd447e993258e58e7afdb2/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:58.313735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e341cb6d0bc441db925b96eb0bba11f, user_id=40ad6646bccd447e993258e58e7afdb2, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:58.316443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:58.350402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3319/6634] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:58 2022] PUT /identity/v3/projects/6e341cb6d0bc441db925b96eb0bba11f/users/40ad6646bccd447e993258e58e7afdb2/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:58.354206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:58.375070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b829-66aa-4c36-b9b1-d9335eaf3fed admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:58.512795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b667231-d93c-4ac6-aceb-6123de5f9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:58.513585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667231-d93c-4ac6-aceb-6123de5f9e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:58.514281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667231-d93c-4ac6-aceb-6123de5f9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:58.514281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667231-d93c-4ac6-aceb-6123de5f9e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:58.515573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b667231-d93c-4ac6-aceb-6123de5f9e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:58.516833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b667231-d93c-4ac6-aceb-6123de5f9e14 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:58.528282 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3316/6635] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:36:58.532984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:58.545626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677da79-672e-4924-b2de-11bd53fd45ba admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:58.550854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:58.552193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:58.552193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:58.552458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] PATH_INFO: `/v3/projects/6e341cb6d0bc441db925b96eb0bba11f/users/40ad6646bccd447e993258e58e7afdb2/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:58.554309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e341cb6d0bc441db925b96eb0bba11f, user_id=40ad6646bccd447e993258e58e7afdb2, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:58.556977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:58.583828 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3320/6636] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:36:58 2022] PUT /identity/v3/projects/6e341cb6d0bc441db925b96eb0bba11f/users/40ad6646bccd447e993258e58e7afdb2/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:36:58.585108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5536-c036-4e26-909e-9f5ddd9c74d1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:58.585379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5536-c036-4e26-909e-9f5ddd9c74d1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:58.585732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5536-c036-4e26-909e-9f5ddd9c74d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:58.684577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7abe5536-c036-4e26-909e-9f5ddd9c74d1 None None] MFA Rules not processed for user `40ad6646bccd447e993258e58e7afdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:36:58.689326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7abe5536-c036-4e26-909e-9f5ddd9c74d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:58.773410 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:58.937015 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3317/6637] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:36:58.950930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:36:58.952947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:36:58.992301 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:59.077544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ded24-e38e-46bb-96dd-ff935f6aac95 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:36:59.083860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277d2e-4350-4a64-8cec-d3069d79ad33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:36:59.085154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277d2e-4350-4a64-8cec-d3069d79ad33 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:36:59.085751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277d2e-4350-4a64-8cec-d3069d79ad33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:36:59.086329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277d2e-4350-4a64-8cec-d3069d79ad33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:36:59.099221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277d2e-4350-4a64-8cec-d3069d79ad33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:36:59.102004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277d2e-4350-4a64-8cec-d3069d79ad33 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:36:59.117845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3321/6638] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:36:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:36:59.924890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5536-c036-4e26-909e-9f5ddd9c74d1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:00.045838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5536-c036-4e26-909e-9f5ddd9c74d1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:00.051898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:00.052911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:00.053469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:00.053892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] PATH_INFO: `/v3/users/764da07c3122405e866e660412919696` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:00.055300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=764da07c3122405e866e660412919696)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:00.057861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:00.211428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764da07c3122405e866e660412919696'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:00.232824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764da07c3122405e866e660412919696'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:00.266082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764da07c3122405e866e660412919696'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:00.268271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764da07c3122405e866e660412919696'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:00.285467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764da07c3122405e866e660412919696'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:00.299827 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3318/6639] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:36:59 2022] DELETE /identity/v3/users/764da07c3122405e866e660412919696 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:00.308933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:00.310685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:00.310685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:00.353726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:00.355578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:00.453801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:00.455296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:00.519288 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3322/6640] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:00.534507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:00.540089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:00.573430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981d9d-c146-4e87-add5-89f93337f75f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:00.584670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:00.585309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:00.585685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:00.586083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:00.590667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:00.607668 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:00.745405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:00.747861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:00.797165 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3319/6641] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:00.851371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd866c98-1552-44ad-b567-af8c28c633a5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:00.878987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:00.885899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:00.886789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:00.891472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:00.944246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:00.947155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:00.983974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3323/6642] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:37:01.928889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:01.930694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:01.963612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78892c3-440a-4edb-ab28-c131e95c65c5 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:01.982609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:01.987126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:01.987437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:01.987719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] PATH_INFO: `/v3/projects/21ea67c3cf804fdc80cda151603e7974` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:01.993870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:01.994950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:01.995374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ea67c3cf804fdc80cda151603e7974)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:02.000208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:02.022479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b37b9a-6369-40ac-80bc-f625efb74145 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:02.034038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:02.035112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:02.035509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:02.035829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] PATH_INFO: `/v3/users/d1dd37c2421a4a609ba4778b51d9742e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:02.039453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dd37c2421a4a609ba4778b51d9742e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:02.041445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:02.126302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ea67c3cf804fdc80cda151603e7974', 'request_id': 'req-ce28b461-65cd-4e08-826a-20eb90940cbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.146429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dd37c2421a4a609ba4778b51d9742e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.147681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ea67c3cf804fdc80cda151603e7974', 'request_id': 'req-ce28b461-65cd-4e08-826a-20eb90940cbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.163468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dd37c2421a4a609ba4778b51d9742e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.165212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dd37c2421a4a609ba4778b51d9742e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.167301 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:02.168632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ea67c3cf804fdc80cda151603e7974', 'request_id': 'req-ce28b461-65cd-4e08-826a-20eb90940cbf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.176787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dd37c2421a4a609ba4778b51d9742e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.177876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6491472d-dddc-4554-82c0-bf6a67db11c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dd37c2421a4a609ba4778b51d9742e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.204903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] The token cache is being invalidate because project 21ea67c3cf804fdc80cda151603e7974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:02.205316 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3324/6643] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:01 2022] DELETE /identity/v3/users/d1dd37c2421a4a609ba4778b51d9742e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:02.206003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.208116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.210171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:02.210567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:02.210983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:02.212471 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3320/6644] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:01 2022] DELETE /identity/v3/projects/21ea67c3cf804fdc80cda151603e7974 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:02.216567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:02.220333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:02.254892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:02.259184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:02.403811 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3325/6645] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:02.404078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b461-65cd-4e08-826a-20eb90940cbf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:02.413888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:02.416238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:02.417883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:02.418502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:02.419015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] PATH_INFO: `/v3/users/40ad6646bccd447e993258e58e7afdb2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:02.419142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:02.420947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ad6646bccd447e993258e58e7afdb2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:02.423776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:02.474972 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:02.503177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b7fa3-803a-4f75-833e-036888b28a02 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:02.509880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:02.510506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:02.510897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:02.511047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:02.512035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ad6646bccd447e993258e58e7afdb2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.525820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ad6646bccd447e993258e58e7afdb2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.542964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:02.544890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:02.545047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ad6646bccd447e993258e58e7afdb2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.545718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ad6646bccd447e993258e58e7afdb2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.557968 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3326/6646] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:02.559444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ad6646bccd447e993258e58e7afdb2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:02.572884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3321/6647] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:02 2022] DELETE /identity/v3/users/40ad6646bccd447e993258e58e7afdb2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:03.146755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.161928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad0df-63ba-4bd0-b4f2-7298aa5b9017 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.227407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.227991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.228277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.228569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] PATH_INFO: `/v3/projects/6e341cb6d0bc441db925b96eb0bba11f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.229752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e341cb6d0bc441db925b96eb0bba11f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.231705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.236369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.237926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.252284 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:03.257068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0fa59-057d-4093-9d13-a970df6ac205 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.264499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.265415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.265637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.265996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] PATH_INFO: `/v3/projects/ccc07e349e774da08b889b118374235f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.267565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc07e349e774da08b889b118374235f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.269752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.290350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e341cb6d0bc441db925b96eb0bba11f', 'request_id': 'req-cac0b08e-1681-4bb7-a019-663041a3cb71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.299498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e341cb6d0bc441db925b96eb0bba11f', 'request_id': 'req-cac0b08e-1681-4bb7-a019-663041a3cb71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.305615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e341cb6d0bc441db925b96eb0bba11f', 'request_id': 'req-cac0b08e-1681-4bb7-a019-663041a3cb71'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.317934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] The token cache is being invalidate because project 6e341cb6d0bc441db925b96eb0bba11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:03.318350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.320705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cac0b08e-1681-4bb7-a019-663041a3cb71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.322558 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3327/6648] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:03 2022] DELETE /identity/v3/projects/6e341cb6d0bc441db925b96eb0bba11f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:03.326229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc07e349e774da08b889b118374235f', 'request_id': 'req-81091e62-903d-4b4d-878d-110232861b95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.327147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6b62-6199-46a3-9ba5-5cd526c28594 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.327451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6b62-6199-46a3-9ba5-5cd526c28594 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.327991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6b62-6199-46a3-9ba5-5cd526c28594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.334057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc07e349e774da08b889b118374235f', 'request_id': 'req-81091e62-903d-4b4d-878d-110232861b95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.341634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc07e349e774da08b889b118374235f', 'request_id': 'req-81091e62-903d-4b4d-878d-110232861b95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.351356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e5ed6b62-6199-46a3-9ba5-5cd526c28594 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:03.352728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e5ed6b62-6199-46a3-9ba5-5cd526c28594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.359938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] The token cache is being invalidate because project ccc07e349e774da08b889b118374235f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:03.360545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.361420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.363575 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3322/6649] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:03 2022] DELETE /identity/v3/projects/ccc07e349e774da08b889b118374235f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:37:03.367697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.369167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.426110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3328/6650] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:03.435281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3807a4-68d4-4832-b1e3-fb2adf71dd95 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.435567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3807a4-68d4-4832-b1e3-fb2adf71dd95 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.435839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3807a4-68d4-4832-b1e3-fb2adf71dd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.449406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091e62-903d-4b4d-878d-110232861b95 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.454945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.455612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0e3807a4-68d4-4832-b1e3-fb2adf71dd95 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:03.455738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.456184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.456517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] PATH_INFO: `/v3/users/296c372bf8224006b9391834409ab7e9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.457231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e3807a4-68d4-4832-b1e3-fb2adf71dd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.458081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=296c372bf8224006b9391834409ab7e9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.460742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.467440 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3329/6651] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:03.471356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3807a4-68d4-4832-b1e3-fb2adf71dd95 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.483209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3807a4-68d4-4832-b1e3-fb2adf71dd95 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.488058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.488935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.489224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.489497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.490274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:03.490820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.492529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.507082 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3330/6652] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:37:03.507687 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:03.511317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.523245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296c372bf8224006b9391834409ab7e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.523530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958dab9-a109-4a0b-9946-fe4d27c26de4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.529014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.529700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.529977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.530246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.530902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.532457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296c372bf8224006b9391834409ab7e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.533077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.545840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296c372bf8224006b9391834409ab7e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.546456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296c372bf8224006b9391834409ab7e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.554435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296c372bf8224006b9391834409ab7e9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.560757 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3323/6653] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:03 2022] DELETE /identity/v3/users/296c372bf8224006b9391834409ab7e9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:03.568816 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3331/6654] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:03 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:37:03.572157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.573677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.642909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864faf-f427-4cfd-8d11-6c13b98795ca admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.702295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.702922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.703199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.703466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.704105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.706103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.732265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3324/6655] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:03 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:03.734504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.734658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.736224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.748752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32126c-83f6-4be0-bd8b-165f86584a70 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.754824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.755700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.755978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.756255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] PATH_INFO: `/v3/projects/64177b16520b4b0b98a373fedcd8436d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.757595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64177b16520b4b0b98a373fedcd8436d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.758233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d43b80-334f-44f3-ab5d-51c3bcf954c6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.759548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.768659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.769320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.769608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.769901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.770592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.772251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.784801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3332/6656] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:03.787923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.799071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708e53-6a75-47b6-8a2b-ed5f556b5f24 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.805171 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:03.812136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64177b16520b4b0b98a373fedcd8436d', 'request_id': 'req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.820508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64177b16520b4b0b98a373fedcd8436d', 'request_id': 'req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.826324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64177b16520b4b0b98a373fedcd8436d', 'request_id': 'req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.841395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] The token cache is being invalidate because project 64177b16520b4b0b98a373fedcd8436d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:03.841763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.842409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2868d7c9-7de5-4786-9cba-0b151ee8b5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:03.844013 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3325/6657] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:03 2022] DELETE /identity/v3/projects/64177b16520b4b0b98a373fedcd8436d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:03.848397 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:03.848886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b50d-5604-45a2-be68-a7ee43cce959 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.849235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b50d-5604-45a2-be68-a7ee43cce959 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.849516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b50d-5604-45a2-be68-a7ee43cce959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.860001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.860618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.860929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.861203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.861844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.863546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.870020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c407b50d-5604-45a2-be68-a7ee43cce959 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:03.871367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c407b50d-5604-45a2-be68-a7ee43cce959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.874200 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3333/6658] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:37:03.878348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.879714 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3326/6659] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:03.880492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.886998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c495-8207-4289-9180-ce8a9ab07880 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.887277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c495-8207-4289-9180-ce8a9ab07880 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.887548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c495-8207-4289-9180-ce8a9ab07880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.893421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b144ab-b741-40e9-be5a-cb87af6d06fd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.899026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d1286-cde8-43e4-8f55-6593ff525001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:03.899707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1286-cde8-43e4-8f55-6593ff525001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.899984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1286-cde8-43e4-8f55-6593ff525001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.900257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1286-cde8-43e4-8f55-6593ff525001 admin admin] PATH_INFO: `/v3/projects/cf0cdde799334edfae56a0a3818e4d9e/users/57eb813cb03f41d1be1d1a4c84a35c93/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.907755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d239c495-8207-4289-9180-ce8a9ab07880 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:03.909001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d239c495-8207-4289-9180-ce8a9ab07880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:03.917597 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3327/6660] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:03.919589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d1286-cde8-43e4-8f55-6593ff525001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0cdde799334edfae56a0a3818e4d9e, user_id=57eb813cb03f41d1be1d1a4c84a35c93, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:03.921906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c495-8207-4289-9180-ce8a9ab07880 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:03.922553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d1286-cde8-43e4-8f55-6593ff525001 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:03.931447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c495-8207-4289-9180-ce8a9ab07880 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:03.936280 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3334/6661] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:03 2022] PUT /identity/v3/projects/cf0cdde799334edfae56a0a3818e4d9e/users/57eb813cb03f41d1be1d1a4c84a35c93/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:37:03.946413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:03.946702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:03.946980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:03.982957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] MFA Rules not processed for user `57eb813cb03f41d1be1d1a4c84a35c93`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:03.984891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:04.001850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.002937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.003220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.003495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.004208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:04.004514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.006210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.023326 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3328/6662] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:37:04.025072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.037461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcd5b9-b5e5-4d99-b1b1-c70ac96a434c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.044094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.044717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.045024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.045301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.045988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.047851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.061981 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3335/6663] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:04.073242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.075433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:04.080956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3329/6664] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:04 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:04.085284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.157037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66b0cc-7fd7-4efd-ae91-d86f1b88a52b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.168643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e032f-d9e4-45b0-9879-82cc05b44efd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.175117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.176404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.176404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.176906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.177687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.180170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.211176 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3330/6665] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:04 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:37:04.215549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.223191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.223511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.223855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.224126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.227620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785cc98-fa0f-406c-ab49-65a875de02a0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.232901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.233662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.234036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.234374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.235095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.236864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.248102 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3331/6666] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:04.252097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.256636 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:04.264968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71845478-957c-488c-88cc-a4e614727bd3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.269982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.270893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.271285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.271660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.272413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.274183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.275860 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:04.290376 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3332/6667] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:37:04.294729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.299163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.300659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.308904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0849e-1090-431a-ae7c-bef5036da35f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.311032 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3336/6668] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:37:04.314587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500826b-cebd-4a1e-816c-4ccb1469addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.315279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500826b-cebd-4a1e-816c-4ccb1469addd admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.315558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500826b-cebd-4a1e-816c-4ccb1469addd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.315886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500826b-cebd-4a1e-816c-4ccb1469addd admin admin] PATH_INFO: `/v3/projects/4199135508b14a4b81f66aa4b85ea3b8/users/c7f5850704d74f7293d0fb2babb052cf/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.334986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.335213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500826b-cebd-4a1e-816c-4ccb1469addd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4199135508b14a4b81f66aa4b85ea3b8, user_id=c7f5850704d74f7293d0fb2babb052cf, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.337867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500826b-cebd-4a1e-816c-4ccb1469addd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.346286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85ac60-8310-4178-bd1a-3f77bac85460 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.351880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.352576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.352886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.353159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] PATH_INFO: `/v3/users/57eb813cb03f41d1be1d1a4c84a35c93` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.354350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57eb813cb03f41d1be1d1a4c84a35c93)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.354730 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3333/6669] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:04 2022] PUT /identity/v3/projects/4199135508b14a4b81f66aa4b85ea3b8/users/c7f5850704d74f7293d0fb2babb052cf/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:37:04.358778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.365409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.365729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.365960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.396595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] MFA Rules not processed for user `c7f5850704d74f7293d0fb2babb052cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:04.398007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:04.420346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57eb813cb03f41d1be1d1a4c84a35c93'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:04.432488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57eb813cb03f41d1be1d1a4c84a35c93'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:04.434190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57eb813cb03f41d1be1d1a4c84a35c93'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:04.444346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57eb813cb03f41d1be1d1a4c84a35c93'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:04.446042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-995ca69e-1b1b-486a-a4b1-a78ca54ba346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57eb813cb03f41d1be1d1a4c84a35c93'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:04.470687 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3337/6670] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:04 2022] DELETE /identity/v3/users/57eb813cb03f41d1be1d1a4c84a35c93 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:37:04.475798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.476158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.476583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.487205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3334/6671] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:04.491997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.496966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:04.505145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:04.506549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:04.574623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f266-4703-44e9-8ad2-f5fc910335ca None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.593446 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3338/6672] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:04.599626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.602197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:04.656562 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:04.663257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.664381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.664670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.665096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.666277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.668642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.681253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a80dd-1233-4b9a-8987-0cc1885acf66 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.686822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.687568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.687861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.688266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.690355 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:04.705964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.708389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.709549 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3335/6673] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:04 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:04.713225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.721906 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3339/6674] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:04.805060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab491f6a-a089-4de6-bc00-bbda5f8d980a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.814657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.815353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.815807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.816242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.817300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.819552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.842719 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3336/6675] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:04 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:04.847225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.860491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19342a8-6e0e-4d58-a7dd-a8b6a9618932 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.866709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.867595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.867892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.868191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.869559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.870952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.883864 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3340/6676] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:04.887946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.916606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1a80c-2e82-460e-aae3-f670eb1814bb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:04.922663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:04.923539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:04.923995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:04.924446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] PATH_INFO: `/v3/projects/6294c1d04bc84fd89fae1c0337db4e48/users/95847bd0c4f449abad2103a936d9f6d3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:04.946737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6294c1d04bc84fd89fae1c0337db4e48, user_id=95847bd0c4f449abad2103a936d9f6d3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:04.950044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:04.966423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3337/6677] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:04 2022] PUT /identity/v3/projects/6294c1d04bc84fd89fae1c0337db4e48/users/95847bd0c4f449abad2103a936d9f6d3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:37:04.970845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:04.982094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289099-bc03-4435-a038-e0941a5d6fa1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.037312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.039525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:05.048958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.049730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.049993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.050388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.052069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.053775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.065314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3341/6678] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:05.069654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.083597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b7d5-13cd-4fa4-a7cf-1598b9664eec admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.088971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bddb6b-b8a8-4501-adc7-449e89ff9161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.089898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bddb6b-b8a8-4501-adc7-449e89ff9161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.090349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bddb6b-b8a8-4501-adc7-449e89ff9161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.090779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bddb6b-b8a8-4501-adc7-449e89ff9161 admin admin] PATH_INFO: `/v3/projects/6294c1d04bc84fd89fae1c0337db4e48/users/95847bd0c4f449abad2103a936d9f6d3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.093005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bddb6b-b8a8-4501-adc7-449e89ff9161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6294c1d04bc84fd89fae1c0337db4e48, user_id=95847bd0c4f449abad2103a936d9f6d3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.095654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bddb6b-b8a8-4501-adc7-449e89ff9161 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.108338 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3342/6679] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:05 2022] PUT /identity/v3/projects/6294c1d04bc84fd89fae1c0337db4e48/users/95847bd0c4f449abad2103a936d9f6d3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:37:05.121188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3429-87fe-42a4-9d75-86f913a65704 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.121544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3429-87fe-42a4-9d75-86f913a65704 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.121874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3429-87fe-42a4-9d75-86f913a65704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.131193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb3973-aa49-40f5-bdc7-b6820b594fbb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.159726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0f5d3429-87fe-42a4-9d75-86f913a65704 None None] MFA Rules not processed for user `95847bd0c4f449abad2103a936d9f6d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:05.161382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0f5d3429-87fe-42a4-9d75-86f913a65704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:05.212447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.213169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.213482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.213771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] PATH_INFO: `/v3/projects/cf0cdde799334edfae56a0a3818e4d9e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.215070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0cdde799334edfae56a0a3818e4d9e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.217389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.229000 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:05.249931 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3343/6680] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:05.262487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3429-87fe-42a4-9d75-86f913a65704 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.277925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0cdde799334edfae56a0a3818e4d9e', 'request_id': 'req-052de356-cec7-4f26-bba6-67723d420661'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:05.284572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0cdde799334edfae56a0a3818e4d9e', 'request_id': 'req-052de356-cec7-4f26-bba6-67723d420661'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:05.291024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0cdde799334edfae56a0a3818e4d9e', 'request_id': 'req-052de356-cec7-4f26-bba6-67723d420661'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:05.304841 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:05.305422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] The token cache is being invalidate because project cf0cdde799334edfae56a0a3818e4d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:05.305920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:05.306789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-052de356-cec7-4f26-bba6-67723d420661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:05.308518 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3338/6681] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:05 2022] DELETE /identity/v3/projects/cf0cdde799334edfae56a0a3818e4d9e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:05.313757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0adc-a4a5-456d-b190-8b6cc1ec5596 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.314043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0adc-a4a5-456d-b190-8b6cc1ec5596 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.314321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0adc-a4a5-456d-b190-8b6cc1ec5596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.322828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3429-87fe-42a4-9d75-86f913a65704 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.334692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-087d0adc-a4a5-456d-b190-8b6cc1ec5596 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:05.335849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-087d0adc-a4a5-456d-b190-8b6cc1ec5596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:05.378530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.379209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.379484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.380073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.381882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:05.398540 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3339/6682] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:05.406188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a03c-8424-4db7-82ef-ed2fd423c94a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.406523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a03c-8424-4db7-82ef-ed2fd423c94a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.406801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a03c-8424-4db7-82ef-ed2fd423c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.428989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e2d9a03c-8424-4db7-82ef-ed2fd423c94a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:05.430222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e2d9a03c-8424-4db7-82ef-ed2fd423c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:05.439009 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3340/6683] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:05.443316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a03c-8424-4db7-82ef-ed2fd423c94a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.451165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.452647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.452815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a03c-8424-4db7-82ef-ed2fd423c94a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.457750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.458381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.458662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.458930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.459610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:05.459910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.461517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.462655 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3344/6684] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:05.476396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3341/6685] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:37:05.478576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.489365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098513-82c4-4e37-957b-0034b3e7ee80 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.494425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.495107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.495592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.495934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.496701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.498839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.532310 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3345/6686] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:05 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:37:05.536490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.550346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaea26-859a-4e12-b3ae-d53332ed1e79 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.613187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.614277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.614538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.614803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.615444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.617463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.647028 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3342/6687] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:05 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:05.648724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.660462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0eea7-bd53-4c57-abf8-1e2d11a7a777 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.666617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.667452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.667706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.668000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.668701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.670371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.682780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3346/6688] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:05.687310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.698642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b616971-7229-4b60-964a-6b2c22047a55 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.704094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ef305-5b53-4205-81ce-2c7a72206c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.704756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ef305-5b53-4205-81ce-2c7a72206c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.705068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ef305-5b53-4205-81ce-2c7a72206c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.705343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ef305-5b53-4205-81ce-2c7a72206c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.706014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ef305-5b53-4205-81ce-2c7a72206c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.707834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ef305-5b53-4205-81ce-2c7a72206c38 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.709326 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:05.724029 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3343/6689] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:05.725377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.738458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f8804-2141-494e-a8e6-9948bc8cb93f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:05.746813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:05.747212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.747560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.747840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] PATH_INFO: `/v3/projects/9f7a12a642e9499c99441faff6aba72e/users/879d4de0e39244adba9aab8e4a7725d1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.766467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7a12a642e9499c99441faff6aba72e, user_id=879d4de0e39244adba9aab8e4a7725d1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:05.769708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:05.803927 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3347/6690] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:05 2022] PUT /identity/v3/projects/9f7a12a642e9499c99441faff6aba72e/users/879d4de0e39244adba9aab8e4a7725d1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:05.806255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:05.806542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:05.806815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:05.842687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] MFA Rules not processed for user `879d4de0e39244adba9aab8e4a7725d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:05.844042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:05.920891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3344/6691] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:05.935067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:05.937702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:06.000548 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:06.009123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8798e3-35c5-48a4-9cfb-2065cc488862 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:06.013556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204204b-9c71-452f-8654-ed066a5f5cd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:06.014195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204204b-9c71-452f-8654-ed066a5f5cd8 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:06.014473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204204b-9c71-452f-8654-ed066a5f5cd8 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:06.014767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204204b-9c71-452f-8654-ed066a5f5cd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:06.025491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204204b-9c71-452f-8654-ed066a5f5cd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:06.026968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204204b-9c71-452f-8654-ed066a5f5cd8 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:06.036473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3348/6692] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:07.853211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:07.854924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:07.964383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16763f-4b0a-41e6-a9f4-5dc2755607f6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:07.974267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:07.975194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:07.975473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:07.975993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] PATH_INFO: `/v3/users/c7f5850704d74f7293d0fb2babb052cf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:07.977350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f5850704d74f7293d0fb2babb052cf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:07.979802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:08.050211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f5850704d74f7293d0fb2babb052cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:08.061180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f5850704d74f7293d0fb2babb052cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:08.082807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f5850704d74f7293d0fb2babb052cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:08.083746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f5850704d74f7293d0fb2babb052cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:08.094667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-56369f3b-33cc-4938-8c73-b1b550681c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f5850704d74f7293d0fb2babb052cf'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:08.106379 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3345/6693] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:07 2022] DELETE /identity/v3/users/c7f5850704d74f7293d0fb2babb052cf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:08.111341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:08.112044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:08.112244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:08.153908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:08.155170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:08.271386 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3349/6694] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:08.281740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:08.282556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:08.282989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:08.287311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:08.289368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:08.304796 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:08.331288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:08.332799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:08.423452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e62c-6dc8-46de-939b-0c041abc0f8d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:08.430922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:08.431804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:08.432234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:08.432655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:08.451246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:08.453397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:08.464899 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3346/6695] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:08.469341 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3350/6696] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:08.482516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:08.484643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:08.602670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c4f2c-e53c-4b09-9a74-71e8f7383e41 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:08.609293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:08.609940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:08.610213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:08.610662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:08.622242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:08.623855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:08.637502 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3347/6697] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:08.841055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:08.843003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:08.880156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580e5b-4ab5-49b0-85c0-72015732b7e0 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:08.885856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:08.886516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:08.886794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:08.887068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] PATH_INFO: `/v3/projects/4199135508b14a4b81f66aa4b85ea3b8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:08.888257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4199135508b14a4b81f66aa4b85ea3b8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:08.890246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:08.971586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4199135508b14a4b81f66aa4b85ea3b8', 'request_id': 'req-613e2e11-21b1-4247-a212-ce5383e4a065'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:08.986078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4199135508b14a4b81f66aa4b85ea3b8', 'request_id': 'req-613e2e11-21b1-4247-a212-ce5383e4a065'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:08.995577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4199135508b14a4b81f66aa4b85ea3b8', 'request_id': 'req-613e2e11-21b1-4247-a212-ce5383e4a065'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.011671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] The token cache is being invalidate because project 4199135508b14a4b81f66aa4b85ea3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:09.011941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.012554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.014579 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3351/6698] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:08 2022] DELETE /identity/v3/projects/4199135508b14a4b81f66aa4b85ea3b8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:09.018475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:09.031352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f59f5-3e3c-47ef-9532-198b560a8026 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:09.116453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:09.117573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:09.117990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:09.118336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] PATH_INFO: `/v3/users/95847bd0c4f449abad2103a936d9f6d3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:09.119785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=95847bd0c4f449abad2103a936d9f6d3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:09.123167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:09.196320 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:09.203504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95847bd0c4f449abad2103a936d9f6d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.216989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95847bd0c4f449abad2103a936d9f6d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.230873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95847bd0c4f449abad2103a936d9f6d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.231643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95847bd0c4f449abad2103a936d9f6d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.244484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9a590490-03c2-4222-9a1e-e6233f4cbe3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95847bd0c4f449abad2103a936d9f6d3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.251674 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3348/6699] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:09 2022] DELETE /identity/v3/users/95847bd0c4f449abad2103a936d9f6d3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:09.650719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:09.652203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:09.668741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e2e11-21b1-4247-a212-ce5383e4a065 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:09.689201 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:09.761402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:09.762479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:09.762479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:09.762803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] PATH_INFO: `/v3/projects/6294c1d04bc84fd89fae1c0337db4e48` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:09.764041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6294c1d04bc84fd89fae1c0337db4e48)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:09.766146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:09.826189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6294c1d04bc84fd89fae1c0337db4e48', 'request_id': 'req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.839675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6294c1d04bc84fd89fae1c0337db4e48', 'request_id': 'req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.851858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6294c1d04bc84fd89fae1c0337db4e48', 'request_id': 'req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.878261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] The token cache is being invalidate because project 6294c1d04bc84fd89fae1c0337db4e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:09.879513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.882861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bdc81e10-88c4-42b9-8b43-81b5eb4bd058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:09.884822 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3352/6700] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:09 2022] DELETE /identity/v3/projects/6294c1d04bc84fd89fae1c0337db4e48 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:09.889791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1c66-9d6d-4689-9bc7-5a192b3451ba None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:09.890166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1c66-9d6d-4689-9bc7-5a192b3451ba None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:09.890575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1c66-9d6d-4689-9bc7-5a192b3451ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:09.920266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8cda1c66-9d6d-4689-9bc7-5a192b3451ba None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:09.921748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8cda1c66-9d6d-4689-9bc7-5a192b3451ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:09.996977 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3349/6701] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:09.999206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a266-5a68-404f-9b9d-617aab2f3d0d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:09.999487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a266-5a68-404f-9b9d-617aab2f3d0d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:09.999768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a266-5a68-404f-9b9d-617aab2f3d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.021996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1910a266-5a68-404f-9b9d-617aab2f3d0d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:10.023158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1910a266-5a68-404f-9b9d-617aab2f3d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:10.044800 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3353/6702] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:10.046257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1c66-9d6d-4689-9bc7-5a192b3451ba None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:10.057844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1c66-9d6d-4689-9bc7-5a192b3451ba None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:10.062660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:10.063276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.063553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.063824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.064485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:10.064805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:10.066933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:10.080680 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3350/6703] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:37:10.085726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910a266-5a68-404f-9b9d-617aab2f3d0d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:10.096525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910a266-5a68-404f-9b9d-617aab2f3d0d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:10.103188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:10.106136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.107142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.107508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.108240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:10.110558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:10.165909 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3354/6704] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:10 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:10.168715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:10.186678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224677-e571-4438-a750-7c4629f9aceb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:10.390569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:10.392864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.393304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.393417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.396640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:10.399527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:10.432503 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3351/6705] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:10 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:10.437033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:10.449712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b3c7-a23b-412c-8a54-203825797e47 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:10.456374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:10.457126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.457401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.457664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.458368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:10.460190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:10.476483 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3355/6706] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:10.480706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:10.492796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b99f65-26cd-4662-949c-f74c68a979ce admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:10.501344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770924c-510b-40d7-b683-0b66c710be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:10.502122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770924c-510b-40d7-b683-0b66c710be3f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.502490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770924c-510b-40d7-b683-0b66c710be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.502781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770924c-510b-40d7-b683-0b66c710be3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.503488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770924c-510b-40d7-b683-0b66c710be3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:10.506042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770924c-510b-40d7-b683-0b66c710be3f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:10.522291 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3352/6707] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:10.525678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:10.538277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f72c-e5fd-4b00-8b08-98abdfdd1100 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:10.549718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:10.551229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.551686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.552404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] PATH_INFO: `/v3/projects/15698f5ce2214b528d90379a236b7462/users/8fc6dd4986684750974b9c036a47791a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.574778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15698f5ce2214b528d90379a236b7462, user_id=8fc6dd4986684750974b9c036a47791a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:10.578495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:10.594727 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3356/6708] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:10 2022] PUT /identity/v3/projects/15698f5ce2214b528d90379a236b7462/users/8fc6dd4986684750974b9c036a47791a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:10.605935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277dc8d-6af3-45f7-8aec-935a7320f9cd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.607116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277dc8d-6af3-45f7-8aec-935a7320f9cd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.607403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277dc8d-6af3-45f7-8aec-935a7320f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.646140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4277dc8d-6af3-45f7-8aec-935a7320f9cd None None] MFA Rules not processed for user `8fc6dd4986684750974b9c036a47791a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:10.647430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4277dc8d-6af3-45f7-8aec-935a7320f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:10.661855 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:10.736884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3353/6709] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:10.747676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:10.750427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:10.821746 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:10.842683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e927-a982-4ca9-b9d6-2790d6ba8a65 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:10.846996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32312c1-1aa9-4387-a1fd-3aac7dd0cacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:10.847697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32312c1-1aa9-4387-a1fd-3aac7dd0cacc service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:10.847972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32312c1-1aa9-4387-a1fd-3aac7dd0cacc service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:10.848241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32312c1-1aa9-4387-a1fd-3aac7dd0cacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:10.860961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32312c1-1aa9-4387-a1fd-3aac7dd0cacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:10.862500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32312c1-1aa9-4387-a1fd-3aac7dd0cacc service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:10.887251 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3357/6710] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:10.916804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277dc8d-6af3-45f7-8aec-935a7320f9cd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:11.032462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277dc8d-6af3-45f7-8aec-935a7320f9cd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:11.045160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:11.046014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:11.046384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:11.046925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] PATH_INFO: `/v3/users/8fc6dd4986684750974b9c036a47791a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:11.048408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc6dd4986684750974b9c036a47791a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:11.050626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:11.121531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc6dd4986684750974b9c036a47791a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.137593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc6dd4986684750974b9c036a47791a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.153781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc6dd4986684750974b9c036a47791a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.154524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc6dd4986684750974b9c036a47791a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.163634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc6dd4986684750974b9c036a47791a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.172822 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3354/6711] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:10 2022] DELETE /identity/v3/users/8fc6dd4986684750974b9c036a47791a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:11.175520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:11.176348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:11.176683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:11.196841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:11.198086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:11.272103 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3358/6712] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:11.281535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:11.283075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:11.329985 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:11.363037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ca60-29c2-46ef-9156-a69420b13185 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:11.367209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b1f4d-2c06-4ae2-b367-ed6c3e3017ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:11.367923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1f4d-2c06-4ae2-b367-ed6c3e3017ac service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:11.368209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1f4d-2c06-4ae2-b367-ed6c3e3017ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:11.368485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1f4d-2c06-4ae2-b367-ed6c3e3017ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:11.382082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b1f4d-2c06-4ae2-b367-ed6c3e3017ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:11.383539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b1f4d-2c06-4ae2-b367-ed6c3e3017ac service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:11.394721 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3355/6713] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:11.710698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:11.713116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:11.727508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3a4ce-6cec-44b5-a08d-83038e63741a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:11.732384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:11.734674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:11.734966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:11.735236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] PATH_INFO: `/v3/projects/15698f5ce2214b528d90379a236b7462` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:11.736621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15698f5ce2214b528d90379a236b7462)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:11.738672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:11.795704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15698f5ce2214b528d90379a236b7462', 'request_id': 'req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.806125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15698f5ce2214b528d90379a236b7462', 'request_id': 'req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.814522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15698f5ce2214b528d90379a236b7462', 'request_id': 'req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.827952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] The token cache is being invalidate because project 15698f5ce2214b528d90379a236b7462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:11.828248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.828971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b263cd4-4a7b-41f4-be5d-3e1ac077e20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:11.830555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3359/6714] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:11 2022] DELETE /identity/v3/projects/15698f5ce2214b528d90379a236b7462 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:11.835937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971d978-e191-4767-b08c-3f6136154b99 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:11.836300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971d978-e191-4767-b08c-3f6136154b99 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:11.836503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971d978-e191-4767-b08c-3f6136154b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:11.859025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2971d978-e191-4767-b08c-3f6136154b99 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:11.860288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2971d978-e191-4767-b08c-3f6136154b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:11.930702 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3356/6715] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:11.939878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11e787-b71a-48b8-b214-f6e8c7b274e0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:11.940162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11e787-b71a-48b8-b214-f6e8c7b274e0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:11.940437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11e787-b71a-48b8-b214-f6e8c7b274e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:11.961306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1b11e787-b71a-48b8-b214-f6e8c7b274e0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:11.962605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1b11e787-b71a-48b8-b214-f6e8c7b274e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:11.980819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3360/6716] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:11.984168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971d978-e191-4767-b08c-3f6136154b99 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:11.997260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971d978-e191-4767-b08c-3f6136154b99 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:12.002555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:12.003455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.003912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.004262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.005260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:12.006106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:12.008070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:12.032079 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3357/6717] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:37:12.042405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11e787-b71a-48b8-b214-f6e8c7b274e0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:12.054741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11e787-b71a-48b8-b214-f6e8c7b274e0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:12.059811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:12.060435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.060725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.061016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.061650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:12.063612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:12.101059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3361/6718] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:12 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:37:12.102423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:12.115212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0653-fac3-4090-ab78-837ba5440f31 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:12.217040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:12.222236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.222236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.222236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.222236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:12.222236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:12.252579 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3358/6719] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:12 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:37:12.256430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:12.274112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747857f-7454-4764-8f63-6f8478117b42 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:12.279934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:12.280675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.281008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.281284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.281942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:12.283862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:12.305139 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3362/6720] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:37:12.313583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:12.323915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e4ab-2213-460d-8908-cb3e8f4609c7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:12.328954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c78e-a708-4da5-9681-824a9873fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:12.329453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c78e-a708-4da5-9681-824a9873fe20 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.329736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c78e-a708-4da5-9681-824a9873fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.330129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c78e-a708-4da5-9681-824a9873fe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.330783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c78e-a708-4da5-9681-824a9873fe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:12.332748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c78e-a708-4da5-9681-824a9873fe20 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:12.352604 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3359/6721] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:12.353924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:12.367177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ca3c6-cec4-40ac-bbe1-31232968cdb4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:12.370741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:12.371422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.371704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.371980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] PATH_INFO: `/v3/projects/76269e58f30f4f1dbef296c486e78b37/users/50ef1656de7c4244a4be82e95b47df77/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.394109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76269e58f30f4f1dbef296c486e78b37, user_id=50ef1656de7c4244a4be82e95b47df77, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:12.397681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:12.418890 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3363/6722] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:12 2022] PUT /identity/v3/projects/76269e58f30f4f1dbef296c486e78b37/users/50ef1656de7c4244a4be82e95b47df77/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:12.432011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4695e9-79b6-4daf-ae9a-261cff0c6d09 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.432433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4695e9-79b6-4daf-ae9a-261cff0c6d09 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.432945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4695e9-79b6-4daf-ae9a-261cff0c6d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.473147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ba4695e9-79b6-4daf-ae9a-261cff0c6d09 None None] MFA Rules not processed for user `50ef1656de7c4244a4be82e95b47df77`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:12.475086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba4695e9-79b6-4daf-ae9a-261cff0c6d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:12.511249 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:12.571091 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3360/6723] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:12.578020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:12.579740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:12.600731 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:12.655694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982d8ff-1988-4b45-bc46-7b0d99704679 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:12.660921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:12.661748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:12.662701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:12.663148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:12.676844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:12.678422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:12.694394 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3364/6724] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:22.564256 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=13 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:22.684372 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=24 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:24.344917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382980e2-9f78-412e-846a-9277ae74b83a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:24.345506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382980e2-9f78-412e-846a-9277ae74b83a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:24.345506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382980e2-9f78-412e-846a-9277ae74b83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:24.407090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-382980e2-9f78-412e-846a-9277ae74b83a None None] MFA Rules not processed for user `05c1f10a225e4f14885bf583527e93a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:24.408338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-382980e2-9f78-412e-846a-9277ae74b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:24.499603 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3361/6725] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:24.659122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:24.661897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:24.781867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be3545-6a75-4341-af1e-9d2ca051182f service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:24.788171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:24.789301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:24.789599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:24.789855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] PATH_INFO: `/v3/users/27a75d14c8494952a4577bff44f15f99` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:24.791156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a75d14c8494952a4577bff44f15f99)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:24.793375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:24.871124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a75d14c8494952a4577bff44f15f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:24.883466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a75d14c8494952a4577bff44f15f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:24.884409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a75d14c8494952a4577bff44f15f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:24.896833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a75d14c8494952a4577bff44f15f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:24.897828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bfa541ee-628e-419a-a0f6-c569c9ef1fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a75d14c8494952a4577bff44f15f99'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:24.935877 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3365/6726] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:24 2022] DELETE /identity/v3/users/27a75d14c8494952a4577bff44f15f99 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:25.255183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382980e2-9f78-412e-846a-9277ae74b83a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:25.271944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382980e2-9f78-412e-846a-9277ae74b83a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:25.400516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:25.402348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:25.405935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:25.406434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] PATH_INFO: `/v3/projects/455488ff7064493a91bb38fc683bd233` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:25.409650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=455488ff7064493a91bb38fc683bd233)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:25.411988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:25.483276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455488ff7064493a91bb38fc683bd233', 'request_id': 'req-ef8c5efe-f592-4e73-a25c-8426fc59d333'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:25.490848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455488ff7064493a91bb38fc683bd233', 'request_id': 'req-ef8c5efe-f592-4e73-a25c-8426fc59d333'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:25.499339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455488ff7064493a91bb38fc683bd233', 'request_id': 'req-ef8c5efe-f592-4e73-a25c-8426fc59d333'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:25.519879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] The token cache is being invalidate because project 455488ff7064493a91bb38fc683bd233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:25.520227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:25.523069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef8c5efe-f592-4e73-a25c-8426fc59d333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:25.523212 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3362/6727] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:25 2022] DELETE /identity/v3/projects/455488ff7064493a91bb38fc683bd233 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:25.528078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f3c5-aed6-448b-b20e-32540ebc6d5f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:25.528360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f3c5-aed6-448b-b20e-32540ebc6d5f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:25.528874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f3c5-aed6-448b-b20e-32540ebc6d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:25.568696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-db56f3c5-aed6-448b-b20e-32540ebc6d5f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:25.570185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-db56f3c5-aed6-448b-b20e-32540ebc6d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:25.737417 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3366/6728] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:25.740148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150cf9-ec86-4648-920b-bb8bc0ae2c53 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:25.740438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150cf9-ec86-4648-920b-bb8bc0ae2c53 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:25.740754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150cf9-ec86-4648-920b-bb8bc0ae2c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:25.779199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8d150cf9-ec86-4648-920b-bb8bc0ae2c53 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:25.781055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8d150cf9-ec86-4648-920b-bb8bc0ae2c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:25.795266 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3363/6729] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:25.796353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f3c5-aed6-448b-b20e-32540ebc6d5f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:25.808354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f3c5-aed6-448b-b20e-32540ebc6d5f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:25.822711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:25.823947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:25.824980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:25.825323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:25.826173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:25.826546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:25.828247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:25.844825 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3367/6730] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:37:25.849133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d150cf9-ec86-4648-920b-bb8bc0ae2c53 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:25.861600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d150cf9-ec86-4648-920b-bb8bc0ae2c53 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:25.867808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:25.868842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:25.869308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:25.869782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:25.871103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:25.873462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:25.934864 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3364/6731] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:25 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:25.939205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:25.956009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef2e9-cdc8-4f09-9bb5-4a9083d7b099 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:25.968392 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:26.114923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:26.116362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:26.117030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:26.117510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:26.118513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:26.121454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:26.164756 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3368/6732] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:25 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:26.167921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:26.182864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a2a2b-9451-44bf-aabe-c7445970d7b6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:26.198296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:26.198878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:26.199217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:26.199416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:26.200370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:26.202095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:26.207582 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:26.234184 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3365/6733] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:26.235054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:26.259139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd3725-060e-43b4-88c8-3c4c6864b456 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:26.265168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae23264-6353-461d-a020-871bba9756ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:26.265795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23264-6353-461d-a020-871bba9756ce admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:26.266072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23264-6353-461d-a020-871bba9756ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:26.266347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23264-6353-461d-a020-871bba9756ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:26.266999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae23264-6353-461d-a020-871bba9756ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:26.269280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae23264-6353-461d-a020-871bba9756ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:26.282534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3369/6734] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:37:26.287226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:26.303910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f2af1-d396-48a4-b9b7-3a96e7c77f5d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:26.318295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ead72a-79ab-4514-a95a-16b7c96cd2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:26.320439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ead72a-79ab-4514-a95a-16b7c96cd2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:26.321237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ead72a-79ab-4514-a95a-16b7c96cd2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:26.322149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ead72a-79ab-4514-a95a-16b7c96cd2a1 admin admin] PATH_INFO: `/v3/projects/5fccfb6e12034a7fb9cab13a9e9530d7/users/7b11b9adba9849b9ab5fd32b35c8ecf0/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:26.353400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ead72a-79ab-4514-a95a-16b7c96cd2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fccfb6e12034a7fb9cab13a9e9530d7, user_id=7b11b9adba9849b9ab5fd32b35c8ecf0, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:26.356826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ead72a-79ab-4514-a95a-16b7c96cd2a1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:26.377089 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3366/6735] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:26 2022] PUT /identity/v3/projects/5fccfb6e12034a7fb9cab13a9e9530d7/users/7b11b9adba9849b9ab5fd32b35c8ecf0/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:26.387973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:26.388302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:26.388989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:26.435935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] MFA Rules not processed for user `7b11b9adba9849b9ab5fd32b35c8ecf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:26.438271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:26.550295 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3370/6736] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:26.551001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:26.551459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:26.551542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:26.596994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] MFA Rules not processed for user `7b11b9adba9849b9ab5fd32b35c8ecf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:26.599331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:26.627766 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3367/6737] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:26.635787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:26.638950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:26.759678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bf30d-26c4-418c-908d-5ccb55417a8c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:26.767617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:26.767832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:26.768316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:26.768776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:26.778953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:26.780642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:26.786943 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:26.793079 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3371/6738] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:29.796256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:29.798043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:29.914196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b61e60-6ac5-46ee-8e23-ec1b223c300c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:29.926267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d379c-02c5-4c2a-b8a7-87b32d15795a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:29.927102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d379c-02c5-4c2a-b8a7-87b32d15795a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:29.927530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d379c-02c5-4c2a-b8a7-87b32d15795a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:29.927957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d379c-02c5-4c2a-b8a7-87b32d15795a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:29.934117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d37d379c-02c5-4c2a-b8a7-87b32d15795a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:29.969813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d379c-02c5-4c2a-b8a7-87b32d15795a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:29.971750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d379c-02c5-4c2a-b8a7-87b32d15795a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:29.986352 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3368/6739] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:34.510118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:34.511671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:34.637943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f4e6-a023-412e-a7c7-4dc588295bd0 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:34.644153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:34.645147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:34.645640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:34.646149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] PATH_INFO: `/v3/users/879d4de0e39244adba9aab8e4a7725d1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:34.647678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879d4de0e39244adba9aab8e4a7725d1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:34.650369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:34.741156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879d4de0e39244adba9aab8e4a7725d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:34.753162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879d4de0e39244adba9aab8e4a7725d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:34.754006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879d4de0e39244adba9aab8e4a7725d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:34.764351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879d4de0e39244adba9aab8e4a7725d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:34.765177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879d4de0e39244adba9aab8e4a7725d1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:34.795802 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3372/6740] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:34 2022] DELETE /identity/v3/users/879d4de0e39244adba9aab8e4a7725d1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:34.803072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:34.804177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:34.804527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:34.834599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:34.835936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:34.942020 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3369/6741] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:34.953079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:34.954691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:35.061555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09cec4-3522-4f33-8225-83b5ebf42bc8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:35.065958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e27ddc-b38b-4a9d-b611-a3fe6e2dcfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:35.067107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e27ddc-b38b-4a9d-b611-a3fe6e2dcfbf service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:35.067331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e27ddc-b38b-4a9d-b611-a3fe6e2dcfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:35.067649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e27ddc-b38b-4a9d-b611-a3fe6e2dcfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:35.078578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e27ddc-b38b-4a9d-b611-a3fe6e2dcfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:35.080246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e27ddc-b38b-4a9d-b611-a3fe6e2dcfbf service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:35.092325 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3373/6742] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:35.389339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:35.390936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:35.410411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbcbc3-c5e5-4fb3-98ee-27eb062440a8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:35.416470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:35.417155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:35.417432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:35.417698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] PATH_INFO: `/v3/projects/9f7a12a642e9499c99441faff6aba72e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:35.418817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7a12a642e9499c99441faff6aba72e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:35.421869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:35.482881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7a12a642e9499c99441faff6aba72e', 'request_id': 'req-af4a00e2-4d21-4b74-9c6e-005218b319aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:35.490005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7a12a642e9499c99441faff6aba72e', 'request_id': 'req-af4a00e2-4d21-4b74-9c6e-005218b319aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:35.504751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7a12a642e9499c99441faff6aba72e', 'request_id': 'req-af4a00e2-4d21-4b74-9c6e-005218b319aa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:35.507575 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:35.550188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] The token cache is being invalidate because project 9f7a12a642e9499c99441faff6aba72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:35.550841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:35.553224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-af4a00e2-4d21-4b74-9c6e-005218b319aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:35.558628 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3370/6743] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:35 2022] DELETE /identity/v3/projects/9f7a12a642e9499c99441faff6aba72e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:35.560718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1db6-0c1e-4acc-ab55-61ae5c058362 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:35.561204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1db6-0c1e-4acc-ab55-61ae5c058362 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:35.561462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1db6-0c1e-4acc-ab55-61ae5c058362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:35.584373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-130c1db6-0c1e-4acc-ab55-61ae5c058362 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:35.585856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-130c1db6-0c1e-4acc-ab55-61ae5c058362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:35.611768 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:35.701106 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3374/6744] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:35.713155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8663ac-7100-4ff3-9a23-abe41986c193 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:35.713568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8663ac-7100-4ff3-9a23-abe41986c193 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:35.714027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8663ac-7100-4ff3-9a23-abe41986c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:35.737943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6e8663ac-7100-4ff3-9a23-abe41986c193 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:35.741594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e8663ac-7100-4ff3-9a23-abe41986c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:35.763890 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3371/6745] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:35.768960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1db6-0c1e-4acc-ab55-61ae5c058362 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:35.779786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1db6-0c1e-4acc-ab55-61ae5c058362 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:35.785210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:35.786165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:35.786653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:35.787160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:35.788500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:35.789063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:35.790940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:35.806034 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3375/6746] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:37:35.810644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8663ac-7100-4ff3-9a23-abe41986c193 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:35.821258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8663ac-7100-4ff3-9a23-abe41986c193 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:35.826241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:35.826857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:35.827129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:35.827395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:35.828022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:35.830121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:35.865813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3372/6747] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:35 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:37:35.870332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:35.881052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833df02-85a8-406a-811e-eeea33086493 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:35.978302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:35.979005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:35.979346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:35.979679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:35.980376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:35.982500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:36.008983 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3376/6748] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:35 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:36.013142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:36.035902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6447-7468-4e34-a1f2-2f3a23fe9eaf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:36.044426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:36.045187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:36.045656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:36.046047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:36.046736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:36.048603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:36.071390 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3373/6749] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:36.081063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:36.092988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf38d-6018-4826-b8df-21641993acb4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:36.098134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21ca8-c9bc-49f1-be6b-7de0fea5eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:36.098776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21ca8-c9bc-49f1-be6b-7de0fea5eef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:36.099055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21ca8-c9bc-49f1-be6b-7de0fea5eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:36.099324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21ca8-c9bc-49f1-be6b-7de0fea5eef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:36.100684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a21ca8-c9bc-49f1-be6b-7de0fea5eef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:36.101665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a21ca8-c9bc-49f1-be6b-7de0fea5eef6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:36.115245 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3377/6750] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:37:36.119656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:36.136986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd34ed4-95e8-4149-8992-2bdfb961ecac admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:36.145187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:36.146798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:36.147279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:36.147665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] PATH_INFO: `/v3/projects/742cf9edd954490fbdf9fb7f1726a515/users/fb5cea141cb342eaa766d1af01515457/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:36.167715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742cf9edd954490fbdf9fb7f1726a515, user_id=fb5cea141cb342eaa766d1af01515457, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:36.170498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:36.185973 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3374/6751] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:36 2022] PUT /identity/v3/projects/742cf9edd954490fbdf9fb7f1726a515/users/fb5cea141cb342eaa766d1af01515457/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:36.196809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:36.197097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:36.197372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:36.227657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] MFA Rules not processed for user `fb5cea141cb342eaa766d1af01515457`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:36.228932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:36.302619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3378/6752] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:36.313311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:36.315390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:36.379127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7315a3e-f994-481c-9097-b8e8c5f119e1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:36.383201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:36.383893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:36.384178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:36.384451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:36.393576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:36.395403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:36.405345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3375/6753] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:36.686333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:36.687928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:36.725144 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:36.844329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f5a83-7a7c-467b-b816-d8cc8e5570b5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:36.873208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:36.873967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:36.874376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:36.874735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:36.877111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:36.920100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:36.922057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:36.959404 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3379/6754] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:41.478825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:41.482799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:41.513019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144e7a3-1f2f-45ae-86f0-1fe68d27dce1 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:41.537582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:41.538950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:41.540687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:41.541153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:41.544692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:41.584370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:41.586740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:41.616076 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3376/6755] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:41.757276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:41.759505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:41.906053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ba5a5-259d-4086-9cf3-da56781c31fe service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:41.913542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50301eed-6ddf-47dd-9244-52e5ddc71c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:41.914897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301eed-6ddf-47dd-9244-52e5ddc71c16 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:41.916739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301eed-6ddf-47dd-9244-52e5ddc71c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:41.917165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301eed-6ddf-47dd-9244-52e5ddc71c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:41.925054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-50301eed-6ddf-47dd-9244-52e5ddc71c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:41.946306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301eed-6ddf-47dd-9244-52e5ddc71c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:41.948812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301eed-6ddf-47dd-9244-52e5ddc71c16 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:41.972203 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3380/6756] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:43.110720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:43.252826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea170b3-f083-4241-b532-bd9a44c77e7b service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:43.259791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:43.260559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:43.260947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:43.261274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] PATH_INFO: `/v3/users/fb5cea141cb342eaa766d1af01515457` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:43.262730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5cea141cb342eaa766d1af01515457)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:43.265799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:43.310989 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:43.351630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5cea141cb342eaa766d1af01515457'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:43.366693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5cea141cb342eaa766d1af01515457'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:43.402512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5cea141cb342eaa766d1af01515457'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:43.403416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5cea141cb342eaa766d1af01515457'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:43.421937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5cea141cb342eaa766d1af01515457'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:43.435729 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3377/6757] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:37:43 2022] DELETE /identity/v3/users/fb5cea141cb342eaa766d1af01515457 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:43.440748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:43.441635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:43.443099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:43.482471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:43.484143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:43.610769 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3381/6758] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:37:43.617544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:43.619121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:43.715640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3122a85-c675-4896-98a1-7f76875c33cb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:43.720253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe837-a2d4-42db-ae3f-f5e5ba477568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:43.721364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe837-a2d4-42db-ae3f-f5e5ba477568 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:43.722499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe837-a2d4-42db-ae3f-f5e5ba477568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:43.723010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe837-a2d4-42db-ae3f-f5e5ba477568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:43.735726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe837-a2d4-42db-ae3f-f5e5ba477568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:43.738446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe837-a2d4-42db-ae3f-f5e5ba477568 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:43.751878 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3378/6759] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:44.104358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:44.108443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:44.165961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5031-bf20-4624-b38e-6194524bfa3a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:44.175040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:44.176120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.176579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.177040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] PATH_INFO: `/v3/projects/742cf9edd954490fbdf9fb7f1726a515` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.178235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=742cf9edd954490fbdf9fb7f1726a515)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:44.183213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:44.269115 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:44.296962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742cf9edd954490fbdf9fb7f1726a515', 'request_id': 'req-6106351f-c38f-45a0-bc26-f1ede77bbd67'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:44.318061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742cf9edd954490fbdf9fb7f1726a515', 'request_id': 'req-6106351f-c38f-45a0-bc26-f1ede77bbd67'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:44.329292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742cf9edd954490fbdf9fb7f1726a515', 'request_id': 'req-6106351f-c38f-45a0-bc26-f1ede77bbd67'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:44.361506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] The token cache is being invalidate because project 742cf9edd954490fbdf9fb7f1726a515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:37:44.367453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:44.369006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6106351f-c38f-45a0-bc26-f1ede77bbd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:37:44.370751 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3382/6760] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:37:44 2022] DELETE /identity/v3/projects/742cf9edd954490fbdf9fb7f1726a515 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:44.375557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9449-760c-45c0-8740-72b567cdc357 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.376136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9449-760c-45c0-8740-72b567cdc357 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.376243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9449-760c-45c0-8740-72b567cdc357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.411605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-664c9449-760c-45c0-8740-72b567cdc357 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:44.413605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-664c9449-760c-45c0-8740-72b567cdc357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:44.505776 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3379/6761] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:44.601258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4e5fd-62e4-48bf-b6f6-a9fb4d03c910 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.601829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4e5fd-62e4-48bf-b6f6-a9fb4d03c910 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.601829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4e5fd-62e4-48bf-b6f6-a9fb4d03c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.626353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-68a4e5fd-62e4-48bf-b6f6-a9fb4d03c910 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:44.628160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68a4e5fd-62e4-48bf-b6f6-a9fb4d03c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:44.637656 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3383/6762] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:44.642796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c9449-760c-45c0-8740-72b567cdc357 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:44.656033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c9449-760c-45c0-8740-72b567cdc357 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:44.661611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:44.662247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.662528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.663108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.664504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:37:44.664844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:44.666618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:44.687371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4e5fd-62e4-48bf-b6f6-a9fb4d03c910 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:44.693639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3380/6763] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:37:44.698545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4e5fd-62e4-48bf-b6f6-a9fb4d03c910 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:44.704828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:44.705557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.705951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.706412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.707069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:44.709196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:44.754637 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3384/6764] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:44 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:44.758896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:44.772154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37e2b-3462-44a6-ba56-5d248cc4f863 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:44.803542 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:44.841782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:44.842332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.842612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.843163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.843557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:44.845597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:44.870339 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3381/6765] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:44 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:44.874874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:44.891862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacdadc-599f-44f0-8598-46615e60f0d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:44.897039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:44.897750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.898036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.898424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.899224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:44.901273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:44.916478 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3385/6766] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:44.917714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:44.929421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7952eb-abea-4920-b1df-732319ab9bd8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:44.934264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2cb01-f23b-46d4-908b-c6e47705d1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:44.934888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cb01-f23b-46d4-908b-c6e47705d1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.935164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cb01-f23b-46d4-908b-c6e47705d1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.935450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cb01-f23b-46d4-908b-c6e47705d1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.936081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2cb01-f23b-46d4-908b-c6e47705d1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:44.937728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2cb01-f23b-46d4-908b-c6e47705d1c0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:44.953061 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3382/6767] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:37:44.954351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:44.966154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b56ae-660e-451c-97d4-d8dda9baa680 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:44.974835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:44.975453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:44.975734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:44.976084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] PATH_INFO: `/v3/projects/61eaeb3998c145b4b4647f88e3617a93/users/702bd4b2a2a2423daa2193226929af24/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:44.998749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61eaeb3998c145b4b4647f88e3617a93, user_id=702bd4b2a2a2423daa2193226929af24, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:45.001434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:45.016546 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3386/6768] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:44 2022] PUT /identity/v3/projects/61eaeb3998c145b4b4647f88e3617a93/users/702bd4b2a2a2423daa2193226929af24/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:45.027945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae36a0-4daa-42d2-a977-e1a07b9a4cb6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.028233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae36a0-4daa-42d2-a977-e1a07b9a4cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.028516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae36a0-4daa-42d2-a977-e1a07b9a4cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.074243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f3ae36a0-4daa-42d2-a977-e1a07b9a4cb6 None None] MFA Rules not processed for user `702bd4b2a2a2423daa2193226929af24`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:45.075484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f3ae36a0-4daa-42d2-a977-e1a07b9a4cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:45.190326 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3383/6769] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:45.192498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:45.277155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4fd49-0ca8-43b0-b62a-ac35f8f9c653 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:45.283645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:45.284922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.285635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.285926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.286605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:45.290266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:45.326478 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3387/6770] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:45 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:45.331950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae36a0-4daa-42d2-a977-e1a07b9a4cb6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:45.348621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae36a0-4daa-42d2-a977-e1a07b9a4cb6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:45.428439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:45.429252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.429602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.429957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.430705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:45.432993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:45.458820 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3384/6771] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:45 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:45.462742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:45.474071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219afbe-94ce-4365-b741-9014ab8b3732 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:45.479577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:45.480282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.480627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.480993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.481729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:45.483509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:45.496467 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3388/6772] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:45.500622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:45.511415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4ad25-dfca-4ca9-be72-4780d1ae75f5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:45.516530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b7393-313e-445d-b149-0a4361915785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:45.517621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7393-313e-445d-b149-0a4361915785 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.517899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7393-313e-445d-b149-0a4361915785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.518229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7393-313e-445d-b149-0a4361915785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.518897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b7393-313e-445d-b149-0a4361915785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:45.520544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b7393-313e-445d-b149-0a4361915785 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:45.536634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:45.543667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3385/6773] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:45.549975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5022b-8937-4c96-87b9-f5201c768a6f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:45.555377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:45.556143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.556488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.556860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] PATH_INFO: `/v3/projects/a8ed8a98d0014e58afe6e1dff4d4d188/users/56a4fc52dcad4418b388347826cde644/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.598578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ed8a98d0014e58afe6e1dff4d4d188, user_id=56a4fc52dcad4418b388347826cde644, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:45.601386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:45.629319 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3389/6774] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:45 2022] PUT /identity/v3/projects/a8ed8a98d0014e58afe6e1dff4d4d188/users/56a4fc52dcad4418b388347826cde644/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:45.640807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeba89-7c13-48cf-a7e2-19333692f403 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.641002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeba89-7c13-48cf-a7e2-19333692f403 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.641699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeba89-7c13-48cf-a7e2-19333692f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.710168 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:45.717940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-88aeba89-7c13-48cf-a7e2-19333692f403 None None] MFA Rules not processed for user `56a4fc52dcad4418b388347826cde644`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:45.721798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-88aeba89-7c13-48cf-a7e2-19333692f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:45.864719 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3386/6775] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:45.868920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:45.899163 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:45.966959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb066ffc-5f6d-411f-af89-efd44318d5f4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:45.993723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:45.996481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:45.996921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:45.998091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:45.998872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:46.006319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:46.053413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3390/6776] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:37:45 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:46.057262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeba89-7c13-48cf-a7e2-19333692f403 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:46.071064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeba89-7c13-48cf-a7e2-19333692f403 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:46.159439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:46.160375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:46.160860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:46.161310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:46.162454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:46.165156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:46.214651 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3387/6777] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:37:46 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:37:46.218910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:46.237237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefeec4-a567-4621-b74a-e4da4583585f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:46.249030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:46.249832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:46.250173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:46.250446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:46.251108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:46.265043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:46.298875 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3391/6778] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:46.300633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:46.314988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69a28-c2a9-475a-9d90-d338287cbac1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:46.328828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:46.330332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:46.331295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:46.331862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] PATH_INFO: `/v3/projects/cb237a22556e44fa87f02ee7e123291a/users/ae8ba01baaea48ea93d2123f456977d7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:46.375663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb237a22556e44fa87f02ee7e123291a, user_id=ae8ba01baaea48ea93d2123f456977d7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:46.380062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:46.404236 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3388/6779] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:46 2022] PUT /identity/v3/projects/cb237a22556e44fa87f02ee7e123291a/users/ae8ba01baaea48ea93d2123f456977d7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:46.405516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:46.421281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fffbeb-5584-40cb-a0a4-78593fe843c9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:46.531309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e4e40-1ca7-4040-975e-516dc39de6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:46.532265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4e40-1ca7-4040-975e-516dc39de6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:46.532834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4e40-1ca7-4040-975e-516dc39de6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:46.533315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4e40-1ca7-4040-975e-516dc39de6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:46.534719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e4e40-1ca7-4040-975e-516dc39de6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:46.536386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e4e40-1ca7-4040-975e-516dc39de6a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:46.549626 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3392/6780] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:37:46.556536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:46.571322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8cad5-42e7-48a4-acfd-6e57d96c4d9f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:46.579563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:46.580490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:46.581029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:46.581494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] PATH_INFO: `/v3/projects/cb237a22556e44fa87f02ee7e123291a/users/ae8ba01baaea48ea93d2123f456977d7/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:46.583682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb237a22556e44fa87f02ee7e123291a, user_id=ae8ba01baaea48ea93d2123f456977d7, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:46.586532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:46.607309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3389/6781] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:37:46 2022] PUT /identity/v3/projects/cb237a22556e44fa87f02ee7e123291a/users/ae8ba01baaea48ea93d2123f456977d7/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:37:46.618919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:46.619359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:46.619467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:46.650718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] MFA Rules not processed for user `ae8ba01baaea48ea93d2123f456977d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:37:46.651866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:46.738302 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3393/6782] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:37:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:37:46.749457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:46.751246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:46.831671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9023-3e32-4759-b637-1253344d732f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:46.836101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:46.836874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:46.837267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:46.837635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:46.848281 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:46.926952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:46.928508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:46.938617 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3390/6783] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:49.786048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:49.787880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:49.817070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae78e85-5117-4539-b7bf-1216856b8d4a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:49.826111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:49.827007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:49.827435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:49.827876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:49.850047 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:49.966662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:49.968132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:49.992056 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3394/6784] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:50.909930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:50.929587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea2210-735e-49a4-a1af-869bba325c89 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:50.938815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:50.939698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:50.940815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:50.941297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:50.956087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:50.957954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:50.985981 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3391/6785] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:37:56.303227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:37:56.304950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:56.390240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b628a-af51-48f5-ac92-df41c19e3c31 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:37:56.395079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e180d46-48b7-47c5-b94a-39e8c56dc497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:37:56.395708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180d46-48b7-47c5-b94a-39e8c56dc497 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:37:56.396177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180d46-48b7-47c5-b94a-39e8c56dc497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:37:56.396481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180d46-48b7-47c5-b94a-39e8c56dc497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:37:56.398591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2e180d46-48b7-47c5-b94a-39e8c56dc497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:37:56.476024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e180d46-48b7-47c5-b94a-39e8c56dc497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:37:56.478078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e180d46-48b7-47c5-b94a-39e8c56dc497 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:37:56.489974 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3395/6786] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:38:00.964205 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=29 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:01.034925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:01.062217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47ee4d-476d-412b-b2a0-e0ff1f8b80ad service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:01.071521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:01.073666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:01.075714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:01.076294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] PATH_INFO: `/v3/users/702bd4b2a2a2423daa2193226929af24` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:01.078220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=702bd4b2a2a2423daa2193226929af24)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:01.089714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:01.313991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702bd4b2a2a2423daa2193226929af24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:01.336212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702bd4b2a2a2423daa2193226929af24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:01.390445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702bd4b2a2a2423daa2193226929af24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:01.391839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702bd4b2a2a2423daa2193226929af24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:01.417664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702bd4b2a2a2423daa2193226929af24'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:01.436696 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3392/6787] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:01 2022] DELETE /identity/v3/users/702bd4b2a2a2423daa2193226929af24 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:01.441575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:01.442075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:01.442181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:01.487040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:01.488839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:01.617214 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:01.643963 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3396/6788] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:01.685754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:01.689118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:01.891950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:01.893743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:01.916031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b5bfe-cf66-48d1-830e-2eccd0396ada admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:01.918251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f9712-1dc6-4f7a-985c-8ee17b0e2b91 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:01.935558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:01.936200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:01.936472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:01.936795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:01.945445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:01.946352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:01.947915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:01.948354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] PATH_INFO: `/v3/users/61445b694d0c484c99648ec99f21a34a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:01.950652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=61445b694d0c484c99648ec99f21a34a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:01.956582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:01.971411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:01.972926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:02.031034 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3393/6789] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:02.068385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61445b694d0c484c99648ec99f21a34a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.093610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61445b694d0c484c99648ec99f21a34a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.096102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61445b694d0c484c99648ec99f21a34a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.105133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61445b694d0c484c99648ec99f21a34a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.107351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-24b30030-e508-4d54-814d-f162257eb2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61445b694d0c484c99648ec99f21a34a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.151199 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3397/6790] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:01 2022] DELETE /identity/v3/users/61445b694d0c484c99648ec99f21a34a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:02.507873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:02.527265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78730d-4246-4a3d-a168-c68aec1e4153 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:02.672361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:02.675624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:02.676290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:02.676755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] PATH_INFO: `/v3/projects/22b84439bde64075ab7459b430b0e612` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:02.678948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b84439bde64075ab7459b430b0e612)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:02.682223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:02.721754 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:02.799115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b84439bde64075ab7459b430b0e612', 'request_id': 'req-b76bec93-a77a-456f-b592-70b948db4c90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.807551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b84439bde64075ab7459b430b0e612', 'request_id': 'req-b76bec93-a77a-456f-b592-70b948db4c90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.819768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b84439bde64075ab7459b430b0e612', 'request_id': 'req-b76bec93-a77a-456f-b592-70b948db4c90'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.842900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] The token cache is being invalidate because project 22b84439bde64075ab7459b430b0e612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:02.846364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.848011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:02.850732 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3394/6791] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:02 2022] DELETE /identity/v3/projects/22b84439bde64075ab7459b430b0e612 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:02.858290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858be6-10b4-48d7-90ca-ca36c3e31ed0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:02.858857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858be6-10b4-48d7-90ca-ca36c3e31ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:02.858857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858be6-10b4-48d7-90ca-ca36c3e31ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:02.894488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-74858be6-10b4-48d7-90ca-ca36c3e31ed0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:02.895710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-74858be6-10b4-48d7-90ca-ca36c3e31ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:02.910980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:02.913030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:03.027697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bec93-a77a-456f-b592-70b948db4c90 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.035787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3398/6792] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:03.046796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b35c2-6dbe-4a8e-85b1-37d79a8b1cc6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.047650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b35c2-6dbe-4a8e-85b1-37d79a8b1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.048603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b35c2-6dbe-4a8e-85b1-37d79a8b1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.056276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.057265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.057695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.058911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] PATH_INFO: `/v3/projects/61eaeb3998c145b4b4647f88e3617a93` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.060849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61eaeb3998c145b4b4647f88e3617a93)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.066628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:03.091536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-539b35c2-6dbe-4a8e-85b1-37d79a8b1cc6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:03.093041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-539b35c2-6dbe-4a8e-85b1-37d79a8b1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:03.104042 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3399/6793] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:03.108493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b35c2-6dbe-4a8e-85b1-37d79a8b1cc6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:03.134848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61eaeb3998c145b4b4647f88e3617a93', 'request_id': 'req-7d81f7ab-66ec-4cd4-9887-cafe7c348228'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.141126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b35c2-6dbe-4a8e-85b1-37d79a8b1cc6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.152156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61eaeb3998c145b4b4647f88e3617a93', 'request_id': 'req-7d81f7ab-66ec-4cd4-9887-cafe7c348228'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.160590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61eaeb3998c145b4b4647f88e3617a93', 'request_id': 'req-7d81f7ab-66ec-4cd4-9887-cafe7c348228'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.185474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] The token cache is being invalidate because project 61eaeb3998c145b4b4647f88e3617a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:03.185676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.188307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.190840 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3395/6794] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:02 2022] DELETE /identity/v3/projects/61eaeb3998c145b4b4647f88e3617a93 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:03.196071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:03.198187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:03.283202 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:03.296619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.297057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.297322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.297734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.298403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:03.298909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.300515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:03.326012 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:03.337092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3400/6795] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:03.342680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:03.344378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:03.358011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366ec26-9d77-4e1b-844a-3bcf086f8528 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.370248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81f7ab-66ec-4cd4-9887-cafe7c348228 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.370443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.370976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.371721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.371721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.372244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.374216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:03.387358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.388134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.388408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.388680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] PATH_INFO: `/v3/users/56a4fc52dcad4418b388347826cde644` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.389948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a4fc52dcad4418b388347826cde644)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.391913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:03.436533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3401/6796] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:03 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:03.440974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:03.507487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a4fc52dcad4418b388347826cde644'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.523193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a4fc52dcad4418b388347826cde644'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.557949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274317c-9f37-4959-b94c-58182d533beb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.562767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a4fc52dcad4418b388347826cde644'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.564680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a4fc52dcad4418b388347826cde644'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.567943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.568606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.568867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.575174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.575573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.578433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:03.583059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a4fc52dcad4418b388347826cde644'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:03.598836 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3396/6797] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:03 2022] DELETE /identity/v3/users/56a4fc52dcad4418b388347826cde644 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:03.653852 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3402/6798] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:03 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:03.657628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:03.661333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:03.834110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654f43-6e53-4059-a421-0caa50f3bed5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.842498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.843247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.845042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.845333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.846136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.850696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:03.882120 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3397/6799] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:03.884236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:03.904879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb57c4-a4a1-48f6-8b7d-623afea402e9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.920866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20e813-919a-4cc6-b315-61e6252ec24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.921518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20e813-919a-4cc6-b315-61e6252ec24f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.925135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20e813-919a-4cc6-b315-61e6252ec24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.925694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20e813-919a-4cc6-b315-61e6252ec24f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.927049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20e813-919a-4cc6-b315-61e6252ec24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.928974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20e813-919a-4cc6-b315-61e6252ec24f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:03.946586 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3403/6800] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:03.947550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:03.958151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed06d63-c3c7-4f45-84ce-11239360d4e9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:03.964798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:03.965709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:03.966145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:03.966571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] PATH_INFO: `/v3/projects/ae30e3cbe1d14686babdfacfbc234493/users/a846d618ecc2473bab65718f3b707cff/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:03.986016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae30e3cbe1d14686babdfacfbc234493, user_id=a846d618ecc2473bab65718f3b707cff, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:03.989181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.019181 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3398/6801] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:03 2022] PUT /identity/v3/projects/ae30e3cbe1d14686babdfacfbc234493/users/a846d618ecc2473bab65718f3b707cff/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:04.032700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16c3f-937b-49a5-8dcf-93d413c351d8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.033316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16c3f-937b-49a5-8dcf-93d413c351d8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.033652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16c3f-937b-49a5-8dcf-93d413c351d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.039493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.041464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:04.096447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-56f16c3f-937b-49a5-8dcf-93d413c351d8 None None] MFA Rules not processed for user `a846d618ecc2473bab65718f3b707cff`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:04.097670 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:04.099375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56f16c3f-937b-49a5-8dcf-93d413c351d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:04.172487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0cdd-bd4d-4451-9f6a-4dbc7e06f51b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.181575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.182319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.182911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.183251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] PATH_INFO: `/v3/projects/a8ed8a98d0014e58afe6e1dff4d4d188` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.184653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ed8a98d0014e58afe6e1dff4d4d188)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.187131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.212225 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3404/6802] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:04.216676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16c3f-937b-49a5-8dcf-93d413c351d8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.230769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16c3f-937b-49a5-8dcf-93d413c351d8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.251875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ed8a98d0014e58afe6e1dff4d4d188', 'request_id': 'req-59f0ef48-1d45-411e-babd-b505d05e0ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.259436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ed8a98d0014e58afe6e1dff4d4d188', 'request_id': 'req-59f0ef48-1d45-411e-babd-b505d05e0ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.266506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ed8a98d0014e58afe6e1dff4d4d188', 'request_id': 'req-59f0ef48-1d45-411e-babd-b505d05e0ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.283627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] The token cache is being invalidate because project a8ed8a98d0014e58afe6e1dff4d4d188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:04.283991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.284816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.286440 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3399/6803] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:04 2022] DELETE /identity/v3/projects/a8ed8a98d0014e58afe6e1dff4d4d188 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:04.291114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.293994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:04.298559 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:04.322999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.323922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.324375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.325466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.326305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.329115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.388246 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3405/6804] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:04 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:04.389991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.391901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:04.399476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0ef48-1d45-411e-babd-b505d05e0ad3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.477650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.478446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.478826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.479225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] PATH_INFO: `/v3/users/ae8ba01baaea48ea93d2123f456977d7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.480929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8ba01baaea48ea93d2123f456977d7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.483176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.483408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190d54-2f02-4f68-97f0-85d601c242c4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.488654 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:04.494298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.494919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.495195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.495462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.496100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.498333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.540501 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3406/6805] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:04 2022] POST /identity/v3/users => generated 301 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:04.544266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.566096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c8718-1c69-4ddf-861d-a1b7c5064022 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.567965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8ba01baaea48ea93d2123f456977d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.579812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.580523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.580935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.582282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.583000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.584716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.589765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8ba01baaea48ea93d2123f456977d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.604916 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3407/6806] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:04.607483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8ba01baaea48ea93d2123f456977d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.608249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8ba01baaea48ea93d2123f456977d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.610051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.617432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8ba01baaea48ea93d2123f456977d7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:04.623972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d319a-a054-4f87-8481-a351bc9b21d6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.625011 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3400/6807] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:04 2022] DELETE /identity/v3/users/ae8ba01baaea48ea93d2123f456977d7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:04.704287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.705520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.705949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.706398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] PATH_INFO: `/v3/projects/3b781bd015a442f4bf63469a8c98deca/users/0d95c0b949a445caa01c3e67994334f6/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.732050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b781bd015a442f4bf63469a8c98deca, user_id=0d95c0b949a445caa01c3e67994334f6, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.737040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.758060 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3408/6808] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:04 2022] PUT /identity/v3/projects/3b781bd015a442f4bf63469a8c98deca/users/0d95c0b949a445caa01c3e67994334f6/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:04.762847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.764407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:04.781709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eddc69-bbe6-48ce-b28a-ae2de75e2362 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.875194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fe8fc-d0c6-4540-aa8f-69cd4f484e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.875860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fe8fc-d0c6-4540-aa8f-69cd4f484e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.877033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fe8fc-d0c6-4540-aa8f-69cd4f484e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.877539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fe8fc-d0c6-4540-aa8f-69cd4f484e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.877979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fe8fc-d0c6-4540-aa8f-69cd4f484e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.879620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fe8fc-d0c6-4540-aa8f-69cd4f484e88 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.890723 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3401/6809] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:04.895083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:04.909387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15634-44d5-49c5-9398-48b5643949df admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:04.917947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:04.917947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.917947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.917947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] PATH_INFO: `/v3/projects/3b781bd015a442f4bf63469a8c98deca/users/0d95c0b949a445caa01c3e67994334f6/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:04.920009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b781bd015a442f4bf63469a8c98deca, user_id=0d95c0b949a445caa01c3e67994334f6, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:04.923065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:04.956242 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3409/6810] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:04 2022] PUT /identity/v3/projects/3b781bd015a442f4bf63469a8c98deca/users/0d95c0b949a445caa01c3e67994334f6/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:04.958089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7ec8-7e7b-483a-963b-dff67fa11ec9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:04.958407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7ec8-7e7b-483a-963b-dff67fa11ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:04.958686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7ec8-7e7b-483a-963b-dff67fa11ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.035043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f96c7ec8-7e7b-483a-963b-dff67fa11ec9 None None] MFA Rules not processed for user `0d95c0b949a445caa01c3e67994334f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:05.036309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f96c7ec8-7e7b-483a-963b-dff67fa11ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:05.088192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.090418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:05.136889 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:05.177040 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3402/6811] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:05.181643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c7ec8-7e7b-483a-963b-dff67fa11ec9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.189124 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:05.195397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c7ec8-7e7b-483a-963b-dff67fa11ec9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.201835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.202726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.203157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.203829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects/ae30e3cbe1d14686babdfacfbc234493` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.206247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:get_project(project_id=ae30e3cbe1d14686babdfacfbc234493)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.209125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.212957 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3403/6812] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects/ae30e3cbe1d14686babdfacfbc234493 => generated 387 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:05.215943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.220285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156026e7-c0c7-426f-bc82-8ca8bb3ad89c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.228156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.228866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8d6e-a943-47c7-8845-ab2300687810 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.229503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.229807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.230079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] PATH_INFO: `/v3/projects/cb237a22556e44fa87f02ee7e123291a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.233265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb237a22556e44fa87f02ee7e123291a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.234680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.235393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.235820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.236702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.238559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.238786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.240267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.286295 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3404/6813] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:38:05 2022] POST /identity/v3/projects => generated 339 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:05.288994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.350140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb237a22556e44fa87f02ee7e123291a', 'request_id': 'req-d517a342-503f-4d4c-99bc-6cdbccfecea4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:05.359653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb237a22556e44fa87f02ee7e123291a', 'request_id': 'req-d517a342-503f-4d4c-99bc-6cdbccfecea4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:05.381404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb237a22556e44fa87f02ee7e123291a', 'request_id': 'req-d517a342-503f-4d4c-99bc-6cdbccfecea4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:05.392582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50547-84b7-44e5-a04c-09a3cc9c3caf tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.400154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] The token cache is being invalidate because project cb237a22556e44fa87f02ee7e123291a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:05.400602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:05.401640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d517a342-503f-4d4c-99bc-6cdbccfecea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:05.404845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3410/6814] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:05 2022] DELETE /identity/v3/projects/cb237a22556e44fa87f02ee7e123291a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:05.410272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4805f-96e0-40f0-aaf2-7dc98372f869 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.410835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4805f-96e0-40f0-aaf2-7dc98372f869 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.411477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4805f-96e0-40f0-aaf2-7dc98372f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.453356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9fb4805f-96e0-40f0-aaf2-7dc98372f869 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:05.454863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9fb4805f-96e0-40f0-aaf2-7dc98372f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:05.490374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.491140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.491681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.492038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.492870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.495245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.519074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3405/6815] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects => generated 4725 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:05.523325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.526377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:05.541689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7ed1-1e4d-40ef-adfe-5341146e638a tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.548506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112c7f3-187e-45df-8d91-b64a00cf4b81 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.549474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c7f3-187e-45df-8d91-b64a00cf4b81 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.551234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c7f3-187e-45df-8d91-b64a00cf4b81 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.551234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c7f3-187e-45df-8d91-b64a00cf4b81 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects/ae30e3cbe1d14686babdfacfbc234493` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.552917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112c7f3-187e-45df-8d91-b64a00cf4b81 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:get_project(project_id=ae30e3cbe1d14686babdfacfbc234493)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.556452 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3411/6816] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:05.557642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112c7f3-187e-45df-8d91-b64a00cf4b81 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.560629 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3406/6817] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects/ae30e3cbe1d14686babdfacfbc234493 => generated 387 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:05.563840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4805f-96e0-40f0-aaf2-7dc98372f869 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.566482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a443ad-54c0-43c1-8752-db1b47b7a43f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.566658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a443ad-54c0-43c1-8752-db1b47b7a43f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.566933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a443ad-54c0-43c1-8752-db1b47b7a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.581640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4805f-96e0-40f0-aaf2-7dc98372f869 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.586629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.587350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.587822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.588104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects/f7d5cfc68f314281987f76c02cc940fc` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.589498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7d5cfc68f314281987f76c02cc940fc)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.591786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.597758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d6a443ad-54c0-43c1-8752-db1b47b7a43f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:05.599168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d6a443ad-54c0-43c1-8752-db1b47b7a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:05.609744 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3412/6818] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects/f7d5cfc68f314281987f76c02cc940fc => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:05.610740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.611765 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3407/6819] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:05.612701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a443ad-54c0-43c1-8752-db1b47b7a43f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.623332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a443ad-54c0-43c1-8752-db1b47b7a43f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.623805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d211d05-201d-47c9-b906-6ff4c6a391b6 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.629189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.629816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.630100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.630218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.630368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.631015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.631138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.631456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.631818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.632582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:05.632996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.633128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.635615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.649275 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3408/6820] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:05.654130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.664566 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3413/6821] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects => generated 4725 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:05.666081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1b287-b80c-4fd4-94c1-b07ee3729858 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.671029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.684162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575352ff-e3df-4e7a-87b0-6bf10add1dc2 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.684475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.686469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.688464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.690256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.690432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.691307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.691436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.691634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.691914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.692676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:05.693244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.696083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.697335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.748460 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3414/6822] 10.222.0.46 () {58 vars in 1166 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects?domain_id=default => generated 4394 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:05.754902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.760462 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3409/6823] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:05 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:05.763097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.795047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1400145-f92a-4f65-8302-65f9b182df9f tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.833813 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:05.861095 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:05.903868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66140163-633f-4593-9894-aa6e34fa6eab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.922216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.923144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.924266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.924817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.927357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.933700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.934398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.934686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.934966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.935518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.935681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.939831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:05.968731 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3410/6824] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:05 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:05.973127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.979495 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3415/6825] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects => generated 5082 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:05.982878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:05.989455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32938968-d954-4e4f-8bce-7b2b5eaf6058 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:05.995252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:05.995680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:05.996406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:05.996406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:05.997831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:05.999045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.005439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022d9ca-04cd-4335-9c16-ea1223bdb967 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.012270 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3411/6826] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:06.015324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.016072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.017516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.017971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.018350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.019157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:06.019770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.022751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.044978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cf95-85a8-4ac8-b655-31d903bcfba5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.050399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.051182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.051559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.051927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.052683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.054614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.059708 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3416/6827] 10.222.0.46 () {58 vars in 1166 bytes} [Sun Aug 21 01:38:05 2022] GET /identity/v3/projects?domain_id=default => generated 4751 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:06.065922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.073219 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3412/6828] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:06.078256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.084464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d95cf-fbe4-4ed7-9b50-41dfa9346b54 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.089651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf96ac-9a00-4107-8c39-079d6318505d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.089865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.090496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.090773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.091044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.091700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.093641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.096014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.102736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.102878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.103264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] PATH_INFO: `/v3/projects/b66b806e65424e56b49412c91d270e30/users/1972cecb38fe443bbf248e71e6f01c12/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.122447 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3417/6829] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:38:06 2022] GET /identity/v3/projects => generated 5082 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:06.123637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.130222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.133101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66b806e65424e56b49412c91d270e30, user_id=1972cecb38fe443bbf248e71e6f01c12, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.137068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.148914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad10f25-4d2b-459e-8a8e-ad1f153751d8 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.153789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.154595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.154740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.154967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] PATH_INFO: `/v3/users/7b11b9adba9849b9ab5fd32b35c8ecf0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.156121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b11b9adba9849b9ab5fd32b35c8ecf0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.158182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.160284 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3413/6830] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:06 2022] PUT /identity/v3/projects/b66b806e65424e56b49412c91d270e30/users/1972cecb38fe443bbf248e71e6f01c12/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:06.161095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.249088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b11b9adba9849b9ab5fd32b35c8ecf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.263300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b11b9adba9849b9ab5fd32b35c8ecf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.264036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b11b9adba9849b9ab5fd32b35c8ecf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.275502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b11b9adba9849b9ab5fd32b35c8ecf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.276258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2736a127-e6e2-4f7d-bfe4-7e443790c69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b11b9adba9849b9ab5fd32b35c8ecf0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.280661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53289f36-d0e1-43e6-8ca1-ce6cd0202eef admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.290954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2075-6e0b-4b5e-a145-41c065fc65af tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.291825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2075-6e0b-4b5e-a145-41c065fc65af tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.292108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2075-6e0b-4b5e-a145-41c065fc65af tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.292387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2075-6e0b-4b5e-a145-41c065fc65af tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.293175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2075-6e0b-4b5e-a145-41c065fc65af tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-990886037) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:06.293410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2075-6e0b-4b5e-a145-41c065fc65af tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.295305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2075-6e0b-4b5e-a145-41c065fc65af tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.309969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3418/6831] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:06 2022] DELETE /identity/v3/users/7b11b9adba9849b9ab5fd32b35c8ecf0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:06.311790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.312225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.312883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.319680 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3414/6832] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:06 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-990886037 => generated 534 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:06.321177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.321464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.321739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.345599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:06.347097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.353809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] MFA Rules not processed for user `1972cecb38fe443bbf248e71e6f01c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:06.355484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.442246 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:06.464483 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3415/6833] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:06.465652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.467092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.468027 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3419/6834] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:06.476516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.478299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.485387 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:06.564728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad4a81-f473-494d-a855-ad1a6ee16714 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.571594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45260c-507a-4ac8-9768-ac2ee40d5925 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.574926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d95c0b949a445caa01c3e67994334f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b781bd015a442f4bf63469a8c98deca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.576329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.576692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.576844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.577159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] PATH_INFO: `/v3/projects/f7d5cfc68f314281987f76c02cc940fc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.577617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.577961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.578295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.579468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7d5cfc68f314281987f76c02cc940fc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.582836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.591262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.594391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:06.618335 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3420/6835] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:38:06.620150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.628076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.659192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d5cfc68f314281987f76c02cc940fc', 'request_id': 'req-25d0bf38-9c97-460c-b4ad-405a6f642618'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.669624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d5cfc68f314281987f76c02cc940fc', 'request_id': 'req-25d0bf38-9c97-460c-b4ad-405a6f642618'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.689463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d5cfc68f314281987f76c02cc940fc', 'request_id': 'req-25d0bf38-9c97-460c-b4ad-405a6f642618'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.721155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] The token cache is being invalidate because project f7d5cfc68f314281987f76c02cc940fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:06.721471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.722397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:06.729538 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3416/6836] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:06 2022] DELETE /identity/v3/projects/f7d5cfc68f314281987f76c02cc940fc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:06.733532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:06.736093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.764369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec144f1-6c6d-4b47-b047-ff19211a687b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.895664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.896442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.896846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.897241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.899309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:06.911248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0bf38-9c97-460c-b4ad-405a6f642618 tempest-ListProjectsStaticTestJSON-1685524321 tempest-ListProjectsStaticTestJSON-1685524321-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:06.918208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:06.919621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:06.920024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:06.920393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] PATH_INFO: `/v3/users/a846d618ecc2473bab65718f3b707cff` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:06.922009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a846d618ecc2473bab65718f3b707cff)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:06.924325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.000117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.004461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.019469 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:07.022820 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3421/6837] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:07.023434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a846d618ecc2473bab65718f3b707cff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.034389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.037836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:07.051359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a846d618ecc2473bab65718f3b707cff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.054410 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:07.068666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824bfbd-3e29-453f-9769-6b8a36425593 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.076707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.077998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.078521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.079033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] PATH_INFO: `/v3/projects/5fccfb6e12034a7fb9cab13a9e9530d7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.082220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a846d618ecc2473bab65718f3b707cff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.082568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fccfb6e12034a7fb9cab13a9e9530d7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.083022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a846d618ecc2473bab65718f3b707cff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.086864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.093823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4dec6c4a-1963-4e1a-8ada-892b9ec0bd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a846d618ecc2473bab65718f3b707cff'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.108000 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3417/6838] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:06 2022] DELETE /identity/v3/users/a846d618ecc2473bab65718f3b707cff => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:07.109961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.110390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.111069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.146867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:07.148200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:07.168878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fccfb6e12034a7fb9cab13a9e9530d7', 'request_id': 'req-6365ef56-f573-458c-8963-2ad616d524ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.183650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fccfb6e12034a7fb9cab13a9e9530d7', 'request_id': 'req-6365ef56-f573-458c-8963-2ad616d524ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.193158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fccfb6e12034a7fb9cab13a9e9530d7', 'request_id': 'req-6365ef56-f573-458c-8963-2ad616d524ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.213865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] The token cache is being invalidate because project 5fccfb6e12034a7fb9cab13a9e9530d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:07.214297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.215459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6365ef56-f573-458c-8963-2ad616d524ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:07.218637 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3422/6839] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:07 2022] DELETE /identity/v3/projects/5fccfb6e12034a7fb9cab13a9e9530d7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:07.224034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63df2-71dc-4249-bedd-63dc9d0985d3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.225154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63df2-71dc-4249-bedd-63dc9d0985d3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.225620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63df2-71dc-4249-bedd-63dc9d0985d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.245064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3418/6840] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:07.256707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.258233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:07.269922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-71e63df2-71dc-4249-bedd-63dc9d0985d3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:07.271281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-71e63df2-71dc-4249-bedd-63dc9d0985d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:07.281913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3423/6841] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:07.292419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d6ba-d816-4a59-a633-9c6ce370dec0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.292697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d6ba-d816-4a59-a633-9c6ce370dec0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.292996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d6ba-d816-4a59-a633-9c6ce370dec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.322752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c375d6ba-d816-4a59-a633-9c6ce370dec0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:07.325212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c375d6ba-d816-4a59-a633-9c6ce370dec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:07.349391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874df96-7f8d-47ee-973e-d1ceb620f9ce None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.352532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3424/6842] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:07.353767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.354465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.355634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.355988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.357544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d6ba-d816-4a59-a633-9c6ce370dec0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.369518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d6ba-d816-4a59-a633-9c6ce370dec0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.370507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.372582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.378207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.378903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.379306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.379498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.380113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:07.380451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.382138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.392725 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3419/6843] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:38:07.396578 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3425/6844] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:07.401140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.413204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749ab4-5ab1-4dde-b0ce-254a1c4506f1 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.418689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.419316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.419595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.419869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.420518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.422518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.485653 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3420/6845] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:07 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:07.487400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.501766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67cadc-ef63-4561-8ae7-35d699c7c03a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.609020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.609837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.610261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.610675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.611580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.613841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.653517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3426/6846] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:07 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:07.657764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.672597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a5974-bcff-4de7-b28d-ec58b5cd3a5f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.679860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.680897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.681411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.681860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.682739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.686205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.701928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3421/6847] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:07.702983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.715338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664e22d-b265-422e-8c06-4fb8b8e9c9c9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.721198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.722025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.722628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.723090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.723750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.725416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.741073 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3427/6848] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:07.742294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.753494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782b12-170f-4a49-a440-ff6ba6cd4771 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.771076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c472c-7a28-4bdd-a775-4adf3cc1f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.772072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c472c-7a28-4bdd-a775-4adf3cc1f2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.773435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c472c-7a28-4bdd-a775-4adf3cc1f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.773875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c472c-7a28-4bdd-a775-4adf3cc1f2fe admin admin] PATH_INFO: `/v3/projects/550503c288c1403d86958b009e04616c/users/42796dc1e8b3465bb461b1c012f4d34b/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.806494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c472c-7a28-4bdd-a775-4adf3cc1f2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=550503c288c1403d86958b009e04616c, user_id=42796dc1e8b3465bb461b1c012f4d34b, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.807826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:07.809197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c472c-7a28-4bdd-a775-4adf3cc1f2fe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:07.810266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:07.834435 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3422/6849] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:07 2022] PUT /identity/v3/projects/550503c288c1403d86958b009e04616c/users/42796dc1e8b3465bb461b1c012f4d34b/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:07.838201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ea6b-cd74-45ed-bb38-d3f370b631e3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:07.851242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5894b0-75d3-4d92-99b3-84a05ed4af5e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.854292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5894b0-75d3-4d92-99b3-84a05ed4af5e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.854764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5894b0-75d3-4d92-99b3-84a05ed4af5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.871962 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:07.887194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bf5894b0-75d3-4d92-99b3-84a05ed4af5e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:07.890400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bf5894b0-75d3-4d92-99b3-84a05ed4af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:07.891715 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:07.952753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:07.953549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:07.953943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:07.954459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] PATH_INFO: `/v3/projects/ae30e3cbe1d14686babdfacfbc234493` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:07.955853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae30e3cbe1d14686babdfacfbc234493)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:07.958443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:08.048864 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3423/6850] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:08.056150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae30e3cbe1d14686babdfacfbc234493', 'request_id': 'req-efc6f244-3a83-4583-91cf-90962c5060e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.059796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5894b0-75d3-4d92-99b3-84a05ed4af5e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:08.075245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae30e3cbe1d14686babdfacfbc234493', 'request_id': 'req-efc6f244-3a83-4583-91cf-90962c5060e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.084371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae30e3cbe1d14686babdfacfbc234493', 'request_id': 'req-efc6f244-3a83-4583-91cf-90962c5060e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.105198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] The token cache is being invalidate because project ae30e3cbe1d14686babdfacfbc234493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:08.105488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.110262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.114114 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3428/6851] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:07 2022] DELETE /identity/v3/projects/ae30e3cbe1d14686babdfacfbc234493 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:08.119742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:08.123592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:08.160994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5894b0-75d3-4d92-99b3-84a05ed4af5e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:08.242816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f244-3a83-4583-91cf-90962c5060e6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:08.251652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:08.253299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:08.254409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:08.255422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] PATH_INFO: `/v3/users/0d95c0b949a445caa01c3e67994334f6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:08.258536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d95c0b949a445caa01c3e67994334f6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:08.261697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:08.262365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:08.262653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:08.263550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:08.265049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:08.268528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:08.286027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:08.288544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:08.301597 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3424/6852] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:08.348825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d95c0b949a445caa01c3e67994334f6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.365280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d95c0b949a445caa01c3e67994334f6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.365949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d95c0b949a445caa01c3e67994334f6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.380485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d95c0b949a445caa01c3e67994334f6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.381548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b0fd92a5-70a4-4dfc-abef-3f6c00518bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d95c0b949a445caa01c3e67994334f6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:08.392583 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:08.417208 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3429/6853] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:08 2022] DELETE /identity/v3/users/0d95c0b949a445caa01c3e67994334f6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:09.079712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:09.091516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257cf67-1cfd-4fc1-8dd4-eeaad945f18f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:09.209833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:09.210966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:09.211393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:09.211820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] PATH_INFO: `/v3/projects/3b781bd015a442f4bf63469a8c98deca` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:09.214238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b781bd015a442f4bf63469a8c98deca)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:09.216281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:09.244936 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:09.320523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b781bd015a442f4bf63469a8c98deca', 'request_id': 'req-6da077e6-13ea-46ab-bd65-6821aaa4e92c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:09.331951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b781bd015a442f4bf63469a8c98deca', 'request_id': 'req-6da077e6-13ea-46ab-bd65-6821aaa4e92c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:09.339695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b781bd015a442f4bf63469a8c98deca', 'request_id': 'req-6da077e6-13ea-46ab-bd65-6821aaa4e92c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:09.361193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] The token cache is being invalidate because project 3b781bd015a442f4bf63469a8c98deca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:09.361488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:09.362332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6da077e6-13ea-46ab-bd65-6821aaa4e92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:09.363913 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3425/6854] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:09 2022] DELETE /identity/v3/projects/3b781bd015a442f4bf63469a8c98deca => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:09.370015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8281e4-ecb6-42e5-82cb-8225c083dc01 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:09.370542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8281e4-ecb6-42e5-82cb-8225c083dc01 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:09.370542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8281e4-ecb6-42e5-82cb-8225c083dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:09.401433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ce8281e4-ecb6-42e5-82cb-8225c083dc01 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:09.403280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ce8281e4-ecb6-42e5-82cb-8225c083dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:09.501609 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3430/6855] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:09.510269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878981b-cb52-47f3-940a-f73f5ed4001e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:09.510656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878981b-cb52-47f3-940a-f73f5ed4001e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:09.510998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878981b-cb52-47f3-940a-f73f5ed4001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:09.590226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e878981b-cb52-47f3-940a-f73f5ed4001e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:09.591825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e878981b-cb52-47f3-940a-f73f5ed4001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:09.615373 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3426/6856] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:09.615594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8281e4-ecb6-42e5-82cb-8225c083dc01 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:09.640828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8281e4-ecb6-42e5-82cb-8225c083dc01 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:09.659890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6db948-8a91-429c-ab9b-5a56e6494aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:09.662755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6db948-8a91-429c-ab9b-5a56e6494aad admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:09.665702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6db948-8a91-429c-ab9b-5a56e6494aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:09.666192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6db948-8a91-429c-ab9b-5a56e6494aad admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:09.668934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6db948-8a91-429c-ab9b-5a56e6494aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:09.675151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6db948-8a91-429c-ab9b-5a56e6494aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:09.678698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6db948-8a91-429c-ab9b-5a56e6494aad admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:09.712561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3431/6857] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:09.717894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878981b-cb52-47f3-940a-f73f5ed4001e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:09.734079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878981b-cb52-47f3-940a-f73f5ed4001e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:09.746041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:09.746698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:09.747137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:09.747421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:09.748076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:09.753089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:09.814442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a413-8da1-435c-9687-68be0bf56979 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:09.814900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a413-8da1-435c-9687-68be0bf56979 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:09.815302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a413-8da1-435c-9687-68be0bf56979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:09.827097 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3427/6858] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:09 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:09.831488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:09.863321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2387a413-8da1-435c-9687-68be0bf56979 None None] MFA Rules not processed for user `1972cecb38fe443bbf248e71e6f01c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:09.864584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2387a413-8da1-435c-9687-68be0bf56979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:09.962000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0ad6-10d0-45ed-921a-65cabc5cb40a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:09.968630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:09.969583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:09.969994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:09.970450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:09.971208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:09.974430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:09.996546 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3432/6859] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:10.013870 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3428/6860] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:09 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:10.017000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a413-8da1-435c-9687-68be0bf56979 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:10.030318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a413-8da1-435c-9687-68be0bf56979 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:10.035695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:10.036460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:10.037245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:10.037766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:10.038571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:10.042158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:10.057688 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3433/6861] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:10.061528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:10.082570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85418908-5ddd-4325-b0c2-da7642c84018 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:10.087963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eeb0a-d22b-4e8b-bab7-4680ec4876c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:10.089865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eeb0a-d22b-4e8b-bab7-4680ec4876c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:10.091064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eeb0a-d22b-4e8b-bab7-4680ec4876c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:10.091443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eeb0a-d22b-4e8b-bab7-4680ec4876c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:10.092253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765eeb0a-d22b-4e8b-bab7-4680ec4876c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:10.094620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765eeb0a-d22b-4e8b-bab7-4680ec4876c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:10.125298 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3429/6862] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:10.129705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:10.149833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c70f8-79c3-4fe8-9100-aee618522311 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:10.156190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:10.157535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:10.157991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:10.158389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] PATH_INFO: `/v3/projects/8ffeeb2d4abc4f428e4fc9857a4c9ee7/users/4aa89c8996c941869383ed31bcef492f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:10.411683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffeeb2d4abc4f428e4fc9857a4c9ee7, user_id=4aa89c8996c941869383ed31bcef492f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:10.420040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:10.452212 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3434/6863] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:10 2022] PUT /identity/v3/projects/8ffeeb2d4abc4f428e4fc9857a4c9ee7/users/4aa89c8996c941869383ed31bcef492f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:10.467824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d179-06e4-4884-8e59-40bcb5cc4bac None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:10.467824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d179-06e4-4884-8e59-40bcb5cc4bac None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:10.467824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d179-06e4-4884-8e59-40bcb5cc4bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:10.533972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ed21d179-06e4-4884-8e59-40bcb5cc4bac None None] MFA Rules not processed for user `4aa89c8996c941869383ed31bcef492f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:10.534849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ed21d179-06e4-4884-8e59-40bcb5cc4bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:10.625515 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:10.695431 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3430/6864] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:10.700862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:10.827512 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:10.858801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaaba0-0bbd-4b96-bc17-db14a2f8d66d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:10.873028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:10.873786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:10.874172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:10.879785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:10.879785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:10.879785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:10.943818 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3435/6865] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:10 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:10.945006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d179-06e4-4884-8e59-40bcb5cc4bac None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:10.963837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d179-06e4-4884-8e59-40bcb5cc4bac None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:11.032967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:11.034989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:11.080878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:11.081521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.081805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.082078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.082729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:11.087781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:11.143857 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3431/6866] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:10 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:11.147958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:11.159995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923755d-0388-459f-b440-b120c5072070 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:11.165486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:11.166433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.166808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.167178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.167972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:11.169716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:11.171328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa711e-ece8-4aca-989d-4d25566e8be5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:11.181321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:11.182114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.182395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.182661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.186510 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3432/6867] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:11.186645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:11.187715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:11.200066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92d6e1-9019-45b9-a89c-3a90c3dc4826 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:11.202634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:11.204988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:11.205501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:11.207132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.207516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.207889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] PATH_INFO: `/v3/projects/ed748c685fd54be59d40b5ea05d169d1/users/c784695045e94840abb67b57d746a630/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.228220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed748c685fd54be59d40b5ea05d169d1, user_id=c784695045e94840abb67b57d746a630, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:11.234483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:11.237416 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3436/6868] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:38:11.261751 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3433/6869] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:11 2022] PUT /identity/v3/projects/ed748c685fd54be59d40b5ea05d169d1/users/c784695045e94840abb67b57d746a630/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:11.264041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:11.278502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd161439-0447-45f6-b6a5-ffad5eb8c2ed service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:11.374994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf041b9c-83bb-4a2e-90b4-483a6787f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:11.375655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041b9c-83bb-4a2e-90b4-483a6787f115 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.375937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041b9c-83bb-4a2e-90b4-483a6787f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.376210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041b9c-83bb-4a2e-90b4-483a6787f115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.377514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf041b9c-83bb-4a2e-90b4-483a6787f115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:11.380917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf041b9c-83bb-4a2e-90b4-483a6787f115 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:11.414212 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3437/6870] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:11.418296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:11.439900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2363d1-c624-4561-8d1e-31fcfdc63c5e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:11.457824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:11.458237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.458657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.463106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] PATH_INFO: `/v3/projects/ed748c685fd54be59d40b5ea05d169d1/users/c784695045e94840abb67b57d746a630/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.470114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed748c685fd54be59d40b5ea05d169d1, user_id=c784695045e94840abb67b57d746a630, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:11.477044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:11.504284 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3434/6871] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:11 2022] PUT /identity/v3/projects/ed748c685fd54be59d40b5ea05d169d1/users/c784695045e94840abb67b57d746a630/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:11.515981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6330ee-ad1b-4516-8905-aa913f89a061 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.516729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6330ee-ad1b-4516-8905-aa913f89a061 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.517297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6330ee-ad1b-4516-8905-aa913f89a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.581934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ce6330ee-ad1b-4516-8905-aa913f89a061 None None] MFA Rules not processed for user `c784695045e94840abb67b57d746a630`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:11.586339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ce6330ee-ad1b-4516-8905-aa913f89a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:11.717869 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:11.779396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3438/6872] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:11.779700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:11.795327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099efa41-555e-452c-89c4-46643f3ba20b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:11.809138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:11.809801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:11.810079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:11.810361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:11.811036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:11.819689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:11.845183 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3435/6873] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:38:11 2022] POST /identity/v3/domains => generated 275 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:11.850087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6330ee-ad1b-4516-8905-aa913f89a061 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:11.863122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6330ee-ad1b-4516-8905-aa913f89a061 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.017268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.018076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.018363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.018638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.019285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.021311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.111076 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3439/6874] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:11 2022] POST /identity/v3/users => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:12.113469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.150405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71c3c-6cd4-40e4-ac05-ee85ba0ecaa4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.172195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.173226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.173384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.173760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.174934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.177578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.219403 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3436/6875] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:12 2022] POST /identity/v3/users => generated 321 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:12.224858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.237532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5183c-3ffb-4e57-9222-8253ffa975e4 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.252711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.253436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.253729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.254008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users/2813f1f277204dc08acabf51c26d29d4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.300275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:get_user(user_id=2813f1f277204dc08acabf51c26d29d4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.311002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.316908 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3440/6876] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:38:12 2022] GET /identity/v3/users/2813f1f277204dc08acabf51c26d29d4 => generated 346 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:12.318450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.338401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894755c2-0e6c-41b3-9ada-a0e09cd0ced9 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.356055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.357028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.357389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.357751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.358556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Adding query filter params (domain_id=436aa79a4c034275a780e8ce5b711622) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:12.359662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.370335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.386259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3437/6877] 10.222.0.46 () {58 vars in 1207 bytes} [Sun Aug 21 01:38:12 2022] GET /identity/v3/users?domain_id=436aa79a4c034275a780e8ce5b711622 => generated 483 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:12.391459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.403664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2cb5d-c213-4593-a784-de55514c7c7e tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.429814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.431412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.432060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.432492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.433402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.435532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.481074 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3441/6878] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:12 2022] GET /identity/v3/users => generated 7444 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:12.486513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.517086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169372fa-59af-4454-b127-fe8adeb20102 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.525046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.526039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.526697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.527201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.528379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Adding query filter params (name=tempest-test_user-926685193) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:12.529553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.531781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.577358 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3438/6879] 10.222.0.46 () {58 vars in 1187 bytes} [Sun Aug 21 01:38:12 2022] GET /identity/v3/users?name=tempest-test_user-926685193 => generated 473 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:12.579369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.594637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f469f-e90c-49a6-8cf9-ccca5c771f47 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.601705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.603025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.603536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.604017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.605701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:12.606275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.609341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.669346 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3442/6880] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:38:12 2022] GET /identity/v3/users?enabled=False => generated 429 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:12.671386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.689621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf163361-cf81-467d-af98-dcffa0df77e7 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:12.697445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:12.698515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:12.699978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:12.699978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users/73f9cf40ae17489c993a011a52a5bd72` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:12.720644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:delete_user(user_id=73f9cf40ae17489c993a011a52a5bd72)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:12.723155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:12.726965 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:12.782507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f9cf40ae17489c993a011a52a5bd72'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:12.795929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f9cf40ae17489c993a011a52a5bd72'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:12.817168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f9cf40ae17489c993a011a52a5bd72'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:12.819715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f9cf40ae17489c993a011a52a5bd72'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:12.828375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f9cf40ae17489c993a011a52a5bd72'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:12.836272 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3439/6881] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:12 2022] DELETE /identity/v3/users/73f9cf40ae17489c993a011a52a5bd72 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:12.840115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:12.841942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:12.870952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3b4dc-c6fe-4b8a-a87e-32d7045ff377 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:13.032084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:13.032939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:13.045431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:13.045870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/users/2813f1f277204dc08acabf51c26d29d4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:13.050088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2813f1f277204dc08acabf51c26d29d4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:13.054413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:13.120679 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:13.183785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2813f1f277204dc08acabf51c26d29d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.204346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2813f1f277204dc08acabf51c26d29d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.205545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2813f1f277204dc08acabf51c26d29d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.232613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2813f1f277204dc08acabf51c26d29d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.234477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2813f1f277204dc08acabf51c26d29d4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.296838 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3443/6882] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:12 2022] DELETE /identity/v3/users/2813f1f277204dc08acabf51c26d29d4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:13.301264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:13.329160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046aea8-ee91-47eb-916a-1e04ec23aa77 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:13.417409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:13.418844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:13.418844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:13.418844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/domains/436aa79a4c034275a780e8ce5b711622` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:13.422395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=436aa79a4c034275a780e8ce5b711622)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:13.422938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:13.457963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '436aa79a4c034275a780e8ce5b711622'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.459855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '436aa79a4c034275a780e8ce5b711622'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.497022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '436aa79a4c034275a780e8ce5b711622'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.497416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '436aa79a4c034275a780e8ce5b711622'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.500318 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3440/6883] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:13 2022] PATCH /identity/v3/domains/436aa79a4c034275a780e8ce5b711622 => generated 276 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:13.506196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:13.508497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:13.534628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac24f-7eac-4251-b64b-b3f508213ca5 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:13.694188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c784695045e94840abb67b57d746a630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed748c685fd54be59d40b5ea05d169d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:13.695127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:13.695596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:13.696054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] PATH_INFO: `/v3/domains/436aa79a4c034275a780e8ce5b711622` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:13.709920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=436aa79a4c034275a780e8ce5b711622)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:13.712631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:13.745705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '436aa79a4c034275a780e8ce5b711622'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.750663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '436aa79a4c034275a780e8ce5b711622'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.838413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436aa79a4c034275a780e8ce5b711622', 'request_id': 'req-ca85d526-18ee-4612-bc5c-3b529f4522e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.850451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436aa79a4c034275a780e8ce5b711622', 'request_id': 'req-ca85d526-18ee-4612-bc5c-3b529f4522e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.858916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436aa79a4c034275a780e8ce5b711622', 'request_id': 'req-ca85d526-18ee-4612-bc5c-3b529f4522e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.875719 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:13.887495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] The token cache is being invalidate because project 436aa79a4c034275a780e8ce5b711622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:13.889048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.890893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.905477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '436aa79a4c034275a780e8ce5b711622', 'request_id': 'req-ca85d526-18ee-4612-bc5c-3b529f4522e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.906444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '436aa79a4c034275a780e8ce5b711622', 'request_id': 'req-ca85d526-18ee-4612-bc5c-3b529f4522e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.908116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ca85d526-18ee-4612-bc5c-3b529f4522e6 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '436aa79a4c034275a780e8ce5b711622', 'request_id': 'req-ca85d526-18ee-4612-bc5c-3b529f4522e6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:13.935795 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3444/6884] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:13 2022] DELETE /identity/v3/domains/436aa79a4c034275a780e8ce5b711622 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:13.937475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:13.945306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:14.036263 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:14.077838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f03de-fac0-44f9-bbb7-a6565dfdf434 tempest-UsersV3TestJSON-1633559404 tempest-UsersV3TestJSON-1633559404-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:14.276623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:14.277695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:14.278305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:14.278783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] PATH_INFO: `/v3/users/4aa89c8996c941869383ed31bcef492f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:14.280490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa89c8996c941869383ed31bcef492f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:14.282781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:14.372290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa89c8996c941869383ed31bcef492f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:14.387875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa89c8996c941869383ed31bcef492f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:14.414886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa89c8996c941869383ed31bcef492f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:14.416748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa89c8996c941869383ed31bcef492f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:14.428186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa89c8996c941869383ed31bcef492f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:14.437535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3441/6885] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:13 2022] DELETE /identity/v3/users/4aa89c8996c941869383ed31bcef492f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:14.444153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7934179-679c-47a6-96e4-1fae4e66c968 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:14.444153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7934179-679c-47a6-96e4-1fae4e66c968 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:14.444153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7934179-679c-47a6-96e4-1fae4e66c968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:14.477091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b7934179-679c-47a6-96e4-1fae4e66c968 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:14.478378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7934179-679c-47a6-96e4-1fae4e66c968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:14.583350 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3445/6886] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:14.599006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:14.601695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:14.695148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86fd37-0191-4f98-948f-191cdad718ec admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:14.701734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:14.703246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:14.703780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:14.704279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:14.718586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:14.722149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:14.739475 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3442/6887] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:15.372492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58841ee1-5ea3-447e-b575-0727586fcad0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:15.372808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58841ee1-5ea3-447e-b575-0727586fcad0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:15.373115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58841ee1-5ea3-447e-b575-0727586fcad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:15.406959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-58841ee1-5ea3-447e-b575-0727586fcad0 None None] MFA Rules not processed for user `42796dc1e8b3465bb461b1c012f4d34b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:15.408043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58841ee1-5ea3-447e-b575-0727586fcad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:15.504082 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3446/6888] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:15.690285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:15.691970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:15.725560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3111-e76a-48cd-bc28-251f10ba7f25 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:15.732830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:15.737290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:15.737882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:15.739486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] PATH_INFO: `/v3/projects/8ffeeb2d4abc4f428e4fc9857a4c9ee7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:15.741795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffeeb2d4abc4f428e4fc9857a4c9ee7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:15.744143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:15.761595 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:15.829460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffeeb2d4abc4f428e4fc9857a4c9ee7', 'request_id': 'req-2dc5edf1-2015-47b4-b093-1182f6a0dab8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:15.843312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffeeb2d4abc4f428e4fc9857a4c9ee7', 'request_id': 'req-2dc5edf1-2015-47b4-b093-1182f6a0dab8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:15.858178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffeeb2d4abc4f428e4fc9857a4c9ee7', 'request_id': 'req-2dc5edf1-2015-47b4-b093-1182f6a0dab8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:15.894993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] The token cache is being invalidate because project 8ffeeb2d4abc4f428e4fc9857a4c9ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:15.895695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:15.898541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:15.900760 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3443/6889] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:15 2022] DELETE /identity/v3/projects/8ffeeb2d4abc4f428e4fc9857a4c9ee7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:15.904971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58841ee1-5ea3-447e-b575-0727586fcad0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:15.927665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58841ee1-5ea3-447e-b575-0727586fcad0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:16.014966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:16.016054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:16.016487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:16.017933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] PATH_INFO: `/v3/users/c784695045e94840abb67b57d746a630` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:16.020635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c784695045e94840abb67b57d746a630)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:16.023149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:16.043569 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:16.131911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c784695045e94840abb67b57d746a630'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:16.152122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c784695045e94840abb67b57d746a630'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:16.152834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c784695045e94840abb67b57d746a630'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:16.177457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c784695045e94840abb67b57d746a630'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:16.178787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4413869e-6c45-47ab-8c48-f84990197f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c784695045e94840abb67b57d746a630'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:16.223012 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3447/6890] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:15 2022] DELETE /identity/v3/users/c784695045e94840abb67b57d746a630 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:17.148096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:17.149605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:17.180941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5edf1-2015-47b4-b093-1182f6a0dab8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:17.337513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:17.339555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:17.340374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:17.341141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] PATH_INFO: `/v3/projects/ed748c685fd54be59d40b5ea05d169d1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:17.353236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed748c685fd54be59d40b5ea05d169d1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:17.356453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:17.424074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed748c685fd54be59d40b5ea05d169d1', 'request_id': 'req-f19f1758-4107-42f5-9191-46551afc7648'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:17.432058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed748c685fd54be59d40b5ea05d169d1', 'request_id': 'req-f19f1758-4107-42f5-9191-46551afc7648'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:17.444567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed748c685fd54be59d40b5ea05d169d1', 'request_id': 'req-f19f1758-4107-42f5-9191-46551afc7648'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:17.465268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] The token cache is being invalidate because project ed748c685fd54be59d40b5ea05d169d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:17.472901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:17.477951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f19f1758-4107-42f5-9191-46551afc7648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:17.480127 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3444/6891] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:17 2022] DELETE /identity/v3/projects/ed748c685fd54be59d40b5ea05d169d1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:17.484992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03a31-b95f-48de-9f2d-cfff03c94ab2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:17.485566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03a31-b95f-48de-9f2d-cfff03c94ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:17.485853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03a31-b95f-48de-9f2d-cfff03c94ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:17.510030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-72d03a31-b95f-48de-9f2d-cfff03c94ab2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:17.511342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-72d03a31-b95f-48de-9f2d-cfff03c94ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:17.661088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3448/6892] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:17.669194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f898c-8ebf-49df-bc0c-3b6987f32524 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:17.669622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f898c-8ebf-49df-bc0c-3b6987f32524 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:17.669994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f898c-8ebf-49df-bc0c-3b6987f32524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:17.718303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1a5f898c-8ebf-49df-bc0c-3b6987f32524 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:17.719521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1a5f898c-8ebf-49df-bc0c-3b6987f32524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:17.736383 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3445/6893] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:17.742352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d03a31-b95f-48de-9f2d-cfff03c94ab2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:17.755956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d03a31-b95f-48de-9f2d-cfff03c94ab2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:17.761129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:17.761875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:17.762166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:17.766445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:17.767210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:17.767518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:17.769302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:17.806584 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3449/6894] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:17.808312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f898c-8ebf-49df-bc0c-3b6987f32524 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:17.820855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f898c-8ebf-49df-bc0c-3b6987f32524 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:17.829993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:17.830431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:17.830714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:17.830989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:17.831656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:17.834324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:17.877225 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:17.889239 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3446/6895] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:17 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:17.893276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:17.910090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f039d62-ba37-4892-b73f-affefe57d698 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:17.991292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:17.992863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:17.993306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:17.993905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:17.994701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:17.997073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.036976 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3450/6896] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:17 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:18.041825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.059183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef45b0-d03e-4d80-838f-ca584c7995bc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:18.078517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:18.080612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.080930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.081365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.082054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:18.087698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.103856 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3447/6897] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:18.108556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.127021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff04b-0c6b-49bb-88d9-4e46d36b8b89 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:18.139438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27525df0-30a3-4d02-ad85-e48c19adda4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:18.141752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525df0-30a3-4d02-ad85-e48c19adda4b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.142059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525df0-30a3-4d02-ad85-e48c19adda4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.142414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525df0-30a3-4d02-ad85-e48c19adda4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.143297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27525df0-30a3-4d02-ad85-e48c19adda4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:18.145293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27525df0-30a3-4d02-ad85-e48c19adda4b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.149124 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:18.172102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.188320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3451/6898] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:18.197637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c331-45d3-42e1-8d43-d923055bfe96 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:18.253213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:18.254311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.254943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.255488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] PATH_INFO: `/v3/projects/a7632ec3cbf24f46af143bf29753092b/users/f8ca521853ad477fa808b73538412547/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.297384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7632ec3cbf24f46af143bf29753092b, user_id=f8ca521853ad477fa808b73538412547, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:18.300818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.345136 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3448/6899] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:18 2022] PUT /identity/v3/projects/a7632ec3cbf24f46af143bf29753092b/users/f8ca521853ad477fa808b73538412547/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:18.347022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852fa34-2f92-4add-8d0d-67fab0816fe4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.347299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852fa34-2f92-4add-8d0d-67fab0816fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.347565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852fa34-2f92-4add-8d0d-67fab0816fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.406879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2852fa34-2f92-4add-8d0d-67fab0816fe4 None None] MFA Rules not processed for user `f8ca521853ad477fa808b73538412547`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:18.408584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2852fa34-2f92-4add-8d0d-67fab0816fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:18.545901 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3452/6900] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:18.546724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.661111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da3b15-31a1-4ce6-a392-ee322c1cbad0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:18.666544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:18.668062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.668062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.668062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.668335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:18.670303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.718481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852fa34-2f92-4add-8d0d-67fab0816fe4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.718746 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3449/6901] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:18 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:18.739598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852fa34-2f92-4add-8d0d-67fab0816fe4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:18.828612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:18.829460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.830589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.831702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.831702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:18.835286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.866942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3453/6902] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:18 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:18.871581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.887877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ffd3d-85ae-4609-8947-99eede91889f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:18.893516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:18.894245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.894581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.895058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.895794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:18.897677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.912102 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3450/6903] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:18.919213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.932669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d6384-7ae3-4e35-b69c-b8cfffb3330e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:18.937428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:18.938306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:18.938706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:18.939969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] PATH_INFO: `/v3/projects/3ee22a29f6174b14ae60cf5a9735756b/users/7dd684c2cd264b5ea6bfa6a70b93ff8d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:18.957915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee22a29f6174b14ae60cf5a9735756b, user_id=7dd684c2cd264b5ea6bfa6a70b93ff8d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:18.960735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:18.981760 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3454/6904] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:18 2022] PUT /identity/v3/projects/3ee22a29f6174b14ae60cf5a9735756b/users/7dd684c2cd264b5ea6bfa6a70b93ff8d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:18.985711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:18.996484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88a50-268f-4688-9bde-c9b52e30e799 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:19.075280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb161b0-8633-4646-abb9-d85649a0fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:19.075973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb161b0-8633-4646-abb9-d85649a0fbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:19.076253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb161b0-8633-4646-abb9-d85649a0fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:19.076525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb161b0-8633-4646-abb9-d85649a0fbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:19.078107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb161b0-8633-4646-abb9-d85649a0fbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:19.080000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb161b0-8633-4646-abb9-d85649a0fbf6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:19.102415 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3451/6905] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:19.104620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:19.130020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633fc5-983f-46fd-8005-6c2c27e7afbe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:19.143406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:19.144508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:19.144947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:19.147907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] PATH_INFO: `/v3/projects/3ee22a29f6174b14ae60cf5a9735756b/users/7dd684c2cd264b5ea6bfa6a70b93ff8d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:19.152495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee22a29f6174b14ae60cf5a9735756b, user_id=7dd684c2cd264b5ea6bfa6a70b93ff8d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:19.155516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:19.173547 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3455/6906] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:19 2022] PUT /identity/v3/projects/3ee22a29f6174b14ae60cf5a9735756b/users/7dd684c2cd264b5ea6bfa6a70b93ff8d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:19.186143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812705d3-6c04-4020-b14b-82fb9ba82b7d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:19.186720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812705d3-6c04-4020-b14b-82fb9ba82b7d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:19.186720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812705d3-6c04-4020-b14b-82fb9ba82b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:19.240187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-812705d3-6c04-4020-b14b-82fb9ba82b7d None None] MFA Rules not processed for user `7dd684c2cd264b5ea6bfa6a70b93ff8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:19.242004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-812705d3-6c04-4020-b14b-82fb9ba82b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:19.272652 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:19.340484 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3452/6907] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:19.346389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:19.361272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13666ac-e50c-46dc-9baa-a67375570086 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:19.366298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dd684c2cd264b5ea6bfa6a70b93ff8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee22a29f6174b14ae60cf5a9735756b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:19.366904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:19.367179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:19.367627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:19.368479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:19.370521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:19.417698 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3456/6908] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:19 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:19.422092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812705d3-6c04-4020-b14b-82fb9ba82b7d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:19.520108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812705d3-6c04-4020-b14b-82fb9ba82b7d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:19.670600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8ca521853ad477fa808b73538412547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7632ec3cbf24f46af143bf29753092b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:19.671569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:19.672290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:19.672710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] PATH_INFO: `/v3/projects/f4ee4b4389f94b6798b2706bea3c357a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:19.674920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] RBAC: Authorizing `identity:delete_project(project_id=f4ee4b4389f94b6798b2706bea3c357a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 21 01:38:19.683207 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 21 01:38:19.684480 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:19.686734 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3453/6909] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:19 2022] DELETE /identity/v3/projects/f4ee4b4389f94b6798b2706bea3c357a => generated 136 bytes in 265 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:38:19.691537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:19.727692 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:19.846575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae3340-5383-467a-a0ac-5cf0e2c84ab8 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:19.854471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dd684c2cd264b5ea6bfa6a70b93ff8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee22a29f6174b14ae60cf5a9735756b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:19.855321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:19.855718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:19.856147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] PATH_INFO: `/v3/projects/f4ee4b4389f94b6798b2706bea3c357a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:19.858161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f4ee4b4389f94b6798b2706bea3c357a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:19.861389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:19.947033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ee4b4389f94b6798b2706bea3c357a', 'request_id': 'req-fe764543-12b5-4be3-93c7-a29272af16b9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:19.968933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ee4b4389f94b6798b2706bea3c357a', 'request_id': 'req-fe764543-12b5-4be3-93c7-a29272af16b9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:19.979682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ee4b4389f94b6798b2706bea3c357a', 'request_id': 'req-fe764543-12b5-4be3-93c7-a29272af16b9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.002144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] The token cache is being invalidate because project f4ee4b4389f94b6798b2706bea3c357a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:20.002548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.003713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fe764543-12b5-4be3-93c7-a29272af16b9 tempest-ProjectsNegativeTestJSON-1941580150 tempest-ProjectsNegativeTestJSON-1941580150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.008810 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3457/6910] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:19 2022] DELETE /identity/v3/projects/f4ee4b4389f94b6798b2706bea3c357a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:20.010691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:20.012485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:20.091538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654280a3-ca7c-4f60-94eb-1e456b462dcf tempest-ProjectsNegativeTestJSON-1238963543 tempest-ProjectsNegativeTestJSON-1238963543-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:20.152080 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:20.229252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:20.230683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:20.231207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:20.231691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] PATH_INFO: `/v3/users/f8ca521853ad477fa808b73538412547` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:20.234111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ca521853ad477fa808b73538412547)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:20.239387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:20.330799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ca521853ad477fa808b73538412547'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.348158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ca521853ad477fa808b73538412547'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.370365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ca521853ad477fa808b73538412547'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.372425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ca521853ad477fa808b73538412547'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.392557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ca521853ad477fa808b73538412547'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:20.401212 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3454/6911] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:20 2022] DELETE /identity/v3/users/f8ca521853ad477fa808b73538412547 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:20.406994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:20.407275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:20.407637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:20.452918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:20.457934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:20.620294 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3458/6912] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:20.648596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:20.650678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:20.743191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8c06-ed01-47d8-9b0b-59508c0d74ce admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:20.749833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:20.750821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:20.751374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:20.751986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:20.767832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:20.770512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:20.784802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3455/6913] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:21.632139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:21.633819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:21.689459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccd479-03c1-4beb-90a6-e0aa2cb34212 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:21.704079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:21.712479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:21.712840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:21.713085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] PATH_INFO: `/v3/projects/a7632ec3cbf24f46af143bf29753092b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:21.714794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7632ec3cbf24f46af143bf29753092b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:21.716887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:21.791626 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:21.800451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7632ec3cbf24f46af143bf29753092b', 'request_id': 'req-fac4ee28-05d6-4fe9-b750-e767f0ea3099'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:21.826074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7632ec3cbf24f46af143bf29753092b', 'request_id': 'req-fac4ee28-05d6-4fe9-b750-e767f0ea3099'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:21.845999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7632ec3cbf24f46af143bf29753092b', 'request_id': 'req-fac4ee28-05d6-4fe9-b750-e767f0ea3099'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:21.879868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] The token cache is being invalidate because project a7632ec3cbf24f46af143bf29753092b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:21.880561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:21.882515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:21.885963 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3459/6914] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:21 2022] DELETE /identity/v3/projects/a7632ec3cbf24f46af143bf29753092b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:21.889571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:21.904174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2712438-15e6-4581-9403-cd36ad93a021 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:21.989291 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:22.007590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:22.009519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:22.009888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:22.010253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] PATH_INFO: `/v3/users/7dd684c2cd264b5ea6bfa6a70b93ff8d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:22.012082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd684c2cd264b5ea6bfa6a70b93ff8d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:22.014967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:22.093406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd684c2cd264b5ea6bfa6a70b93ff8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.121773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd684c2cd264b5ea6bfa6a70b93ff8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.181188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd684c2cd264b5ea6bfa6a70b93ff8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.185603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd684c2cd264b5ea6bfa6a70b93ff8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.211708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd684c2cd264b5ea6bfa6a70b93ff8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.230651 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3456/6915] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:21 2022] DELETE /identity/v3/users/7dd684c2cd264b5ea6bfa6a70b93ff8d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:22.317434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:22.318927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:22.343165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ee28-05d6-4fe9-b750-e767f0ea3099 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:22.473662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:22.474342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:22.474617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:22.474883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] PATH_INFO: `/v3/users/42796dc1e8b3465bb461b1c012f4d34b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:22.477670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=42796dc1e8b3465bb461b1c012f4d34b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:22.479534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:22.534288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42796dc1e8b3465bb461b1c012f4d34b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.545254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42796dc1e8b3465bb461b1c012f4d34b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.546226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42796dc1e8b3465bb461b1c012f4d34b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.554547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42796dc1e8b3465bb461b1c012f4d34b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.555168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42796dc1e8b3465bb461b1c012f4d34b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:22.578473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3460/6916] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:22 2022] DELETE /identity/v3/users/42796dc1e8b3465bb461b1c012f4d34b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:22.862515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:22.864038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:22.896141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f74c2-d4e3-448c-8e76-b1d5f3ef63b6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:22.901880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:22.903320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:22.972395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:22.974242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:22.974685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:22.975492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] PATH_INFO: `/v3/projects/550503c288c1403d86958b009e04616c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:22.977291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=550503c288c1403d86958b009e04616c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:22.979564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.017355 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:23.043617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550503c288c1403d86958b009e04616c', 'request_id': 'req-0cc142fa-388a-40b0-bdbd-e2835ad79578'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.052718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550503c288c1403d86958b009e04616c', 'request_id': 'req-0cc142fa-388a-40b0-bdbd-e2835ad79578'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.059626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db817989-e775-4808-a103-876e6087a6eb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.060043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550503c288c1403d86958b009e04616c', 'request_id': 'req-0cc142fa-388a-40b0-bdbd-e2835ad79578'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.074042 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:23.081922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] The token cache is being invalidate because project 550503c288c1403d86958b009e04616c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:23.082632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.083546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0cc142fa-388a-40b0-bdbd-e2835ad79578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.088134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3457/6917] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:22 2022] DELETE /identity/v3/projects/550503c288c1403d86958b009e04616c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:23.096421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f456359-a545-4bea-8534-7104e0022f10 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.096711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f456359-a545-4bea-8534-7104e0022f10 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.097034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f456359-a545-4bea-8534-7104e0022f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.118326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6f456359-a545-4bea-8534-7104e0022f10 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:23.119595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f456359-a545-4bea-8534-7104e0022f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:23.145595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.146318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.146703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.147207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] PATH_INFO: `/v3/projects/3ee22a29f6174b14ae60cf5a9735756b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.148753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee22a29f6174b14ae60cf5a9735756b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.151118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.190732 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3458/6918] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:23.198022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23973d5-57e6-4496-af7f-5ed1ef179b2e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.198302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23973d5-57e6-4496-af7f-5ed1ef179b2e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.199040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23973d5-57e6-4496-af7f-5ed1ef179b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.213885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee22a29f6174b14ae60cf5a9735756b', 'request_id': 'req-31bbae37-6fd7-4342-89cd-38feaa7e55a0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.221655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b23973d5-57e6-4496-af7f-5ed1ef179b2e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:23.222956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b23973d5-57e6-4496-af7f-5ed1ef179b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:23.225796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee22a29f6174b14ae60cf5a9735756b', 'request_id': 'req-31bbae37-6fd7-4342-89cd-38feaa7e55a0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.233628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee22a29f6174b14ae60cf5a9735756b', 'request_id': 'req-31bbae37-6fd7-4342-89cd-38feaa7e55a0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.248720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] The token cache is being invalidate because project 3ee22a29f6174b14ae60cf5a9735756b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:23.249314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.250354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-31bbae37-6fd7-4342-89cd-38feaa7e55a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:23.252537 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3461/6919] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:22 2022] DELETE /identity/v3/projects/3ee22a29f6174b14ae60cf5a9735756b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:23.257183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debe34-6436-460c-8ccc-e34aacdedb76 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.257701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debe34-6436-460c-8ccc-e34aacdedb76 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.258140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debe34-6436-460c-8ccc-e34aacdedb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.281139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-10debe34-6436-460c-8ccc-e34aacdedb76 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:23.282399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-10debe34-6436-460c-8ccc-e34aacdedb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:23.295820 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3459/6920] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:23.300588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23973d5-57e6-4496-af7f-5ed1ef179b2e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.312586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23973d5-57e6-4496-af7f-5ed1ef179b2e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.319890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.320517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.320818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.321096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.321757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:23.322058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.323665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.341660 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3460/6921] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:23.342663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.352282 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3462/6922] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:23.352883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afe85-aa43-4560-b270-eeadca8806ba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.360686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd369-6290-49d6-a564-8138a65b779c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.361005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd369-6290-49d6-a564-8138a65b779c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.361463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd369-6290-49d6-a564-8138a65b779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.362328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.362480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.362883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.363224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.363914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.366044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.384973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4fafd369-6290-49d6-a564-8138a65b779c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:23.386385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4fafd369-6290-49d6-a564-8138a65b779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:23.402894 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3461/6923] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:23.404330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.421842 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3463/6924] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:23.422765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd369-6290-49d6-a564-8138a65b779c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.439864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd369-6290-49d6-a564-8138a65b779c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.459678 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:23.491798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03771fe-cbe4-40bc-a37d-087cbd8811fd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.498872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.499672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.499798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.500016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.502473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.503027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.513885 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:23.535298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.535918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.537886 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3462/6925] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:23.541230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.541537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.542827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:23.542827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.543298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.544992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.557021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c89b8-f125-4ff2-ab5c-6e42dba5636f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.565025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.566326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.566831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.567489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.568341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.570655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.581425 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3464/6926] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:23.584969 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3463/6927] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:23.585695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.588480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.604981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201be55b-0dd6-486b-8f2b-4cfa0020d8e0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.621313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.622318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859488db-74f6-4537-be1e-cffa19ce8630 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.622486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.622597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.622864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.623502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.626235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.637597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.638232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.638512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.638821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.639449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.641078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.661727 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3464/6928] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:23.666374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.676884 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3465/6929] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:23.680800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.682657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413c61-907d-4657-ac91-27e108cd93ff admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.807115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9f274-9984-49a4-a6b8-4fd32e3033ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.808252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9f274-9984-49a4-a6b8-4fd32e3033ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.808725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9f274-9984-49a4-a6b8-4fd32e3033ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.809747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9f274-9984-49a4-a6b8-4fd32e3033ef admin admin] PATH_INFO: `/v3/projects/24074b7c54cd45b8be3d92ef4d03de82/users/367f66617baf4548838a3dc62943424f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.812657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff200be-c7ad-4666-b55b-819161b3b421 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.823453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.825085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.825085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.825448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.826393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.830022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.835459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9f274-9984-49a4-a6b8-4fd32e3033ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=24074b7c54cd45b8be3d92ef4d03de82, user_id=367f66617baf4548838a3dc62943424f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.840106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9f274-9984-49a4-a6b8-4fd32e3033ef admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.863178 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3465/6930] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:23 2022] PUT /identity/v3/projects/24074b7c54cd45b8be3d92ef4d03de82/users/367f66617baf4548838a3dc62943424f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:23.875028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629aa0f-529b-46a4-9317-4f5757c2e770 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.875304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629aa0f-529b-46a4-9317-4f5757c2e770 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.875578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629aa0f-529b-46a4-9317-4f5757c2e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.877776 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3466/6931] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:23.881709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.893108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98de22d-ec83-4a35-9463-2c27899e974c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.905383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b629aa0f-529b-46a4-9317-4f5757c2e770 None None] MFA Rules not processed for user `367f66617baf4548838a3dc62943424f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:23.906563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b629aa0f-529b-46a4-9317-4f5757c2e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:23.958494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.959288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.959446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.959721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.960380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.962024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:23.973281 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3467/6932] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:23.977691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.981137 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3466/6933] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:23.985389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629aa0f-529b-46a4-9317-4f5757c2e770 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:23.990253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109b27e-b719-4c39-8301-fdc58423b762 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.994982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:23.995587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:23.995863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:23.996130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:23.996814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:23.997954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629aa0f-529b-46a4-9317-4f5757c2e770 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:23.998693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.003291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.003909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.004186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.004569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.005243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.007235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.021172 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3468/6934] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:24.025111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.035830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a863e06-75b9-42c2-854f-ab205cd94e23 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.042020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50c791-b2b1-4546-bbde-daa85b461186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.042528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50c791-b2b1-4546-bbde-daa85b461186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.042528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50c791-b2b1-4546-bbde-daa85b461186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.045823 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3467/6935] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:23 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:24.045918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50c791-b2b1-4546-bbde-daa85b461186 admin admin] PATH_INFO: `/v3/projects/6378a6df1f5d4732b24de6f9d8178359/users/433d31cbf77549c993aceb188c5525fe/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.047741 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:24.054270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.072258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50c791-b2b1-4546-bbde-daa85b461186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6378a6df1f5d4732b24de6f9d8178359, user_id=433d31cbf77549c993aceb188c5525fe, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.079579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50c791-b2b1-4546-bbde-daa85b461186 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.119633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3469/6936] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:24 2022] PUT /identity/v3/projects/6378a6df1f5d4732b24de6f9d8178359/users/433d31cbf77549c993aceb188c5525fe/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:24.119859 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:24.128907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16e7f-e7c5-436b-b215-b8bb6ff1b88c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.129267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16e7f-e7c5-436b-b215-b8bb6ff1b88c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.129688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16e7f-e7c5-436b-b215-b8bb6ff1b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.174711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-52d16e7f-e7c5-436b-b215-b8bb6ff1b88c None None] MFA Rules not processed for user `433d31cbf77549c993aceb188c5525fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:24.176076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-52d16e7f-e7c5-436b-b215-b8bb6ff1b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:24.206274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c143f-cc49-4a6e-b48d-e816f06df516 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.290119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.291080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.291415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.291822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.292803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.298422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.309633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3470/6937] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:24.311131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d16e7f-e7c5-436b-b215-b8bb6ff1b88c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.328941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d16e7f-e7c5-436b-b215-b8bb6ff1b88c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.334483 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3468/6938] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:24.337225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.338020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.338405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.339095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.339589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.340616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.342937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.348575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede2471-d532-4e4c-b26c-d35d7cc7e3b7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.353600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.354222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.354497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.354763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.355410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.357056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.377592 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3469/6939] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:24.378565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.388973 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3471/6940] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:24.392016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.393938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9458b29-e60c-4881-b85b-e4ab221fa4ce admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.475943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.476705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.477011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.477401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] PATH_INFO: `/v3/projects/37ca2065e3684719944405ad06f41928/users/8ba62117fe56431cb1c819fe7160a84e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.481486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96c0e-e0e4-48dc-b832-f832e35f7724 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.490850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.495478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.495836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.496224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.496797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.498744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.508227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ca2065e3684719944405ad06f41928, user_id=8ba62117fe56431cb1c819fe7160a84e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.511151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.531067 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3470/6941] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:24 2022] PUT /identity/v3/projects/37ca2065e3684719944405ad06f41928/users/8ba62117fe56431cb1c819fe7160a84e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:24.544151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.545768 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3472/6942] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:24.550596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.584054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d812cc7-5afd-4e2c-90e5-8dfa699db421 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.604854 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:24.653098 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:24.659457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332e6c1-4a4b-4fb2-95f0-4a0d4feefab0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.667208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.667838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.668180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.668458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.669144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.670762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.678151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.679033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.679380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.679723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.680449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.685623 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3471/6943] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:24.687486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.690054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.702748 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3473/6944] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:24.703959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.706660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14db33d-b43d-4e17-8eec-cb5d57bdfbfe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.712671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabe455-63eb-4af9-9fb6-02c87625bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.713267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe455-63eb-4af9-9fb6-02c87625bf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.713545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe455-63eb-4af9-9fb6-02c87625bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.713816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe455-63eb-4af9-9fb6-02c87625bf5f admin admin] PATH_INFO: `/v3/projects/37ca2065e3684719944405ad06f41928/users/8ba62117fe56431cb1c819fe7160a84e/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.715420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cd54-0b9c-4922-8c4e-d383d161ca7d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.715797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabe455-63eb-4af9-9fb6-02c87625bf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ca2065e3684719944405ad06f41928, user_id=8ba62117fe56431cb1c819fe7160a84e, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.718619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabe455-63eb-4af9-9fb6-02c87625bf5f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.724871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.729913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.730695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.731043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] PATH_INFO: `/v3/projects/5751075de2bc41d7ba71a925074efad8/users/6a74fe1f5c954942a25f55fb2b07c4ce/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.744012 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3472/6945] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:24 2022] PUT /identity/v3/projects/37ca2065e3684719944405ad06f41928/users/8ba62117fe56431cb1c819fe7160a84e/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:24.745559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a852b9-5635-4e14-b112-f1e8f98cb5bd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.745844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a852b9-5635-4e14-b112-f1e8f98cb5bd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.746117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a852b9-5635-4e14-b112-f1e8f98cb5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.754266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5751075de2bc41d7ba71a925074efad8, user_id=6a74fe1f5c954942a25f55fb2b07c4ce, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.759169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.781081 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3474/6946] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:24 2022] PUT /identity/v3/projects/5751075de2bc41d7ba71a925074efad8/users/6a74fe1f5c954942a25f55fb2b07c4ce/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:24.781874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-51a852b9-5635-4e14-b112-f1e8f98cb5bd None None] MFA Rules not processed for user `8ba62117fe56431cb1c819fe7160a84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:24.782066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.783399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-51a852b9-5635-4e14-b112-f1e8f98cb5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:24.859097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff0ee-24e9-4a97-b5ea-e9f2eafc34e3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.864334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.865140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.865508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.865867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.866645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.868220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3473/6947] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:24.872886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.873076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a852b9-5635-4e14-b112-f1e8f98cb5bd None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.885158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a852b9-5635-4e14-b112-f1e8f98cb5bd None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.885475 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3475/6948] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:24.888872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.890300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.890921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.891200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.891476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.892337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.894016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.903117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff169-bbf2-440f-9a9e-170149116a57 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.911806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623288e5-3301-44ec-805d-44b3149bfd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:24.912655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623288e5-3301-44ec-805d-44b3149bfd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.913197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623288e5-3301-44ec-805d-44b3149bfd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.915139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623288e5-3301-44ec-805d-44b3149bfd00 admin admin] PATH_INFO: `/v3/projects/5751075de2bc41d7ba71a925074efad8/users/6a74fe1f5c954942a25f55fb2b07c4ce/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.917526 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3474/6949] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/services => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:24.921949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:24.922596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623288e5-3301-44ec-805d-44b3149bfd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5751075de2bc41d7ba71a925074efad8, user_id=6a74fe1f5c954942a25f55fb2b07c4ce, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:24.925668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623288e5-3301-44ec-805d-44b3149bfd00 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:24.938352 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3476/6950] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:24 2022] PUT /identity/v3/projects/5751075de2bc41d7ba71a925074efad8/users/6a74fe1f5c954942a25f55fb2b07c4ce/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:24.948915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d258-ef30-4183-9236-87523d42cc60 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:24.949573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d258-ef30-4183-9236-87523d42cc60 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:24.950078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d258-ef30-4183-9236-87523d42cc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:24.963429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01586-b9f9-4a41-bce0-b6c5a1d47752 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:24.986416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5a90d258-ef30-4183-9236-87523d42cc60 None None] MFA Rules not processed for user `6a74fe1f5c954942a25f55fb2b07c4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:24.989044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5a90d258-ef30-4183-9236-87523d42cc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:25.090870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.095414 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3477/6951] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3441 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:25.096800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90d258-ef30-4183-9236-87523d42cc60 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.107163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90d258-ef30-4183-9236-87523d42cc60 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.109703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.110536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.111019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.112955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.118732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.121437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.122304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.122657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.122998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.123883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.133458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.153556 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1977723490. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:25.153556 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:25.153556 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:25.164146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3478/6952] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/roles => generated 234 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.166253 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:25.168036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.182460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53777-cb92-4717-969a-51432ba6025d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.192154 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:25.205417 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3475/6953] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:38:24 2022] POST /identity/v3/endpoints => generated 360 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.206432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.221299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.222005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.222279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.222719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.224017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.225882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.234347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed7703-8459-4ac0-b8d8-ea60b6f21e99 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.240346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.241167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.241452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.242008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-1977723490` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.242600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1977723490)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.244016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.246389 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3476/6954] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:38:25 2022] GET /identity/v3/regions/tempest-region-1977723490 => generated 180 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:25.250185 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3479/6955] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/roles => generated 234 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.250997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.254076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.264643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ebd97-751c-429e-848a-76494dff8820 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.269291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092367-7574-474c-a1fe-ebdca97f713d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.270953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.271708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.272117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.272540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.273512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.275544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.297470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.299106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.299784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.300295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.301257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.303628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.313852 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3477/6956] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/services => generated 288 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.318076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.330493 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3480/6957] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/roles => generated 235 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.335102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.349002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2bfbb-d078-43bd-a7b6-dd65ccd919fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.354240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017a406-1d13-49f6-a92c-550694e04286 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.369987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.371828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.372120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.372394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.373214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.374649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.375030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.375908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.380466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.381247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.383572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.388309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.401982 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-313676208. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:25.401982 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:25.401982 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:25.425688 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3481/6958] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/domains => generated 276 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:25.426784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.457335 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3478/6959] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/endpoints => generated 361 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.462007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.521260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9724746-4aa1-4142-9f41-f297192615a2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.558473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e32e7c-5b78-45b1-91f3-7ebc3946b6a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.614701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.615350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.615632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.615909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.621066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.625189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.636186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.637370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.637545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.637873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-313676208` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.638587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-313676208)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.639825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.645839 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3479/6960] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:38:25 2022] GET /identity/v3/regions/tempest-region-313676208 => generated 178 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:25.647042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.676878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bfae-5db0-4069-91ad-4513cbc02a4c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.692752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.693397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.693688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.694058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.694702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.696322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.727748 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3482/6961] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/projects => generated 400 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.729845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.752982 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-30552458. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:25.752982 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:25.752982 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:25.806586 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3480/6962] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/endpoints => generated 356 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.811623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:25.867701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f27e-8ca3-4073-ac3b-46903ecb2670 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.883999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20975d39-8d12-4080-bf32-d149837600e5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:25.908727 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:25.936861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:25.937534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:25.937792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:25.938115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:25.939091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:25.942478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:25.947440 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:25.972576 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3483/6963] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/groups => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:25.974510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.001607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.003320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.003431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef964729-0690-4a4b-b0e9-d2724ecfb1c5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.004512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.005024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-30552458` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.006092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-30552458)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.007892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.014074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3481/6964] 10.222.0.46 () {58 vars in 1200 bytes} [Sun Aug 21 01:38:25 2022] GET /identity/v3/regions/tempest-region-30552458 => generated 176 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:26.014813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.015457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.015735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.016058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.016347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.017594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.018763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.029085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49497d1a-6096-49e3-b26a-72083b0ba107 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.037243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.038244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.039019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.039506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.040488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.041847 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:26.041847 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:26.041847 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:26.043144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.053209 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3484/6965] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:25 2022] POST /identity/v3/roles => generated 235 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:26.054358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.060361 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3482/6966] 10.222.0.46 () {58 vars in 1134 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints => generated 4391 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:26.062050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.075493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccdab-4a58-4881-96a1-7b52e40fd494 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.082575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64eeac-d6d9-4e8d-bce0-03908049cdb0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.083494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.084532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.085070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.085986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints/fc59d6e99990437783ffee1ff4c5be8b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.093943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=fc59d6e99990437783ffee1ff4c5be8b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.095855 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:26.095855 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:26.095855 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:26.097143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.097765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.097947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.098554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.098554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.099190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.101156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.105104 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3483/6967] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints/fc59d6e99990437783ffee1ff4c5be8b => generated 356 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:26.106635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.127205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07830a6-2026-42bb-a7e8-2c98a699448a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.139131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.140268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.141373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.142018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints/fc59d6e99990437783ffee1ff4c5be8b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.146930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fc59d6e99990437783ffee1ff4c5be8b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.148699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.149562 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3485/6968] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:26 2022] POST /identity/v3/users => generated 442 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:26.153594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.166525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fc59d6e99990437783ffee1ff4c5be8b', 'request_id': 'req-08d47193-18e7-4a5a-8987-74d621334b2a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:26.170832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695be52-91e3-41e4-86b5-28e9e9926478 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.179713 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3484/6969] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:26 2022] DELETE /identity/v3/endpoints/fc59d6e99990437783ffee1ff4c5be8b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:26.183534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.207447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.208040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.208321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.208589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.208881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47193-18e7-4a5a-8987-74d621334b2a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.209294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.210446 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:26.210446 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:26.210446 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:26.211396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.214999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.215867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.216312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.216735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.217522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.219484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.230835 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3485/6970] 10.222.0.46 () {58 vars in 1134 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints => generated 4048 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:26.235147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.243305 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3486/6971] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:26 2022] POST /identity/v3/roles => generated 269 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:26.247424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.249371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c4a0-f5d7-4398-8980-963494accddb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.258737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1293371-cc5a-440d-9be1-17577a23472e tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.265683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.265981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.267037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.267647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.268047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.268312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/97d2869f7db7492ea538a6d0752d1f25` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.268436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.268619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints/fc59d6e99990437783ffee1ff4c5be8b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.284351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:38:26.287883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=97d2869f7db7492ea538a6d0752d1f25)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.290916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Could not find endpoint: fc59d6e99990437783ffee1ff4c5be8b.: keystone.exception.EndpointNotFound: Could not find endpoint: fc59d6e99990437783ffee1ff4c5be8b. Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._iter().one() Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._only_one_row( Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:26.316975 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: fc59d6e99990437783ffee1ff4c5be8b. Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:26.318363 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:38:26.319485 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: fc59d6e99990437783ffee1ff4c5be8b. Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:26.320451 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3486/6973] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:26 2022] DELETE /identity/v3/endpoints/fc59d6e99990437783ffee1ff4c5be8b => generated 114 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:38:26.322519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.322674 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3487/6973] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:26 2022] PUT /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/97d2869f7db7492ea538a6d0752d1f25 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:26.322674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.338445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625f6e-d15e-4f5d-bfb7-a9419b98d4c0 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.400820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35a8a-01a7-4fdb-9ade-a8c1457585ed tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.406341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.407471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.407969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.408640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-30552458` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.409557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-30552458)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.411765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.432036 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-30552458. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:26.432036 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:26.432036 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:26.458501 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3488/6974] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:38:26 2022] DELETE /identity/v3/regions/tempest-region-30552458 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:26.461776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.511161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae8c02-da8c-4b37-bcba-1ed124dd7d2d tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.517392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.518152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.518570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.518938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.519690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.520848 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:26.520848 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:26.520848 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:26.521980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.526932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.527818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.528263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.528683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.529647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Adding query filter params (scope.project.id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user.id=d9bac9e4d7bb49d0a3d7449ff7e60d27) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:26.530127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.535875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.538432 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3489/6975] 10.222.0.46 () {58 vars in 1134 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints => generated 4048 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:26.539505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.557763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae982f0-efdb-41a5-8925-1417df68fc05 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.567409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.568166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.568683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.569034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.570534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Adding query filter params (service_id=42d601dc876d467e8ad76a2c44b1ded0) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:26.574456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.578380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.600614 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3490/6976] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints?service_id=42d601dc876d467e8ad76a2c44b1ded0 => generated 502 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:26.606061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.624513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5afc5-a8ec-48ce-a839-b6537994514a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.641845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.642612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.642939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.643180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.643829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Adding query filter params (service_id=d98acac0117d4b349272e4013fca67d0) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:26.644135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.645763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.651046 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3487/6977] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/role_assignments?scope.project.id=cd99e3ebce1f4af2b8b5f9c5fe212ec2&user.id=d9bac9e4d7bb49d0a3d7449ff7e60d27&effective => generated 228 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:26.656900 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3491/6978] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints?service_id=d98acac0117d4b349272e4013fca67d0 => generated 503 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:26.663370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.664029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.675550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d014e-529d-4156-bb14-3c0ea40a3134 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.682540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.683649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.684151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.684713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.685600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:26.686110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.691143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.697875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868dcfc-448a-496a-a7ad-e91a68c1c02a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.704742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.706082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.706561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.707014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3492/6979] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:26.707187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/97d2869f7db7492ea538a6d0752d1f25` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.710941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=97d2869f7db7492ea538a6d0752d1f25)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.712320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.714188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.720409 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:26.723139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 97d2869f7db7492ea538a6d0752d1f25 was removed from user d9bac9e4d7bb49d0a3d7449ff7e60d27 on project cd99e3ebce1f4af2b8b5f9c5fe212ec2. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:26.723871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:26.724461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:26.743938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57378d6-2498-440e-93f4-899de8ba232a tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.760633 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3488/6980] 10.222.0.46 () {58 vars in 1467 bytes} [Sun Aug 21 01:38:26 2022] DELETE /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/97d2869f7db7492ea538a6d0752d1f25 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:26.763582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.787785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:26.806885 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=7,keystone:SELECT=92,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:26.891299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.892356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.892649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.892949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.893621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:26.894065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.895678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.902478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793212-8b9e-4e5f-805e-6418a22f22a2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.908750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.909558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.909932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.910257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/97d2869f7db7492ea538a6d0752d1f25` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.911850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=97d2869f7db7492ea538a6d0752d1f25)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.913028 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:26.913028 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:26.913028 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:26.913936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.915471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3493/6981] 10.222.0.46 () {58 vars in 1171 bytes} [Sun Aug 21 01:38:26 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:26.927423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:26.931736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:26.963612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c69ea-dac3-4a79-90f6-2bf86e68c75e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:26.973530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:26.974321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:26.976992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:26.978493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:26.982860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:26.986436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 97d2869f7db7492ea538a6d0752d1f25 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:26.986795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:26.987943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:26.988530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:26.992848 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3489/6982] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:26 2022] DELETE /identity/v3/roles/97d2869f7db7492ea538a6d0752d1f25 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:26.999630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.002772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:27.027529 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3494/6983] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:26 2022] POST /identity/v3/services => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:27.031666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.035221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:27.092684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389dbe7-2e37-418a-9048-f0b48eb2e731 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.124340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b5ec-0668-4ad3-ac7e-cffd04abfe4b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.153289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.153978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.154447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.154658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/844d9780feb741a6bb3fde8658c0b3a9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.157075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=844d9780feb741a6bb3fde8658c0b3a9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.159881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.195095 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3490/6984] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:26 2022] PUT /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/844d9780feb741a6bb3fde8658c0b3a9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:27.209420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.215467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.216027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.216308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.216580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.217320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.220135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.246176 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1563421950. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:27.246176 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:27.246176 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:27.281998 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3495/6985] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:38:27 2022] POST /identity/v3/endpoints => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:27.285039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.297808 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:27.315949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c66810-23c6-49d6-8294-b0f8f3c32782 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.332487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d938a1-9428-4749-91e3-775835b208ef tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.354838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.356114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.357321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.358221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.360114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.361724 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:27.361724 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:27.361724 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:27.363334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.384096 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:27.392087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.395237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.397290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.398389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-1563421950` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.399418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1563421950)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.400520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.404873 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3496/6986] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:38:27 2022] GET /identity/v3/regions/tempest-region-1563421950 => generated 180 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:27.405721 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3491/6987] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:27 2022] PUT /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 519 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:27.409182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.410288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.423297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3788ec6-37f2-4278-a100-a654a15dbb2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.487896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.488884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.489254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.489648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints/d8b85bac9803440eb1c76fb0a1728886` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.495410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=d8b85bac9803440eb1c76fb0a1728886)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.497307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.510393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250568-bc20-47d6-977a-b78716cedc5d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.517006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.518320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.518835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.519122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.519865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Adding query filter params (scope.project.id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user.id=d9bac9e4d7bb49d0a3d7449ff7e60d27) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:27.520171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.520719 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-680717248. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:27.520719 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:27.520719 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:27.522171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.572095 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3497/6988] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:38:27 2022] PATCH /identity/v3/endpoints/d8b85bac9803440eb1c76fb0a1728886 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:27.576165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.614763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465d198-a0ad-4a4f-a90a-38b49eb46a43 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.631180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.633127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.634093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.637875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-680717248` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.639169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-680717248)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.641404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.647399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3498/6989] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:38:27 2022] GET /identity/v3/regions/tempest-region-680717248 => generated 178 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:27.664042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.672333 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3492/6990] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:38:27 2022] GET /identity/v3/role_assignments?scope.project.id=cd99e3ebce1f4af2b8b5f9c5fe212ec2&user.id=d9bac9e4d7bb49d0a3d7449ff7e60d27&effective => generated 1061 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:27.673776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.685056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732201-1552-43bb-8c79-2d8200843111 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.691577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a81ce1-3bca-40d7-82d5-a52c8ae2f645 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.697192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.697983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.698367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.698742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints/d8b85bac9803440eb1c76fb0a1728886` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.707057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d8b85bac9803440eb1c76fb0a1728886)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.733713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.733923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.734061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.734061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.734061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.738182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.739322 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:27.739322 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:27.739322 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:27.740225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.755858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd8b85bac9803440eb1c76fb0a1728886', 'request_id': 'req-0c7f9aaa-0c68-471d-9594-a898afe238e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:27.764196 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3493/6991] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:27 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:27.770353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.784354 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3499/6992] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:27 2022] DELETE /identity/v3/endpoints/d8b85bac9803440eb1c76fb0a1728886 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:27.790475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:27.845931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f9aaa-0c68-471d-9594-a898afe238e2 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.913181 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:27.943160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3435-bcca-42be-88b1-d19967c74472 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:27.968117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.968921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.969276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.969905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.971417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Adding query filter params (scope.project.id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user.id=d9bac9e4d7bb49d0a3d7449ff7e60d27) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:27.972808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.975780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:27.978923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:27.979659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:27.979951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:27.980208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-680717248` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:27.982496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-680717248)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:27.986916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.017319 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:28.033972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3500/6993] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:38:27 2022] DELETE /identity/v3/regions/tempest-region-680717248 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:28.035894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.047251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3494/6994] 10.222.0.46 () {58 vars in 1356 bytes} [Sun Aug 21 01:38:27 2022] GET /identity/v3/role_assignments?scope.project.id=cd99e3ebce1f4af2b8b5f9c5fe212ec2&user.id=d9bac9e4d7bb49d0a3d7449ff7e60d27&effective => generated 577 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:28.052998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.066587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a4668-7de7-43e2-8fd5-878847ab7d3a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.080470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55596e-2809-4427-9bb4-83f3eed37336 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.088910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.089699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.089996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.090380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.092355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.094042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.095258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.099134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.099471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.099745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-1563421950` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.102468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1563421950)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07.: keystone.exception.ImpliedRoleNotFound: 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07. Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = query.one() Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._iter().one() Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._only_one_row( Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:28.105007 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 21 01:38:28.112108 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 21 01:38:28.113884 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 21 01:38:28.113884 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 21 01:38:28.113884 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 21 01:38:28.113884 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07. Aug 21 01:38:28.113884 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:28.113884 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3495/6995] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 137 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:38:28.114634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.114785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.161625 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3501/6996] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/regions/tempest-region-1563421950 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:28.162293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.237552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7021-dbac-43dc-9882-2ae0ef065c41 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.256099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.257799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.258605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.259363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/services/f9a33a2d58f347b98b74f82b589561ba` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.260590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f9a33a2d58f347b98b74f82b589561ba)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.271855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.293826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32167b-ea87-48db-a8d3-a7543e17f1fe tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.315379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.316239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.316620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.317143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/844d9780feb741a6bb3fde8658c0b3a9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.319901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=844d9780feb741a6bb3fde8658c0b3a9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.323090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.329701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 844d9780feb741a6bb3fde8658c0b3a9 was removed from user d9bac9e4d7bb49d0a3d7449ff7e60d27 on project cd99e3ebce1f4af2b8b5f9c5fe212ec2. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:28.330047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:28.331031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:28.337680 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3502/6997] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/services/f9a33a2d58f347b98b74f82b589561ba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:28.344896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.348816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:28.359399 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3496/6998] 10.222.0.46 () {58 vars in 1467 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/844d9780feb741a6bb3fde8658c0b3a9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:28.366627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.368195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:28.426554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362becf5-604f-4c71-b25a-e6670e0eac2e tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.468554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba56cc-fc45-41c0-b817-07c383fa1d98 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.493050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.495247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.495542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.496574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.499743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.499995 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:28.499995 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:28.499995 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:28.503409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.545300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.546576 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3497/6999] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:28 2022] POST /identity/v3/roles => generated 272 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:28.547365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.548464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.549237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints/153a2863bfe548fcbf0d13b2654498c2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.553203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.564011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=153a2863bfe548fcbf0d13b2654498c2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.567759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.575842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9678a7-cd5a-4578-b989-bfe490bee062 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.584513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '153a2863bfe548fcbf0d13b2654498c2', 'request_id': 'req-68347ddb-ec4b-42f5-8f83-d59db452e1dc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:28.585591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.586454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.586779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.587059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.587826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Adding query filter params (domain_id=dc05591c8d0f4643b12b3bb664b39a19) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:28.588131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.590136 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:28.590136 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:28.590136 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:28.591102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.613238 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3498/7000] 10.222.0.46 () {58 vars in 1207 bytes} [Sun Aug 21 01:38:28 2022] GET /identity/v3/roles?domain_id=dc05591c8d0f4643b12b3bb664b39a19 => generated 409 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:28.615416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.620399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3503/7001] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/endpoints/153a2863bfe548fcbf0d13b2654498c2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:28.625749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.637703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47121418-ff17-4974-af50-79af2dc3b008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.670021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.671234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.671665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347ddb-ec4b-42f5-8f83-d59db452e1dc tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.671762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.672310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/47488b8623ed423782ded16dc983b7b1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.674946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=47488b8623ed423782ded16dc983b7b1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.678577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.683606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.684293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.684578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.684882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-313676208` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.685482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-313676208)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.687104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.702279 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:28.721630 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-313676208. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:28.721630 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:28.721630 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:28.730780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3504/7002] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/regions/tempest-region-313676208 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:28.734805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.755878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 47488b8623ed423782ded16dc983b7b1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:28.756117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:28.759183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:28.769063 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3499/7003] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/roles/47488b8623ed423782ded16dc983b7b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:28.771094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.775075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:28.776582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f956-39ea-449b-8286-0d917699541c tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.829441 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:28.886960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.887679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.887957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.888237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/services/d98acac0117d4b349272e4013fca67d0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.888459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147958-7f93-48f9-b89d-c4a60750379c tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.889855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d98acac0117d4b349272e4013fca67d0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.892657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.920404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.921058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.921315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.921978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:28.922278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Adding query filter params (domain_id=dc05591c8d0f4643b12b3bb664b39a19) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:28.922563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:28.927168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:28.933526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3505/7004] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/services/d98acac0117d4b349272e4013fca67d0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:28.937784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.942352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:28.952158 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3500/7005] 10.222.0.46 () {58 vars in 1207 bytes} [Sun Aug 21 01:38:28 2022] GET /identity/v3/roles?domain_id=dc05591c8d0f4643b12b3bb664b39a19 => generated 148 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:28.958097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:28.970171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd683b-ca40-455c-bacf-6e3df6aade71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.991021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbb430-c68d-474e-9b14-b47dd8e79d82 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:28.998043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:28.998683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:28.998968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:28.999242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/47488b8623ed423782ded16dc983b7b1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.005863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.011754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.012400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.012882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/endpoints/567d7ba871994c688e3ae03cddb42714` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.019651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=567d7ba871994c688e3ae03cddb42714)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.020858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:38:29.022065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Could not find role: 47488b8623ed423782ded16dc983b7b1.: keystone.exception.RoleNotFound: Could not find role: 47488b8623ed423782ded16dc983b7b1. Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 21 01:38:29.032958 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:38:29.034142 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 47488b8623ed423782ded16dc983b7b1. Aug 21 01:38:29.035150 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:29.037350 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3501/7006] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/roles/47488b8623ed423782ded16dc983b7b1 => generated 110 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:38:29.041752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '567d7ba871994c688e3ae03cddb42714', 'request_id': 'req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.042298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.061382 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3506/7007] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:28 2022] DELETE /identity/v3/endpoints/567d7ba871994c688e3ae03cddb42714 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:29.061601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bdaa7-352a-4ae8-a762-d2c3cafe1ed1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.083432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.118723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.119557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.120871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.121227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.130382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dc05591c8d0f4643b12b3bb664b39a19, group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.133762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.148108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f479cc-4492-4d87-aaa2-0ac1a675bf12 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.162158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.162974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.163719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.163965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/regions/tempest-region-1977723490` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.164577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1977723490)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.166230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.167288 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3502/7008] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:29 2022] PUT /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:29.173374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.191467 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1977723490. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:38:29.191467 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:38:29.191467 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:29.199933 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3507/7009] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:38:29 2022] DELETE /identity/v3/regions/tempest-region-1977723490 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:29.204203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.239803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967386a-cd68-4638-b00b-a9a38e809296 tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.268698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ca78-6918-49f3-8f69-744fe9e69de3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.289910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.290651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.290932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.291204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.293524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=dc05591c8d0f4643b12b3bb664b39a19, group_id=03d76b0d665f460caa66b3e09d76d12d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.294781 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:29.294781 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:29.294781 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:29.296613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.316050 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3503/7010] 10.222.0.46 () {58 vars in 1365 bytes} [Sun Aug 21 01:38:29 2022] GET /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles => generated 410 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:29.320074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.325802 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:29.331773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2c85-1fe3-4f8d-aed8-c1a70928942a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.343771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.344484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.345633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.345978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.349866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=dc05591c8d0f4643b12b3bb664b39a19, group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.353405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.362266 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3504/7011] 10.222.0.46 () {58 vars in 1465 bytes} [Sun Aug 21 01:38:29 2022] HEAD /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:29.366687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.378258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e8fea-00fa-499f-85c3-eafe372506bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.380342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba62117fe56431cb1c819fe7160a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ca2065e3684719944405ad06f41928', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.381290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.381563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.381932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] PATH_INFO: `/v3/services/42d601dc876d467e8ad76a2c44b1ded0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.382632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorizing `identity:delete_service(service_id=42d601dc876d467e8ad76a2c44b1ded0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.383668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.384262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.384482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.384860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.385200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.387516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dc05591c8d0f4643b12b3bb664b39a19, group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.390367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.397653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role bc2b27de09944e42a31127bf64e8ad89 was removed from group 03d76b0d665f460caa66b3e09d76d12d on domain dc05591c8d0f4643b12b3bb664b39a19. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:29.397914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.398647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.420540 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3508/7012] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:29 2022] DELETE /identity/v3/services/42d601dc876d467e8ad76a2c44b1ded0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:29.420810 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3505/7013] 10.222.0.46 () {58 vars in 1467 bytes} [Sun Aug 21 01:38:29 2022] DELETE /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:29.422415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.425278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:29.425431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.426905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:29.469916 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:29.507601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b38d-cd6c-46f3-963f-a4cd6e37263b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.526033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.527036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.527513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.527976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.530881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.534171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.535288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948043-5602-4ab2-bb73-129277827edb tempest-EndPointsTestJSON-281752617 tempest-EndPointsTestJSON-281752617-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.590259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3506/7014] 10.222.0.46 () {60 vars in 1486 bytes} [Sun Aug 21 01:38:29 2022] PUT /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:29.593860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.655312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.668553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.668872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.669218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] PATH_INFO: `/v3/users/367f66617baf4548838a3dc62943424f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.672490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367f66617baf4548838a3dc62943424f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.675164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.770344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb130bf-343b-4573-bbd7-b9659ad79fbd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.784658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.785461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.785736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.786015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.791243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_grants(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, group_id=03d76b0d665f460caa66b3e09d76d12d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.795005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.799045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367f66617baf4548838a3dc62943424f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.811896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367f66617baf4548838a3dc62943424f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.812530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367f66617baf4548838a3dc62943424f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.825875 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3507/7015] 10.222.0.46 () {58 vars in 1368 bytes} [Sun Aug 21 01:38:29 2022] GET /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles => generated 411 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:29.827467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:29.831648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:29.832508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367f66617baf4548838a3dc62943424f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.833504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a9483f75-b82c-4b90-8bc4-f6b2e2b12a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367f66617baf4548838a3dc62943424f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:29.858662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ffc4f-fce6-4e22-8152-361d6b4dc542 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:29.868079 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3509/7016] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:29 2022] DELETE /identity/v3/users/367f66617baf4548838a3dc62943424f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:29.872667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.872667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.872955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.875729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c37cde-e773-4673-8573-52b5a7b0ad60 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:29.876822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37cde-e773-4673-8573-52b5a7b0ad60 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.877084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37cde-e773-4673-8573-52b5a7b0ad60 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.877363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c37cde-e773-4673-8573-52b5a7b0ad60 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/groups/03d76b0d665f460caa66b3e09d76d12d/users/d9bac9e4d7bb49d0a3d7449ff7e60d27` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:29.880011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c37cde-e773-4673-8573-52b5a7b0ad60 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=03d76b0d665f460caa66b3e09d76d12d, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:29.881973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c37cde-e773-4673-8573-52b5a7b0ad60 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:29.914980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:29.922251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:29.949538 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3508/7017] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:38:29 2022] PUT /identity/v3/groups/03d76b0d665f460caa66b3e09d76d12d/users/d9bac9e4d7bb49d0a3d7449ff7e60d27 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:29.954494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3b56d-19db-47d0-9177-5c49a3ebad31 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:29.954788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3b56d-19db-47d0-9177-5c49a3ebad31 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:29.955103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3b56d-19db-47d0-9177-5c49a3ebad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:30.039863 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:30.062419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a6e3b56d-19db-47d0-9177-5c49a3ebad31 None None] MFA Rules not processed for user `d9bac9e4d7bb49d0a3d7449ff7e60d27`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:30.066791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6e3b56d-19db-47d0-9177-5c49a3ebad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:30.091506 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3510/7018] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:30.094128 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:30.107048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:30.108779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:30.245018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4392729-c4bb-4267-becb-0fe1e8dd7e86 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:30.280877 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3509/7019] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:30.282064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3b56d-19db-47d0-9177-5c49a3ebad31 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:30.338856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:30.339535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:30.349113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:30.349476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:30.465040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3b56d-19db-47d0-9177-5c49a3ebad31 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:30.471092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:30.471964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:30.472427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:30.472706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:30.473625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:30.475146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:30.475848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:30.481344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:30.491737 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3511/7020] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:30.494936 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3510/7021] 10.222.0.46 () {58 vars in 1468 bytes} [Sun Aug 21 01:38:30 2022] HEAD /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:30.498934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:30.513212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab5787-f760-476d-9e5a-bf1d2e6db9e0 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:30.518555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:30.520836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:30.521904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:30.521904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:30.524019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:30.530159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:30.539540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role bc2b27de09944e42a31127bf64e8ad89 was removed from group 03d76b0d665f460caa66b3e09d76d12d on project cd99e3ebce1f4af2b8b5f9c5fe212ec2. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:30.539887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:30.540626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:30.565281 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3512/7022] 10.222.0.46 () {58 vars in 1470 bytes} [Sun Aug 21 01:38:30 2022] DELETE /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:30.570887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:30.573159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:30.610938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe04f4-1eeb-4f32-bd27-289753a46e75 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:30.771316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:30.772255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:30.772615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:30.772994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/groups/03d76b0d665f460caa66b3e09d76d12d/users/d9bac9e4d7bb49d0a3d7449ff7e60d27` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:30.775383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=03d76b0d665f460caa66b3e09d76d12d, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:30.777891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:30.810367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd9bac9e4d7bb49d0a3d7449ff7e60d27'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:30.835778 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3511/7023] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:38:30 2022] DELETE /identity/v3/groups/03d76b0d665f460caa66b3e09d76d12d/users/d9bac9e4d7bb49d0a3d7449ff7e60d27 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:30.842454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:30.855243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed906c-1748-45ea-814f-1dfaf86de2f0 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:30.887565 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:30.928088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:30.929370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:30.929808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:30.930366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:30.932592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:30.933913 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:30.933913 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:30.933913 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:30.935302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:30.945681 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3513/7024] 10.222.0.46 () {60 vars in 1381 bytes} [Sun Aug 21 01:38:30 2022] PUT /identity/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:30.948360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:30.951025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:30.957880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:30.975375 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:30.988092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe808-f64a-45b3-b471-9a28dfaff0bf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.011939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.013788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.015912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.016339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.019362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=03d76b0d665f460caa66b3e09d76d12d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.023609 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:31.023609 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:31.023609 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:31.025740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.058075 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3514/7025] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:38:30 2022] GET /identity/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles => generated 376 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:31.062215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.083810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648863e-6b6b-45dc-b72f-56b378e03899 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.095643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.097886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.098291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.099479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.105807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.107067 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:31.107067 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:31.107067 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:31.108345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.120648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ec33-b616-4ae5-8a97-62498720a5c1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.123904 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3515/7026] 10.222.0.46 () {58 vars in 1363 bytes} [Sun Aug 21 01:38:31 2022] HEAD /identity/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.129237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.140519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.141442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.144000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.144530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] PATH_INFO: `/v3/projects/24074b7c54cd45b8be3d92ef4d03de82` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.148581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24074b7c54cd45b8be3d92ef4d03de82)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.154159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.158056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f590-9a0d-4149-b7d1-77f9e223b730 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.164627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.165654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.166213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.166396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.168184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=03d76b0d665f460caa66b3e09d76d12d, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.169352 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:31.169352 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:31.169352 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:31.170480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.198565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3516/7027] 10.222.0.46 () {58 vars in 1365 bytes} [Sun Aug 21 01:38:31 2022] DELETE /identity/v3/system/groups/03d76b0d665f460caa66b3e09d76d12d/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.204200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.219457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736b7eb-d6ee-4a55-a2f2-4998062f42b3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.228912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.230032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.230610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.231029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.234251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dc05591c8d0f4643b12b3bb664b39a19, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.237532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.248259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24074b7c54cd45b8be3d92ef4d03de82', 'request_id': 'req-ef763bd2-efcc-4a02-ba91-476c689ed1e0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.259741 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3517/7028] 10.222.0.46 () {60 vars in 1480 bytes} [Sun Aug 21 01:38:31 2022] PUT /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.261220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.262343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24074b7c54cd45b8be3d92ef4d03de82', 'request_id': 'req-ef763bd2-efcc-4a02-ba91-476c689ed1e0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.276230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24074b7c54cd45b8be3d92ef4d03de82', 'request_id': 'req-ef763bd2-efcc-4a02-ba91-476c689ed1e0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.310413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] The token cache is being invalidate because project 24074b7c54cd45b8be3d92ef4d03de82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:31.311323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.316983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.319487 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3512/7029] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:30 2022] DELETE /identity/v3/projects/24074b7c54cd45b8be3d92ef4d03de82 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.323413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.325393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:31.367668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e902-affa-4e46-b42b-46149f9267cf tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.373835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.375043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.375436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.375853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.379403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=dc05591c8d0f4643b12b3bb664b39a19, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.388926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.414256 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3518/7030] 10.222.0.46 () {58 vars in 1362 bytes} [Sun Aug 21 01:38:31 2022] GET /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles => generated 409 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:31.416511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.419289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef763bd2-efcc-4a02-ba91-476c689ed1e0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.419540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:31.445551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab165c-79b7-4129-a797-ebf3105d81b4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.451154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.452055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.452554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.452941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.458117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=dc05591c8d0f4643b12b3bb664b39a19, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.461896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.473480 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3519/7031] 10.222.0.46 () {58 vars in 1462 bytes} [Sun Aug 21 01:38:31 2022] HEAD /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.474918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.478079 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:31.494537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc751-852a-4f97-90bc-00e8f9849fa5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.497733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.498751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.499318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.499867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] PATH_INFO: `/v3/users/8ba62117fe56431cb1c819fe7160a84e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.502582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.502858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba62117fe56431cb1c819fe7160a84e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.503311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.503593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.503867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.504923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.506933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dc05591c8d0f4643b12b3bb664b39a19, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.510958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.519105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role bc2b27de09944e42a31127bf64e8ad89 was removed from user d9bac9e4d7bb49d0a3d7449ff7e60d27 on domain dc05591c8d0f4643b12b3bb664b39a19. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:31.519816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.520702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.548905 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3520/7032] 10.222.0.46 () {58 vars in 1464 bytes} [Sun Aug 21 01:38:31 2022] DELETE /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.551016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.553525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:31.575258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba62117fe56431cb1c819fe7160a84e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.591421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba62117fe56431cb1c819fe7160a84e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.617378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba62117fe56431cb1c819fe7160a84e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.618310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba62117fe56431cb1c819fe7160a84e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.626281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba62117fe56431cb1c819fe7160a84e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:31.638616 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:31.638844 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3513/7033] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:31 2022] DELETE /identity/v3/users/8ba62117fe56431cb1c819fe7160a84e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:31.664459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7dca2-6eb0-43b4-bebd-335b206dff6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.761221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.762220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.762461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.762743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.766548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.769573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.800977 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3521/7034] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:31 2022] PUT /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.801620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.803559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:31.830076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ad11-8b26-4fba-a08c-f553da3009f4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.899085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.900045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.900490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.900983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.903920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_grants(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.909893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.935374 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3514/7035] 10.222.0.46 () {58 vars in 1365 bytes} [Sun Aug 21 01:38:31 2022] GET /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles => generated 410 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:31.939338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:31.957008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47762a-1689-4daf-91b7-2bea085adab2 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:31.965015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:31.966085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:31.968647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:31.969204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:31.973255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:31.977599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:31.988077 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3522/7036] 10.222.0.46 () {58 vars in 1465 bytes} [Sun Aug 21 01:38:31 2022] HEAD /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:31.992224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.007547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dcd7e-9a8e-4c35-a7bf-50db470a8f23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.015573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.017014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.017014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.017014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.020057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2, user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.023673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.030723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role bc2b27de09944e42a31127bf64e8ad89 was removed from user d9bac9e4d7bb49d0a3d7449ff7e60d27 on project cd99e3ebce1f4af2b8b5f9c5fe212ec2. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:32.031149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:32.033121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:32.062027 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3515/7037] 10.222.0.46 () {58 vars in 1467 bytes} [Sun Aug 21 01:38:31 2022] DELETE /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:32.067015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.069550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:32.097135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a934de-3b35-4533-90be-fe7b0120a336 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.157842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.159429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:32.202407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.203659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.204145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.204538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.207131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.209460 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:32.209460 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:32.209460 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:32.213111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.241717 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3523/7038] 10.222.0.46 () {60 vars in 1378 bytes} [Sun Aug 21 01:38:32 2022] PUT /identity/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:32.243173 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:32.246787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.261961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337cd7-c7c1-4aa8-8778-082e2fed6e23 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.271885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.272840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.273362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.273498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.275087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.276311 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:32.276311 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:32.276311 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:32.277488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.297467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8a1d7-ca50-4d4f-9131-4c385772632f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.300425 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3524/7039] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:38:32 2022] GET /identity/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles => generated 375 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:32.305416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.306796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.307628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.308056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.308504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] PATH_INFO: `/v3/projects/37ca2065e3684719944405ad06f41928` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.309868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ca2065e3684719944405ad06f41928)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.311943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.322717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a01b65-245e-4e74-9f4d-4469f4df16d3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.335452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.336386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.337027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.337459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.339311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.340614 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:32.340614 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:32.340614 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:32.342325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.348713 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3525/7040] 10.222.0.46 () {58 vars in 1360 bytes} [Sun Aug 21 01:38:32 2022] HEAD /identity/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:32.352831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.367575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353aad-a34a-458a-8f19-2e9b95ea352a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.385915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ca2065e3684719944405ad06f41928', 'request_id': 'req-65129b82-8c35-4577-a427-c6b0d017b77b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:32.396264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ca2065e3684719944405ad06f41928', 'request_id': 'req-65129b82-8c35-4577-a427-c6b0d017b77b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:32.404793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ca2065e3684719944405ad06f41928', 'request_id': 'req-65129b82-8c35-4577-a427-c6b0d017b77b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:32.426538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] The token cache is being invalidate because project 37ca2065e3684719944405ad06f41928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:32.426942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:32.427975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65129b82-8c35-4577-a427-c6b0d017b77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:32.433276 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3516/7041] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:32 2022] DELETE /identity/v3/projects/37ca2065e3684719944405ad06f41928 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:32.436888 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:32.438464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f640e-2ee0-4a09-8e03-18d485692b69 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.438909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f640e-2ee0-4a09-8e03-18d485692b69 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.439555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f640e-2ee0-4a09-8e03-18d485692b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.467495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.471196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.471579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.471951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.474000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27, role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.475675 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:32.475675 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:32.475675 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:32.476003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-af8f640e-2ee0-4a09-8e03-18d485692b69 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:32.477165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.477291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-af8f640e-2ee0-4a09-8e03-18d485692b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:32.490147 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3526/7042] 10.222.0.46 () {58 vars in 1362 bytes} [Sun Aug 21 01:38:32 2022] DELETE /identity/v3/system/users/d9bac9e4d7bb49d0a3d7449ff7e60d27/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:32.496345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.502538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:32.529692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc19a-f29c-431b-a98e-2419dd28c59d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.544720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.545539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.546272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.546683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.548506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.551147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.584405 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3527/7043] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:32 2022] POST /identity/v3/roles => generated 269 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:32.588523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.594689 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3517/7044] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:32.603483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8896b-c5c9-49cc-8e3d-03bdd6b3adf4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.603899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8896b-c5c9-49cc-8e3d-03bdd6b3adf4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.604260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8896b-c5c9-49cc-8e3d-03bdd6b3adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.609846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a4b27-3f08-4583-ae80-28768787a836 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.624882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.627504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.628106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.628481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.630945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.636274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.656566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-66b8896b-c5c9-49cc-8e3d-03bdd6b3adf4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:32.658080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-66b8896b-c5c9-49cc-8e3d-03bdd6b3adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:32.671270 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3518/7045] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:32.673665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8896b-c5c9-49cc-8e3d-03bdd6b3adf4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.689009 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3528/7046] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:32 2022] POST /identity/v3/roles => generated 270 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:32.692634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.697048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8896b-c5c9-49cc-8e3d-03bdd6b3adf4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.702782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.703628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.704150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.704531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.705336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:32.705772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.707518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.718945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbb302-122e-4f16-bbb9-c9df6e567059 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.732813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3519/7047] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:32.735696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.744437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.744729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.744881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.745135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/009ec7d0fc9e458eb3a4aab049f3abfb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.748468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9b747-5e53-49b8-9cbe-ca6ee43a35a8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.749713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5a3e4f29391d47a08d6eb7ae0969cd34, implied_role_id=009ec7d0fc9e458eb3a4aab049f3abfb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.751195 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:32.751195 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:32.751195 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:32.751739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.758556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.759280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.759741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.760021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.760792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.762814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:32.794450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3529/7048] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:32 2022] PUT /identity/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/009ec7d0fc9e458eb3a4aab049f3abfb => generated 530 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:32.798570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.821397 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3520/7049] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:32 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:32.824202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:32.879267 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:32.888272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6990c-5d68-40a8-8231-1513813dbb4f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.977636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a77a9-bad7-4df6-b4fb-55ea40b10d9a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:32.989967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:32.991549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:32.991851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:32.992289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:32.993057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:32.995028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.025196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.025968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.026929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.027321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.029427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.038444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.051765 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3521/7050] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:32 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:33.059680 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3530/7051] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:38:32 2022] POST /identity/v3/domains => generated 277 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:33.068094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.068507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.085683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3627c-975a-4f9d-97b0-a2317634f48a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.144442 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:33.190348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.191287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.191603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.192013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.192514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3bb7f-f9dd-452a-a0f9-21bab546b809 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.193685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.196629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.197703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.198356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.198638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.198923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.199602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.201362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.212612 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3522/7052] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:33 2022] GET /identity/v3/roles => generated 2322 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:33.216720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.224821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3531/7053] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:33 2022] POST /identity/v3/roles => generated 270 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:33.227906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f18a7-47e1-4d93-b31e-605702e77bb2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.229011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.235985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.236702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.237035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.237335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.238660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.240329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.250728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30ffe-8b30-4d41-97c7-c5ce4e9dc903 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.256793 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3523/7054] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:33 2022] GET /identity/v3/roles => generated 2322 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:33.257707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.257834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.259649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.260028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.260217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/5839f8ec805d41f89eb0071e64e08aac` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.265489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5a3e4f29391d47a08d6eb7ae0969cd34, implied_role_id=5839f8ec805d41f89eb0071e64e08aac)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.267242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.271448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c15ff-e049-4b1f-afa9-69be9f4d628f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.277041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8a99-daf2-4e17-9542-21d8df460c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.277927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8a99-daf2-4e17-9542-21d8df460c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.278268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8a99-daf2-4e17-9542-21d8df460c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.278803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8a99-daf2-4e17-9542-21d8df460c86 admin admin] PATH_INFO: `/v3/projects/e1cd67eee2174242ae1a6b6ec7558a24/users/6c50e4c0b3254b7bb73212bdeba2661e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.308799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8a99-daf2-4e17-9542-21d8df460c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cd67eee2174242ae1a6b6ec7558a24, user_id=6c50e4c0b3254b7bb73212bdeba2661e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.308799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8a99-daf2-4e17-9542-21d8df460c86 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.309113 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3532/7055] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:33 2022] PUT /identity/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/5839f8ec805d41f89eb0071e64e08aac => generated 530 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:33.309113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.321857 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3524/7056] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:33 2022] PUT /identity/v3/projects/e1cd67eee2174242ae1a6b6ec7558a24/users/6c50e4c0b3254b7bb73212bdeba2661e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:33.394294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6c643-8274-47da-a72e-de6b3f3a934b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.420477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919d66-ba15-42f1-b997-e99ef8d4bc40 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.420680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919d66-ba15-42f1-b997-e99ef8d4bc40 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.420968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919d66-ba15-42f1-b997-e99ef8d4bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.449486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1c919d66-ba15-42f1-b997-e99ef8d4bc40 None None] MFA Rules not processed for user `6c50e4c0b3254b7bb73212bdeba2661e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:33.450726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1c919d66-ba15-42f1-b997-e99ef8d4bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:33.466756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.467659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.468104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.468417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.470325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5a3e4f29391d47a08d6eb7ae0969cd34, implied_role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.472406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.507253 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3533/7057] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:33 2022] PUT /identity/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/bc2b27de09944e42a31127bf64e8ad89 => generated 525 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:33.509525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.556266 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:33.557435 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3525/7058] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:33.558602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919d66-ba15-42f1-b997-e99ef8d4bc40 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.577096 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:33.614498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7941-af1e-4d33-bbe5-433ef04dd51f tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.620839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.621746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.623871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.627397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/bc2b27de09944e42a31127bf64e8ad89/implies/5a3e4f29391d47a08d6eb7ae0969cd34` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.629671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bc2b27de09944e42a31127bf64e8ad89, implied_role_id=5a3e4f29391d47a08d6eb7ae0969cd34)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.631562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] 5a3e4f29391d47a08d6eb7ae0969cd34 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 5a3e4f29391d47a08d6eb7ae0969cd34 cannot be an implied roles. Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 21 01:38:33.658022 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 21 01:38:33.659197 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:33.659197 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:33.659197 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 21 01:38:33.659197 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 21 01:38:33.659197 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 5a3e4f29391d47a08d6eb7ae0969cd34 cannot be an implied roles. Aug 21 01:38:33.659197 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:33.664482 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3534/7059] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:33 2022] PUT /identity/v3/roles/bc2b27de09944e42a31127bf64e8ad89/implies/5a3e4f29391d47a08d6eb7ae0969cd34 => generated 116 bytes in 154 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:38:33.669675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.681417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48a62e-f556-4b4b-a108-b3056142ab72 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.695155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919d66-ba15-42f1-b997-e99ef8d4bc40 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.695787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.696560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.696944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.697296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.700048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5a3e4f29391d47a08d6eb7ae0969cd34, implied_role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.701245 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:33.701245 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:33.701245 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:33.702589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.722644 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3535/7060] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:33 2022] DELETE /identity/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:33.724827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.830698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.831975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.832304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.832803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.833316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.836325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.848592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19913650-3a7f-459a-93a6-b5a4d7b902fc tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:33.855038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:33.855845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:33.856990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:33.857372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/5839f8ec805d41f89eb0071e64e08aac` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:33.859283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5a3e4f29391d47a08d6eb7ae0969cd34, implied_role_id=5839f8ec805d41f89eb0071e64e08aac)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:33.861848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:33.887064 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3536/7061] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:33 2022] DELETE /identity/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/5839f8ec805d41f89eb0071e64e08aac => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:33.893064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3526/7062] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:33 2022] POST /identity/v3/projects => generated 367 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:33.895140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.897052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:33.992261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef4c3-17aa-420e-81b2-a7ec76786a78 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.009549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ee5b-76ee-4fa0-9847-6a31b9e2ba9b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.016157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.017373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.017655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.017931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.018552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.020648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.064079 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3527/7063] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:33 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:34.065127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.066362 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:34.078836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf8c6-e105-41f1-af01-61ca1d5f6468 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.091002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.092703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.094179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.094632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5839f8ec805d41f89eb0071e64e08aac` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.096469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.097796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.098165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.098464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.098670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5839f8ec805d41f89eb0071e64e08aac)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.100387 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:34.100387 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:34.100387 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:34.101352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.105130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.109027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.139517 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3528/7064] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:34 2022] GET /identity/v3/roles => generated 2322 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:34.141121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.157811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 5839f8ec805d41f89eb0071e64e08aac has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:34.158401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecf652-8759-488d-9e60-70579b4aa0e9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.159221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.161788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.163862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.164542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.164847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.165128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] PATH_INFO: `/v3/projects/7376788e17ec44668042e074a39ddab3/users/f63103ebda0b421d984c75abfc33915a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.166200 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3537/7065] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:33 2022] DELETE /identity/v3/roles/5839f8ec805d41f89eb0071e64e08aac => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:34.170478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.172092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:34.189041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7376788e17ec44668042e074a39ddab3, user_id=f63103ebda0b421d984c75abfc33915a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.193400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.218024 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:34.232877 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3529/7066] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:34 2022] PUT /identity/v3/projects/7376788e17ec44668042e074a39ddab3/users/f63103ebda0b421d984c75abfc33915a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:34.236950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.239504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:34.254899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc6b01-2d09-4d3a-80cc-20d6b910387b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.350242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.350780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.351157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.351933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/c3498a8bd56049baaefe5fef4bf16698` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.366692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c3498a8bd56049baaefe5fef4bf16698)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.369467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.393036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149e34-78ab-4a23-a5b8-1224952251cc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.398075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.398704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.398979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.399279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.399985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.401657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.412165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.413103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.420358 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3530/7067] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:34 2022] GET /identity/v3/roles => generated 2322 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:34.421495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.424023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:34.443394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983cb9c-9bcf-41bd-9504-df785c17bb68 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.450579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.451351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.454833 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3538/7068] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:34 2022] PATCH /identity/v3/domains/c3498a8bd56049baaefe5fef4bf16698 => generated 278 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:34.459043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.460660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:34.494221 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:34.541501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5883a0-c292-4481-a33d-c8eebc05d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.542202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5883a0-c292-4481-a33d-c8eebc05d66d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.542631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5883a0-c292-4481-a33d-c8eebc05d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.542912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5883a0-c292-4481-a33d-c8eebc05d66d admin admin] PATH_INFO: `/v3/projects/7376788e17ec44668042e074a39ddab3/users/f63103ebda0b421d984c75abfc33915a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.545322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5883a0-c292-4481-a33d-c8eebc05d66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7376788e17ec44668042e074a39ddab3, user_id=f63103ebda0b421d984c75abfc33915a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.548723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5883a0-c292-4481-a33d-c8eebc05d66d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.551264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d454-4725-4572-b0aa-46e42f01f0b8 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.556745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.557531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.557891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.558243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/c3498a8bd56049baaefe5fef4bf16698` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.568873 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3531/7069] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:34 2022] PUT /identity/v3/projects/7376788e17ec44668042e074a39ddab3/users/f63103ebda0b421d984c75abfc33915a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:34.572685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c3498a8bd56049baaefe5fef4bf16698)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.573845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6eb95-0407-4404-8c44-23cca38f678a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.574206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6eb95-0407-4404-8c44-23cca38f678a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.574485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6eb95-0407-4404-8c44-23cca38f678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.574725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.601947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.605763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.613886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d1a6eb95-0407-4404-8c44-23cca38f678a None None] MFA Rules not processed for user `f63103ebda0b421d984c75abfc33915a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:34.615545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1a6eb95-0407-4404-8c44-23cca38f678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:34.683579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698', 'request_id': 'req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.705561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698', 'request_id': 'req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.714394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698', 'request_id': 'req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.720342 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3532/7070] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:34.722792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6eb95-0407-4404-8c44-23cca38f678a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.736968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] The token cache is being invalidate because project c3498a8bd56049baaefe5fef4bf16698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:34.737827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.737975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.741265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6eb95-0407-4404-8c44-23cca38f678a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.750565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698', 'request_id': 'req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.752525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698', 'request_id': 'req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.753287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c3498a8bd56049baaefe5fef4bf16698', 'request_id': 'req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:34.760939 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:34.772497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3539/7071] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:34 2022] DELETE /identity/v3/domains/c3498a8bd56049baaefe5fef4bf16698 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:34.777810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.780223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:34.839098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.841419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.841784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.842393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.843275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.845975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:34.885235 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:34.894183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ef826-d804-4ae0-b26c-2a4de4fe7353 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:34.900922 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3533/7072] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:34 2022] POST /identity/v3/projects => generated 358 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:34.903542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:34.906295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:34.994605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:34.995293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:34.995642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:34.996010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/009ec7d0fc9e458eb3a4aab049f3abfb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:34.998254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5a3e4f29391d47a08d6eb7ae0969cd34, implied_role_id=009ec7d0fc9e458eb3a4aab049f3abfb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:34.999968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.015688 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3540/7073] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:34 2022] DELETE /identity/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34/implies/009ec7d0fc9e458eb3a4aab049f3abfb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:35.019919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701e88-aa2e-4d4c-8694-9f5c558cd64f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.020302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.099215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.100538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.101013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.101452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.102402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.105125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.130146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746e29-e21c-4682-8168-eb908d2739e1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.135821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.137243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.137738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.138361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/009ec7d0fc9e458eb3a4aab049f3abfb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.140033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=009ec7d0fc9e458eb3a4aab049f3abfb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.142457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.151874 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3534/7074] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:34 2022] POST /identity/v3/users => generated 416 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:35.153816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.166156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0948-36c4-4a1f-9cda-a7c895a8eb91 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.171141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.171790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.172119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.172548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/users/17fdf942e72644dc8c1ec059ba89f220` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.193659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_user(user_id=17fdf942e72644dc8c1ec059ba89f220)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.195940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.202195 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3535/7075] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:38:35 2022] GET /identity/v3/users/17fdf942e72644dc8c1ec059ba89f220 => generated 416 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:35.202374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 009ec7d0fc9e458eb3a4aab049f3abfb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:35.202374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.205331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.205780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.208711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:35.217960 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3541/7076] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:35 2022] DELETE /identity/v3/roles/009ec7d0fc9e458eb3a4aab049f3abfb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:35.218999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.221580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:35.227286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e0e5c-9ebd-411c-9e8a-d148ff16a83e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.249398 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:35.304714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88339fd-1431-4b4e-8e6f-befe4d4a12d1 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.306076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.306893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.307322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.307785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/users/17fdf942e72644dc8c1ec059ba89f220` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.309229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_user(user_id=17fdf942e72644dc8c1ec059ba89f220)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.310411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.311074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.311481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.311762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.312048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.313066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5a3e4f29391d47a08d6eb7ae0969cd34)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.315140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.324334 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:35.356330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 5a3e4f29391d47a08d6eb7ae0969cd34 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:35.356681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.357426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.359604 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3542/7077] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:35 2022] DELETE /identity/v3/roles/5a3e4f29391d47a08d6eb7ae0969cd34 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:35.365730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.367574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:35.373081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fdf942e72644dc8c1ec059ba89f220'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.385569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fdf942e72644dc8c1ec059ba89f220'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.409526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fdf942e72644dc8c1ec059ba89f220'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.411725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fdf942e72644dc8c1ec059ba89f220'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.424720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fdf942e72644dc8c1ec059ba89f220'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.439223 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3536/7078] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:35 2022] DELETE /identity/v3/users/17fdf942e72644dc8c1ec059ba89f220 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:35.444358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.446054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:35.455832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223f941-cc43-429e-8881-25af623af2af tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.538747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.539583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.539864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.540178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.541857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.543490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.571271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240349a-c906-414a-b834-3f36bf062402 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.581257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.583139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.583394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.583675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/a9a55b454c234a73a052eabe6df41a86` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.585345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9a55b454c234a73a052eabe6df41a86)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.588742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.599140 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3543/7079] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:35 2022] PUT /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 519 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:35.613843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.618982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:35.653311 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:35.662062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a55b454c234a73a052eabe6df41a86', 'request_id': 'req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.670753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a55b454c234a73a052eabe6df41a86', 'request_id': 'req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.680996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a55b454c234a73a052eabe6df41a86', 'request_id': 'req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.701601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project a9a55b454c234a73a052eabe6df41a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:35.701927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.702583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:35.706121 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3537/7080] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:35 2022] DELETE /identity/v3/projects/a9a55b454c234a73a052eabe6df41a86 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:35.711214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.713686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:35.715335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc42ff1-e55d-4cb9-9949-862242f94ff3 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.730582 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:35.815459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.816362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.816800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.817172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.824069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.825614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e82b8e-52d8-4a38-9aa5-063c883ca24d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.826178 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:35.826178 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:35.826178 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:35.827631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.829571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.831256 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:35.831256 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:35.831256 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:35.833007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.833579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.835915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.836358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.837790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.838988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.842352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.852860 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3544/7081] 10.222.0.46 () {58 vars in 1345 bytes} [Sun Aug 21 01:38:35 2022] HEAD /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:35.857104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.859284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:35.868160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3538/7082] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:35 2022] POST /identity/v3/projects => generated 348 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:35.870442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:35.873386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa77b1-8b0d-4a57-9bbb-eb76c8d65b71 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:35.967572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:35.968515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:35.969078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:35.969635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:35.972967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:35.975777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:35.987391 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3545/7083] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:38:35 2022] GET /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 519 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:35.991834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.002253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3b952-b29f-4208-a549-09cd8733dea0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.006815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8d1c-b46a-4af3-b3bb-fa26d4710fd9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.018185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.019144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.019523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.019925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.038530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.038714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.039591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.039883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.040159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.040937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:36.041247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.043063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.043180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.060823 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3539/7084] 10.222.0.46 () {58 vars in 1160 bytes} [Sun Aug 21 01:38:35 2022] GET /identity/v3/projects?is_domain=True => generated 1343 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:36.061976 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3546/7085] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:35 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:36.063644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.065515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.084864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f7633-0ce2-437b-a2ce-581c2775f616 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.157740 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:36.167816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.168800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.169240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.169918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.171003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.173288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.174048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67cedd-6ca9-444d-9a0c-62b264441f1a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.181027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.181739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.183937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.184244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.190861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.193666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.195914 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3540/7086] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:38:36 2022] GET /identity/v3/domains => generated 1094 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:36.199863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07.: keystone.exception.ImpliedRoleNotFound: 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07. Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = query.one() Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._iter().one() Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._only_one_row( Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:36.210583 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 21 01:38:36.212036 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 21 01:38:36.213044 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 21 01:38:36.213044 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07. Aug 21 01:38:36.213044 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:36.213236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f196cd9-5ce9-4145-bd33-a5a2b6754375 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.213324 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3547/7087] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:38:36 2022] GET /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 137 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:38:36.220404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.221356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.221640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.222081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/2a8ddca10e37496b8c4d4b14b84d5d1f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.223395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.223986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:update_project(project_id=2a8ddca10e37496b8c4d4b14b84d5d1f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.227899 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:36.227899 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:36.227899 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:36.228978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.241351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.242107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.242975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6b7ef-b48d-41b0-9587-d7ba9eb7a352 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.275134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.276075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.277517 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:36.279023 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3541/7088] 10.222.0.46 () {60 vars in 1252 bytes} [Sun Aug 21 01:38:36 2022] PATCH /identity/v3/projects/2a8ddca10e37496b8c4d4b14b84d5d1f => generated 362 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:36.283599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.285331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:36.317450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.318398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.318851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.319261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.321015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.323157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07.: keystone.exception.ImpliedRoleNotFound: 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07. Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = query.one() Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._iter().one() Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._only_one_row( Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:36.332731 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 21 01:38:36.333847 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 21 01:38:36.334841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 21 01:38:36.334841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 21 01:38:36.334841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 21 01:38:36.334841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 844d9780feb741a6bb3fde8658c0b3a9 does not imply 8d7028fd9aa44fa38af909e9a54cdb07. Aug 21 01:38:36.334841 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:36.334841 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3548/7089] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:36 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 137 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:38:36.340953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.343146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:36.356819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d99dd7-0b0b-4257-892c-82e28aee68c6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.363787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48f8f-ebb8-41c0-a9c7-bef39ae5cea2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.367896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.368803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.369105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.369422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.369734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.370482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.370857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.371224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/2a8ddca10e37496b8c4d4b14b84d5d1f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.371495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.373439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.387284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a8ddca10e37496b8c4d4b14b84d5d1f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.389257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.405995 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3549/7090] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:36 2022] PUT /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 519 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:36.410100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.419361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.424003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.491373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5253-773e-4c16-a7e0-ef0e6dca4719 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.495864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f', 'request_id': 'req-fee675ae-ee6d-4d72-b234-503a28156c7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.507992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f', 'request_id': 'req-fee675ae-ee6d-4d72-b234-503a28156c7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.520207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f', 'request_id': 'req-fee675ae-ee6d-4d72-b234-503a28156c7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.542258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project 2a8ddca10e37496b8c4d4b14b84d5d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:36.542553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.543301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.553229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f', 'request_id': 'req-fee675ae-ee6d-4d72-b234-503a28156c7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.554028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f', 'request_id': 'req-fee675ae-ee6d-4d72-b234-503a28156c7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.554666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2a8ddca10e37496b8c4d4b14b84d5d1f', 'request_id': 'req-fee675ae-ee6d-4d72-b234-503a28156c7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:36.559778 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:36.589358 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3542/7091] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:36 2022] DELETE /identity/v3/projects/2a8ddca10e37496b8c4d4b14b84d5d1f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:36.596639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.598858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:36.609053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.609933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.610492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.610979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.612991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=9f71b3fde0bc4c1db00dc99ec6344f03)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.614700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.654419 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3550/7092] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:36 2022] PUT /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03 => generated 520 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:36.658961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.662091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:36.708308 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:36.716387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee675ae-ee6d-4d72-b234-503a28156c7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.763063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92c7c-f804-4478-a1ee-e398cecdd925 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.768755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.769888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.770220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.770591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.773054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f71b3fde0bc4c1db00dc99ec6344f03, implied_role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.774955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.803507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.804485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.805277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.805830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.806561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.808910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.812690 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3551/7093] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:36 2022] PUT /identity/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89 => generated 521 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:36.817612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.847446 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3543/7094] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:36 2022] POST /identity/v3/projects => generated 358 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:36.851491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.910658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85090e25-b46f-4606-b1f9-41208b95ed8d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.946453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824bff-d4d5-4ac2-90b0-a2815530233a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.953255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:36.954587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:36.955093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:36.955502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/d80b8ad9a8f443e7812c06efd6c5846e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:36.957190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=d80b8ad9a8f443e7812c06efd6c5846e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:36.960344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:36.965294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3544/7095] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:36 2022] GET /identity/v3/projects/d80b8ad9a8f443e7812c06efd6c5846e => generated 358 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:36.966870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:36.988692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874f35-b2dd-467b-9344-778925932d59 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:36.999731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.000617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.000987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.001272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/d80b8ad9a8f443e7812c06efd6c5846e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.002287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.002433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d80b8ad9a8f443e7812c06efd6c5846e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.003279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.003741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.004201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.004442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.005266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.008169 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:37.008169 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:37.008169 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:37.010292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.037511 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3552/7096] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:38:36 2022] GET /identity/v3/role_inferences => generated 1606 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:37.042853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.050298 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:37.054802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbebee8-52ca-4445-9343-acbe116f5099 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.079072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80b8ad9a8f443e7812c06efd6c5846e', 'request_id': 'req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.089836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80b8ad9a8f443e7812c06efd6c5846e', 'request_id': 'req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.096603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80b8ad9a8f443e7812c06efd6c5846e', 'request_id': 'req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.115961 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:37.117993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project d80b8ad9a8f443e7812c06efd6c5846e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:37.118200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.119257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.129259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3545/7097] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:36 2022] DELETE /identity/v3/projects/d80b8ad9a8f443e7812c06efd6c5846e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:37.137186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.137968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:37.145534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.146240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.146513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.147339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.148848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f71b3fde0bc4c1db00dc99ec6344f03, implied_role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.150740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.179870 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3553/7098] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:37 2022] DELETE /identity/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:37.185736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.189395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:37.223427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc1d7-0223-47ce-9fdf-d85d0b800cd7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.274987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7390069-1a87-47fd-b4fd-9ce0b45a2338 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.280616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.281352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.282308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.282732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.284618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=9f71b3fde0bc4c1db00dc99ec6344f03)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.287078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.288691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.289308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.289590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.289864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.290496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.292531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.299458 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3554/7099] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:37 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:37.305133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.344621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3546/7100] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:37 2022] POST /identity/v3/projects => generated 360 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:37.349088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.389847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4777d-e606-444b-9f1f-8dd7e8e7175a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.438894 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:37.463358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d89d8-022c-438f-9738-80b87a830e7f tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.472318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.473206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.473551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.473829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/48f04d3f5d1943f7ab8e77249f1ef243` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.475519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=48f04d3f5d1943f7ab8e77249f1ef243)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.478516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.484290 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3547/7101] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:37 2022] GET /identity/v3/projects/48f04d3f5d1943f7ab8e77249f1ef243 => generated 360 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:37.485656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.487456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.489125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.490135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.490636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.493755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.496456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.497818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9cb04-51fb-4433-b482-d157484eb383 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.507483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.507941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.508231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.508589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/48f04d3f5d1943f7ab8e77249f1ef243` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.511088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3555/7102] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:37 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:37.516437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.522979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48f04d3f5d1943f7ab8e77249f1ef243)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.525677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.552815 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:37.609501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f45f6-5dc0-45f1-9913-bbb2b7acfbda tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.631656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f04d3f5d1943f7ab8e77249f1ef243', 'request_id': 'req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.642384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f04d3f5d1943f7ab8e77249f1ef243', 'request_id': 'req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.666412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f04d3f5d1943f7ab8e77249f1ef243', 'request_id': 'req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.696177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.696851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.697148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.697415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.698065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.699731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.707707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project 48f04d3f5d1943f7ab8e77249f1ef243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:37.708519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.711425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:37.718922 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3556/7103] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:37 2022] GET /identity/v3/roles => generated 2322 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:37.719244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3548/7104] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:37 2022] DELETE /identity/v3/projects/48f04d3f5d1943f7ab8e77249f1ef243 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:37.719475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.723551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:37.723730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.725928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:37.741987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267e61-795f-4dbb-b55e-b35bdc120251 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.749152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.749908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.750222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.750500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.751423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.753268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.775092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3557/7105] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:38:37 2022] POST /identity/v3/roles => generated 235 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:37.779426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.803981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf14f1-3862-4016-8a87-d6ba383a65a9 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.812245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.812987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.813319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.813599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/45426d0716234933a0b638d697664d95` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.815310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:update_role(role_id=45426d0716234933a0b638d697664d95)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.816972 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:37.816972 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:37.816972 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:37.818623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.830639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dcdd0-7cce-4d0d-b368-ae892c5b80e8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.837517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.839263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.839552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.839982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.840625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.851725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.857062 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3558/7106] 10.222.0.46 () {60 vars in 1243 bytes} [Sun Aug 21 01:38:37 2022] PATCH /identity/v3/roles/45426d0716234933a0b638d697664d95 => generated 236 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:37.859182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.878223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4868128-ff0d-4bc6-842e-b2b5bdbe1395 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.884526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:37.885320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:37.885615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:37.885890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/45426d0716234933a0b638d697664d95` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:37.897590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:get_role(role_id=45426d0716234933a0b638d697664d95)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:37.898801 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:37.898801 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:37.898801 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:37.899711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:37.901103 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3549/7107] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:38:37 2022] POST /identity/v3/projects => generated 348 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:37.901735 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3559/7108] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:38:37 2022] GET /identity/v3/roles/45426d0716234933a0b638d697664d95 => generated 236 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:37.902234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.905340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:37.918157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293910c-a590-4146-9b55-6380f741c5cd tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.987736 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:37.994443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccccc9-917a-4b76-aa18-72a69461bad7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:37.999992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.002469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.002943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.003073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.003712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.005429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.007523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.008825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.009734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.010194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/a84c7b52931748d2a0515b36b32c5e0d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.012681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=a84c7b52931748d2a0515b36b32c5e0d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.016943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.019261 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3560/7109] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:37 2022] GET /identity/v3/roles => generated 2549 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:38.019958 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3550/7110] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:37 2022] GET /identity/v3/projects/a84c7b52931748d2a0515b36b32c5e0d => generated 348 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:38.023227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.024596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.037368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67911ea-8191-48cc-a828-dadc92f20b6d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.042472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863a71-7add-4281-bfc1-4dfcb561556e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.045068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.046029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.046243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.046446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/45426d0716234933a0b638d697664d95` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.048459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_role(role_id=45426d0716234933a0b638d697664d95)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.050569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.050901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.051545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.051824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.052094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/a84c7b52931748d2a0515b36b32c5e0d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.053411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a84c7b52931748d2a0515b36b32c5e0d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.055559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.067110 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:38.104378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 45426d0716234933a0b638d697664d95 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:38.104968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.105349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.107941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3561/7111] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:38 2022] DELETE /identity/v3/roles/45426d0716234933a0b638d697664d95 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:38.113170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.115117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:38.123395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84c7b52931748d2a0515b36b32c5e0d', 'request_id': 'req-4171a840-f538-48ad-a099-7aa9fb598c7c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.132969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84c7b52931748d2a0515b36b32c5e0d', 'request_id': 'req-4171a840-f538-48ad-a099-7aa9fb598c7c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.139801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84c7b52931748d2a0515b36b32c5e0d', 'request_id': 'req-4171a840-f538-48ad-a099-7aa9fb598c7c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.157022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project a84c7b52931748d2a0515b36b32c5e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:38.157381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.159014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.165786 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3551/7112] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:38 2022] DELETE /identity/v3/projects/a84c7b52931748d2a0515b36b32c5e0d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:38.166830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.168426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:38.193904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1f6d-d46e-4a96-8a19-8d505286dfb4 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.198608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.199295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.199567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.199846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.201742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.203095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.241299 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3562/7113] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:38 2022] PUT /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 519 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:38.245614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.247584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:38.277141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a840-f538-48ad-a099-7aa9fb598c7c tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.356195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08497f54-b668-462a-9578-99a1bf476346 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.363483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.364464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.364992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.365471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.368212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=9f71b3fde0bc4c1db00dc99ec6344f03)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.370719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.374858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.376953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.378306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.380332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.381158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.383441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.401640 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3563/7114] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:38 2022] PUT /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03 => generated 520 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:38.405632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.409424 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3552/7115] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:38:38 2022] POST /identity/v3/domains => generated 276 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:38.414581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.455152 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:38.476810 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:38.514183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7145-ae63-4a7c-b7c3-b908578b1c29 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.532895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5d16-07f3-4928-b96b-f52fd4250cd6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.539078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.540030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.540215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.540602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.541382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.543479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.594522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.595370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.595700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.596002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.598215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f71b3fde0bc4c1db00dc99ec6344f03, implied_role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.602343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.603534 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3553/7116] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:38 2022] POST /identity/v3/projects => generated 403 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:38.605475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.644366 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3564/7117] 10.222.0.46 () {60 vars in 1363 bytes} [Sun Aug 21 01:38:38 2022] PUT /identity/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89 => generated 521 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:38.651098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.729701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790882a-5640-468e-a723-a9edc3cb3f82 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.803689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b634e-1ad0-4909-ac0d-30dbce69809d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.809740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.810401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.810733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.811005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.812150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=9f71b3fde0bc4c1db00dc99ec6344f03)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.813573 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:38.813573 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:38.813573 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:38.814475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.821450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3565/7118] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:38:38 2022] GET /identity/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies => generated 490 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:38.825215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.840851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ece64-d822-4ae8-9b84-0960f0b9d1ee tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.847183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.848073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.849343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.849780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.851826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.853718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.865088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3566/7119] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:38:38 2022] GET /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies => generated 659 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:38.866513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.871541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.872213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.872488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.872778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/16cebec31b624cbb980a5d746fba831a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.873974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=16cebec31b624cbb980a5d746fba831a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.876220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.878236 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3554/7120] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:38 2022] GET /identity/v3/projects/16cebec31b624cbb980a5d746fba831a => generated 403 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:38.882338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe229fb-1e60-48b4-8034-3e031b63c207 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.886567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.888458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.889505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.890000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.890452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.893480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f71b3fde0bc4c1db00dc99ec6344f03, implied_role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.897128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.898880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3649d7c-6463-4762-8dbd-8f07f16d4547 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:38.905634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:38.906534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:38.906981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:38.908130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/16cebec31b624cbb980a5d746fba831a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:38.909878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16cebec31b624cbb980a5d746fba831a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:38.912497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:38.916192 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3567/7121] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:38 2022] DELETE /identity/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03/implies/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:38.920063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:38.979317 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:38.983119 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:38.987977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cebec31b624cbb980a5d746fba831a', 'request_id': 'req-a202aebf-6369-47a4-984e-f1744233dc2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:38.995950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cebec31b624cbb980a5d746fba831a', 'request_id': 'req-a202aebf-6369-47a4-984e-f1744233dc2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.004146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8cdb1-8f79-4606-99d5-289e393e017b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.005705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cebec31b624cbb980a5d746fba831a', 'request_id': 'req-a202aebf-6369-47a4-984e-f1744233dc2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.021094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project 16cebec31b624cbb980a5d746fba831a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:39.021281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.021953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.025247 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3555/7122] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:38 2022] DELETE /identity/v3/projects/16cebec31b624cbb980a5d746fba831a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:39.027723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.029089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.070307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.070969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.071248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.071519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.073231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=9f71b3fde0bc4c1db00dc99ec6344f03)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:39.074827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:39.087431 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3568/7123] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:38 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/9f71b3fde0bc4c1db00dc99ec6344f03 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:39.091966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.096454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.099704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202aebf-6369-47a4-984e-f1744233dc2b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.173415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107569b3-5845-4832-8337-f429427ea820 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.179415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.180484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.180993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.181424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.181709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.182072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.182500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.182777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains/bb25075e035e4b49bec312b0b29e9705` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.183826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=844d9780feb741a6bb3fde8658c0b3a9, implied_role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:39.184324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bb25075e035e4b49bec312b0b29e9705)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:39.185727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:39.187734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:39.199055 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3569/7124] 10.222.0.46 () {58 vars in 1347 bytes} [Sun Aug 21 01:38:39 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9/implies/8d7028fd9aa44fa38af909e9a54cdb07 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:39.204441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.218475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.219565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.268845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.269620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.277062 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3556/7125] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:39 2022] PATCH /identity/v3/domains/bb25075e035e4b49bec312b0b29e9705 => generated 277 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:39.278504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.280550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.293558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed704-3682-4bf9-90a6-93fffe57097a tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.330303 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:39.348418 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:39.373713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c2f2-3129-42f0-bf8e-4f5b7bbc9fe0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.378045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.379591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.379876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.380000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.380999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.381292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.381477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/c3498a8bd56049baaefe5fef4bf16698` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.381874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains/bb25075e035e4b49bec312b0b29e9705` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.390637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:38:39.395881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bb25075e035e4b49bec312b0b29e9705)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Could not find domain: c3498a8bd56049baaefe5fef4bf16698.: keystone.exception.DomainNotFound: Could not find domain: c3498a8bd56049baaefe5fef4bf16698. Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c3498a8bd56049baaefe5fef4bf16698. Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:39.396462 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:39.397637 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c3498a8bd56049baaefe5fef4bf16698. Aug 21 01:38:39.398641 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:39.399681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:39.399761 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3570/7126] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:39 2022] PATCH /identity/v3/domains/c3498a8bd56049baaefe5fef4bf16698 => generated 112 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:38:39.402015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.403875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.419870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787632-54bf-4717-b94f-306206a83980 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.426957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.427701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.428177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.428520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/users/d9bac9e4d7bb49d0a3d7449ff7e60d27` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.429810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d9bac9e4d7bb49d0a3d7449ff7e60d27)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:39.430949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.432595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:39.437564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.499202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bac9e4d7bb49d0a3d7449ff7e60d27'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.508827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705', 'request_id': 'req-61aa5c60-3300-4327-a2df-95bbed7711ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.513505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bac9e4d7bb49d0a3d7449ff7e60d27'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.514340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bac9e4d7bb49d0a3d7449ff7e60d27'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.518953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705', 'request_id': 'req-61aa5c60-3300-4327-a2df-95bbed7711ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.525354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bac9e4d7bb49d0a3d7449ff7e60d27'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.526508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bac9e4d7bb49d0a3d7449ff7e60d27'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.529220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705', 'request_id': 'req-61aa5c60-3300-4327-a2df-95bbed7711ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.551178 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3571/7127] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:39 2022] DELETE /identity/v3/users/d9bac9e4d7bb49d0a3d7449ff7e60d27 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:39.554643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project bb25075e035e4b49bec312b0b29e9705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:39.555169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.556221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.556804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.561037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.572384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705', 'request_id': 'req-61aa5c60-3300-4327-a2df-95bbed7711ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.574324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705', 'request_id': 'req-61aa5c60-3300-4327-a2df-95bbed7711ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.575669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bb25075e035e4b49bec312b0b29e9705', 'request_id': 'req-61aa5c60-3300-4327-a2df-95bbed7711ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.596671 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3557/7128] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:39 2022] DELETE /identity/v3/domains/bb25075e035e4b49bec312b0b29e9705 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:39.602412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.604158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.716588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa5c60-3300-4327-a2df-95bbed7711ed tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.740977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f0bb1-d902-4b29-acb3-b5ee3b685d61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:39.747177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.747867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.748152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.748426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/bc2b27de09944e42a31127bf64e8ad89` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.749895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bc2b27de09944e42a31127bf64e8ad89)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:39.752490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:39.771485 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:39.861154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:39.861801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:39.862081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:39.862356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:39.863022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:39.865045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:39.870586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role bc2b27de09944e42a31127bf64e8ad89 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:39.870888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.871919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:39.877515 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3572/7129] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:39 2022] DELETE /identity/v3/roles/bc2b27de09944e42a31127bf64e8ad89 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:39.881363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.885816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.892164 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3558/7130] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:38:39 2022] POST /identity/v3/domains => generated 276 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:39.897252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:39.902569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:39.908648 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:40.025262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e386-a4c2-4ed2-8134-246587beba6d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.032981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:40.033715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:40.034886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:40.035188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:40.036270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:40.039218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:40.077500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec81b3-6ba3-4f81-84f6-720346941b61 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.150652 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3559/7131] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:39 2022] POST /identity/v3/projects => generated 410 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:40.159170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:40.179665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:40.180524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:40.180944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:40.181364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/groups/03d76b0d665f460caa66b3e09d76d12d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:40.182984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_group(group_id=03d76b0d665f460caa66b3e09d76d12d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:40.185495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:40.277471 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3573/7132] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:38:39 2022] DELETE /identity/v3/groups/03d76b0d665f460caa66b3e09d76d12d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:40.283781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:40.355639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbb3ed-3453-4eeb-8ff0-a1b072b2d128 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.393139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a31a-71b1-43eb-853a-ac91b750823b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.403085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:40.404085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:40.405872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:40.406583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:40.408931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd99e3ebce1f4af2b8b5f9c5fe212ec2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:40.412539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:40.441432 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:40.462025 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:40.499388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd99e3ebce1f4af2b8b5f9c5fe212ec2', 'request_id': 'req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.500933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:40.501529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:40.501980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:40.502259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:40.502921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:40.505606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:40.516626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd99e3ebce1f4af2b8b5f9c5fe212ec2', 'request_id': 'req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.528113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd99e3ebce1f4af2b8b5f9c5fe212ec2', 'request_id': 'req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.549888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] The token cache is being invalidate because project cd99e3ebce1f4af2b8b5f9c5fe212ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:40.550179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.551187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.553349 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3560/7134] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:40 2022] POST /identity/v3/projects => generated 404 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:40.557368 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3574/7134] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:40 2022] DELETE /identity/v3/projects/cd99e3ebce1f4af2b8b5f9c5fe212ec2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:40.558003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:40.558247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:40.560227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:40.560607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:40.661768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9d6ca-ea37-4bf4-a651-7a1b24045008 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.676864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8ad3-0a52-4fce-8c37-3c5742ced613 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.683952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:40.685587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:40.686262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:40.686748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/f70b3b73e5764852911bafc3bc670801` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:40.688694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f70b3b73e5764852911bafc3bc670801)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:40.691487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:40.739156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:40.739893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:40.740258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:40.740597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:40.742521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dc05591c8d0f4643b12b3bb664b39a19)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:40.744502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:40.778921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.780562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.783162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70b3b73e5764852911bafc3bc670801', 'request_id': 'req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.793493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70b3b73e5764852911bafc3bc670801', 'request_id': 'req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.832059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70b3b73e5764852911bafc3bc670801', 'request_id': 'req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.835259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.836693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.839967 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3575/7135] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:40 2022] PATCH /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19 => generated 277 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:40.844053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:40.846553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:40.849816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project f70b3b73e5764852911bafc3bc670801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:40.849816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.850570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:40.855702 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3561/7136] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:40 2022] DELETE /identity/v3/projects/f70b3b73e5764852911bafc3bc670801 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:40.857264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:40.858989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:40.876239 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:40.938720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928f88-b0be-41e5-a76f-a35ef33425a5 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.950284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:40.951013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:40.951298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:40.951633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/domains/dc05591c8d0f4643b12b3bb664b39a19` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:40.958184 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:40.966373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85eaf1-a1f7-4034-856d-2ee77fc1ec4b tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:40.973496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dc05591c8d0f4643b12b3bb664b39a19)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:40.977707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:41.017011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.023669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.085543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:41.086449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:41.086921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:41.087274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/31123d2a48e1421f952f502e45396523` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:41.088917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=31123d2a48e1421f952f502e45396523)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:41.091101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:41.102416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19', 'request_id': 'req-4244300f-bb9f-4390-8f9a-5191b7269141'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.115794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19', 'request_id': 'req-4244300f-bb9f-4390-8f9a-5191b7269141'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.123670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19', 'request_id': 'req-4244300f-bb9f-4390-8f9a-5191b7269141'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.144254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] The token cache is being invalidate because project dc05591c8d0f4643b12b3bb664b39a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:41.144538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.146208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.156648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19', 'request_id': 'req-4244300f-bb9f-4390-8f9a-5191b7269141'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.158014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19', 'request_id': 'req-4244300f-bb9f-4390-8f9a-5191b7269141'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.158685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dc05591c8d0f4643b12b3bb664b39a19', 'request_id': 'req-4244300f-bb9f-4390-8f9a-5191b7269141'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.172641 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3576/7137] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:40 2022] DELETE /identity/v3/domains/dc05591c8d0f4643b12b3bb664b39a19 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:41.177084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:41.179060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:41.187433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31123d2a48e1421f952f502e45396523', 'request_id': 'req-0c3e5045-8621-471e-b6a2-abd4975f5d69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.197518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31123d2a48e1421f952f502e45396523', 'request_id': 'req-0c3e5045-8621-471e-b6a2-abd4975f5d69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.223019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31123d2a48e1421f952f502e45396523', 'request_id': 'req-0c3e5045-8621-471e-b6a2-abd4975f5d69'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.255101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project 31123d2a48e1421f952f502e45396523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:41.255440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.256137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.257928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3562/7138] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:40 2022] DELETE /identity/v3/projects/31123d2a48e1421f952f502e45396523 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:41.262414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:41.263289 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:41.265719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:41.287546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244300f-bb9f-4390-8f9a-5191b7269141 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:41.376180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5045-8621-471e-b6a2-abd4975f5d69 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:41.382749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:41.383997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:41.384494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:41.385055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains/a39e9f040aa94fbdb528554873f61e45` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:41.386718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a39e9f040aa94fbdb528554873f61e45)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:41.388747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:41.399903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:41.400619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:41.400944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:41.401226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:41.402666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9f71b3fde0bc4c1db00dc99ec6344f03)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:41.405280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:41.428205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.429373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.462617 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:41.464333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 9f71b3fde0bc4c1db00dc99ec6344f03 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:41.465026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.466149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.473188 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3577/7139] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:41 2022] DELETE /identity/v3/roles/9f71b3fde0bc4c1db00dc99ec6344f03 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:41.474364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:41.476194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.476516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:41.478309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.486215 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3563/7140] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:41 2022] PATCH /identity/v3/domains/a39e9f040aa94fbdb528554873f61e45 => generated 277 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:41.488309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:41.492710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:41.608092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f994-8eb9-4c50-92f3-5ec059680b79 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:41.635662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1224-9627-41e2-aa30-9643e538ec7d tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:41.648136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:41.648840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:41.649122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:41.649396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/8d7028fd9aa44fa38af909e9a54cdb07` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:41.651859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8d7028fd9aa44fa38af909e9a54cdb07)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:41.655580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:41.732014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 8d7028fd9aa44fa38af909e9a54cdb07 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:41.732317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.733170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.743782 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3578/7141] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:41 2022] DELETE /identity/v3/roles/8d7028fd9aa44fa38af909e9a54cdb07 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:41.744809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:41.747478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:41.749511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:41.750203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:41.750555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:41.750916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains/a39e9f040aa94fbdb528554873f61e45` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:41.775278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a39e9f040aa94fbdb528554873f61e45)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:41.779672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:41.814454 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:41.831040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.835619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.886037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620ba1-f17c-45a0-8f30-2acd9ead04a6 tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:41.914532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45', 'request_id': 'req-81ddea1f-11ae-45c4-8449-9cbc805991f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.957153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45', 'request_id': 'req-81ddea1f-11ae-45c4-8449-9cbc805991f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.973733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45', 'request_id': 'req-81ddea1f-11ae-45c4-8449-9cbc805991f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.975665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a74fe1f5c954942a25f55fb2b07c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5751075de2bc41d7ba71a925074efad8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:41.976901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:41.977282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:41.977815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] PATH_INFO: `/v3/roles/844d9780feb741a6bb3fde8658c0b3a9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:41.980576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorizing `identity:delete_role(role_id=844d9780feb741a6bb3fde8658c0b3a9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:41.984128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:41.997943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project a39e9f040aa94fbdb528554873f61e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:41.998564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:41.999502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.010378 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:42.030763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45', 'request_id': 'req-81ddea1f-11ae-45c4-8449-9cbc805991f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.031549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45', 'request_id': 'req-81ddea1f-11ae-45c4-8449-9cbc805991f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.032282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a39e9f040aa94fbdb528554873f61e45', 'request_id': 'req-81ddea1f-11ae-45c4-8449-9cbc805991f7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.048293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invalidating the token cache because role 844d9780feb741a6bb3fde8658c0b3a9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:42.048293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.048646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.062198 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3579/7142] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:41 2022] DELETE /identity/v3/roles/844d9780feb741a6bb3fde8658c0b3a9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:42.073842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:42.076258 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3564/7143] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:41 2022] DELETE /identity/v3/domains/a39e9f040aa94fbdb528554873f61e45 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:42.077286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:42.080063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:42.087968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:42.275444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddea1f-11ae-45c4-8449-9cbc805991f7 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:42.318450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad86f5-bd74-4f5a-bf2e-eb04e5afcf3b tempest-RolesV3TestJSON-816040653 tempest-RolesV3TestJSON-816040653-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:42.339538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:42.340284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:42.340625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:42.340944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] PATH_INFO: `/v3/users/433d31cbf77549c993aceb188c5525fe` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:42.342335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] RBAC: Authorizing `identity:delete_user(user_id=433d31cbf77549c993aceb188c5525fe)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:42.346891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:42.372971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:42.374515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:42.375687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:42.376872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:42.382051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:42.386553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:42.454956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3565/7144] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:42 2022] POST /identity/v3/projects => generated 377 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:42.460116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:42.464060 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:42.465947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:42.466424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433d31cbf77549c993aceb188c5525fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.481893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433d31cbf77549c993aceb188c5525fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.482682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433d31cbf77549c993aceb188c5525fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.497031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433d31cbf77549c993aceb188c5525fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.497825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7b115794-b0d2-4d5b-8b89-45592ce6513d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433d31cbf77549c993aceb188c5525fe'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.525831 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3580/7145] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:42 2022] DELETE /identity/v3/users/433d31cbf77549c993aceb188c5525fe => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:42.530354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:42.530770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:42.531475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:42.602510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:42.604306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:42.635991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58c2f-8785-479b-bb2f-3ac653a53901 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:42.679153 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:42.737719 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3581/7146] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:42.748152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:42.749789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:42.751094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:42.752069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:42.752499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:42.753559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/0d9f24e144e34a6b8bb26c30ac875bdd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:42.756252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d9f24e144e34a6b8bb26c30ac875bdd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:42.760089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:42.762133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3566/7147] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:42 2022] GET /identity/v3/projects/0d9f24e144e34a6b8bb26c30ac875bdd => generated 377 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:42.766060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:42.771212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:42.802359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc68e2-bcdc-45e2-adde-d83b623930c1 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:42.808617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:42.809584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:42.810491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:42.810491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:42.811196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:42.813739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:42.836338 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3567/7148] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:38:42 2022] GET /identity/v3/projects => generated 5423 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:42.841007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:42.854866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a35bcf-ad3f-48c8-8e01-30d0cec5d7a0 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:42.855082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6aae2-0353-4795-97cc-46e6e8dc4e1c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:42.860811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:42.861695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:42.862469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:42.862940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:42.863396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:42.863521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:42.863818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:42.864163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/0d9f24e144e34a6b8bb26c30ac875bdd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:42.865429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d9f24e144e34a6b8bb26c30ac875bdd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:42.867839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:42.883164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:42.884962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:42.902590 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3582/7149] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:38:42.944950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9f24e144e34a6b8bb26c30ac875bdd', 'request_id': 'req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.953958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9f24e144e34a6b8bb26c30ac875bdd', 'request_id': 'req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.965471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9f24e144e34a6b8bb26c30ac875bdd', 'request_id': 'req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.994852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project 0d9f24e144e34a6b8bb26c30ac875bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:42.995586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:42.996666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.002793 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3568/7150] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:42 2022] DELETE /identity/v3/projects/0d9f24e144e34a6b8bb26c30ac875bdd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:43.004954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.037398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b4b57-2ad3-4b60-9b32-d53694732589 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:43.141021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:43.141859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:43.142158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:43.143182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:43.143417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:43.145832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:43.167589 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:43.197288 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3583/7151] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:38:43 2022] POST /identity/v3/projects => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:43.201724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.203237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:43.217666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbc9d0-bb34-4ed7-8478-6fc05f6c10ad tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:43.314740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:43.315409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:43.315692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:43.315968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/b46897addc6c4f03849fdd834cd92fc6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:43.317209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:update_project(project_id=b46897addc6c4f03849fdd834cd92fc6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:43.319340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:43.376819 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3569/7152] 10.222.0.46 () {60 vars in 1252 bytes} [Sun Aug 21 01:38:43 2022] PATCH /identity/v3/projects/b46897addc6c4f03849fdd834cd92fc6 => generated 360 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:43.378979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.390496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdc782-e83c-4d5a-871d-9d29639cab29 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:43.396231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:43.397031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:43.397328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:43.397650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/b46897addc6c4f03849fdd834cd92fc6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:43.428584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=b46897addc6c4f03849fdd834cd92fc6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:43.431300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:43.437521 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3584/7153] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:43 2022] GET /identity/v3/projects/b46897addc6c4f03849fdd834cd92fc6 => generated 347 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:43.442114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.450723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.452792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:43.455731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04cd42-cefe-4e82-b578-bdff09406670 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:43.469125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:43.469984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:43.470346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:43.470724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/b46897addc6c4f03849fdd834cd92fc6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:43.473299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b46897addc6c4f03849fdd834cd92fc6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:43.475490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:43.491166 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:43.589557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46897addc6c4f03849fdd834cd92fc6', 'request_id': 'req-817ebd81-b84a-43e0-8495-63cdb89539fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.600535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46897addc6c4f03849fdd834cd92fc6', 'request_id': 'req-817ebd81-b84a-43e0-8495-63cdb89539fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.609366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc752-d693-4775-bf3c-f3ee2de99c74 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:43.631881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46897addc6c4f03849fdd834cd92fc6', 'request_id': 'req-817ebd81-b84a-43e0-8495-63cdb89539fe'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.661991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project b46897addc6c4f03849fdd834cd92fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:43.662286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.668262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.675211 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3570/7154] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:43 2022] DELETE /identity/v3/projects/b46897addc6c4f03849fdd834cd92fc6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:43.676530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.678962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:43.753448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:43.754201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:43.754574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:43.754958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] PATH_INFO: `/v3/projects/6378a6df1f5d4732b24de6f9d8178359` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:43.756284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6378a6df1f5d4732b24de6f9d8178359)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:43.760703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:43.791063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd81-b84a-43e0-8495-63cdb89539fe tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:43.797386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:43.798369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:43.798804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:43.799274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:43.800567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:43.803035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:43.865404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6378a6df1f5d4732b24de6f9d8178359', 'request_id': 'req-a7f224e8-52e9-4a39-b333-51b0ab82895a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.877340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6378a6df1f5d4732b24de6f9d8178359', 'request_id': 'req-a7f224e8-52e9-4a39-b333-51b0ab82895a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.879332 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3571/7155] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:43 2022] POST /identity/v3/projects => generated 359 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:43.886083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.889549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6378a6df1f5d4732b24de6f9d8178359', 'request_id': 'req-a7f224e8-52e9-4a39-b333-51b0ab82895a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.909495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] The token cache is being invalidate because project 6378a6df1f5d4732b24de6f9d8178359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:43.910113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.912188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:43.918145 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3585/7156] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:43 2022] DELETE /identity/v3/projects/6378a6df1f5d4732b24de6f9d8178359 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:43.920017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:43.921709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:43.947154 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:44.012564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8298ae-f480-41c3-8717-d4f36ab4d202 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.020520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.021366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.022414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:44.023335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/41e9820370744ecebf7083159977da95` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:44.025143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:update_project(project_id=41e9820370744ecebf7083159977da95)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:44.030000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:44.040545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f224e8-52e9-4a39-b333-51b0ab82895a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.079855 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:44.132015 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3572/7157] 10.222.0.46 () {60 vars in 1252 bytes} [Sun Aug 21 01:38:43 2022] PATCH /identity/v3/projects/41e9820370744ecebf7083159977da95 => generated 371 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:44.135801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:44.140303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:44.143524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.144416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.144870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:44.145239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] PATH_INFO: `/v3/users/6a74fe1f5c954942a25f55fb2b07c4ce` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:44.146575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a74fe1f5c954942a25f55fb2b07c4ce)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:44.148735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:44.174517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102fa4e-846d-4f65-9f3a-93da510e415d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.188963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.189648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.189929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:44.190202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/41e9820370744ecebf7083159977da95` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:44.211859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=41e9820370744ecebf7083159977da95)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:44.216410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:44.223361 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3573/7158] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:44 2022] GET /identity/v3/projects/41e9820370744ecebf7083159977da95 => generated 358 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:44.233761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:44.246975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a74fe1f5c954942a25f55fb2b07c4ce'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.248124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea716f01-ff24-45c2-b722-4e40619e87b6 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.259015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a74fe1f5c954942a25f55fb2b07c4ce'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.260180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a74fe1f5c954942a25f55fb2b07c4ce'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.265904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.268952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a74fe1f5c954942a25f55fb2b07c4ce'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.270105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a74fe1f5c954942a25f55fb2b07c4ce'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.270847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.270847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:44.272159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/41e9820370744ecebf7083159977da95` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:44.275781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41e9820370744ecebf7083159977da95)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:44.277805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:44.306243 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3586/7159] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:43 2022] DELETE /identity/v3/users/6a74fe1f5c954942a25f55fb2b07c4ce => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:44.360946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e9820370744ecebf7083159977da95', 'request_id': 'req-41da8850-0ac2-4bdc-b4c3-f6706db654c2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.370789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e9820370744ecebf7083159977da95', 'request_id': 'req-41da8850-0ac2-4bdc-b4c3-f6706db654c2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.378650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e9820370744ecebf7083159977da95', 'request_id': 'req-41da8850-0ac2-4bdc-b4c3-f6706db654c2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.416759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project 41e9820370744ecebf7083159977da95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:44.417209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.418738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:44.429622 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3574/7160] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:44 2022] DELETE /identity/v3/projects/41e9820370744ecebf7083159977da95 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:44.431201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:44.432870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:44.534896 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:44.575933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a59ce7-6144-4a47-a7d1-ff3b4c16ddf1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.651245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.652120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.652610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:44.653153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:44.654093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:44.656854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:44.705799 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3587/7161] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:44 2022] POST /identity/v3/projects => generated 354 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:44.707290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:44.709360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:44.725130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da8850-0ac2-4bdc-b4c3-f6706db654c2 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.819724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:44.822595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:44.849669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.850326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.850602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:44.853211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/6b63eecab18d4982b90e721e96379d01` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:44.855961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:update_project(project_id=6b63eecab18d4982b90e721e96379d01)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:44.857919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:44.929921 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3575/7162] 10.222.0.46 () {60 vars in 1252 bytes} [Sun Aug 21 01:38:44 2022] PATCH /identity/v3/projects/6b63eecab18d4982b90e721e96379d01 => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:44.940757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:44.957773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008a506-9a48-4bd1-b4ab-d0a1e286c5b8 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.967091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.968348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.968825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:44.969318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/6b63eecab18d4982b90e721e96379d01` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:44.982833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef32f4-cced-4f02-aa03-764dfdd89f9a tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:44.986137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:get_project(project_id=6b63eecab18d4982b90e721e96379d01)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:44.988625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:44.991133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3576/7163] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:44 2022] GET /identity/v3/projects/6b63eecab18d4982b90e721e96379d01 => generated 355 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:38:44.995685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:44.996688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:44.998442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:44.999430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.000832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] PATH_INFO: `/v3/projects/5751075de2bc41d7ba71a925074efad8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.002777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5751075de2bc41d7ba71a925074efad8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.005041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.018098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155cb0-a194-4099-832b-c9c6849c0222 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.025125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.026464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.026921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.027636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/projects/6b63eecab18d4982b90e721e96379d01` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.029241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6b63eecab18d4982b90e721e96379d01)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.032023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.053215 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:45.075514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5751075de2bc41d7ba71a925074efad8', 'request_id': 'req-8e35954d-ad8e-4aa6-962f-a53ba455248a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.088946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5751075de2bc41d7ba71a925074efad8', 'request_id': 'req-8e35954d-ad8e-4aa6-962f-a53ba455248a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.101811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5751075de2bc41d7ba71a925074efad8', 'request_id': 'req-8e35954d-ad8e-4aa6-962f-a53ba455248a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.112235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b63eecab18d4982b90e721e96379d01', 'request_id': 'req-5984c935-57d4-4229-a246-0172db1c177e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.120064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] The token cache is being invalidate because project 5751075de2bc41d7ba71a925074efad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:45.120456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.121287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e35954d-ad8e-4aa6-962f-a53ba455248a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.123795 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3588/7164] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:44 2022] DELETE /identity/v3/projects/5751075de2bc41d7ba71a925074efad8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:45.123965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b63eecab18d4982b90e721e96379d01', 'request_id': 'req-5984c935-57d4-4229-a246-0172db1c177e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.130314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468ef48-0ef9-481e-9d1e-a7bb40e9fef0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.130598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468ef48-0ef9-481e-9d1e-a7bb40e9fef0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.130874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468ef48-0ef9-481e-9d1e-a7bb40e9fef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.136557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b63eecab18d4982b90e721e96379d01', 'request_id': 'req-5984c935-57d4-4229-a246-0172db1c177e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.145319 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:45.155526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] The token cache is being invalidate because project 6b63eecab18d4982b90e721e96379d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:45.156327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.157323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.160418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3577/7165] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:44 2022] DELETE /identity/v3/projects/6b63eecab18d4982b90e721e96379d01 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:45.166425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.170367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:45.174084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0468ef48-0ef9-481e-9d1e-a7bb40e9fef0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:45.175656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0468ef48-0ef9-481e-9d1e-a7bb40e9fef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:45.285156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3589/7166] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:45.304258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c935-57d4-4229-a246-0172db1c177e tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.339331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616bf26-0f17-4753-af05-976beddc5c02 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.342317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616bf26-0f17-4753-af05-976beddc5c02 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.342929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616bf26-0f17-4753-af05-976beddc5c02 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.343397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616bf26-0f17-4753-af05-976beddc5c02 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains/a39e9f040aa94fbdb528554873f61e45` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.367828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616bf26-0f17-4753-af05-976beddc5c02 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-5616bf26-0f17-4753-af05-976beddc5c02 tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Could not find domain: a39e9f040aa94fbdb528554873f61e45.: keystone.exception.DomainNotFound: Could not find domain: a39e9f040aa94fbdb528554873f61e45. Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a39e9f040aa94fbdb528554873f61e45. Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:45.378916 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:45.380006 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a39e9f040aa94fbdb528554873f61e45. Aug 21 01:38:45.380977 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:38:45.385638 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3578/7167] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:45 2022] PATCH /identity/v3/domains/a39e9f040aa94fbdb528554873f61e45 => generated 112 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:38:45.388853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468ef48-0ef9-481e-9d1e-a7bb40e9fef0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.392193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba357-b600-4138-8815-2c1547ba9eb0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.392479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba357-b600-4138-8815-2c1547ba9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.392891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba357-b600-4138-8815-2c1547ba9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.410352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468ef48-0ef9-481e-9d1e-a7bb40e9fef0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.425023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63103ebda0b421d984c75abfc33915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7376788e17ec44668042e074a39ddab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.425752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.426033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.426308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] PATH_INFO: `/v3/domains/bb25075e035e4b49bec312b0b29e9705` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.439732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4f4ba357-b600-4138-8815-2c1547ba9eb0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:45.441487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4f4ba357-b600-4138-8815-2c1547ba9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:45.442397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Could not find domain: bb25075e035e4b49bec312b0b29e9705.: keystone.exception.DomainNotFound: Could not find domain: bb25075e035e4b49bec312b0b29e9705. Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bb25075e035e4b49bec312b0b29e9705. Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:45.449720 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:45.450903 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bb25075e035e4b49bec312b0b29e9705. Aug 21 01:38:45.451849 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:45.453312 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3590/7168] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:38:45 2022] PATCH /identity/v3/domains/bb25075e035e4b49bec312b0b29e9705 => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:38:45.456882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.461054 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3579/7169] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:45.462234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:45.464190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ba357-b600-4138-8815-2c1547ba9eb0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.483108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ba357-b600-4138-8815-2c1547ba9eb0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.490665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d0a0-ce56-482a-a2c1-bd18b8aa6e4d tempest-ProjectsTestJSON-762093483 tempest-ProjectsTestJSON-762093483-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.493249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.494326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.494606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.494885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.495547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:45.495851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.501291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.503796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.504456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.504729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.505022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] PATH_INFO: `/v3/users/6c50e4c0b3254b7bb73212bdeba2661e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.508933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c50e4c0b3254b7bb73212bdeba2661e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.514333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.524974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3580/7170] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:45.530760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.542496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad3f4-c62f-4ace-be8f-2e9a4641d25a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.548220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.549215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.549878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.550262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.550985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.553124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.593285 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3581/7171] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:45 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:45.600401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.654278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c50e4c0b3254b7bb73212bdeba2661e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.676963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c50e4c0b3254b7bb73212bdeba2661e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.678003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c50e4c0b3254b7bb73212bdeba2661e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.693004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c50e4c0b3254b7bb73212bdeba2661e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.694108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ec8792-bd67-400a-9cab-5ef19e26c3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c50e4c0b3254b7bb73212bdeba2661e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:45.720241 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:45.726026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313379-5a98-46fd-acf4-2afa1b49d81f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.731129 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3591/7172] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:45 2022] DELETE /identity/v3/users/6c50e4c0b3254b7bb73212bdeba2661e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:45.737488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.739446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.739927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.740045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.740271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.740383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.740543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.742599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.748381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.762069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:45.763346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:45.814543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3582/7173] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:45 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:45.819961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.822788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:45.847485 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3592/7174] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:45.855327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.856825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4812-0d7d-4e63-bc62-56937252f34a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.859415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:45.873394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.873726 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:45.874639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.874921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.875197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.875969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.882673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.911893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3583/7175] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:45.916202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.942568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d609f-a952-4f74-854d-02d4144998a7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.952047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ab25-70a2-4de2-a488-32560cd9c086 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:45.955879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.956656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.956796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaadfa-2126-4d7e-ab08-eb996a9e4811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:45.957142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.957410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaadfa-2126-4d7e-ab08-eb996a9e4811 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:45.957622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.957730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaadfa-2126-4d7e-ab08-eb996a9e4811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:45.957957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaadfa-2126-4d7e-ab08-eb996a9e4811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:45.958525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.960274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.978112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaadfa-2126-4d7e-ab08-eb996a9e4811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:45.980020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaadfa-2126-4d7e-ab08-eb996a9e4811 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:45.984822 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3584/7176] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:45.989203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:45.999321 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3593/7177] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:46.000432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f1ab-a4f6-4f4f-9299-caa8cf0288fb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:46.005820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:46.006521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:46.006873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:46.007544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] PATH_INFO: `/v3/projects/0de1cdaf185640eba1e7ee9f77a759f8/users/aa08140ed0494673a0be652f941d20df/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:46.029954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de1cdaf185640eba1e7ee9f77a759f8, user_id=aa08140ed0494673a0be652f941d20df, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:46.033531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:46.062112 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3585/7178] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:45 2022] PUT /identity/v3/projects/0de1cdaf185640eba1e7ee9f77a759f8/users/aa08140ed0494673a0be652f941d20df/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:46.074073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a212-1eb1-4f9e-9e06-a815815904cf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:46.074346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a212-1eb1-4f9e-9e06-a815815904cf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:46.074615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a212-1eb1-4f9e-9e06-a815815904cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:46.140603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3188a212-1eb1-4f9e-9e06-a815815904cf None None] MFA Rules not processed for user `aa08140ed0494673a0be652f941d20df`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:46.142041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3188a212-1eb1-4f9e-9e06-a815815904cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:46.227384 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3594/7179] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:46.229029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:46.244671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae346b1-a228-4eec-9835-0b2dcb0e9f6a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:46.255421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f42a0-0a9a-4c50-95c7-60bcd348f042 tempest-IdentityCatalogTest-1738306750 tempest-IdentityCatalogTest-1738306750-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa08140ed0494673a0be652f941d20df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de1cdaf185640eba1e7ee9f77a759f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:46.255909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f42a0-0a9a-4c50-95c7-60bcd348f042 tempest-IdentityCatalogTest-1738306750 tempest-IdentityCatalogTest-1738306750-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:46.256190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f42a0-0a9a-4c50-95c7-60bcd348f042 tempest-IdentityCatalogTest-1738306750 tempest-IdentityCatalogTest-1738306750-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:46.256706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f42a0-0a9a-4c50-95c7-60bcd348f042 tempest-IdentityCatalogTest-1738306750 tempest-IdentityCatalogTest-1738306750-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:46.257094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f42a0-0a9a-4c50-95c7-60bcd348f042 tempest-IdentityCatalogTest-1738306750 tempest-IdentityCatalogTest-1738306750-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:46.260608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f42a0-0a9a-4c50-95c7-60bcd348f042 tempest-IdentityCatalogTest-1738306750 tempest-IdentityCatalogTest-1738306750-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:46.264828 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3586/7180] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:38:46 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:46.269073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a212-1eb1-4f9e-9e06-a815815904cf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:46.394429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a212-1eb1-4f9e-9e06-a815815904cf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:46.400634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:46.402021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:46.402515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:46.403223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] PATH_INFO: `/v3/users/aa08140ed0494673a0be652f941d20df` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:46.404978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa08140ed0494673a0be652f941d20df)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:46.409499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:46.511148 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:46.520116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa08140ed0494673a0be652f941d20df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.531367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa08140ed0494673a0be652f941d20df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.533576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa08140ed0494673a0be652f941d20df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.554362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa08140ed0494673a0be652f941d20df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.560349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa08140ed0494673a0be652f941d20df'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.596817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3595/7181] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:46 2022] DELETE /identity/v3/users/aa08140ed0494673a0be652f941d20df => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:46.601161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:46.601636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:46.602105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:46.643633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:46.644920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:46.744393 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3587/7182] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:46.759962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:46.763968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:46.774961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:46.776968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:46.798841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc7216-76d0-4ddb-b150-1ba10913621f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:46.808807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:46.810014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:46.810447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:46.810815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] PATH_INFO: `/v3/projects/e1cd67eee2174242ae1a6b6ec7558a24` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:46.815659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1cd67eee2174242ae1a6b6ec7558a24)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:46.817787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:46.888020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e12f77-616c-47a4-a397-116a0e52f709 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:46.898141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:46.898751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:46.899812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:46.899812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:46.928224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:46.934753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:46.935432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1cd67eee2174242ae1a6b6ec7558a24', 'request_id': 'req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.943844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1cd67eee2174242ae1a6b6ec7558a24', 'request_id': 'req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.950578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1cd67eee2174242ae1a6b6ec7558a24', 'request_id': 'req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.961850 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3596/7183] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:46.994978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] The token cache is being invalidate because project e1cd67eee2174242ae1a6b6ec7558a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:46.996138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:46.997947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:47.003922 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3588/7184] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:46 2022] DELETE /identity/v3/projects/e1cd67eee2174242ae1a6b6ec7558a24 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:47.007905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:47.026676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0389cf-8543-46b1-a0cc-799b66e55beb service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:47.218951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:47.222953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:47.223246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:47.224831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] PATH_INFO: `/v3/users/f63103ebda0b421d984c75abfc33915a` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:47.227289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63103ebda0b421d984c75abfc33915a)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:47.234038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:47.331604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63103ebda0b421d984c75abfc33915a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:47.345834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63103ebda0b421d984c75abfc33915a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:47.346615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63103ebda0b421d984c75abfc33915a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:47.370432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63103ebda0b421d984c75abfc33915a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:47.371200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3addcaa8-88db-4ba4-8594-743bcd623570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63103ebda0b421d984c75abfc33915a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:47.378037 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:47.417907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3597/7185] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:47 2022] DELETE /identity/v3/users/f63103ebda0b421d984c75abfc33915a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:47.582444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:47.583960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:47.626121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d32b4a-617f-4201-a1ed-c98ee71f3a31 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:47.701107 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:47.822941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:47.822941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:47.822941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:47.822941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] PATH_INFO: `/v3/projects/0de1cdaf185640eba1e7ee9f77a759f8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:47.825462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de1cdaf185640eba1e7ee9f77a759f8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:47.827710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:48.021043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de1cdaf185640eba1e7ee9f77a759f8', 'request_id': 'req-e22baa57-8282-486c-8e7d-dff9a38adfec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.033516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de1cdaf185640eba1e7ee9f77a759f8', 'request_id': 'req-e22baa57-8282-486c-8e7d-dff9a38adfec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.047590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de1cdaf185640eba1e7ee9f77a759f8', 'request_id': 'req-e22baa57-8282-486c-8e7d-dff9a38adfec'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.071301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] The token cache is being invalidate because project 0de1cdaf185640eba1e7ee9f77a759f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:48.071582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.072292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.077525 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3589/7186] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:47 2022] DELETE /identity/v3/projects/0de1cdaf185640eba1e7ee9f77a759f8 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:48.082248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8248c-9724-45e8-afd8-e8a8aa2c2d9e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.082744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8248c-9724-45e8-afd8-e8a8aa2c2d9e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.082983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8248c-9724-45e8-afd8-e8a8aa2c2d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.148280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-64f8248c-9724-45e8-afd8-e8a8aa2c2d9e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:48.149903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-64f8248c-9724-45e8-afd8-e8a8aa2c2d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:48.275692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:48.278832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:48.309584 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3598/7187] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:48.317505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26707f2-bb9e-40b6-b5dc-e3abc05c767b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.318057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26707f2-bb9e-40b6-b5dc-e3abc05c767b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.318305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26707f2-bb9e-40b6-b5dc-e3abc05c767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.354061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b26707f2-bb9e-40b6-b5dc-e3abc05c767b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:48.355587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b26707f2-bb9e-40b6-b5dc-e3abc05c767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:48.385928 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3599/7188] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:48.387160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26707f2-bb9e-40b6-b5dc-e3abc05c767b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:48.401626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26707f2-bb9e-40b6-b5dc-e3abc05c767b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:48.414578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:48.415376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.418272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.420202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.420723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:48.421068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:48.427973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:48.460015 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3600/7189] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:48.466258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:48.496001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add720-4d4a-480f-8fd2-db8069cf8de2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:48.497424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22baa57-8282-486c-8e7d-dff9a38adfec admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:48.519717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:48.522860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.523145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.523262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:48.523630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.523866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.524143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.524317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:48.524419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] PATH_INFO: `/v3/projects/7376788e17ec44668042e074a39ddab3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.526764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7376788e17ec44668042e074a39ddab3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:48.531502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:48.533453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:48.606030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3601/7190] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:48 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:48.611457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:48.732332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7376788e17ec44668042e074a39ddab3', 'request_id': 'req-0220013a-03bc-443b-8bd4-776bed450d95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.735054 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:48.752861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7376788e17ec44668042e074a39ddab3', 'request_id': 'req-0220013a-03bc-443b-8bd4-776bed450d95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.759930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d741e1-62be-4fe0-b0fe-402c8d5fcc38 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:48.770780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7376788e17ec44668042e074a39ddab3', 'request_id': 'req-0220013a-03bc-443b-8bd4-776bed450d95'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.828656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] The token cache is being invalidate because project 7376788e17ec44668042e074a39ddab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:48.829324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.834086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0220013a-03bc-443b-8bd4-776bed450d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:48.841698 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3590/7191] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:48 2022] DELETE /identity/v3/projects/7376788e17ec44668042e074a39ddab3 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:48.856731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d626a-0691-4bf1-8bd0-1678cb71bd24 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.857568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d626a-0691-4bf1-8bd0-1678cb71bd24 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.858271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d626a-0691-4bf1-8bd0-1678cb71bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.881964 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:48.915853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c25d626a-0691-4bf1-8bd0-1678cb71bd24 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:48.917173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c25d626a-0691-4bf1-8bd0-1678cb71bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:48.922473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:48.925932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.926476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.927237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.928015 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3591/7192] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:48.929278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:48.935928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:48.940667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414ac2-dbce-407b-a336-c29dee1e393c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:48.941310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414ac2-dbce-407b-a336-c29dee1e393c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:48.941676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414ac2-dbce-407b-a336-c29dee1e393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:48.976170 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3602/7193] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:48 2022] POST /identity/v3/users => generated 287 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:48.984857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:48.997898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:49.007411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-85414ac2-dbce-407b-a336-c29dee1e393c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:49.020869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-85414ac2-dbce-407b-a336-c29dee1e393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:49.036132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd44ab9-bb69-4eb7-a732-17fca9dc4095 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.054094 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3592/7194] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:49.060558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414ac2-dbce-407b-a336-c29dee1e393c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.066873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.066873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.066873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.067248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.067779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.069928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.097504 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3603/7195] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:49.104429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414ac2-dbce-407b-a336-c29dee1e393c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.106601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.119359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a260-3a47-4287-a974-3331393fb113 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.131523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.135144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.135490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.136355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.137152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:49.137478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.139248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.150449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.151101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.151379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.151631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.165147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.169670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.179162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3593/7196] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:49.183674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.198102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e71c6-5f84-4d88-bfdf-76a28de1e102 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.205075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.206167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.206534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.206883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.207723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.219394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.226719 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3604/7197] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:49.229357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.262103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b0d7-c43d-4f55-9467-3ef0751aa5d2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.286877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33732adb-7d17-4c59-acd5-f9889cbbe12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.288651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732adb-7d17-4c59-acd5-f9889cbbe12b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.289190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732adb-7d17-4c59-acd5-f9889cbbe12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.289747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732adb-7d17-4c59-acd5-f9889cbbe12b admin admin] PATH_INFO: `/v3/projects/35b20c1e8ab54836b27ee1c9e1b02893/users/8ea60b920a9e47e8b9363dc53ec9e002/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.301969 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3594/7198] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:49 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:49.302900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.342501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33732adb-7d17-4c59-acd5-f9889cbbe12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b20c1e8ab54836b27ee1c9e1b02893, user_id=8ea60b920a9e47e8b9363dc53ec9e002, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.345322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33732adb-7d17-4c59-acd5-f9889cbbe12b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.381470 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3605/7199] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:49 2022] PUT /identity/v3/projects/35b20c1e8ab54836b27ee1c9e1b02893/users/8ea60b920a9e47e8b9363dc53ec9e002/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:49.383563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04baa6-067d-4d9b-bb40-8f6bacd29641 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.383968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04baa6-067d-4d9b-bb40-8f6bacd29641 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.384342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04baa6-067d-4d9b-bb40-8f6bacd29641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.442756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d04baa6-067d-4d9b-bb40-8f6bacd29641 None None] MFA Rules not processed for user `8ea60b920a9e47e8b9363dc53ec9e002`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:49.444896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d04baa6-067d-4d9b-bb40-8f6bacd29641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:49.446693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51251c04-1631-49d3-9ee5-3273717ec49e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.600681 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3606/7200] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:49.604390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04baa6-067d-4d9b-bb40-8f6bacd29641 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.616658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04baa6-067d-4d9b-bb40-8f6bacd29641 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.622565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.622686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.622952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.623291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.623980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.625622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.629483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.630324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.630759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.631188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.631991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.637069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.662770 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3607/7201] 10.222.0.46 () {60 vars in 1299 bytes} [Sun Aug 21 01:38:49 2022] POST /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2 => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:49.664132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.708888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0d90-962d-46a4-bcc1-fa7943de1937 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.711055 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3595/7202] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:49 2022] POST /identity/v3/users => generated 284 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:49.714311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.716308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.716308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.716308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/50446d1d593b4faa8e1eab2ab8e182ce` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.719140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.719417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002, credential_id=50446d1d593b4faa8e1eab2ab8e182ce)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.724235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.733907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91486b6-5119-4ec3-b36b-66ffc8985770 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.750939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.751596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.751870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.752135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.752832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.754540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.764958 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3608/7203] 10.222.0.46 () {58 vars in 1380 bytes} [Sun Aug 21 01:38:49 2022] DELETE /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/50446d1d593b4faa8e1eab2ab8e182ce => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:49.770789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.777752 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3596/7204] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:49.783907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.784572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e33fb-0bca-4384-ba4b-36e941855e87 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.793526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.794571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.795167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.801228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.802687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.804749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.809843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89036899-90b4-4161-8cf8-c899f5168a31 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.822536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.825392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.825392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.825392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.827518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.827518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.846871 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3609/7205] 10.222.0.46 () {60 vars in 1299 bytes} [Sun Aug 21 01:38:49 2022] POST /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2 => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:49.853432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.857569 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3597/7206] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:49.858922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.879572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998dea6-af6c-4fbb-8220-33c5c01c88cc tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.883619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afceff-547f-4a10-acf2-f64ff18cf568 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.889343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.890302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.890845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.891517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/9954be5164f8459ebcf9d5394c71e680` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.900493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002, credential_id=9954be5164f8459ebcf9d5394c71e680)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.904354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.905319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a93764-1c9e-475d-a409-590f3efe6268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.907065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a93764-1c9e-475d-a409-590f3efe6268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.907581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a93764-1c9e-475d-a409-590f3efe6268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.908093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a93764-1c9e-475d-a409-590f3efe6268 admin admin] PATH_INFO: `/v3/projects/3f9b4b358ad943a4a6308b1477dd8986/users/cb4a833fe77f41d38b04cf4489da587e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:49.912106 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:49.939657 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3610/7207] 10.222.0.46 () {58 vars in 1380 bytes} [Sun Aug 21 01:38:49 2022] DELETE /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/9954be5164f8459ebcf9d5394c71e680 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:49.944391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:49.948581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a93764-1c9e-475d-a409-590f3efe6268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9b4b358ad943a4a6308b1477dd8986, user_id=cb4a833fe77f41d38b04cf4489da587e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:49.959788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a93764-1c9e-475d-a409-590f3efe6268 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:49.971712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a0971-28ac-4a45-9e5c-eaeb31b07055 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:49.982038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb6db1-e4c3-4469-a8e5-d3641e446613 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:49.982723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb6db1-e4c3-4469-a8e5-d3641e446613 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:49.983007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb6db1-e4c3-4469-a8e5-d3641e446613 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:49.983283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb6db1-e4c3-4469-a8e5-d3641e446613 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/9954be5164f8459ebcf9d5394c71e680` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.003856 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3598/7208] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:49 2022] PUT /identity/v3/projects/3f9b4b358ad943a4a6308b1477dd8986/users/cb4a833fe77f41d38b04cf4489da587e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:50.005849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8dd7-06ac-4ef4-bdca-21d59bcfb1ac None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.006829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8dd7-06ac-4ef4-bdca-21d59bcfb1ac None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.007323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8dd7-06ac-4ef4-bdca-21d59bcfb1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-68fb6db1-e4c3-4469-a8e5-d3641e446613 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Could not find credential: 865714d3f58de20725afeaf8e08f12dc543f46536714d29204607b47cdac4420.: keystone.exception.CredentialNotFound: Could not find credential: 865714d3f58de20725afeaf8e08f12dc543f46536714d29204607b47cdac4420. Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 21 01:38:50.030744 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:38:50.031936 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 865714d3f58de20725afeaf8e08f12dc543f46536714d29204607b47cdac4420. Aug 21 01:38:50.032938 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:50.039686 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3611/7209] 10.222.0.46 () {58 vars in 1377 bytes} [Sun Aug 21 01:38:49 2022] GET /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/9954be5164f8459ebcf9d5394c71e680 => generated 148 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:38:50.040970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb6db1-e4c3-4469-a8e5-d3641e446613 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.072584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb6db1-e4c3-4469-a8e5-d3641e446613 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.084148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-583d8dd7-06ac-4ef4-bdca-21d59bcfb1ac None None] MFA Rules not processed for user `cb4a833fe77f41d38b04cf4489da587e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:50.085572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-583d8dd7-06ac-4ef4-bdca-21d59bcfb1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:50.123038 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:50.232981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.233796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.234129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.234348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.236375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.241237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.277729 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3612/7210] 10.222.0.46 () {60 vars in 1299 bytes} [Sun Aug 21 01:38:50 2022] POST /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2 => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:50.280810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.305163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f3ccb-da70-44ee-a29e-9af4ba67f656 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.318295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.319028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.319351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.319746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.320480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.323154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.370182 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3613/7211] 10.222.0.46 () {60 vars in 1299 bytes} [Sun Aug 21 01:38:50 2022] POST /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2 => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:50.371179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.380974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3599/7212] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:50.387211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d8dd7-06ac-4ef4-bdca-21d59bcfb1ac None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.398644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48fcc5-0daa-4108-9727-f837b5c43280 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.412120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.413350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.413783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.414092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.414663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=8ea60b920a9e47e8b9363dc53ec9e002)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.416858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.438604 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3614/7213] 10.222.0.46 () {58 vars in 1278 bytes} [Sun Aug 21 01:38:50 2022] GET /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2 => generated 865 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:50.450532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.470402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0692-7ee2-412d-8e6a-fddd7b3b7e63 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.486660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.492150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.492355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.492648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/8a4beb863d654cc6a13b5a8814b3b846` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.495220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002, credential_id=8a4beb863d654cc6a13b5a8814b3b846)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.496783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.543009 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3615/7214] 10.222.0.46 () {58 vars in 1380 bytes} [Sun Aug 21 01:38:50 2022] DELETE /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/8a4beb863d654cc6a13b5a8814b3b846 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:50.545122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.579249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d056-93f8-4557-aa2d-cd5eebab40b1 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.595780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.597715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.598009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.598284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/da283680df094ea6b96c53dd94504b9b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.613606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002, credential_id=da283680df094ea6b96c53dd94504b9b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.619978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.648275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d8dd7-06ac-4ef4-bdca-21d59bcfb1ac None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.674545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.676715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.677966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.680257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.681090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.683726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.700571 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3616/7215] 10.222.0.46 () {58 vars in 1380 bytes} [Sun Aug 21 01:38:50 2022] DELETE /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/da283680df094ea6b96c53dd94504b9b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:50.706751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.732193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbe40-af29-43b0-856b-209586fa9ee4 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.743780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.744540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.744970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.745616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.746083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.747940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.771049 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3600/7216] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:50 2022] POST /identity/v3/projects => generated 369 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:50.778324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.802158 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3617/7217] 10.222.0.46 () {60 vars in 1299 bytes} [Sun Aug 21 01:38:50 2022] POST /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2 => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:50.814144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.831047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0b1fd-5e92-4fc4-b798-b7b6babbac2c tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.907184 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:50.915658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9cb24-0df5-4091-9460-c522cfdca729 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:50.922865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:50.923763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:50.924352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:50.924922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:50.925738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:50.928145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:50.968354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3601/7218] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:50 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:50.976524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:50.998401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb7846-5fad-40c3-9dbf-17c10fe9538d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:51.009503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:51.010140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.010425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.010689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.011392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:51.015366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:51.043177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:51.044134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.047498 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3602/7219] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:51.048567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:51.050363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.050669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/0482a96232bc4b208e115374fedcd1a9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.053071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002, credential_id=0482a96232bc4b208e115374fedcd1a9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:51.054574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:51.073988 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3618/7220] 10.222.0.46 () {58 vars in 1377 bytes} [Sun Aug 21 01:38:50 2022] GET /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/0482a96232bc4b208e115374fedcd1a9 => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:51.078193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:51.089844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70a78-434f-4626-9411-5e01bff92649 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:51.102000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a772c-e692-4cc7-a798-f6fdd2934dda admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:51.107865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ea60b920a9e47e8b9363dc53ec9e002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b20c1e8ab54836b27ee1c9e1b02893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:51.108558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.108868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.109148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/0482a96232bc4b208e115374fedcd1a9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.113573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:51.114168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=8ea60b920a9e47e8b9363dc53ec9e002, credential_id=0482a96232bc4b208e115374fedcd1a9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:51.114312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.114715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.114984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] PATH_INFO: `/v3/projects/47315335bf274a27a2e822e2148eb3e5/users/5d1dc890eed9409c9c2ce5fbdd222b46/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.120046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:51.139455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47315335bf274a27a2e822e2148eb3e5, user_id=5d1dc890eed9409c9c2ce5fbdd222b46, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:51.143128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:51.167615 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3619/7221] 10.222.0.46 () {58 vars in 1380 bytes} [Sun Aug 21 01:38:51 2022] DELETE /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002/credentials/OS-EC2/0482a96232bc4b208e115374fedcd1a9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:51.178574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3603/7222] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:51 2022] PUT /identity/v3/projects/47315335bf274a27a2e822e2148eb3e5/users/5d1dc890eed9409c9c2ce5fbdd222b46/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:51.180308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:51.188427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:51.209837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3a799-21f9-4a24-a2dc-15ba9aced694 tempest-EC2CredentialsTest-2091075328 tempest-EC2CredentialsTest-2091075328-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:51.379803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316b99d-9a9d-469a-b9f5-bcc4ecd94f7e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:51.388366 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:51.408431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:51.409165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.411953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.412256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.413553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:51.417935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:51.430365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:51.431284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.431728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.432159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] PATH_INFO: `/v3/users/8ea60b920a9e47e8b9363dc53ec9e002` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.433714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea60b920a9e47e8b9363dc53ec9e002)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:51.439738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:51.461010 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3604/7223] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:51.464927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:51.484978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74942c18-2f31-454b-8465-e122aedd0101 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:51.494909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d71b6-af66-4305-8d59-01e8a3e911f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:51.495937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d71b6-af66-4305-8d59-01e8a3e911f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.496423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d71b6-af66-4305-8d59-01e8a3e911f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.496935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d71b6-af66-4305-8d59-01e8a3e911f6 admin admin] PATH_INFO: `/v3/projects/47315335bf274a27a2e822e2148eb3e5/users/5d1dc890eed9409c9c2ce5fbdd222b46/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.499938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d71b6-af66-4305-8d59-01e8a3e911f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47315335bf274a27a2e822e2148eb3e5, user_id=5d1dc890eed9409c9c2ce5fbdd222b46, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:51.511028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d71b6-af66-4305-8d59-01e8a3e911f6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:51.527215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea60b920a9e47e8b9363dc53ec9e002'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:51.538409 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3605/7224] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:51 2022] PUT /identity/v3/projects/47315335bf274a27a2e822e2148eb3e5/users/5d1dc890eed9409c9c2ce5fbdd222b46/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:51.550492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea60b920a9e47e8b9363dc53ec9e002'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:51.552368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc5e4-6e5f-479a-b96c-f6ffe678080a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.552368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc5e4-6e5f-479a-b96c-f6ffe678080a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.552368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc5e4-6e5f-479a-b96c-f6ffe678080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.552674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea60b920a9e47e8b9363dc53ec9e002'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:51.569464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea60b920a9e47e8b9363dc53ec9e002'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:51.570608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cde4d17f-17cf-4be1-a47d-92757777a2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea60b920a9e47e8b9363dc53ec9e002'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:51.606896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-767cc5e4-6e5f-479a-b96c-f6ffe678080a None None] MFA Rules not processed for user `5d1dc890eed9409c9c2ce5fbdd222b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:51.608511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-767cc5e4-6e5f-479a-b96c-f6ffe678080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:51.641252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3620/7225] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:51 2022] DELETE /identity/v3/users/8ea60b920a9e47e8b9363dc53ec9e002 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:51.646058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81077235-6dce-4c08-a912-665400043d8f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:51.648238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81077235-6dce-4c08-a912-665400043d8f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:51.648570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81077235-6dce-4c08-a912-665400043d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:51.727930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-81077235-6dce-4c08-a912-665400043d8f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:51.729380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-81077235-6dce-4c08-a912-665400043d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:51.874871 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3606/7226] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:51.876453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc5e4-6e5f-479a-b96c-f6ffe678080a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:51.899606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc5e4-6e5f-479a-b96c-f6ffe678080a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:51.925431 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3621/7227] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:51.935771 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:51.936309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81077235-6dce-4c08-a912-665400043d8f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:51.942301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-81077235-6dce-4c08-a912-665400043d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:52.009719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.010370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.010655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.010932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.011646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.013636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.046334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3607/7228] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:38:51 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:52.049224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.100759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81077235-6dce-4c08-a912-665400043d8f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.101511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd9503-1a69-42e0-a4da-00f82e53d455 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.108913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.110571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.113898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.114976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/e9a874d0c2f644919551ae445e974018` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.115812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e9a874d0c2f644919551ae445e974018)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.128849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.129094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.129094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.129310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.129410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.145342 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:52.150859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.154519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.173953 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3608/7229] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:52 2022] DELETE /identity/v3/services/e9a874d0c2f644919551ae445e974018 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:52.174971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.181869 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3622/7230] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:52.214114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bf3c5-febf-4f27-8a4e-ff353fb312b8 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.220731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.222242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.222796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.223127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.223975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.225731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.265116 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3609/7231] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:52 2022] POST /identity/v3/services => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:52.270144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.300536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f97a-6a4b-46fe-8a7f-a834c508b8f3 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.349801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.351664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.352270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.352553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/6b807acd7697403a8b606f56cf0edc95` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.358949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:update_service(service_id=6b807acd7697403a8b606f56cf0edc95)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.363496 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:52.363496 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:52.363496 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:52.367759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.435270 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3623/7232] 10.222.0.46 () {60 vars in 1252 bytes} [Sun Aug 21 01:38:52 2022] PATCH /identity/v3/services/6b807acd7697403a8b606f56cf0edc95 => generated 281 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:52.439489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.464570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a33a7a-7fb8-4e37-8fc9-28895ac1b14b tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.513703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.522407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.527743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.532233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/6b807acd7697403a8b606f56cf0edc95` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.538489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:get_service(service_id=6b807acd7697403a8b606f56cf0edc95)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.539583 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:52.539583 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:38:52.539583 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:38:52.546434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.574321 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3610/7233] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:52 2022] GET /identity/v3/services/6b807acd7697403a8b606f56cf0edc95 => generated 281 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:52.587208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.651078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ba1b2-4354-4dc7-b7ba-8c1b18bc9c38 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.683231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.684093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.684489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.684995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/6b807acd7697403a8b606f56cf0edc95` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.686320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6b807acd7697403a8b606f56cf0edc95)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.694359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.723597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.726473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:52.782912 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3624/7234] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:52 2022] DELETE /identity/v3/services/6b807acd7697403a8b606f56cf0edc95 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:52.788208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.815865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ef083-986b-4303-a607-9e11d4096ba9 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.859946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9b80-b960-4495-8343-8037546a2abe tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.868007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.869089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.869649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.870146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] PATH_INFO: `/v3/projects/35b20c1e8ab54836b27ee1c9e1b02893` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.871603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b20c1e8ab54836b27ee1c9e1b02893)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.873853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.888530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:52.889336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:52.889632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:52.889905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/6b807acd7697403a8b606f56cf0edc95` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:52.890524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:get_service(service_id=6b807acd7697403a8b606f56cf0edc95)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:52.905397 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:52.905397 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:52.905397 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:52.906382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Could not find service: 6b807acd7697403a8b606f56cf0edc95.: keystone.exception.ServiceNotFound: Could not find service: 6b807acd7697403a8b606f56cf0edc95. Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6b807acd7697403a8b606f56cf0edc95. Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:38:52.936565 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:38:52.938106 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6b807acd7697403a8b606f56cf0edc95. Aug 21 01:38:52.939286 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:38:52.954582 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3625/7235] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:38:52 2022] GET /identity/v3/services/6b807acd7697403a8b606f56cf0edc95 => generated 113 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:38:52.956056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:52.968690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b20c1e8ab54836b27ee1c9e1b02893', 'request_id': 'req-a1bc226c-87a8-46b4-8217-58c0c843f8db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:52.991610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddb9df-c89b-4ee5-bd35-84b99302ad45 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:52.994408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b20c1e8ab54836b27ee1c9e1b02893', 'request_id': 'req-a1bc226c-87a8-46b4-8217-58c0c843f8db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:53.031728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b20c1e8ab54836b27ee1c9e1b02893', 'request_id': 'req-a1bc226c-87a8-46b4-8217-58c0c843f8db'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:53.058281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] The token cache is being invalidate because project 35b20c1e8ab54836b27ee1c9e1b02893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:53.058596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:53.063113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a1bc226c-87a8-46b4-8217-58c0c843f8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:53.068863 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3611/7236] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:52 2022] DELETE /identity/v3/projects/35b20c1e8ab54836b27ee1c9e1b02893 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:53.081515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23b26-3d9a-4023-a321-6d891dcd0c2c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.083994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23b26-3d9a-4023-a321-6d891dcd0c2c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.085130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23b26-3d9a-4023-a321-6d891dcd0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.160217 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:53.185926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-13b23b26-3d9a-4023-a321-6d891dcd0c2c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:53.187410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-13b23b26-3d9a-4023-a321-6d891dcd0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:53.188491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.189168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.189444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.189726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.190361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.191986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.274448 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3626/7237] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:52 2022] POST /identity/v3/services => generated 274 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:53.277782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.288674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:53.366058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa61d41-3300-45b6-86dc-c2b494a91308 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.373018 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3612/7238] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3406 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:53.382178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48135d-2b2e-4ea7-aba1-f1b08b9d2bc8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.382586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48135d-2b2e-4ea7-aba1-f1b08b9d2bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.382935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48135d-2b2e-4ea7-aba1-f1b08b9d2bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.387689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.388229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.388519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.388851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.389521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.392378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.439864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0f48135d-2b2e-4ea7-aba1-f1b08b9d2bc8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:53.440089 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3627/7239] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:53 2022] POST /identity/v3/services => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:53.444342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0f48135d-2b2e-4ea7-aba1-f1b08b9d2bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:53.444469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.473681 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3613/7240] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3574 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:53.478697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48135d-2b2e-4ea7-aba1-f1b08b9d2bc8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.495357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c7d69-d422-41f6-9400-3d6a9c6132fa tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.503182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48135d-2b2e-4ea7-aba1-f1b08b9d2bc8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.504112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.504753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.505064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.505345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.506199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.507782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.517662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.518541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.518663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.518979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.520740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:53.521082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.526030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.531392 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3628/7241] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:53 2022] POST /identity/v3/services => generated 272 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:53.535833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.556060 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3614/7242] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:53.557495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.572810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db8dc-fb3b-4f23-bc97-7a6d61a28598 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.600134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa0275-80df-4220-8848-76a0782d4744 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.601576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.602269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.602614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.602953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.603850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.606573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.615223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.616070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.618391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.618867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.620951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.628206 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:38:53.628206 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:38:53.628206 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:38:53.629516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.643893 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3629/7243] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:38:53 2022] GET /identity/v3/services => generated 2976 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:53.649798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.672200 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3615/7244] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:53 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:53.674052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.686096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773cf9c-9d91-42dd-9505-c7fd59c8420c tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.707477 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:53.778691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7adfb-a2e4-41f1-8a1f-4ff9024ee2ea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.780227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.780870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.781150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.781585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.782553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-768383136) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:53.782927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.785100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.790123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.790850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.792094 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3630/7245] 10.222.0.46 () {58 vars in 1220 bytes} [Sun Aug 21 01:38:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-768383136 => generated 416 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:53.792952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.793312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.794018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.796723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.798307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.834723 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3616/7246] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:53 2022] POST /identity/v3/users => generated 306 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:53.838826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.840712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8489b-d987-4a19-8ba1-01553c051a79 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.845723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.846357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.846648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.846922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.847579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1682752498) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:53.847881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.849831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.853070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d72f0-30b2-4ceb-99ea-1fb4b7ee8c57 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.859829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.860602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.861050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.861442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.862264 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3631/7247] 10.222.0.46 () {58 vars in 1222 bytes} [Sun Aug 21 01:38:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1682752498 => generated 418 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:53.862840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.863200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.864966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.875130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f550c-0169-4e77-a288-be837a404581 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.881389 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3617/7248] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:38:53.884427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.885163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.885452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.885727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.885860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.886383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-16145186) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:53.886799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.888612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.904421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd483d5-c4c0-462e-b318-c9c61c12434a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.909941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.911040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.911315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.911587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] PATH_INFO: `/v3/projects/86c81ceba53847579131cab988f83a51/users/d0c0774a03cd4d01bced56ca344c1dfd/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.915641 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3632/7249] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:38:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-16145186 => generated 413 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:53.916661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:53.935956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c81ceba53847579131cab988f83a51, user_id=d0c0774a03cd4d01bced56ca344c1dfd, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.939770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.940550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d4b6e-91c9-4dd7-a453-1567c37d1cd0 tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:53.943981 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:53.958454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:53.959190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:53.959479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:53.959751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/17fcf2f4139b448d9bba352c1dc8d466` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:53.960650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:delete_service(service_id=17fcf2f4139b448d9bba352c1dc8d466)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:53.962273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:53.969613 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3618/7250] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:53 2022] PUT /identity/v3/projects/86c81ceba53847579131cab988f83a51/users/d0c0774a03cd4d01bced56ca344c1dfd/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:53.973832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.011282 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3633/7251] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:53 2022] DELETE /identity/v3/services/17fcf2f4139b448d9bba352c1dc8d466 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:54.016971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.067777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6ce93-350d-4dca-9686-ba104cbc47eb tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:54.109290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a7bb-c59d-4d21-8387-96a944b0d3d3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:54.163416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:54.164047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.164321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.164585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.165275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:54.166901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:54.194916 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3619/7252] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:54.198744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:54.199328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.199443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.199695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.199973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/491f0f711ef641b892d19a0e8169d205` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.200572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:delete_service(service_id=491f0f711ef641b892d19a0e8169d205)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:54.202235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:54.219755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef0483-c9ad-48d8-93ed-b380fa90f93b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:54.232584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f668b4-0c7e-41d3-b72a-71fd48e16baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:54.233302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f668b4-0c7e-41d3-b72a-71fd48e16baa admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.233582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f668b4-0c7e-41d3-b72a-71fd48e16baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.234463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f668b4-0c7e-41d3-b72a-71fd48e16baa admin admin] PATH_INFO: `/v3/projects/86c81ceba53847579131cab988f83a51/users/d0c0774a03cd4d01bced56ca344c1dfd/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.241162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f668b4-0c7e-41d3-b72a-71fd48e16baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c81ceba53847579131cab988f83a51, user_id=d0c0774a03cd4d01bced56ca344c1dfd, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:54.244256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f668b4-0c7e-41d3-b72a-71fd48e16baa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:54.245430 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3634/7253] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:54 2022] DELETE /identity/v3/services/491f0f711ef641b892d19a0e8169d205 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:54.249633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.278230 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3620/7254] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:54 2022] PUT /identity/v3/projects/86c81ceba53847579131cab988f83a51/users/d0c0774a03cd4d01bced56ca344c1dfd/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:54.289867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccba00-6cd8-46f1-a13f-64000056f8fe None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.290612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccba00-6cd8-46f1-a13f-64000056f8fe None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.291145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccba00-6cd8-46f1-a13f-64000056f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.296744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1088f-4538-45f1-8275-aa9ba32bdf1d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:54.354896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5cccba00-6cd8-46f1-a13f-64000056f8fe None None] MFA Rules not processed for user `d0c0774a03cd4d01bced56ca344c1dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:54.356278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5cccba00-6cd8-46f1-a13f-64000056f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:54.382065 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:54.442351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1dc890eed9409c9c2ce5fbdd222b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47315335bf274a27a2e822e2148eb3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:54.443312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.443312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.443545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] PATH_INFO: `/v3/services/626cc22debf44cb9b991ea408a134d63` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.444145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorizing `identity:delete_service(service_id=626cc22debf44cb9b991ea408a134d63)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:54.445983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:54.472600 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3621/7255] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3510 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:54.477512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccba00-6cd8-46f1-a13f-64000056f8fe None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.487413 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3635/7256] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:54 2022] DELETE /identity/v3/services/626cc22debf44cb9b991ea408a134d63 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:54.492350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.494122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:54.568583 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:54.606899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb8600-03b5-4430-b7c6-4ed5c9d3984d tempest-ServicesTestJSON-1831822190 tempest-ServicesTestJSON-1831822190-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:54.612160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccba00-6cd8-46f1-a13f-64000056f8fe None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:54.613078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:54.613745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.614019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.614294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] PATH_INFO: `/v3/users/cb4a833fe77f41d38b04cf4489da587e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.615473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4a833fe77f41d38b04cf4489da587e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:54.617662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:54.626030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:54.630375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.630831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.631855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.640824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:54.652988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:54.722914 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3622/7257] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:54 2022] POST /identity/v3/projects => generated 397 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:54.726997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.733541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4a833fe77f41d38b04cf4489da587e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:54.750651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4a833fe77f41d38b04cf4489da587e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:54.753455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4a833fe77f41d38b04cf4489da587e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:54.766990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4a833fe77f41d38b04cf4489da587e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:54.769156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3496a653-03dd-4fce-83f8-60965907e37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4a833fe77f41d38b04cf4489da587e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:54.808589 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3636/7258] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:54 2022] DELETE /identity/v3/users/cb4a833fe77f41d38b04cf4489da587e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:54.810657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:54.810942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:54.811218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:54.850811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:54.853625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:54.894550 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:54.902332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d8eb3-2153-4a04-ad52-be7841e77ff3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:54.968722 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3637/7259] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:54.978341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:54.980491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:55.041704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:55.042770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:55.043116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:55.043456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:55.044520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:55.046596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:55.089841 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3623/7260] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:54 2022] POST /identity/v3/users => generated 299 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:55.094224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:55.096083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:55.105249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002baab5-64a9-4340-b78c-dc1746949ca0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:55.111309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:55.112894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:55.113179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:55.113451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:55.114617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36af8b2-5617-49ee-8c20-ba9bf4ded5c6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:55.129595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:55.134187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:55.137704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:55.138350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:55.138627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:55.139532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:55.143103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:55.148591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:55.159243 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3638/7261] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:38:55.186296 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3624/7262] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:55.190089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:55.203289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c776-2ca2-4ff5-a394-65f10bfb1155 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:55.217805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3d14-9d9a-481a-84c2-c0465e3f7a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:55.218069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3d14-9d9a-481a-84c2-c0465e3f7a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:55.218325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3d14-9d9a-481a-84c2-c0465e3f7a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:55.218588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3d14-9d9a-481a-84c2-c0465e3f7a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:55.219886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3d14-9d9a-481a-84c2-c0465e3f7a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:55.226715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3d14-9d9a-481a-84c2-c0465e3f7a84 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:55.253916 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3639/7263] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:55.258276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:55.279330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299764-7322-4174-a571-fb1aa0ec8c31 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:55.293645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:55.294358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:55.294640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:55.294915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] PATH_INFO: `/v3/projects/2960259fd8e14e4e992d755106f29dcf/users/393285006f224f4b9604d0c9460ec6d1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:55.334074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2960259fd8e14e4e992d755106f29dcf, user_id=393285006f224f4b9604d0c9460ec6d1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:55.335828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:55.370595 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3625/7264] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:55 2022] PUT /identity/v3/projects/2960259fd8e14e4e992d755106f29dcf/users/393285006f224f4b9604d0c9460ec6d1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:55.382954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:55.383585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:55.384201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:55.505894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] MFA Rules not processed for user `393285006f224f4b9604d0c9460ec6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:55.507760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:55.719529 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3640/7265] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:55.737490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:55.739670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:55.836564 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:56.018144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe222f-b646-4d1a-b08a-171fcd5dee98 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:56.026103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:56.027568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:56.027989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:56.028271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:56.046810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:56.169796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:56.171992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:56.208420 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3626/7266] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:55 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:56.289239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:56.290754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:56.418116 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:56.497843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3d8eb-4af3-4844-9ac4-0eaa58d46025 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:56.515809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:56.516676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:56.517242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:56.517655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] PATH_INFO: `/v3/projects/3f9b4b358ad943a4a6308b1477dd8986` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:56.525751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9b4b358ad943a4a6308b1477dd8986)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:56.531698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:56.708066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9b4b358ad943a4a6308b1477dd8986', 'request_id': 'req-f22872f0-1fa6-41f9-9210-9ef21672c0e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:56.738838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9b4b358ad943a4a6308b1477dd8986', 'request_id': 'req-f22872f0-1fa6-41f9-9210-9ef21672c0e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:56.764658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9b4b358ad943a4a6308b1477dd8986', 'request_id': 'req-f22872f0-1fa6-41f9-9210-9ef21672c0e8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:56.795249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] The token cache is being invalidate because project 3f9b4b358ad943a4a6308b1477dd8986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:56.795539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:56.796549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:56.803862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3641/7267] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:56 2022] DELETE /identity/v3/projects/3f9b4b358ad943a4a6308b1477dd8986 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:56.808483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:56.822784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe81c3-c915-405c-af05-a68ac6280c77 service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:56.977433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:56.978347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:56.980320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:56.980672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] PATH_INFO: `/v3/users/5d1dc890eed9409c9c2ce5fbdd222b46` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:56.983371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1dc890eed9409c9c2ce5fbdd222b46)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:56.986113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:57.114012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1dc890eed9409c9c2ce5fbdd222b46'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.153497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1dc890eed9409c9c2ce5fbdd222b46'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.156240 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:57.189757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1dc890eed9409c9c2ce5fbdd222b46'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.190621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1dc890eed9409c9c2ce5fbdd222b46'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.203574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd173dd6-778b-4b58-b411-7b3e343dfb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1dc890eed9409c9c2ce5fbdd222b46'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.212231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:57.213892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:57.227235 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3627/7268] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:56 2022] DELETE /identity/v3/users/5d1dc890eed9409c9c2ce5fbdd222b46 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:57.237531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22872f0-1fa6-41f9-9210-9ef21672c0e8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:57.391753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:57.392449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:57.392580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:57.392893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] PATH_INFO: `/v3/users/d0c0774a03cd4d01bced56ca344c1dfd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:57.394087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c0774a03cd4d01bced56ca344c1dfd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:57.396614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:57.508219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c0774a03cd4d01bced56ca344c1dfd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.532660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c0774a03cd4d01bced56ca344c1dfd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.533704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c0774a03cd4d01bced56ca344c1dfd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.547985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c0774a03cd4d01bced56ca344c1dfd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.549264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c0774a03cd4d01bced56ca344c1dfd'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:57.597007 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:57.629143 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3642/7269] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:57 2022] DELETE /identity/v3/users/d0c0774a03cd4d01bced56ca344c1dfd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:57.634256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:57.634966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:57.635614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:57.688246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:57.690121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:57.891898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3628/7270] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:57.915348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:57.917383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:58.067273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba07a7-98c5-485d-86ea-3c1d45343735 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.074948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbec0e-9b59-427f-80dc-39ff790034e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:58.076753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbec0e-9b59-427f-80dc-39ff790034e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.077071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbec0e-9b59-427f-80dc-39ff790034e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.077347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbec0e-9b59-427f-80dc-39ff790034e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.104593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbec0e-9b59-427f-80dc-39ff790034e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:58.105889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.107348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:58.118891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbec0e-9b59-427f-80dc-39ff790034e3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:58.147748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505dbd9-e128-4276-9fea-601c62e9df43 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.159632 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3643/7271] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:38:58.165399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:58.166077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.166358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.166634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] PATH_INFO: `/v3/projects/47315335bf274a27a2e822e2148eb3e5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.174061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47315335bf274a27a2e822e2148eb3e5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:58.176032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:58.248141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47315335bf274a27a2e822e2148eb3e5', 'request_id': 'req-ff432506-2431-44d5-a02d-a3ed787f0143'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.256791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47315335bf274a27a2e822e2148eb3e5', 'request_id': 'req-ff432506-2431-44d5-a02d-a3ed787f0143'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.264253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47315335bf274a27a2e822e2148eb3e5', 'request_id': 'req-ff432506-2431-44d5-a02d-a3ed787f0143'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.287962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] The token cache is being invalidate because project 47315335bf274a27a2e822e2148eb3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:58.287962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.288903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ff432506-2431-44d5-a02d-a3ed787f0143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.293957 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3629/7272] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:58 2022] DELETE /identity/v3/projects/47315335bf274a27a2e822e2148eb3e5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:38:58.295907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa0c9-9134-4412-bd0a-680182e3c144 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.296197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa0c9-9134-4412-bd0a-680182e3c144 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.296857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa0c9-9134-4412-bd0a-680182e3c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.327911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7a0aa0c9-9134-4412-bd0a-680182e3c144 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:58.330964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7a0aa0c9-9134-4412-bd0a-680182e3c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:58.430921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3644/7273] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:58.433615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e66b-3c53-40d4-a5aa-be93e72ca92c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.433912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e66b-3c53-40d4-a5aa-be93e72ca92c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.434197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e66b-3c53-40d4-a5aa-be93e72ca92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.468138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fc01e66b-3c53-40d4-a5aa-be93e72ca92c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:58.470621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fc01e66b-3c53-40d4-a5aa-be93e72ca92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:58.482849 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3630/7274] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:38:58.487827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aa0c9-9134-4412-bd0a-680182e3c144 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.502219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aa0c9-9134-4412-bd0a-680182e3c144 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.510192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:58.511762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.512270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.513007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.514203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:38:58.514903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:58.518838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:58.566160 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3645/7275] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:38:58.567299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e66b-3c53-40d4-a5aa-be93e72ca92c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.577642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e66b-3c53-40d4-a5aa-be93e72ca92c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.583815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:58.584609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.585023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.585398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.586149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:58.588185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:58.627374 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3631/7276] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:38:58 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:38:58.631914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.645955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9f90d-3d50-4d4d-995f-2cfd0828a7e6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.751647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.753798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:58.755984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:58.758956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.759257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.759531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.761547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:58.763610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:58.773642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95f86d-a950-4e6d-be94-e089e094bd0d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.783485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:58.784417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.785497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.785838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] PATH_INFO: `/v3/projects/86c81ceba53847579131cab988f83a51` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.789363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c81ceba53847579131cab988f83a51)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:58.795037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:58.808022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3646/7277] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:38:58 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:38:58.812290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.840693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a5b68-4544-43d5-b6b1-e9a189dc260b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.841316 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:58.866450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:58.867147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:58.867427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:58.867704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:58.868364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:58.870594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:58.882062 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:58.882303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c81ceba53847579131cab988f83a51', 'request_id': 'req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.890382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c81ceba53847579131cab988f83a51', 'request_id': 'req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.898757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c81ceba53847579131cab988f83a51', 'request_id': 'req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.918673 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3647/7278] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:58.925599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.934333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] The token cache is being invalidate because project 86c81ceba53847579131cab988f83a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:38:58.934827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.935909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:58.938092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46817922-c243-4f83-90a4-b8fc04ae21ef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:58.938858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3632/7279] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:58 2022] DELETE /identity/v3/projects/86c81ceba53847579131cab988f83a51 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:58.942756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:58.946759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:59.053708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:59.054647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:59.055028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:59.055398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:59.056152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:59.058442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:59.065597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6541c9-09aa-4ff2-8d9b-baa5dbb659c4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:59.072723 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3648/7280] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:38:59.076921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:59.078716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:59.079630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:59.080034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:59.080384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:59.080665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] PATH_INFO: `/v3/users/393285006f224f4b9604d0c9460ec6d1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:59.081993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=393285006f224f4b9604d0c9460ec6d1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:59.084139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:59.095209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a253c5-82c9-4446-995a-fbf045a3d95b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:59.101070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f7b2-e786-4c1d-acaf-c4b043feae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:59.101994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f7b2-e786-4c1d-acaf-c4b043feae63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:59.102455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f7b2-e786-4c1d-acaf-c4b043feae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:59.102895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f7b2-e786-4c1d-acaf-c4b043feae63 admin admin] PATH_INFO: `/v3/projects/6c7b6300a3364416ac09794d5d04dc79/users/fe438cddfff2400690f93435a7e51e3b/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:59.122429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f7b2-e786-4c1d-acaf-c4b043feae63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7b6300a3364416ac09794d5d04dc79, user_id=fe438cddfff2400690f93435a7e51e3b, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:38:59.125855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f7b2-e786-4c1d-acaf-c4b043feae63 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:38:59.150498 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3649/7281] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:38:59 2022] PUT /identity/v3/projects/6c7b6300a3364416ac09794d5d04dc79/users/fe438cddfff2400690f93435a7e51e3b/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:59.161779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:59.162309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:59.162750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:59.168693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393285006f224f4b9604d0c9460ec6d1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:59.183021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393285006f224f4b9604d0c9460ec6d1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:59.216519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:38:59.219500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393285006f224f4b9604d0c9460ec6d1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:59.220277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:59.222173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393285006f224f4b9604d0c9460ec6d1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:59.243660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393285006f224f4b9604d0c9460ec6d1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:59.259021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3633/7282] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:38:58 2022] DELETE /identity/v3/users/393285006f224f4b9604d0c9460ec6d1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:59.397625 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3650/7283] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:38:59.398715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:59.479081 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:59.532655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fabb99-69cd-4378-acc1-9005d474b24e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:59.539243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad6659-2cb2-47da-9976-ff5c16a36809 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:38:59.541072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad6659-2cb2-47da-9976-ff5c16a36809 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:38:59.541549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad6659-2cb2-47da-9976-ff5c16a36809 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:38:59.542041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad6659-2cb2-47da-9976-ff5c16a36809 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:38:59.603902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-16ad6659-2cb2-47da-9976-ff5c16a36809 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:38:59.621786 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3634/7284] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:38:59 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:38:59.739742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:38:59.741505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:38:59.899308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5375f-7a23-4dce-9d8b-ee00b52a2438 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:38:59.903896 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:00.041129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.041811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.042090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.042359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] PATH_INFO: `/v3/projects/2960259fd8e14e4e992d755106f29dcf` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.046318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2960259fd8e14e4e992d755106f29dcf)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:00.048611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:00.144583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2960259fd8e14e4e992d755106f29dcf', 'request_id': 'req-1575f027-42f8-433d-858e-86e79f2e5962'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:00.159854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2960259fd8e14e4e992d755106f29dcf', 'request_id': 'req-1575f027-42f8-433d-858e-86e79f2e5962'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:00.169160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2960259fd8e14e4e992d755106f29dcf', 'request_id': 'req-1575f027-42f8-433d-858e-86e79f2e5962'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:00.190309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] The token cache is being invalidate because project 2960259fd8e14e4e992d755106f29dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:00.190838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:00.191619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1575f027-42f8-433d-858e-86e79f2e5962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:00.194244 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3651/7285] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:38:59 2022] DELETE /identity/v3/projects/2960259fd8e14e4e992d755106f29dcf => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:00.199735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cd01f-b3ce-4bf3-bdc8-66c9d0b9df1a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.200231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cd01f-b3ce-4bf3-bdc8-66c9d0b9df1a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.200485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cd01f-b3ce-4bf3-bdc8-66c9d0b9df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.253746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ed3cd01f-b3ce-4bf3-bdc8-66c9d0b9df1a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:00.255686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ed3cd01f-b3ce-4bf3-bdc8-66c9d0b9df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:00.421589 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3635/7286] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:00.430012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b372c9-18bb-4308-b687-6e33f50b55ea None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.430430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b372c9-18bb-4308-b687-6e33f50b55ea None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.430955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b372c9-18bb-4308-b687-6e33f50b55ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.459707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b6b372c9-18bb-4308-b687-6e33f50b55ea None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:00.461196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b6b372c9-18bb-4308-b687-6e33f50b55ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:00.471132 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3652/7287] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:00.475607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cd01f-b3ce-4bf3-bdc8-66c9d0b9df1a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.487022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cd01f-b3ce-4bf3-bdc8-66c9d0b9df1a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.492244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.493247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.494497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.494497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.495043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:00.495440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:00.497692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:00.516880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b372c9-18bb-4308-b687-6e33f50b55ea None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.522828 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3636/7288] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:00.526905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b372c9-18bb-4308-b687-6e33f50b55ea None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.532480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c50659-bd14-4bb0-ab97-eeb3e50aad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.533426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c50659-bd14-4bb0-ab97-eeb3e50aad09 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.534361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c50659-bd14-4bb0-ab97-eeb3e50aad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.534361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c50659-bd14-4bb0-ab97-eeb3e50aad09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.534879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c50659-bd14-4bb0-ab97-eeb3e50aad09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:00.539896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c50659-bd14-4bb0-ab97-eeb3e50aad09 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:00.583257 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3653/7289] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:00.587740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.607161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d18c9f-0106-4549-924c-ff2de8064bdb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.628246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd35-70c7-4aea-a31a-b1aa3f40d850 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.628246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd35-70c7-4aea-a31a-b1aa3f40d850 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.628816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd35-70c7-4aea-a31a-b1aa3f40d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.649877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-59dfbd35-70c7-4aea-a31a-b1aa3f40d850 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:00.651585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-59dfbd35-70c7-4aea-a31a-b1aa3f40d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:00.660844 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3654/7290] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 01:39:00.665810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778280c-53fa-486b-a4b3-f67135fc0998 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.666096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778280c-53fa-486b-a4b3-f67135fc0998 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.666368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778280c-53fa-486b-a4b3-f67135fc0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.694212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e778280c-53fa-486b-a4b3-f67135fc0998 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:00.695486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e778280c-53fa-486b-a4b3-f67135fc0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:00.710768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.711691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.712067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.712439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.713313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:00.716325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:00.766876 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3637/7291] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:00.768488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.785534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1765841-8c6d-45f5-ae07-82b1e8d02c4d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.791410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.792318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.792705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.793114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.794029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:00.795893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:00.800677 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3655/7292] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:00.802998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778280c-53fa-486b-a4b3-f67135fc0998 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.815511 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3638/7293] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:00.820466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778280c-53fa-486b-a4b3-f67135fc0998 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.824634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.829732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ae68-c82f-40d8-860d-7d63613f9fc6 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.830975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ae68-c82f-40d8-860d-7d63613f9fc6 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.831494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ae68-c82f-40d8-860d-7d63613f9fc6 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.832467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ae68-c82f-40d8-860d-7d63613f9fc6 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.839639 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:00.842704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd634c4-0730-465a-9a53-ff8db8fc333a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.852981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.853403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.855243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.855474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.856686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:00.863312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:00.894112 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3639/7294] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:00.897807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.917729 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-37e6ae68-c82f-40d8-860d-7d63613f9fc6 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:39:00.934414 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 21 01:39:00.935433 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:39:00.936447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c2e1-9227-4c93-b67f-a35afb9b07bb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.941822 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3656/7295] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 188 bytes in 136 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:39:00.942935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ae68-c82f-40d8-860d-7d63613f9fc6 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:00.949946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd928-8a15-465e-804c-2920a80ea213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.950639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd928-8a15-465e-804c-2920a80ea213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.950927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd928-8a15-465e-804c-2920a80ea213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.951206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd928-8a15-465e-804c-2920a80ea213 admin admin] PATH_INFO: `/v3/projects/45e7297a3291421799dffd95529d9977/users/0db2dfe4be6a47d79cff682f50e023f0/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.966719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ae68-c82f-40d8-860d-7d63613f9fc6 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:00.968336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd928-8a15-465e-804c-2920a80ea213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e7297a3291421799dffd95529d9977, user_id=0db2dfe4be6a47d79cff682f50e023f0, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:00.971623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd928-8a15-465e-804c-2920a80ea213 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:00.977071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bf98c-6657-4a85-895c-a14eb58f8b40 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:00.978165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf98c-6657-4a85-895c-a14eb58f8b40 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:00.978458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf98c-6657-4a85-895c-a14eb58f8b40 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:00.979396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf98c-6657-4a85-895c-a14eb58f8b40 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:00.993508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3640/7296] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:00 2022] PUT /identity/v3/projects/45e7297a3291421799dffd95529d9977/users/0db2dfe4be6a47d79cff682f50e023f0/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:01.006001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefebe92-d7bb-4e8a-88c7-9acf4a38bf03 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.006315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefebe92-d7bb-4e8a-88c7-9acf4a38bf03 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.006560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefebe92-d7bb-4e8a-88c7-9acf4a38bf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-699bf98c-6657-4a85-895c-a14eb58f8b40 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:39:01.061434 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 21 01:39:01.062484 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:39:01.067336 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3657/7297] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:00 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 188 bytes in 124 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 21 01:39:01.069766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eefebe92-d7bb-4e8a-88c7-9acf4a38bf03 None None] MFA Rules not processed for user `0db2dfe4be6a47d79cff682f50e023f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:01.071031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eefebe92-d7bb-4e8a-88c7-9acf4a38bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:01.077011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bf98c-6657-4a85-895c-a14eb58f8b40 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:01.090901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bf98c-6657-4a85-895c-a14eb58f8b40 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:01.208898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3641/7298] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:01.211925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefebe92-d7bb-4e8a-88c7-9acf4a38bf03 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:01.225785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8f9e-6410-4e9c-a174-d157bc445384 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:01.227641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8f9e-6410-4e9c-a174-d157bc445384 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.228031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8f9e-6410-4e9c-a174-d157bc445384 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.228407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8f9e-6410-4e9c-a174-d157bc445384 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.291647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefebe92-d7bb-4e8a-88c7-9acf4a38bf03 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:01.294504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-87ac8f9e-6410-4e9c-a174-d157bc445384 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:01.297893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:01.298553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.298836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.299114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.299762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:01.302648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:01.320320 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3658/7299] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:01 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:01.343883 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3642/7300] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:01 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:01.348161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8f9e-6410-4e9c-a174-d157bc445384 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:01.367880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8f9e-6410-4e9c-a174-d157bc445384 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:01.485997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:01.487570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.488006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.488390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.489284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:01.491353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:01.528450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3659/7301] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:01 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:01.532391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:01.550243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897a6c-c0d3-401f-90c3-7ddf419692f8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:01.559654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:01.561174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.561450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.561718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.562426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:01.565604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:01.594929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3643/7302] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:01.596416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:01.624252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c0c7-ccab-4673-9ab7-e59b54b31411 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:01.643440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d13553-3abf-49a4-a2b3-9480abee9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:01.644684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d13553-3abf-49a4-a2b3-9480abee9e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.645014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d13553-3abf-49a4-a2b3-9480abee9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.645281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d13553-3abf-49a4-a2b3-9480abee9e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.646794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d13553-3abf-49a4-a2b3-9480abee9e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:01.648474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d13553-3abf-49a4-a2b3-9480abee9e93 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:01.675520 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3660/7303] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:01.676729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:01.693860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032824b-370c-4404-a40a-4d5352f8ab41 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:01.707899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:01.708810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.709157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.709491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] PATH_INFO: `/v3/projects/cfac0c7ab6ae4a3e84731d7d91b892f8/users/ca5a02c7045d466d9448b22dba9010d6/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.751211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfac0c7ab6ae4a3e84731d7d91b892f8, user_id=ca5a02c7045d466d9448b22dba9010d6, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:01.757440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:01.788542 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3644/7304] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:01 2022] PUT /identity/v3/projects/cfac0c7ab6ae4a3e84731d7d91b892f8/users/ca5a02c7045d466d9448b22dba9010d6/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:01.801876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4a36-f587-435c-8370-2533aee88b6c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:01.802529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4a36-f587-435c-8370-2533aee88b6c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:01.803209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4a36-f587-435c-8370-2533aee88b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:01.864875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ec6a4a36-f587-435c-8370-2533aee88b6c None None] MFA Rules not processed for user `ca5a02c7045d466d9448b22dba9010d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:01.866957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ec6a4a36-f587-435c-8370-2533aee88b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:01.876663 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:01.954778 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3661/7305] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:01.963582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:01.965837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:01.996048 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:02.060152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f5548-4c58-42b2-8cca-00290bf37596 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:02.068497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9441-579d-4117-bc7d-dbdbd4bb88dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:02.069314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9441-579d-4117-bc7d-dbdbd4bb88dc service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:02.069601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9441-579d-4117-bc7d-dbdbd4bb88dc service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:02.069874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9441-579d-4117-bc7d-dbdbd4bb88dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:02.195416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9441-579d-4117-bc7d-dbdbd4bb88dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:02.196901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9441-579d-4117-bc7d-dbdbd4bb88dc service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:02.233309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3645/7306] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:02.325523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd3237-c377-4792-a898-75c86276732c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:02.325753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd3237-c377-4792-a898-75c86276732c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:02.326011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd3237-c377-4792-a898-75c86276732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:02.363023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-dbbd3237-c377-4792-a898-75c86276732c None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:02.364357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dbbd3237-c377-4792-a898-75c86276732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:02.394759 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3662/7307] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:02.396537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256e23-01d6-4872-a36d-e217c088efa3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:02.396883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256e23-01d6-4872-a36d-e217c088efa3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:02.397164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256e23-01d6-4872-a36d-e217c088efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:02.457183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1d256e23-01d6-4872-a36d-e217c088efa3 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:02.458447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d256e23-01d6-4872-a36d-e217c088efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:02.459325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd3237-c377-4792-a898-75c86276732c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:02.486717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd3237-c377-4792-a898-75c86276732c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:02.497815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:02.500245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:02.502416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:02.502873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:02.528497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:02.534096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:02.556178 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3663/7308] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:02.566686 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3646/7309] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:02.571124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:02.591115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc1f47-a505-481a-8a60-826a9b2569f8 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:02.615347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f79b5-05b7-44ba-9806-eb5b2919e0b9 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:02.616013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f79b5-05b7-44ba-9806-eb5b2919e0b9 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:02.616304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f79b5-05b7-44ba-9806-eb5b2919e0b9 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:02.616615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f79b5-05b7-44ba-9806-eb5b2919e0b9 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:02.734999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-844f79b5-05b7-44ba-9806-eb5b2919e0b9 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:02.750653 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3664/7310] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:02 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:03.138398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d256e23-01d6-4872-a36d-e217c088efa3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:03.295274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d256e23-01d6-4872-a36d-e217c088efa3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:03.302785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:03.304325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:03.304885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:03.305645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] PATH_INFO: `/v3/users/0db2dfe4be6a47d79cff682f50e023f0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:03.307332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db2dfe4be6a47d79cff682f50e023f0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:03.309711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:03.365135 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:03.408495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db2dfe4be6a47d79cff682f50e023f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:03.420178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db2dfe4be6a47d79cff682f50e023f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:03.447798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db2dfe4be6a47d79cff682f50e023f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:03.448640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db2dfe4be6a47d79cff682f50e023f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:03.458445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db2dfe4be6a47d79cff682f50e023f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:03.466274 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3647/7311] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:03 2022] DELETE /identity/v3/users/0db2dfe4be6a47d79cff682f50e023f0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:03.471058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05a209-dfb6-4def-8d3b-5e86f14bc76a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:03.471571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05a209-dfb6-4def-8d3b-5e86f14bc76a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:03.471703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05a209-dfb6-4def-8d3b-5e86f14bc76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:03.498780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7c05a209-dfb6-4def-8d3b-5e86f14bc76a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:03.500480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c05a209-dfb6-4def-8d3b-5e86f14bc76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:03.591343 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3665/7312] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:03.601828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:03.603216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:03.691816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1924c-62dd-467a-b2fe-7f856c0eb22e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:03.698613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98b353-f898-4c76-b0be-487c194c8762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:03.699280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b353-f898-4c76-b0be-487c194c8762 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:03.699564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b353-f898-4c76-b0be-487c194c8762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:03.699842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b353-f898-4c76-b0be-487c194c8762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:03.710302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98b353-f898-4c76-b0be-487c194c8762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:03.711718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98b353-f898-4c76-b0be-487c194c8762 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:03.733144 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3648/7313] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:03.756097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b837-568c-4b4a-b833-d53a2dd75a8a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:03.758087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b837-568c-4b4a-b833-d53a2dd75a8a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:03.758544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b837-568c-4b4a-b833-d53a2dd75a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:03.832832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e0f0b837-568c-4b4a-b833-d53a2dd75a8a None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:03.834261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e0f0b837-568c-4b4a-b833-d53a2dd75a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:03.838427 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3666/7314] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:03.844515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:03.845199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:03.845474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:03.874602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:03.876708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:03.966582 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3649/7315] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:03.971538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b837-568c-4b4a-b833-d53a2dd75a8a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:03.987090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b837-568c-4b4a-b833-d53a2dd75a8a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:03.998853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:03.999881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:04.000267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:04.000713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:04.084809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.123334 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3667/7316] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:03 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:04.190111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:04.192745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:04.215802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed96c4c-efd9-43a4-b701-f3d272f2f52e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:04.224011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:04.225304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:04.225844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:04.226191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] PATH_INFO: `/v3/projects/45e7297a3291421799dffd95529d9977` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:04.227596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e7297a3291421799dffd95529d9977)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:04.229646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:04.294764 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:04.302652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e7297a3291421799dffd95529d9977', 'request_id': 'req-f114d318-bb61-46e4-9460-17660c79a68b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.311397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e7297a3291421799dffd95529d9977', 'request_id': 'req-f114d318-bb61-46e4-9460-17660c79a68b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.318645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e7297a3291421799dffd95529d9977', 'request_id': 'req-f114d318-bb61-46e4-9460-17660c79a68b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.334425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] The token cache is being invalidate because project 45e7297a3291421799dffd95529d9977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:04.334979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.336549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.338776 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3650/7317] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:04 2022] DELETE /identity/v3/projects/45e7297a3291421799dffd95529d9977 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:04.342756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:04.346620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:04.362388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74e11-2102-4b3b-8aaa-7f6ff297c2ab tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:04.374269 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:04.456695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:04.457491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:04.457838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:04.458187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] PATH_INFO: `/v3/users/ca5a02c7045d466d9448b22dba9010d6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:04.459439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5a02c7045d466d9448b22dba9010d6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:04.461508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:04.537036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5a02c7045d466d9448b22dba9010d6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.549572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5a02c7045d466d9448b22dba9010d6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.550300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5a02c7045d466d9448b22dba9010d6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.559902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5a02c7045d466d9448b22dba9010d6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.560712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27c1f8d4-a696-47b2-a5c9-4d4adb1ae2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5a02c7045d466d9448b22dba9010d6'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:04.584196 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3668/7318] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:04 2022] DELETE /identity/v3/users/ca5a02c7045d466d9448b22dba9010d6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:05.014161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.033221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114d318-bb61-46e4-9460-17660c79a68b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:05.114779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:05.115445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.115910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.116189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] PATH_INFO: `/v3/projects/cfac0c7ab6ae4a3e84731d7d91b892f8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.117420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfac0c7ab6ae4a3e84731d7d91b892f8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:05.119386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:05.127607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea17c-afa3-4032-a22f-1c4f1ea0e3a6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.127866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea17c-afa3-4032-a22f-1c4f1ea0e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.128151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea17c-afa3-4032-a22f-1c4f1ea0e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.178715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a0eea17c-afa3-4032-a22f-1c4f1ea0e3a6 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:05.180866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0eea17c-afa3-4032-a22f-1c4f1ea0e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:05.189877 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3669/7319] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:05 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:05.191772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f417e-eed3-4ae9-a66a-f57f0fe3831b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.192356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f417e-eed3-4ae9-a66a-f57f0fe3831b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.193124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f417e-eed3-4ae9-a66a-f57f0fe3831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.227932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfac0c7ab6ae4a3e84731d7d91b892f8', 'request_id': 'req-65614d56-a013-46e4-bcc1-47868489f00b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:05.239442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfac0c7ab6ae4a3e84731d7d91b892f8', 'request_id': 'req-65614d56-a013-46e4-bcc1-47868489f00b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:05.243045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e55f417e-eed3-4ae9-a66a-f57f0fe3831b None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:05.246296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfac0c7ab6ae4a3e84731d7d91b892f8', 'request_id': 'req-65614d56-a013-46e4-bcc1-47868489f00b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:05.248808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e55f417e-eed3-4ae9-a66a-f57f0fe3831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:05.270556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] The token cache is being invalidate because project cfac0c7ab6ae4a3e84731d7d91b892f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:05.270858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:05.275057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-65614d56-a013-46e4-bcc1-47868489f00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:05.277865 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3651/7320] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:05 2022] DELETE /identity/v3/projects/cfac0c7ab6ae4a3e84731d7d91b892f8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:05.283791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fe85-536c-40e0-865c-a1cd89053263 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.284093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fe85-536c-40e0-865c-a1cd89053263 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.284335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fe85-536c-40e0-865c-a1cd89053263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.329356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-23b7fe85-536c-40e0-865c-a1cd89053263 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:05.330022 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3670/7321] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:05.330613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-23b7fe85-536c-40e0-865c-a1cd89053263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:05.335029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f417e-eed3-4ae9-a66a-f57f0fe3831b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.347427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f417e-eed3-4ae9-a66a-f57f0fe3831b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:05.353497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa9c91-ac3b-42de-a87d-399d68073db3 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:05.354165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa9c91-ac3b-42de-a87d-399d68073db3 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.354629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa9c91-ac3b-42de-a87d-399d68073db3 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.354998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa9c91-ac3b-42de-a87d-399d68073db3 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.424563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-91aa9c91-ac3b-42de-a87d-399d68073db3 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:05.431257 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:05.449838 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3671/7322] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:05 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:05.463738 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:05.484825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3652/7323] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:05.488326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ddc1-4566-4d33-9f9b-e876b530cbfc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.488918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ddc1-4566-4d33-9f9b-e876b530cbfc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.489428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ddc1-4566-4d33-9f9b-e876b530cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.519284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e655ddc1-4566-4d33-9f9b-e876b530cbfc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:05.520897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e655ddc1-4566-4d33-9f9b-e876b530cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:05.543508 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3672/7324] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:05.548645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fe85-536c-40e0-865c-a1cd89053263 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.565222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fe85-536c-40e0-865c-a1cd89053263 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:05.571315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:05.571960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.572653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.572990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.573726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:05.574035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:05.576116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:05.593623 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3653/7325] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:39:05.598604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655ddc1-4566-4d33-9f9b-e876b530cbfc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.618731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655ddc1-4566-4d33-9f9b-e876b530cbfc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:05.629191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:05.630055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.631169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.631983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.633027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:05.635313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:05.682250 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3673/7326] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:05 2022] POST /identity/v3/projects => generated 409 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:05.686506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.708406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c45e99-e463-4254-97c8-65db0b759789 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:05.798306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:05.799212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.799820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.800273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.801391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:05.803807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:05.850407 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3654/7327] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:05 2022] POST /identity/v3/users => generated 305 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:05.859600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.874934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7debd33-d411-4668-b876-90ef6284c2d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:05.883133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:05.883934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.884211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.885986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.887004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:05.888700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:05.910967 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3674/7328] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:05.914219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.934833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b2b30-7419-47b2-a801-e427fe67f6ce admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:05.948368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec48a-53ff-4795-a522-d1a17da5b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:05.949228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec48a-53ff-4795-a522-d1a17da5b05a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:05.949228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec48a-53ff-4795-a522-d1a17da5b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:05.951377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec48a-53ff-4795-a522-d1a17da5b05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:05.952161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dec48a-53ff-4795-a522-d1a17da5b05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:05.956261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dec48a-53ff-4795-a522-d1a17da5b05a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:05.971035 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3655/7329] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:05.976400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:05.998632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b6cea-9bc8-4fd2-a815-56915d01bfcf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:06.008596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:06.011279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.011812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.012283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] PATH_INFO: `/v3/projects/4ce1092a312b4f4fb9d77848fbd66fdb/users/07e8e119c0c9478ab858030528075c78/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.044037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce1092a312b4f4fb9d77848fbd66fdb, user_id=07e8e119c0c9478ab858030528075c78, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:06.047427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:06.076123 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3675/7330] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:05 2022] PUT /identity/v3/projects/4ce1092a312b4f4fb9d77848fbd66fdb/users/07e8e119c0c9478ab858030528075c78/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:06.091822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6452-54d7-48d3-8023-f5a199eaa5d0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.092493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6452-54d7-48d3-8023-f5a199eaa5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.092903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6452-54d7-48d3-8023-f5a199eaa5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.194766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-791d6452-54d7-48d3-8023-f5a199eaa5d0 None None] MFA Rules not processed for user `07e8e119c0c9478ab858030528075c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:06.196587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-791d6452-54d7-48d3-8023-f5a199eaa5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:06.312694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:06.315298 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3656/7331] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:06 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:06.423995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707e8e-4e4d-4082-95da-67e2c2e7485e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:06.434669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:06.435314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.435594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.435892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.436529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:06.438577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:06.456180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fa9a0-271e-413c-b3f0-a028e64b1531 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.456180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fa9a0-271e-413c-b3f0-a028e64b1531 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.456180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fa9a0-271e-413c-b3f0-a028e64b1531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.481304 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3676/7332] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:06 2022] POST /identity/v3/projects => generated 411 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:06.489378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:06.503491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0b9fa9a0-271e-413c-b3f0-a028e64b1531 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:06.504895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b9fa9a0-271e-413c-b3f0-a028e64b1531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:06.508909 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3657/7333] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:06 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:06.617406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c414a-accb-406a-8ea5-7697b601e4d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:06.630252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:06.631417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.631872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.633564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.634384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:06.636464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:06.670501 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3677/7334] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:06 2022] POST /identity/v3/users => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:06.675634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fa9a0-271e-413c-b3f0-a028e64b1531 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:06.690252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fa9a0-271e-413c-b3f0-a028e64b1531 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:06.695080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:06.695757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.696034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.696303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.697179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:06.698871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:06.715039 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3658/7335] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:06.716213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:06.731959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67709a8d-cc57-4804-95ac-05f772bc3da6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:06.737802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:06.738657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.739007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.739349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] PATH_INFO: `/v3/projects/6295d0030bbb4e12afc6b9a4effeb90f/users/f3d3adc01db6467da72a588eba5c65fd/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.744021 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=7,keystone:DELETE=1,keystone:SELECT=92 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:06.767724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6295d0030bbb4e12afc6b9a4effeb90f, user_id=f3d3adc01db6467da72a588eba5c65fd, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:06.771523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:06.793479 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3678/7336] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:06 2022] PUT /identity/v3/projects/6295d0030bbb4e12afc6b9a4effeb90f/users/f3d3adc01db6467da72a588eba5c65fd/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:06.800212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:06.824749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa9f7-90c5-4e9f-8448-44d89b4bc0df admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:06.864121 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:06.905657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb02f3-8b44-4692-9007-fe966920ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:06.906419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb02f3-8b44-4692-9007-fe966920ddea admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.906794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb02f3-8b44-4692-9007-fe966920ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.907152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb02f3-8b44-4692-9007-fe966920ddea admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.909360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb02f3-8b44-4692-9007-fe966920ddea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:06.911659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb02f3-8b44-4692-9007-fe966920ddea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:06.924180 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3659/7337] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:06.929857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:06.948478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37829ad-5f1d-4dbc-9a13-449e93aa3652 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:06.955613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:06.956723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:06.957419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:06.957758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] PATH_INFO: `/v3/projects/6295d0030bbb4e12afc6b9a4effeb90f/users/f3d3adc01db6467da72a588eba5c65fd/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:06.959918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6295d0030bbb4e12afc6b9a4effeb90f, user_id=f3d3adc01db6467da72a588eba5c65fd, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:06.963422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:06.989058 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3679/7338] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:06 2022] PUT /identity/v3/projects/6295d0030bbb4e12afc6b9a4effeb90f/users/f3d3adc01db6467da72a588eba5c65fd/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:07.000122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34eb9-0d8a-4042-9937-b7604c4fba4f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:07.000614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34eb9-0d8a-4042-9937-b7604c4fba4f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:07.000928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34eb9-0d8a-4042-9937-b7604c4fba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:07.035827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-04b34eb9-0d8a-4042-9937-b7604c4fba4f None None] MFA Rules not processed for user `f3d3adc01db6467da72a588eba5c65fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:07.037215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-04b34eb9-0d8a-4042-9937-b7604c4fba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:07.188647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3660/7339] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:06 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:07.198998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:07.202161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:07.282564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fddd6-0c87-41b1-a17f-a5e5a2c4d4bd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:07.287880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07cf57-327e-40b2-bc7a-fcbae34a6817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:07.288057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cf57-327e-40b2-bc7a-fcbae34a6817 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:07.288356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cf57-327e-40b2-bc7a-fcbae34a6817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:07.288705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cf57-327e-40b2-bc7a-fcbae34a6817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:07.299847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07cf57-327e-40b2-bc7a-fcbae34a6817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:07.301738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07cf57-327e-40b2-bc7a-fcbae34a6817 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:07.315731 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3680/7340] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:07 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:07.515260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52222-9204-4ea1-ac8f-e4116f7c2871 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:07.517067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52222-9204-4ea1-ac8f-e4116f7c2871 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:07.517067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52222-9204-4ea1-ac8f-e4116f7c2871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:07.552612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c0e52222-9204-4ea1-ac8f-e4116f7c2871 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:07.554532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c0e52222-9204-4ea1-ac8f-e4116f7c2871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:07.665889 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3661/7341] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:07.672524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029a61-bede-48ae-8531-9500e0ee6f0b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:07.672524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029a61-bede-48ae-8531-9500e0ee6f0b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:07.673144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029a61-bede-48ae-8531-9500e0ee6f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:07.698206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-74029a61-bede-48ae-8531-9500e0ee6f0b None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:07.699406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-74029a61-bede-48ae-8531-9500e0ee6f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:07.711859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa300-a917-4249-beb8-39317d75839f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:07.712171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa300-a917-4249-beb8-39317d75839f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:07.712600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa300-a917-4249-beb8-39317d75839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:07.736529 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3681/7342] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:07 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:07.833767 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.server.flask.application [None req-04eaa300-a917-4249-beb8-39317d75839f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.46: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 21 01:39:07.838308 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3662/7343] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 125 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 21 01:39:07.840518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f1af7-185b-4ef1-9435-90a7bde62156 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:07.841112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f1af7-185b-4ef1-9435-90a7bde62156 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:07.841387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f1af7-185b-4ef1-9435-90a7bde62156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:07.918209 n-d-master-1 devstack@keystone.service[81886]: WARNING keystone.server.flask.application [None req-ce0f1af7-185b-4ef1-9435-90a7bde62156 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.46: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 21 01:39:07.919736 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3682/7344] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 81 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 21 01:39:07.924430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d137a-23dc-4067-a88e-e1a73342960a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:07.924712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d137a-23dc-4067-a88e-e1a73342960a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:07.925111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d137a-23dc-4067-a88e-e1a73342960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:07.956379 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.server.flask.application [None req-c03d137a-23dc-4067-a88e-e1a73342960a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.46: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 21 01:39:07.961841 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3663/7345] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 38 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 21 01:39:08.083904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f1af7-185b-4ef1-9435-90a7bde62156 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:08.085716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ce0f1af7-185b-4ef1-9435-90a7bde62156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:08.233592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f1af7-185b-4ef1-9435-90a7bde62156 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:08.241243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:08.241984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:08.242389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:08.243006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:08.245149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:08.282608 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:08.327485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:08.329580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:08.341308 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3683/7346] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:39:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 655 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:10.195148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d137a-23dc-4067-a88e-e1a73342960a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:10.197034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c03d137a-23dc-4067-a88e-e1a73342960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:10.255751 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:10.319297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d137a-23dc-4067-a88e-e1a73342960a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:10.324960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:10.325814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:10.326284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:10.326707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] PATH_INFO: `/v3/users/50ef1656de7c4244a4be82e95b47df77` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:10.328131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ef1656de7c4244a4be82e95b47df77)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:10.330589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:10.402692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:10.417928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127748e-cde5-4806-b285-a91bac841403 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:10.425211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:10.426600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:10.426947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:10.427324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] PATH_INFO: `/v3/users/07e8e119c0c9478ab858030528075c78` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:10.431733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e8e119c0c9478ab858030528075c78)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:10.434160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:10.442047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ef1656de7c4244a4be82e95b47df77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.467434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ef1656de7c4244a4be82e95b47df77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.483212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ef1656de7c4244a4be82e95b47df77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.484322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ef1656de7c4244a4be82e95b47df77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.492591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-551e21f4-2744-4988-8106-80c75f760f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ef1656de7c4244a4be82e95b47df77'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.501169 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3664/7347] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:10 2022] DELETE /identity/v3/users/50ef1656de7c4244a4be82e95b47df77 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:10.505558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:10.506000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:10.506470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:10.506742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e8e119c0c9478ab858030528075c78'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.520456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e8e119c0c9478ab858030528075c78'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.521372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e8e119c0c9478ab858030528075c78'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.532019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e8e119c0c9478ab858030528075c78'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.532198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:10.533106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f699f7af-1804-48ea-a22b-ab00b727fe54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e8e119c0c9478ab858030528075c78'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:10.533481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:10.571803 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3684/7348] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:10 2022] DELETE /identity/v3/users/07e8e119c0c9478ab858030528075c78 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:10.576620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:10.577103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:10.577741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:10.613633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:10.615323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:10.620452 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3665/7349] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:10.632216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:10.634616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:10.716269 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3685/7350] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:10.726678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:10.728284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:10.740571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5110356-14be-4b8f-9d11-75078f21a98c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:10.744809 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:10.781760 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:10.802084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651782f3-e093-47fc-b0f3-5ec084c10886 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:10.806460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:10.807116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:10.807400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:10.807676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:10.815179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:10.816325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:10.817147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:10.818277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:10.821198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:10.822674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:10.831239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:10.832837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:10.837100 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3686/7351] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:10.856016 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3666/7352] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:11.041817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.043510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:11.075745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8428ed4-5b60-4b05-9bd7-aa199c151da1 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.097494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.098410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.098817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.099161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] PATH_INFO: `/v3/projects/76269e58f30f4f1dbef296c486e78b37` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.101540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76269e58f30f4f1dbef296c486e78b37)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.103828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.179276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76269e58f30f4f1dbef296c486e78b37', 'request_id': 'req-0f525100-94ed-41c3-af8b-b79156c30c97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.190599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76269e58f30f4f1dbef296c486e78b37', 'request_id': 'req-0f525100-94ed-41c3-af8b-b79156c30c97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.199680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76269e58f30f4f1dbef296c486e78b37', 'request_id': 'req-0f525100-94ed-41c3-af8b-b79156c30c97'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.209576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.212019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:11.216662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] The token cache is being invalidate because project 76269e58f30f4f1dbef296c486e78b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:11.217742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.219140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0f525100-94ed-41c3-af8b-b79156c30c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.221207 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3687/7353] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:11 2022] DELETE /identity/v3/projects/76269e58f30f4f1dbef296c486e78b37 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:11.226635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa8b2-6692-406c-9a63-5901f20f8433 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.227046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa8b2-6692-406c-9a63-5901f20f8433 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.227329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa8b2-6692-406c-9a63-5901f20f8433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.238039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58750a4-970e-40fe-bcf6-f1d6b6b3ae61 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.289926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7e1fa8b2-6692-406c-9a63-5901f20f8433 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:11.291501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7e1fa8b2-6692-406c-9a63-5901f20f8433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:11.319564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.320400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.320941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.321266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] PATH_INFO: `/v3/projects/4ce1092a312b4f4fb9d77848fbd66fdb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.322838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce1092a312b4f4fb9d77848fbd66fdb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.324898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.377646 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3688/7354] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:11.382260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce1092a312b4f4fb9d77848fbd66fdb', 'request_id': 'req-bba73d3f-75d6-4263-bafb-d5851090dfc7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.385515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fab70a-2bab-42e5-af2b-c0c4e73cbb25 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.385805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fab70a-2bab-42e5-af2b-c0c4e73cbb25 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.386082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fab70a-2bab-42e5-af2b-c0c4e73cbb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.391037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce1092a312b4f4fb9d77848fbd66fdb', 'request_id': 'req-bba73d3f-75d6-4263-bafb-d5851090dfc7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.405487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce1092a312b4f4fb9d77848fbd66fdb', 'request_id': 'req-bba73d3f-75d6-4263-bafb-d5851090dfc7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.419552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-81fab70a-2bab-42e5-af2b-c0c4e73cbb25 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:11.422019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-81fab70a-2bab-42e5-af2b-c0c4e73cbb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:11.429084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] The token cache is being invalidate because project 4ce1092a312b4f4fb9d77848fbd66fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:11.429831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.430773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.433176 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3667/7355] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:11 2022] DELETE /identity/v3/projects/4ce1092a312b4f4fb9d77848fbd66fdb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:11.438203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.439946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:11.501683 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:11.516749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3689/7356] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:11.521345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fab70a-2bab-42e5-af2b-c0c4e73cbb25 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.532108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fab70a-2bab-42e5-af2b-c0c4e73cbb25 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.539175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.539813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.540098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.540376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.541352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:11.541658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.543415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.543716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73d3f-75d6-4263-bafb-d5851090dfc7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.545310 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:11.552852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.553515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.553916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.554196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] PATH_INFO: `/v3/users/f3d3adc01db6467da72a588eba5c65fd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.555907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d3adc01db6467da72a588eba5c65fd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.558300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.572370 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3690/7357] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:11.582455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.597991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a188-94ed-435c-8f4a-2273322e3126 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.609591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.610223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.610646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.612525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.613172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.615074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.641689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d3adc01db6467da72a588eba5c65fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.650166 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3691/7358] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:11 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:11.654605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.655474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d3adc01db6467da72a588eba5c65fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.670836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d3adc01db6467da72a588eba5c65fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.671677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d3adc01db6467da72a588eba5c65fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.679652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d3adc01db6467da72a588eba5c65fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:11.688026 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3668/7359] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:11 2022] DELETE /identity/v3/users/f3d3adc01db6467da72a588eba5c65fd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:11.734815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae134d-e913-4b0b-bb74-7f48ffbb2bae admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.815706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.816507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.816919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.817288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.818784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.821717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.847540 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3692/7360] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:11 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:11.851993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.853794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:11.868047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad070c-2147-47e9-ac43-6bcb560cd8cf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.873027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.873715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.874065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.874493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.875577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.877456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.888543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3669/7361] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:11.893054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.904315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7f800-d3aa-4346-be9f-3fcb70d91ee1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.911005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.911719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.912088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.912431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.913203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:11.921420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:11.928969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3693/7362] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:11.932734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:11.945604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172a824-4231-4c1b-ab53-114edfe48b0a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:11.953324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd0407-0ad4-4563-ad61-1918a856f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:11.954118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0407-0ad4-4563-ad61-1918a856f281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:11.954482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0407-0ad4-4563-ad61-1918a856f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:11.954850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0407-0ad4-4563-ad61-1918a856f281 admin admin] PATH_INFO: `/v3/projects/410ce4a4f8c844ca84421fb0d70f098b/users/e7e2668459ff4dec8d8ce715d124b756/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:11.998252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd0407-0ad4-4563-ad61-1918a856f281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410ce4a4f8c844ca84421fb0d70f098b, user_id=e7e2668459ff4dec8d8ce715d124b756, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.001104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd0407-0ad4-4563-ad61-1918a856f281 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.018139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.019660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:12.048294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404d8d-5e5e-42c4-9695-c97c4d9f7d0c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.055821 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3670/7363] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:11 2022] PUT /identity/v3/projects/410ce4a4f8c844ca84421fb0d70f098b/users/e7e2668459ff4dec8d8ce715d124b756/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:12.068123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.068328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.068534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.101325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] MFA Rules not processed for user `e7e2668459ff4dec8d8ce715d124b756`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:12.102587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:12.147104 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:12.158386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722480cd-3831-41b2-b266-852390395009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.159964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722480cd-3831-41b2-b266-852390395009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.161391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722480cd-3831-41b2-b266-852390395009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.161774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722480cd-3831-41b2-b266-852390395009 admin admin] PATH_INFO: `/v3/projects/6295d0030bbb4e12afc6b9a4effeb90f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.163099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722480cd-3831-41b2-b266-852390395009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6295d0030bbb4e12afc6b9a4effeb90f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.165200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722480cd-3831-41b2-b266-852390395009 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.200967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3671/7364] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:12.208604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.210646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:12.240666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-722480cd-3831-41b2-b266-852390395009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6295d0030bbb4e12afc6b9a4effeb90f', 'request_id': 'req-722480cd-3831-41b2-b266-852390395009'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:12.250738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-722480cd-3831-41b2-b266-852390395009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6295d0030bbb4e12afc6b9a4effeb90f', 'request_id': 'req-722480cd-3831-41b2-b266-852390395009'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:12.255396 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:12.258666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-722480cd-3831-41b2-b266-852390395009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6295d0030bbb4e12afc6b9a4effeb90f', 'request_id': 'req-722480cd-3831-41b2-b266-852390395009'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:12.272790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-722480cd-3831-41b2-b266-852390395009 admin admin] The token cache is being invalidate because project 6295d0030bbb4e12afc6b9a4effeb90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:12.273210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-722480cd-3831-41b2-b266-852390395009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:12.274185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-722480cd-3831-41b2-b266-852390395009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:12.276453 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3694/7365] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:12 2022] DELETE /identity/v3/projects/6295d0030bbb4e12afc6b9a4effeb90f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:12.281589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb774415-0dab-43c4-8632-9485c66ace5c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.282570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb774415-0dab-43c4-8632-9485c66ace5c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.283041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb774415-0dab-43c4-8632-9485c66ace5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.315263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bb774415-0dab-43c4-8632-9485c66ace5c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:12.316516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb774415-0dab-43c4-8632-9485c66ace5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:12.317085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9f0c-2b46-4ecb-9d50-9e333e31e650 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.377254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.377527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.377772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.378041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.380064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:12.419070 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3695/7366] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:12.426086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ffb3c-9cc5-4a16-9508-7a99e1b86054 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.427040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ffb3c-9cc5-4a16-9508-7a99e1b86054 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.428030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ffb3c-9cc5-4a16-9508-7a99e1b86054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.449539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.451156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.455237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4a6ffb3c-9cc5-4a16-9508-7a99e1b86054 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:12.457528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a6ffb3c-9cc5-4a16-9508-7a99e1b86054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:12.470657 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3696/7367] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:12.472249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ffb3c-9cc5-4a16-9508-7a99e1b86054 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.476967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3672/7368] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:12.481811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ffb3c-9cc5-4a16-9508-7a99e1b86054 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.487385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.488342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.488692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.489167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.490209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:12.490798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.492854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.507484 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3697/7369] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:12.511565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.525876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3986d2-60bb-4790-821e-279328dbda56 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.531012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.531819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.532106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.532380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.533059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.535838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.575478 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3673/7370] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:12 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:12.579664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.590651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815fb40-4c02-45ec-89e2-9a947649c967 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.702296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.703185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.703517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.703837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.704686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.707066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.733157 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:12.744388 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3698/7371] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:12 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:12.745322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.757387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42bd5a-0d84-4c21-9f98-0b3af3561798 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.763215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.763408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.763664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.763856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.764681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.766643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.782619 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3674/7372] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:12.787127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.802191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1cc47-a10d-42b3-8d15-e588150afa2f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.808237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11563b0e-e89d-42d1-8677-713039d878aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.809378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11563b0e-e89d-42d1-8677-713039d878aa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.809870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11563b0e-e89d-42d1-8677-713039d878aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.810342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11563b0e-e89d-42d1-8677-713039d878aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.811367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11563b0e-e89d-42d1-8677-713039d878aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.813402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11563b0e-e89d-42d1-8677-713039d878aa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.834482 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3699/7373] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:12.838672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:12.854213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f6be-b200-49cc-8e6c-f7ba5e74fdd5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:12.860694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:12.861708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.862146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.862797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] PATH_INFO: `/v3/projects/5cece58697a84b46a3a870b8c21d36d8/users/1f83c9380dc44b1b801118867d47ecc1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.882135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cece58697a84b46a3a870b8c21d36d8, user_id=1f83c9380dc44b1b801118867d47ecc1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:12.885671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:12.906162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3675/7374] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:12 2022] PUT /identity/v3/projects/5cece58697a84b46a3a870b8c21d36d8/users/1f83c9380dc44b1b801118867d47ecc1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:12.920232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:12.920530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:12.920794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:12.975221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] MFA Rules not processed for user `1f83c9380dc44b1b801118867d47ecc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:12.977306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:13.080925 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3700/7375] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:13.092082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:13.094168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:13.151797 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:13.189787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dcacf-a27b-4563-94e2-4e18c5bd5e89 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:13.194018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954db30-d158-460d-80b5-f27ec56a0792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:13.194895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954db30-d158-460d-80b5-f27ec56a0792 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:13.195277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954db30-d158-460d-80b5-f27ec56a0792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:13.195655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954db30-d158-460d-80b5-f27ec56a0792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:13.206543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954db30-d158-460d-80b5-f27ec56a0792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:13.208174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954db30-d158-460d-80b5-f27ec56a0792 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:13.218727 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3676/7376] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:18.323451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:18.324989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:18.549522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597d523-fbba-410a-bab4-aa5f9ab17341 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:18.557296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:18.558086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:18.558371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:18.559063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:18.561063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:18.599706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:18.602295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:18.632664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3701/7377] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:18.973052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a6821-037d-4775-8fdf-e4135da22bda None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:18.974014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a6821-037d-4775-8fdf-e4135da22bda None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:18.974471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a6821-037d-4775-8fdf-e4135da22bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:19.098619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ff9a6821-037d-4775-8fdf-e4135da22bda None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:19.101727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ff9a6821-037d-4775-8fdf-e4135da22bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:19.111155 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3677/7378] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:18 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:19.112192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:19.113870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:19.249793 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:19.255322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9b6cf-e386-4515-bae3-be25ec5b4b11 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:19.260675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:19.261534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:19.262184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:19.262558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:19.324021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:19.336496 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3702/7379] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:19 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:20.342596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bebb81-98da-4ea1-858f-be9afda1c4c0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:20.343400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bebb81-98da-4ea1-858f-be9afda1c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:20.343722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bebb81-98da-4ea1-858f-be9afda1c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:20.369098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:20.371385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:20.397348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b7bebb81-98da-4ea1-858f-be9afda1c4c0 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:20.398559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b7bebb81-98da-4ea1-858f-be9afda1c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:20.413468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3678/7380] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:20 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:20.425607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7244-a415-45e4-80ed-1c162a317313 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:20.425866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7244-a415-45e4-80ed-1c162a317313 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:20.426139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7244-a415-45e4-80ed-1c162a317313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-69da7244-a415-45e4-80ed-1c162a317313 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 21 01:39:20.498905 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:39:20.500813 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 21 01:39:20.501838 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:39:20.508750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3679/7381] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:20 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 01:39:20.510535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4a6b-c47f-4239-a6c9-424c033a962c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:20.511048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4a6b-c47f-4239-a6c9-424c033a962c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:20.511551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4a6b-c47f-4239-a6c9-424c033a962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:20.535924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a01f9-00e9-4509-a17a-1d00f2c0717d tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:20.545247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:20.546422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:20.547011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:20.547503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] PATH_INFO: `/v3/users/e7e2668459ff4dec8d8ce715d124b756` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:20.549784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e2668459ff4dec8d8ce715d124b756)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:20.554952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:20.594011 n-d-master-1 devstack@keystone.service[81885]: WARNING keystone.server.flask.application [None req-0a0b4a6b-c47f-4239-a6c9-424c033a962c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.46: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 21 01:39:20.603873 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3680/7382] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:20 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 91 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 21 01:39:20.606244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92bdbb-1d93-4bea-83f8-897c6781eef4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:20.607104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92bdbb-1d93-4bea-83f8-897c6781eef4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:20.608107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92bdbb-1d93-4bea-83f8-897c6781eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:20.648163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e2668459ff4dec8d8ce715d124b756'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:20.661907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e2668459ff4dec8d8ce715d124b756'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:20.662630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e2668459ff4dec8d8ce715d124b756'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:20.674958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ba92bdbb-1d93-4bea-83f8-897c6781eef4 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:20.676228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba92bdbb-1d93-4bea-83f8-897c6781eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:20.679731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e2668459ff4dec8d8ce715d124b756'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:20.680612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6771b588-30d3-4d78-906e-cb83c8cec9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e2668459ff4dec8d8ce715d124b756'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:20.704248 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3681/7383] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:20.710175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92bdbb-1d93-4bea-83f8-897c6781eef4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:20.726775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92bdbb-1d93-4bea-83f8-897c6781eef4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:20.744562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:20.746801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:20.747357 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3703/7384] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:20 2022] DELETE /identity/v3/users/e7e2668459ff4dec8d8ce715d124b756 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:20.748856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:20.750583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:20.752023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:20.753584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:20.753928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:20.830998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:20.832543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:20.872156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:20.898088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3682/7385] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:20 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:20.948730 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:20.984944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3704/7386] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:21.053190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:21.061235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:21.112416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1a777-5895-4e75-bdf9-d56a96fee8cd tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:21.235933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a9052-21ac-4dd5-98ba-9fc4099471b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:21.238087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9052-21ac-4dd5-98ba-9fc4099471b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:21.238570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9052-21ac-4dd5-98ba-9fc4099471b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:21.239241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9052-21ac-4dd5-98ba-9fc4099471b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:21.279221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a9052-21ac-4dd5-98ba-9fc4099471b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:21.283087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a9052-21ac-4dd5-98ba-9fc4099471b2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:21.308949 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3683/7387] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:21.782163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:21.785219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:21.838355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18e879-5f05-4759-8093-ebcbe0de9f25 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:21.863297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:21.864460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:21.868981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:21.870774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] PATH_INFO: `/v3/projects/410ce4a4f8c844ca84421fb0d70f098b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:21.876040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=410ce4a4f8c844ca84421fb0d70f098b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:21.883878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:21.903577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598c8b-120b-47c4-9203-d59089597791 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:21.904585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598c8b-120b-47c4-9203-d59089597791 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:21.905085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598c8b-120b-47c4-9203-d59089597791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:21.964845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c0598c8b-120b-47c4-9203-d59089597791 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:21.967485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c0598c8b-120b-47c4-9203-d59089597791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:21.980552 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3684/7388] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:21 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:21.986691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401babbd-89e3-41bd-81dc-7f5f32f0cdf3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:21.993767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401babbd-89e3-41bd-81dc-7f5f32f0cdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:21.994375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401babbd-89e3-41bd-81dc-7f5f32f0cdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:22.058024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-401babbd-89e3-41bd-81dc-7f5f32f0cdf3 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:22.060356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-401babbd-89e3-41bd-81dc-7f5f32f0cdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:22.108295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410ce4a4f8c844ca84421fb0d70f098b', 'request_id': 'req-6d207b97-4c22-422d-a05e-f4db2dbc8fae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:22.133704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410ce4a4f8c844ca84421fb0d70f098b', 'request_id': 'req-6d207b97-4c22-422d-a05e-f4db2dbc8fae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:22.136351 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:UPDATE=4,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:22.142759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410ce4a4f8c844ca84421fb0d70f098b', 'request_id': 'req-6d207b97-4c22-422d-a05e-f4db2dbc8fae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:22.171462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] The token cache is being invalidate because project 410ce4a4f8c844ca84421fb0d70f098b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:22.171957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:22.174035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6d207b97-4c22-422d-a05e-f4db2dbc8fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:22.178984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3705/7389] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:21 2022] DELETE /identity/v3/projects/410ce4a4f8c844ca84421fb0d70f098b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:22.186557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7de85-4775-4a38-a751-3909f0034538 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:22.188057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7de85-4775-4a38-a751-3909f0034538 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:22.189534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7de85-4775-4a38-a751-3909f0034538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:22.243829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f9d7de85-4775-4a38-a751-3909f0034538 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:22.246896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f9d7de85-4775-4a38-a751-3909f0034538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:22.256885 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3685/7390] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:22.259003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401babbd-89e3-41bd-81dc-7f5f32f0cdf3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:22.285607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401babbd-89e3-41bd-81dc-7f5f32f0cdf3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:22.311685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db19e49-57c8-43bd-8ffc-0a2a05e52007 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:22.312490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db19e49-57c8-43bd-8ffc-0a2a05e52007 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:22.312879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db19e49-57c8-43bd-8ffc-0a2a05e52007 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:22.313112 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db19e49-57c8-43bd-8ffc-0a2a05e52007 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:22.409147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1db19e49-57c8-43bd-8ffc-0a2a05e52007 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:22.427571 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3686/7391] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:22 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:22.469928 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3706/7392] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:22.473550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbccc7-86f4-46f5-b916-ab7bc0e803b9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:22.474155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbccc7-86f4-46f5-b916-ab7bc0e803b9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:22.474611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbccc7-86f4-46f5-b916-ab7bc0e803b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:22.520827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2dbbccc7-86f4-46f5-b916-ab7bc0e803b9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:22.522107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2dbbccc7-86f4-46f5-b916-ab7bc0e803b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:22.556952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7de85-4775-4a38-a751-3909f0034538 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:22.560300 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3687/7393] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:22.573251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7de85-4775-4a38-a751-3909f0034538 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:22.589068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:22.589714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:22.589993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:22.590261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:22.591416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:22.591416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:22.592992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:22.620542 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3707/7394] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:22.624755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbccc7-86f4-46f5-b916-ab7bc0e803b9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:22.635378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbccc7-86f4-46f5-b916-ab7bc0e803b9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:22.652422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:22.653083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:22.653363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:22.653639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:22.654285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:22.656359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:22.745868 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3688/7395] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:22 2022] POST /identity/v3/projects => generated 353 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:22.746802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:22.761779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb1e67-7f42-45da-a747-bbf47d583791 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:22.923789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:22.926515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:22.927009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:22.927663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:22.928494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:22.930702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:22.939815 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:22.965126 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3708/7396] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:22 2022] POST /identity/v3/users => generated 277 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:22.969411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:22.983246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0639b7-8385-4ea2-abe7-d929485cf3a9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:22.997943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:22.999332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.000187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.000690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.001935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:23.004191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:23.022897 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3689/7397] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:23.023321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:23.036528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a36c9-8a5b-45be-a599-a6e02d13b476 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:23.041806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401624a6-d954-4aca-8be6-cd6fcb5e1d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:23.042774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401624a6-d954-4aca-8be6-cd6fcb5e1d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.044295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401624a6-d954-4aca-8be6-cd6fcb5e1d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.044853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401624a6-d954-4aca-8be6-cd6fcb5e1d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.045735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401624a6-d954-4aca-8be6-cd6fcb5e1d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:23.047594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401624a6-d954-4aca-8be6-cd6fcb5e1d3e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:23.066171 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3709/7398] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:23.067640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:23.085128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d7a6-564a-4407-a8fb-8e17caa9b2db admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:23.093283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:23.094324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.094833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.095516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] PATH_INFO: `/v3/projects/ca07cf9d59244f8595e046ee742f757d/users/d31f5b1335d14f90966f5b6f16a6912c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.122566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca07cf9d59244f8595e046ee742f757d, user_id=d31f5b1335d14f90966f5b6f16a6912c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:23.126263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:23.155628 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3690/7399] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:23 2022] PUT /identity/v3/projects/ca07cf9d59244f8595e046ee742f757d/users/d31f5b1335d14f90966f5b6f16a6912c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:23.158812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4b18-6487-4aab-88d8-1b20db51d149 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.159102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4b18-6487-4aab-88d8-1b20db51d149 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.159715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4b18-6487-4aab-88d8-1b20db51d149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.220297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9b5a4b18-6487-4aab-88d8-1b20db51d149 None None] MFA Rules not processed for user `d31f5b1335d14f90966f5b6f16a6912c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:23.222704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9b5a4b18-6487-4aab-88d8-1b20db51d149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:23.353091 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3710/7400] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:23.362515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:23.364495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:23.434515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208092e8-9917-4e02-97dc-e830be27c2da None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.435087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208092e8-9917-4e02-97dc-e830be27c2da None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.435590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208092e8-9917-4e02-97dc-e830be27c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.461190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-208092e8-9917-4e02-97dc-e830be27c2da None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:23.463079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-208092e8-9917-4e02-97dc-e830be27c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:23.478042 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3711/7401] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:23 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:23.479624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec20c5-2b35-488c-9221-b6fbcbf86408 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.484846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633379-5cd5-40dd-b1a5-111016fbee89 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:23.488245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec20c5-2b35-488c-9221-b6fbcbf86408 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.488819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec20c5-2b35-488c-9221-b6fbcbf86408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.494586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:23.495064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.495345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.495614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.513811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:23.515957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:23.540815 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3691/7402] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:23.553813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7aec20c5-2b35-488c-9221-b6fbcbf86408 None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:23.555262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7aec20c5-2b35-488c-9221-b6fbcbf86408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:23.718252 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3712/7403] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:23.723174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:23.742154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d95f-5747-4d93-a069-be073d8916b0 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:23.762931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1747d6-dda6-419e-b1b7-f41716477031 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe438cddfff2400690f93435a7e51e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c7b6300a3364416ac09794d5d04dc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:23.763608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1747d6-dda6-419e-b1b7-f41716477031 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:23.763889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1747d6-dda6-419e-b1b7-f41716477031 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:23.764966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1747d6-dda6-419e-b1b7-f41716477031 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b/password` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:23.960596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2e1747d6-dda6-419e-b1b7-f41716477031 tempest-IdentityV3UsersTest-1508104405 tempest-IdentityV3UsersTest-1508104405-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:23.963856 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:23.982271 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3692/7404] 10.222.0.46 () {60 vars in 1269 bytes} [Sun Aug 21 01:39:23 2022] POST /identity/v3/users/fe438cddfff2400690f93435a7e51e3b/password => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:24.990021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:24.990543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:24.991102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:25.050549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:25.054970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:25.059929 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3713/7405] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:24 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:26.065599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa763389-9be8-4192-8331-515ee45c38ce None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:26.066178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa763389-9be8-4192-8331-515ee45c38ce None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:26.066178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa763389-9be8-4192-8331-515ee45c38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:26.089859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-aa763389-9be8-4192-8331-515ee45c38ce None None] MFA Rules not processed for user `fe438cddfff2400690f93435a7e51e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:26.091097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aa763389-9be8-4192-8331-515ee45c38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:26.104360 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3693/7406] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:26.105031 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:26.106485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:26.246799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1751d-2860-4c61-aa68-4b8dd32e4acb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:26.252893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:26.253555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:26.253830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:26.254101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] PATH_INFO: `/v3/users/fe438cddfff2400690f93435a7e51e3b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:26.255553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe438cddfff2400690f93435a7e51e3b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:26.257516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:26.260305 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:26.335472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.351120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.351773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.362197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.363828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe438cddfff2400690f93435a7e51e3b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.400092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3714/7407] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:26 2022] DELETE /identity/v3/users/fe438cddfff2400690f93435a7e51e3b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:26.405802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:26.406143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:26.406738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:26.431168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:26.438445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:26.451886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:26.453715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:26.537411 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3694/7408] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:26.548519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:26.550309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:26.595256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be706-d683-461a-b6c7-d9dc354364fb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:26.606005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:26.606677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:26.606955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:26.607231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] PATH_INFO: `/v3/users/d31f5b1335d14f90966f5b6f16a6912c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:26.611367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31f5b1335d14f90966f5b6f16a6912c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:26.614539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:26.653122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a1a8e-f35d-437d-86be-48a2eb449552 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:26.666779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6642287-8cd3-46c3-8639-9e68aaf0a20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:26.667434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642287-8cd3-46c3-8639-9e68aaf0a20b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:26.667721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642287-8cd3-46c3-8639-9e68aaf0a20b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:26.668036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642287-8cd3-46c3-8639-9e68aaf0a20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:26.692474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6642287-8cd3-46c3-8639-9e68aaf0a20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:26.694672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6642287-8cd3-46c3-8639-9e68aaf0a20b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:26.710337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31f5b1335d14f90966f5b6f16a6912c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.713066 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3695/7409] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:26.727227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31f5b1335d14f90966f5b6f16a6912c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.728094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31f5b1335d14f90966f5b6f16a6912c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.738576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31f5b1335d14f90966f5b6f16a6912c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.739634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31f5b1335d14f90966f5b6f16a6912c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:26.761001 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:26.768122 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3715/7410] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:26 2022] DELETE /identity/v3/users/d31f5b1335d14f90966f5b6f16a6912c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:26.775422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:26.775422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:26.776139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:26.800346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:26.801842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:26.965727 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3696/7411] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:27.007813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:27.011578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:27.252155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603cea1-2756-4b2a-9c36-4cdf430b6dcc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:27.259201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f82a5-399c-4423-8c98-9a4cc91f8d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:27.260346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f82a5-399c-4423-8c98-9a4cc91f8d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:27.261123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f82a5-399c-4423-8c98-9a4cc91f8d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:27.261897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f82a5-399c-4423-8c98-9a4cc91f8d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:27.285096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f82a5-399c-4423-8c98-9a4cc91f8d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:27.286948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f82a5-399c-4423-8c98-9a4cc91f8d3e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:27.300531 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3716/7412] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:27.479253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:27.480806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:27.506084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1239-1fd0-4538-8666-4956eda25e2b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:27.518271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:27.519074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:27.519358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:27.519891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] PATH_INFO: `/v3/projects/6c7b6300a3364416ac09794d5d04dc79` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:27.521519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7b6300a3364416ac09794d5d04dc79)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:27.528438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:27.600055 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:27.619693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7b6300a3364416ac09794d5d04dc79', 'request_id': 'req-aebe9091-a5bf-44bc-8bdb-90ab7f975466'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:27.626572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7b6300a3364416ac09794d5d04dc79', 'request_id': 'req-aebe9091-a5bf-44bc-8bdb-90ab7f975466'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:27.633340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7b6300a3364416ac09794d5d04dc79', 'request_id': 'req-aebe9091-a5bf-44bc-8bdb-90ab7f975466'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:27.658888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] The token cache is being invalidate because project 6c7b6300a3364416ac09794d5d04dc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:27.659720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:27.664747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:27.668406 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3697/7413] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:27 2022] DELETE /identity/v3/projects/6c7b6300a3364416ac09794d5d04dc79 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:27.676284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aaad5-fe7c-4a3d-aa9c-e0dbb999fab8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:27.676597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aaad5-fe7c-4a3d-aa9c-e0dbb999fab8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:27.677000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aaad5-fe7c-4a3d-aa9c-e0dbb999fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:27.728277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7f0aaad5-fe7c-4a3d-aa9c-e0dbb999fab8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:27.730990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7f0aaad5-fe7c-4a3d-aa9c-e0dbb999fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:27.762175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:27.763733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:27.888362 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3717/7414] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:27.891816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18136401-1e32-422f-86ca-77470ea53056 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:27.892100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18136401-1e32-422f-86ca-77470ea53056 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:27.895813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18136401-1e32-422f-86ca-77470ea53056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:27.919847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9091-a5bf-44bc-8bdb-90ab7f975466 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:27.932560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:27.933317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:27.933592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:27.933862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] PATH_INFO: `/v3/projects/ca07cf9d59244f8595e046ee742f757d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:27.936580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca07cf9d59244f8595e046ee742f757d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:27.938714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:27.946484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-18136401-1e32-422f-86ca-77470ea53056 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:27.947717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-18136401-1e32-422f-86ca-77470ea53056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:27.966533 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3718/7415] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:27.969693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18136401-1e32-422f-86ca-77470ea53056 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.003190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18136401-1e32-422f-86ca-77470ea53056 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.015785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.016450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.016784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.017223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.017968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:28.018270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.025532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.057680 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3719/7416] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:39:28.063667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.068713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca07cf9d59244f8595e046ee742f757d', 'request_id': 'req-d5bc75a0-0e27-4491-9dbd-158732a5a742'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:28.085606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca07cf9d59244f8595e046ee742f757d', 'request_id': 'req-d5bc75a0-0e27-4491-9dbd-158732a5a742'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:28.089622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a156-9099-4f4a-84a1-73d369dea018 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.122262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca07cf9d59244f8595e046ee742f757d', 'request_id': 'req-d5bc75a0-0e27-4491-9dbd-158732a5a742'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:28.161778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] The token cache is being invalidate because project ca07cf9d59244f8595e046ee742f757d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:28.162149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:28.162833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d5bc75a0-0e27-4491-9dbd-158732a5a742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:28.164715 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3698/7417] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:27 2022] DELETE /identity/v3/projects/ca07cf9d59244f8595e046ee742f757d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:28.169950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2022-0e9a-4ead-a21e-3f372d2d2e4d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.172793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2022-0e9a-4ead-a21e-3f372d2d2e4d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.173101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2022-0e9a-4ead-a21e-3f372d2d2e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.219427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.219863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f55c2022-0e9a-4ead-a21e-3f372d2d2e4d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:28.220478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.220844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.221119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.221307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f55c2022-0e9a-4ead-a21e-3f372d2d2e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:28.221704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.237001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.252160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3699/7418] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:28.263105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cde6a4-3777-4988-8d11-388a5ed0434f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.263601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cde6a4-3777-4988-8d11-388a5ed0434f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.264491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cde6a4-3777-4988-8d11-388a5ed0434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.330128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-98cde6a4-3777-4988-8d11-388a5ed0434f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:28.331369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-98cde6a4-3777-4988-8d11-388a5ed0434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:28.336715 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3720/7419] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:28 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:28.340625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.353495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:28.385836 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:28.509944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356dc3f-142c-4bd0-80f4-a12a2a6e83e8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.516621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.517370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.517832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.518180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.518892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.520949 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:28.521412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.566119 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3721/7420] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:28 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:28.568968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.591917 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3700/7421] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:28.596455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cde6a4-3777-4988-8d11-388a5ed0434f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.598694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30edd8-9aba-47f0-94e3-235bfa9c5fac admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.612098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.612793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.613306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.613585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.614418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.616092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.618470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cde6a4-3777-4988-8d11-388a5ed0434f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.634855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.635446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.635730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.636003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.636689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:28.637019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.638692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.645658 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3722/7422] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:28.647608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.662674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f2856-236d-449e-b0c6-0956725aa5cd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.687417 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3701/7423] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:28.691403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.694756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.695958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.697164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.697704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.702462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.710704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.733358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9480e-e6ca-413e-8216-8c76748df7dd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.749587 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3723/7424] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:28.752045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.753123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.753754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.754028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.754298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.755423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.756897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.791661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81b9b8-fc1c-496b-b10a-bf5a164a99e6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:28.812646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8e326-cade-4528-a77b-b960ce6ad6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:28.813372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8e326-cade-4528-a77b-b960ce6ad6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.813650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8e326-cade-4528-a77b-b960ce6ad6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.813926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8e326-cade-4528-a77b-b960ce6ad6f4 admin admin] PATH_INFO: `/v3/projects/a51c2ed6a0e0416aa4a7cc74dfd46f6b/users/e753a93c57084def908027d17dcb8ad3/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:28.854463 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3702/7425] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:28 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:28.858487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:28.861589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8e326-cade-4528-a77b-b960ce6ad6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51c2ed6a0e0416aa4a7cc74dfd46f6b, user_id=e753a93c57084def908027d17dcb8ad3, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:28.873526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8e326-cade-4528-a77b-b960ce6ad6f4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:28.918268 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3724/7426] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:28 2022] PUT /identity/v3/projects/a51c2ed6a0e0416aa4a7cc74dfd46f6b/users/e753a93c57084def908027d17dcb8ad3/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:28.930534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0ad6-2d7d-40f4-b8ec-7f3589c95f98 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:28.930847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0ad6-2d7d-40f4-b8ec-7f3589c95f98 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:28.931129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0ad6-2d7d-40f4-b8ec-7f3589c95f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.006034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6afd0ad6-2d7d-40f4-b8ec-7f3589c95f98 None None] MFA Rules not processed for user `e753a93c57084def908027d17dcb8ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:29.007451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6afd0ad6-2d7d-40f4-b8ec-7f3589c95f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:29.043524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd607d9-c5e5-47d3-9de3-1b846715558a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.151916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.152642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.153228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.153584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.154716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.156944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.164092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3725/7427] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:29.168554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0ad6-2d7d-40f4-b8ec-7f3589c95f98 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.186157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0ad6-2d7d-40f4-b8ec-7f3589c95f98 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.193611 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3703/7428] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:28 2022] POST /identity/v3/users => generated 285 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:29.195328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.195966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.196402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.196551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.197630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.197967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.200457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.212502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cb321-6cc8-454d-b29a-7b57d4093672 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.220412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.221574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.222477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.223153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.223955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.225843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.238031 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3704/7429] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:29.240916 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3726/7430] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:29 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:29.243852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.245349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.258338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57849e-d3b1-4a78-9885-eed68db41847 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.282853 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:29.304095 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:29.343005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.343644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.343914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.344188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.345061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.347124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.354365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6678-a3b0-4425-a337-4d68d72afc0b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.365665 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3705/7431] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:29.366011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.367541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.380880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.381541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.383219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.383219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.391696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.392928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca650c3c-c55a-47c4-92b6-44d0f1ace2e5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.409669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e2456-d9f3-4c4a-bb6f-142447c626b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.410356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2456-d9f3-4c4a-bb6f-142447c626b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.410637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2456-d9f3-4c4a-bb6f-142447c626b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.410918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2456-d9f3-4c4a-bb6f-142447c626b6 admin admin] PATH_INFO: `/v3/projects/c30866afa2a0437d9af922355730ebaa/users/b1a49032b99d47db91def7e93ac21a16/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.433544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e2456-d9f3-4c4a-bb6f-142447c626b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30866afa2a0437d9af922355730ebaa, user_id=b1a49032b99d47db91def7e93ac21a16, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.437841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e2456-d9f3-4c4a-bb6f-142447c626b6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.451898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3727/7432] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:29 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:29.457638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.472987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3706/7433] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:29 2022] PUT /identity/v3/projects/c30866afa2a0437d9af922355730ebaa/users/b1a49032b99d47db91def7e93ac21a16/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:29.489960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb7e4-699a-453d-83a3-6bc87eac8771 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.490512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb7e4-699a-453d-83a3-6bc87eac8771 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.492056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb7e4-699a-453d-83a3-6bc87eac8771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.498138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377bb3c-8b33-4689-967a-8631c07b40f1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.538987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ab4cb7e4-699a-453d-83a3-6bc87eac8771 None None] MFA Rules not processed for user `b1a49032b99d47db91def7e93ac21a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:29.540620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab4cb7e4-699a-453d-83a3-6bc87eac8771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:29.591664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.592607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.593025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.598326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.599126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.603097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.629168 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3728/7434] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:29.632814 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3707/7435] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:29.634130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.637746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb7e4-699a-453d-83a3-6bc87eac8771 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.662106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488da16-0981-4f5a-9c7c-388bdda58b77 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.667131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb7e4-699a-453d-83a3-6bc87eac8771 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.670767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.671873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.672399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.672797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] PATH_INFO: `/v3/projects/3ae0cd46b7294a439f539becad9499cd/users/8f23abcbd8ce4e5a8297fd9882db979f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.673633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.675057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.675174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.675382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.676095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.678183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.694813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae0cd46b7294a439f539becad9499cd, user_id=8f23abcbd8ce4e5a8297fd9882db979f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.698286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.729586 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3729/7436] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:29 2022] PUT /identity/v3/projects/3ae0cd46b7294a439f539becad9499cd/users/8f23abcbd8ce4e5a8297fd9882db979f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:29.734270 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3708/7437] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:29 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:29.737912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.748215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.906073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d64b-2dc4-4861-9f48-18272d607bf3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.920498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.922592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.922874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.923165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.923811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.930995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.943352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab0c3-9779-46a0-b01d-85488bd9308c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.952780 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:29.958306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900796-a534-4166-942e-84945d07afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.958898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900796-a534-4166-942e-84945d07afcd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.959182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900796-a534-4166-942e-84945d07afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.959456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900796-a534-4166-942e-84945d07afcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.960108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900796-a534-4166-942e-84945d07afcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:29.961844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900796-a534-4166-942e-84945d07afcd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:29.969071 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3709/7438] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:29 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:29.971756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.986587 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3730/7439] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:29.988321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4dbf-4505-42f5-b71c-9920b4f76be8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:29.992116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900796-a534-4166-942e-84945d07afcd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:29.995780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:29.996826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:29.997365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:29.997884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:29.998930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:30.001302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:30.014331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900796-a534-4166-942e-84945d07afcd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:30.016813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3710/7440] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:30.020669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:30.023998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853236c9-ef0d-4b51-b950-7fdac149f68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:30.024706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853236c9-ef0d-4b51-b950-7fdac149f68d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.025015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853236c9-ef0d-4b51-b950-7fdac149f68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.025290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853236c9-ef0d-4b51-b950-7fdac149f68d admin admin] PATH_INFO: `/v3/projects/3ae0cd46b7294a439f539becad9499cd/users/8f23abcbd8ce4e5a8297fd9882db979f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.029567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853236c9-ef0d-4b51-b950-7fdac149f68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae0cd46b7294a439f539becad9499cd, user_id=8f23abcbd8ce4e5a8297fd9882db979f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:30.033014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853236c9-ef0d-4b51-b950-7fdac149f68d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:30.033654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e013-0641-4131-b715-2cce36f345e1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:30.041386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:30.042417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.043192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.043564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] PATH_INFO: `/v3/projects/6af6974b3a774ace823bad6a5dfb3bd0/users/b8e42499b1a546af9a30775da9f18781/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.063093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3731/7441] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:29 2022] PUT /identity/v3/projects/3ae0cd46b7294a439f539becad9499cd/users/8f23abcbd8ce4e5a8297fd9882db979f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:30.074421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.074627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af6974b3a774ace823bad6a5dfb3bd0, user_id=b8e42499b1a546af9a30775da9f18781, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:30.074721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.074972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.078079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:30.084091 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:30.110808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] MFA Rules not processed for user `8f23abcbd8ce4e5a8297fd9882db979f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:30.112519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:30.125971 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3711/7442] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:30 2022] PUT /identity/v3/projects/6af6974b3a774ace823bad6a5dfb3bd0/users/b8e42499b1a546af9a30775da9f18781/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:30.130442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:30.276697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a029-217b-454a-b60d-25fd99e49f19 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:30.282078 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3732/7443] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:30.293894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:30.295540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:30.296526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:30.297499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.297969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.298424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.299262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:30.301305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:30.316518 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3712/7444] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:30.317593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:30.331353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40549cc3-a4fc-44b6-a427-e7df1241bff7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:30.338188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05923022-a686-41cb-a502-2b452e17637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:30.338976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05923022-a686-41cb-a502-2b452e17637e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.339311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05923022-a686-41cb-a502-2b452e17637e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.339656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05923022-a686-41cb-a502-2b452e17637e admin admin] PATH_INFO: `/v3/projects/6af6974b3a774ace823bad6a5dfb3bd0/users/b8e42499b1a546af9a30775da9f18781/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.342253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05923022-a686-41cb-a502-2b452e17637e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af6974b3a774ace823bad6a5dfb3bd0, user_id=b8e42499b1a546af9a30775da9f18781, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:30.354709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05923022-a686-41cb-a502-2b452e17637e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:30.397389 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3713/7445] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:30 2022] PUT /identity/v3/projects/6af6974b3a774ace823bad6a5dfb3bd0/users/b8e42499b1a546af9a30775da9f18781/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:30.399351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.399635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.399909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.404864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ea29-5846-4823-887b-70498e614263 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:30.470929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:30.471999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.472434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.472922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.498383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] MFA Rules not processed for user `b8e42499b1a546af9a30775da9f18781`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:30.500694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:30.603495 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:30.608178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:30.610998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:30.642114 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3714/7446] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:30.649665 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3733/7447] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:30.652566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:30.654097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:30.737674 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:30.820076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6633c-1733-42f3-8f57-5f4c73b6b1bb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:30.824271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139437e-f0ec-4159-a999-b47c5fd69735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:30.824943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139437e-f0ec-4159-a999-b47c5fd69735 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:30.825223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139437e-f0ec-4159-a999-b47c5fd69735 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:30.825499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139437e-f0ec-4159-a999-b47c5fd69735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:30.858241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139437e-f0ec-4159-a999-b47c5fd69735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:30.859855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139437e-f0ec-4159-a999-b47c5fd69735 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:30.876198 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3715/7448] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:33.453346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:33.536948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a714188-b834-4d51-8adb-71bd2b049446 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:33.551013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:33.551784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:33.552028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:33.552313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] PATH_INFO: `/v3/users/b1a49032b99d47db91def7e93ac21a16` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:33.554720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a49032b99d47db91def7e93ac21a16)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:33.556740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:33.632226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a49032b99d47db91def7e93ac21a16'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:33.643505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a49032b99d47db91def7e93ac21a16'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:33.644712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a49032b99d47db91def7e93ac21a16'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:33.661545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a49032b99d47db91def7e93ac21a16'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:33.662572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a49032b99d47db91def7e93ac21a16'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:33.693852 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3734/7449] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:33 2022] DELETE /identity/v3/users/b1a49032b99d47db91def7e93ac21a16 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:33.695663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:33.696381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:33.697004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:33.742342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:33.743634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:33.890787 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3716/7450] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:33.904334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:33.906781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:34.048090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfa751-fcf7-45b8-88fd-6371126df468 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:34.052151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:34.052882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:34.053296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:34.053432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:34.064539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:34.066090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:34.078687 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3735/7451] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:34.686096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:34.688296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:34.760253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad69a-9867-4baa-9abd-203d7420c4db None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:34.777383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:34.778459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:34.778913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:34.779340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] PATH_INFO: `/v3/projects/c30866afa2a0437d9af922355730ebaa` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:34.780964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30866afa2a0437d9af922355730ebaa)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:34.783369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:34.843570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30866afa2a0437d9af922355730ebaa', 'request_id': 'req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:34.851912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30866afa2a0437d9af922355730ebaa', 'request_id': 'req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:34.860868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30866afa2a0437d9af922355730ebaa', 'request_id': 'req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:34.883587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] The token cache is being invalidate because project c30866afa2a0437d9af922355730ebaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:34.884140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:34.885114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:34.887487 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3717/7452] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:34 2022] DELETE /identity/v3/projects/c30866afa2a0437d9af922355730ebaa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:34.891581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:34.902222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e4793-5948-45ed-a125-7f356d53163c service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:34.915961 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:34.972270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:34.983147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:34.984620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:34.985082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] PATH_INFO: `/v3/users/b8e42499b1a546af9a30775da9f18781` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:34.987643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e42499b1a546af9a30775da9f18781)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:34.990288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:35.086506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e42499b1a546af9a30775da9f18781'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:35.096047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e42499b1a546af9a30775da9f18781'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:35.096729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e42499b1a546af9a30775da9f18781'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:35.105180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e42499b1a546af9a30775da9f18781'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:35.105879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8ebdb2fd-f57f-40ca-a9af-414b8eee3bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e42499b1a546af9a30775da9f18781'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:35.142034 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3736/7453] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:34 2022] DELETE /identity/v3/users/b8e42499b1a546af9a30775da9f18781 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:35.789455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:35.791466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:35.817492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba713-4bcc-4d24-8d38-e6c030f73d99 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:35.945946 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:35.966544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:35.967605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:35.968118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:35.968541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] PATH_INFO: `/v3/projects/6af6974b3a774ace823bad6a5dfb3bd0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:35.973464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af6974b3a774ace823bad6a5dfb3bd0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:35.975665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:36.060884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af6974b3a774ace823bad6a5dfb3bd0', 'request_id': 'req-75dc97ee-5cd4-4936-8964-1983c98ae566'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:36.073525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af6974b3a774ace823bad6a5dfb3bd0', 'request_id': 'req-75dc97ee-5cd4-4936-8964-1983c98ae566'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:36.086321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af6974b3a774ace823bad6a5dfb3bd0', 'request_id': 'req-75dc97ee-5cd4-4936-8964-1983c98ae566'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:36.162987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] The token cache is being invalidate because project 6af6974b3a774ace823bad6a5dfb3bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:36.168028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:36.172009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-75dc97ee-5cd4-4936-8964-1983c98ae566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:36.179829 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3718/7454] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:35 2022] DELETE /identity/v3/projects/6af6974b3a774ace823bad6a5dfb3bd0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:36.181643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6d5e8-280e-429e-bfe6-e9d8ba576e2a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:36.182450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6d5e8-280e-429e-bfe6-e9d8ba576e2a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:36.182920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6d5e8-280e-429e-bfe6-e9d8ba576e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:36.219222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-59a6d5e8-280e-429e-bfe6-e9d8ba576e2a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:36.220906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-59a6d5e8-280e-429e-bfe6-e9d8ba576e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:36.363289 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3737/7455] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:36.371228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694648f6-e800-4721-899e-b4c709538fe0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:36.371942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694648f6-e800-4721-899e-b4c709538fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:36.372406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694648f6-e800-4721-899e-b4c709538fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:36.398513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-694648f6-e800-4721-899e-b4c709538fe0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:36.399973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-694648f6-e800-4721-899e-b4c709538fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:36.412815 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3719/7456] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:36.415897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6d5e8-280e-429e-bfe6-e9d8ba576e2a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:36.435212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6d5e8-280e-429e-bfe6-e9d8ba576e2a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:36.450582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:36.452186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:36.452481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:36.452752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:36.453452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:36.454314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:36.456858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:36.505768 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3738/7457] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:39:36.508502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694648f6-e800-4721-899e-b4c709538fe0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:36.521059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694648f6-e800-4721-899e-b4c709538fe0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:36.536220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:36.537025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:36.537393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:36.537905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:36.539020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:36.545289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:36.631940 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3720/7458] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:36 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:36.636188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:36.654477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3532e-664d-403a-b484-c02d522dae98 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:36.702152 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:36.792119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:36.793179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:36.793615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:36.794039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:36.794915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:36.797262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:36.863949 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3739/7459] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:36 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:36.864868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:36.886610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47a6a-0c76-428a-8d6a-98f025dd1f01 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:36.913443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:36.914254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:36.914538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:36.914809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:36.930228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:36.932693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:36.966190 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3721/7460] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:36.967818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:36.982186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5582f1-796a-4091-960b-522748dc0b34 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:36.993804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362af52-df9f-465a-a9c4-464fbda52f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:36.994989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362af52-df9f-465a-a9c4-464fbda52f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:36.995505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362af52-df9f-465a-a9c4-464fbda52f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:36.997009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362af52-df9f-465a-a9c4-464fbda52f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:36.998879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362af52-df9f-465a-a9c4-464fbda52f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:37.000761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362af52-df9f-465a-a9c4-464fbda52f45 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:37.029062 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3740/7461] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:37.029752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:37.042763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b9224-f774-46e0-a891-cb93ef8fad0c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:37.071508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:37.072208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:37.072527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:37.072787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] PATH_INFO: `/v3/projects/15c17700572c42709c6ce61220a25065/users/e2dcbd69b5094ba293c451ae8149d9c8/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:37.095815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c17700572c42709c6ce61220a25065, user_id=e2dcbd69b5094ba293c451ae8149d9c8, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:37.101016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:37.135895 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3722/7462] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:37 2022] PUT /identity/v3/projects/15c17700572c42709c6ce61220a25065/users/e2dcbd69b5094ba293c451ae8149d9c8/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:37.147550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131591-4d49-4189-b1c9-379014583df7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:37.147922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131591-4d49-4189-b1c9-379014583df7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:37.148101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131591-4d49-4189-b1c9-379014583df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:37.196533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c9131591-4d49-4189-b1c9-379014583df7 None None] MFA Rules not processed for user `e2dcbd69b5094ba293c451ae8149d9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:37.198007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c9131591-4d49-4189-b1c9-379014583df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:37.304455 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3741/7463] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:37.309912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:37.496610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0e5da-8033-47c1-8502-b3c978952ac8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:37.511056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:37.511746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:37.512026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:37.512298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:37.513056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:37.515675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:37.588735 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3723/7464] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:37 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:37.592051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131591-4d49-4189-b1c9-379014583df7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:37.614385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131591-4d49-4189-b1c9-379014583df7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:37.740638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:37.741581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:37.742447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:37.742900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:37.743687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:37.747014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:37.774691 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3742/7465] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:37 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:37.778816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:37.785411 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:37.798650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677ca15-3468-4cfa-9d5b-31484c0945b1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:37.810544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:37.811178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:37.811705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:37.811705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:37.812373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:37.814059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:37.848396 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3724/7466] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:37.852804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:37.868193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5602-704f-4c4b-9240-86975eae3034 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:37.874840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:37.876051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:37.876682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:37.877179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] PATH_INFO: `/v3/projects/addbd4e6e19f476cb058784482511e20/users/549b226789ba4836825be5227c7d763f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:37.899329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=addbd4e6e19f476cb058784482511e20, user_id=549b226789ba4836825be5227c7d763f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:37.903052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:37.910100 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:37.940888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:37.941859 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3743/7467] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:37 2022] PUT /identity/v3/projects/addbd4e6e19f476cb058784482511e20/users/549b226789ba4836825be5227c7d763f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:37.959431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68defbb7-fc46-4b87-ba26-c730c82166f9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:38.120557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a506d4-b7bf-4ed7-b502-c4342a9a494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:38.122070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a506d4-b7bf-4ed7-b502-c4342a9a494e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:38.122581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a506d4-b7bf-4ed7-b502-c4342a9a494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:38.123131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a506d4-b7bf-4ed7-b502-c4342a9a494e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:38.124422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a506d4-b7bf-4ed7-b502-c4342a9a494e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:38.128348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a506d4-b7bf-4ed7-b502-c4342a9a494e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:38.143599 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3725/7468] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:38.147537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:38.159771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab498b0-0f29-4bc0-b3d7-ea14178e8768 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:38.174840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:38.175678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:38.175980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:38.176287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] PATH_INFO: `/v3/projects/addbd4e6e19f476cb058784482511e20/users/549b226789ba4836825be5227c7d763f/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:38.182732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=addbd4e6e19f476cb058784482511e20, user_id=549b226789ba4836825be5227c7d763f, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:38.186062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:38.211170 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3744/7469] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:38 2022] PUT /identity/v3/projects/addbd4e6e19f476cb058784482511e20/users/549b226789ba4836825be5227c7d763f/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:38.222261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee666-c926-4760-babd-34a93b548579 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:38.222841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee666-c926-4760-babd-34a93b548579 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:38.223282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee666-c926-4760-babd-34a93b548579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:38.265279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-793ee666-c926-4760-babd-34a93b548579 None None] MFA Rules not processed for user `549b226789ba4836825be5227c7d763f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:38.266918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-793ee666-c926-4760-babd-34a93b548579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:38.454028 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3726/7470] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:38.466202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:38.468183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:38.585593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870ed91-e0ee-4811-bcfa-6dccb2c18440 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:38.589654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:38.590422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:38.590702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:38.590971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:38.605324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:38.606908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:38.633399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3745/7471] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:38.738886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ee666-c926-4760-babd-34a93b548579 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:38.949252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ee666-c926-4760-babd-34a93b548579 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:38.949878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:38.951477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:38.958286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:38.959259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:38.960503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:38.961024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] PATH_INFO: `/v3/users/e2dcbd69b5094ba293c451ae8149d9c8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:38.963434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dcbd69b5094ba293c451ae8149d9c8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:38.966144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:38.987947 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:39.055720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dcbd69b5094ba293c451ae8149d9c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.083035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dcbd69b5094ba293c451ae8149d9c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.089197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd58b6-4db9-4ccc-9537-2895f9e30514 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:39.097988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:39.100166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:39.109964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:39.111290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:39.114269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:39.121570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dcbd69b5094ba293c451ae8149d9c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.126254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dcbd69b5094ba293c451ae8149d9c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.144021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2f08f352-0357-49f7-b746-d0f18e5c94f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dcbd69b5094ba293c451ae8149d9c8'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.152939 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3727/7472] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:38 2022] DELETE /identity/v3/users/e2dcbd69b5094ba293c451ae8149d9c8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:39.158249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:39.158573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:39.159364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:39.159776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:39.161933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:39.181443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:39.182938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:39.187708 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3746/7473] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:39.268974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3728/7474] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:39.278661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:39.280826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:39.295389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ba0b-4cc6-415b-b874-7a888cdb9b95 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:39.385302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:39.386082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:39.386363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:39.386636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:39.397397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:39.398861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:39.410854 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3747/7475] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:39.754197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:39.756117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:39.782475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227679-3fbb-4e96-a448-3d1dab141a31 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:39.793754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:39.794766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:39.795142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:39.795689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] PATH_INFO: `/v3/projects/15c17700572c42709c6ce61220a25065` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:39.798309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c17700572c42709c6ce61220a25065)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:39.801677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:39.867997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c17700572c42709c6ce61220a25065', 'request_id': 'req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.894240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c17700572c42709c6ce61220a25065', 'request_id': 'req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.900851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c17700572c42709c6ce61220a25065', 'request_id': 'req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.920655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] The token cache is being invalidate because project 15c17700572c42709c6ce61220a25065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:39.921021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.921804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:39.926319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3729/7476] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:39 2022] DELETE /identity/v3/projects/15c17700572c42709c6ce61220a25065 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:39.927674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:39.940828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537905e0-3814-4091-8daf-1e80b91fdcc0 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:40.027167 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:40.080147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:40.080849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:40.081132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:40.081910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] PATH_INFO: `/v3/users/549b226789ba4836825be5227c7d763f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:40.082731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549b226789ba4836825be5227c7d763f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:40.084794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:40.105712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:40.107400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:40.168205 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:40.189491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549b226789ba4836825be5227c7d763f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:40.206084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549b226789ba4836825be5227c7d763f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:40.206941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549b226789ba4836825be5227c7d763f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:40.233912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549b226789ba4836825be5227c7d763f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:40.235252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549b226789ba4836825be5227c7d763f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:40.276615 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3748/7477] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:39 2022] DELETE /identity/v3/users/549b226789ba4836825be5227c7d763f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:40.302709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3141e9-037d-42dd-bdd4-6ae66f0a70d0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:40.438728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f23abcbd8ce4e5a8297fd9882db979f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae0cd46b7294a439f539becad9499cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:40.440164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:40.440646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:40.441250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:40.442228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:40.442686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:40.444724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:40.464723 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3730/7478] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:40.470820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:40.474616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:40.495979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade692e-0b9b-4174-8f8d-981a67a8cb41 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:40.501990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f23abcbd8ce4e5a8297fd9882db979f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae0cd46b7294a439f539becad9499cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:40.502939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:40.503428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:40.503789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:40.504572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:40.507049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:40.555916 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3749/7479] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:40 2022] POST /identity/v3/projects => generated 348 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:40.557886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:40.575585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f50c-edea-4eab-9a3f-6b24de7943f3 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:40.685393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95268703-f821-4a5e-bd2b-d54c6cbbf780 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f23abcbd8ce4e5a8297fd9882db979f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae0cd46b7294a439f539becad9499cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:40.686358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268703-f821-4a5e-bd2b-d54c6cbbf780 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:40.686824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268703-f821-4a5e-bd2b-d54c6cbbf780 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:40.687256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268703-f821-4a5e-bd2b-d54c6cbbf780 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:40.688085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95268703-f821-4a5e-bd2b-d54c6cbbf780 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:40.690563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95268703-f821-4a5e-bd2b-d54c6cbbf780 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:40.692449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95268703-f821-4a5e-bd2b-d54c6cbbf780 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:40.723232 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3731/7480] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:41.276625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:41.279488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:41.405923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba097fd8-0e98-464c-9b39-12c891647bd4 tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:41.411462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:41.412191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:41.412591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:41.412915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] PATH_INFO: `/v3/projects/addbd4e6e19f476cb058784482511e20` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:41.414178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=addbd4e6e19f476cb058784482511e20)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:41.416273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:41.463029 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:41.483028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addbd4e6e19f476cb058784482511e20', 'request_id': 'req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:41.495555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addbd4e6e19f476cb058784482511e20', 'request_id': 'req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:41.502885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addbd4e6e19f476cb058784482511e20', 'request_id': 'req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:41.517798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] The token cache is being invalidate because project addbd4e6e19f476cb058784482511e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:41.518147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:41.518788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:41.520673 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3750/7481] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:41 2022] DELETE /identity/v3/projects/addbd4e6e19f476cb058784482511e20 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:41.530102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722384-f57a-4f9c-b1c5-9fd504023bca None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:41.532532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722384-f57a-4f9c-b1c5-9fd504023bca None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:41.533064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722384-f57a-4f9c-b1c5-9fd504023bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:41.610695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7d722384-f57a-4f9c-b1c5-9fd504023bca None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:41.614888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d722384-f57a-4f9c-b1c5-9fd504023bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:41.704025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:41.705468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:41.721458 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:41.756455 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3732/7482] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:41.761338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675beeec-c881-4245-9a06-010778cfc201 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:41.761668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675beeec-c881-4245-9a06-010778cfc201 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:41.761877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675beeec-c881-4245-9a06-010778cfc201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:41.860256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-675beeec-c881-4245-9a06-010778cfc201 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:41.862210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-675beeec-c881-4245-9a06-010778cfc201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:41.873433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3733/7483] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:41.884560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675beeec-c881-4245-9a06-010778cfc201 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:41.896467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675beeec-c881-4245-9a06-010778cfc201 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:41.902122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:41.902872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:41.903324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:41.903816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:41.904674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:41.905231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:41.907102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:41.907370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8168ec-f02b-4f1e-9d10-3e913d3a9021 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:41.921855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f23abcbd8ce4e5a8297fd9882db979f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae0cd46b7294a439f539becad9499cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:41.922832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:41.923285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:41.923713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] PATH_INFO: `/v3/projects/77123cb485fe4ab088fcbf5596e00352` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:41.923885 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3734/7484] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:41.925322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77123cb485fe4ab088fcbf5596e00352)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:41.927718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:41.928430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:41.947168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25550877-ea53-4e5f-90e0-adcde3483044 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:41.955240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:41.955884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:41.957872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:41.957966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:41.958726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:41.961000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:42.009296 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3735/7485] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:41 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:42.012451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.025830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77123cb485fe4ab088fcbf5596e00352', 'request_id': 'req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:42.035475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77123cb485fe4ab088fcbf5596e00352', 'request_id': 'req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:42.050174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77123cb485fe4ab088fcbf5596e00352', 'request_id': 'req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:42.105544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] The token cache is being invalidate because project 77123cb485fe4ab088fcbf5596e00352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:42.105943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:42.106824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:42.113584 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3751/7486] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:41 2022] DELETE /identity/v3/projects/77123cb485fe4ab088fcbf5596e00352 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:42.132236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.134518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:42.139151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2359-e875-445b-b09f-8fec5425021b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:42.144369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:42.145026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:42.145671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:42.145671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:42.146207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:42.149899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:42.184806 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3736/7487] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:42 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:42.187553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.190832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:42.226062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948faa9-c1f8-454e-9f6d-a5796aefa7eb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:42.237325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:42.238346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:42.238922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:42.240476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:42.241403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:42.243689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:42.259994 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:42.277437 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3737/7488] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:42.277898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.279088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507bcfd-235d-4ff0-a9fa-ad6943e8e06f tempest-RoutersAdminTest-1223273380 tempest-RoutersAdminTest-1223273380-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:42.314648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f80399-7efb-4fc2-861d-6d2930013f3a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:42.327984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:42.328702 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:42.329154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:42.331465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:42.331465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:42.348464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:42.365179 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3738/7489] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:42.366490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.377802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c4797-a4ef-46a8-b2d7-61accd870a3a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:42.383794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710302b3-170a-4cc5-b93c-2d0ad7479dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:42.386002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710302b3-170a-4cc5-b93c-2d0ad7479dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:42.386422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710302b3-170a-4cc5-b93c-2d0ad7479dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:42.387460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710302b3-170a-4cc5-b93c-2d0ad7479dd1 admin admin] PATH_INFO: `/v3/projects/29c77149f5394fe1ad4f4f41028d9810/users/58faf3c2db8e414ca162b0593dfc9bae/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:42.405277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710302b3-170a-4cc5-b93c-2d0ad7479dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c77149f5394fe1ad4f4f41028d9810, user_id=58faf3c2db8e414ca162b0593dfc9bae, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:42.408224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710302b3-170a-4cc5-b93c-2d0ad7479dd1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:42.437142 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3739/7490] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:42 2022] PUT /identity/v3/projects/29c77149f5394fe1ad4f4f41028d9810/users/58faf3c2db8e414ca162b0593dfc9bae/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:42.439668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:42.440166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:42.440620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:42.450847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:42.451800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:42.452136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:42.452408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:42.456813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:42.499269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] MFA Rules not processed for user `58faf3c2db8e414ca162b0593dfc9bae`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:42.502639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:42.601056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:42.602093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:42.611927 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:42.615670 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3752/7491] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:42.666093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3740/7492] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:42.670606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.698501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d5ac8-b06c-41ce-ab1d-f8d88d4715fb service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:42.838827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:42.840028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:42.840316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:42.840630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:42.842480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:42.847925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:42.893817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.895409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:42.900473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3753/7493] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:42 2022] POST /identity/v3/projects => generated 393 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:42.904626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:42.913338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049d7ea-6c0f-4136-b2b5-63911ee77e1b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:43.011821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:43.012459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.012750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.013113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] PATH_INFO: `/v3/users/1f83c9380dc44b1b801118867d47ecc1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.014293 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:43.014424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f83c9380dc44b1b801118867d47ecc1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:43.016744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:43.042118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675d4fe-1d1f-40b7-acc3-14ac326431d3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:43.047196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:43.048303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.048583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.049520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.050625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:43.053169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:43.084193 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3754/7494] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:42 2022] POST /identity/v3/users => generated 303 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:43.087856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:43.101942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f83c9380dc44b1b801118867d47ecc1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:43.118214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9174273-b0df-4569-9a53-5409d7b1d29e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:43.129802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f83c9380dc44b1b801118867d47ecc1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:43.165286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:43.166420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.166952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.167291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.168010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:43.169715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:43.174552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f83c9380dc44b1b801118867d47ecc1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:43.175483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f83c9380dc44b1b801118867d47ecc1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:43.184540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-715d5250-bae0-4b6b-ad2e-7f2061e0f407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f83c9380dc44b1b801118867d47ecc1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:43.193700 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3741/7495] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:42 2022] DELETE /identity/v3/users/1f83c9380dc44b1b801118867d47ecc1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:43.198146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3755/7496] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:43.202215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:43.203354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.203707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.204050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.204195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:43.229946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:43.231374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:43.232649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c1b2-849c-4888-b264-f8e1af8cf751 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:43.364874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:43.365622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.366001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.366163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] PATH_INFO: `/v3/projects/3abfdeff38084004a68c7286ccae0909/users/51d51174e7c04072bd145dde71c036ba/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.383452 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3742/7497] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:43.389534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:43.391720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:43.402785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abfdeff38084004a68c7286ccae0909, user_id=51d51174e7c04072bd145dde71c036ba, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:43.403450 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:43.409376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:43.456620 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3756/7498] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:43 2022] PUT /identity/v3/projects/3abfdeff38084004a68c7286ccae0909/users/51d51174e7c04072bd145dde71c036ba/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:43.457282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:43.542730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611c30-dddf-4c03-af4f-8228363035fb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:43.573346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f64bb-f64e-4a1b-bacd-330902506952 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:43.579090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:43.580049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.580477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.580965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.581813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:43.584010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:43.597515 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3757/7499] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:43.602401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:43.614671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dfb42-6e9b-4a77-b04f-ae38f063f069 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:43.620309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8073c-48bd-4128-9c94-b16c0a36d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:43.621294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8073c-48bd-4128-9c94-b16c0a36d342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.621724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8073c-48bd-4128-9c94-b16c0a36d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.622199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8073c-48bd-4128-9c94-b16c0a36d342 admin admin] PATH_INFO: `/v3/projects/3abfdeff38084004a68c7286ccae0909/users/51d51174e7c04072bd145dde71c036ba/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.624513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8073c-48bd-4128-9c94-b16c0a36d342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abfdeff38084004a68c7286ccae0909, user_id=51d51174e7c04072bd145dde71c036ba, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:43.626986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:43.627690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.628141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.628477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.629925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8073c-48bd-4128-9c94-b16c0a36d342 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:43.643171 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3758/7500] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:43 2022] PUT /identity/v3/projects/3abfdeff38084004a68c7286ccae0909/users/51d51174e7c04072bd145dde71c036ba/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:43.646461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:43.648152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:43.653863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:43.654170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:43.654539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:43.667910 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3743/7501] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:43.697050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] MFA Rules not processed for user `51d51174e7c04072bd145dde71c036ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:43.698710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:43.722815 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:43.853128 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3759/7502] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:43.865667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:43.869900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:43.975495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:43.977398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:44.024754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40b5b2-ed59-465e-a3d7-c512fafa8aa9 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.091423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf8e74-100d-419b-b63c-f2447cd232ab None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.096450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.097312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.097911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.098368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] PATH_INFO: `/v3/projects/5cece58697a84b46a3a870b8c21d36d8` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.105606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cece58697a84b46a3a870b8c21d36d8)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.122824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.150999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.156856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.157764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.158057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.178854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.180675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.194944 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3744/7503] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:44.210327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cece58697a84b46a3a870b8c21d36d8', 'request_id': 'req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:44.226965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cece58697a84b46a3a870b8c21d36d8', 'request_id': 'req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:44.238502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cece58697a84b46a3a870b8c21d36d8', 'request_id': 'req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:44.261270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] The token cache is being invalidate because project 5cece58697a84b46a3a870b8c21d36d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:44.261834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:44.262738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-7ab1a36e-9f6c-4f35-9626-717f7767b3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:44.271477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:44.273072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3760/7504] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:43 2022] DELETE /identity/v3/projects/5cece58697a84b46a3a870b8c21d36d8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:44.275364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:44.278394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa340163-12e1-4c4f-83b6-af1048ab68b4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.278751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa340163-12e1-4c4f-83b6-af1048ab68b4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.280184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa340163-12e1-4c4f-83b6-af1048ab68b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.295290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5128-0da9-43c7-8b3a-a5aff3af17ee service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.320725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fa340163-12e1-4c4f-83b6-af1048ab68b4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:44.322124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fa340163-12e1-4c4f-83b6-af1048ab68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:44.322570 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:44.375752 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:44.402106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.403349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.403659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.403935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.406773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:44.429139 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3761/7505] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:44.430721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2ad0-cd1f-4736-b116-28fe8030bf52 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.431181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2ad0-cd1f-4736-b116-28fe8030bf52 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.431549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2ad0-cd1f-4736-b116-28fe8030bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.457379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f74a2ad0-cd1f-4736-b116-28fe8030bf52 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:44.459553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f74a2ad0-cd1f-4736-b116-28fe8030bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:44.474745 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3762/7506] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:44.477091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2ad0-cd1f-4736-b116-28fe8030bf52 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:44.488666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2ad0-cd1f-4736-b116-28fe8030bf52 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.491398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.494906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.494906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.495359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.495755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.496553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:44.496983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.497174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.499322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.516499 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3763/7507] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:44.517805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:44.541403 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3745/7508] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:44.542648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ed435-a002-4dd5-adb1-f60442361afa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.548269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.549272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.550237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.550602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.551327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.553642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.597888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3764/7509] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:44 2022] POST /identity/v3/projects => generated 403 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:44.601341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:44.625314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad313248-7642-4a1d-aa68-ab25c7ceb6db service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.698180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.698924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.698924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.699191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.699764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.702124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.733182 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3746/7510] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:44 2022] POST /identity/v3/users => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:44.741884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:44.763605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a1605-fc12-4c04-a515-bb6fd985e60b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.783183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.784177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.784445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.784722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.785424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.787045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.798730 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3765/7511] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:44.802619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:44.813141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67c59-1cfd-4468-8ffc-f722abd2fffe admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.818551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49026d-f991-4e37-a5cd-877dcf3dfce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.819452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49026d-f991-4e37-a5cd-877dcf3dfce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.819922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49026d-f991-4e37-a5cd-877dcf3dfce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.820233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49026d-f991-4e37-a5cd-877dcf3dfce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.820909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49026d-f991-4e37-a5cd-877dcf3dfce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.822660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49026d-f991-4e37-a5cd-877dcf3dfce2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.835383 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3747/7512] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:44.839399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:44.850537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2bd5-0a13-45e1-9a97-78e0f277aaa3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:44.857771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:44.858503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.858783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.859112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] PATH_INFO: `/v3/projects/b0b93bc387b3412f99dfe57def485319/users/9cdec564f0dd427fa3d1cd08bb27bb20/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.887840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b93bc387b3412f99dfe57def485319, user_id=9cdec564f0dd427fa3d1cd08bb27bb20, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:44.891349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:44.920624 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3766/7513] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:44 2022] PUT /identity/v3/projects/b0b93bc387b3412f99dfe57def485319/users/9cdec564f0dd427fa3d1cd08bb27bb20/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:44.922165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8aeb-9d53-454c-a55d-815e667eaf51 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:44.922455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8aeb-9d53-454c-a55d-815e667eaf51 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:44.922751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8aeb-9d53-454c-a55d-815e667eaf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:44.950899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-905b8aeb-9d53-454c-a55d-815e667eaf51 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:44.953013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-905b8aeb-9d53-454c-a55d-815e667eaf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:45.097558 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:45.135703 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3748/7514] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:45.174772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:45.177177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:45.268263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b1b1-49e0-4aff-8b37-12435988c795 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:45.273817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:45.274676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:45.275166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:45.275619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:45.287060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:45.288724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:45.300258 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3767/7515] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:46.633758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5154-cfa3-4cbe-b272-d5fff86dd8e7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:46.634324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5154-cfa3-4cbe-b272-d5fff86dd8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:46.634488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5154-cfa3-4cbe-b272-d5fff86dd8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:46.683531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-76fd5154-cfa3-4cbe-b272-d5fff86dd8e7 None None] MFA Rules not processed for user `9cdec564f0dd427fa3d1cd08bb27bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:46.685767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-76fd5154-cfa3-4cbe-b272-d5fff86dd8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:46.800108 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3749/7516] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:46.801681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:46.812942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389566a-cdbe-4451-ad94-c9da2950607a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:46.817904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:46.818528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:46.818807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:46.819134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:46.819988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:46.821778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:46.878831 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3768/7517] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:46 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:46.882902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5154-cfa3-4cbe-b272-d5fff86dd8e7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:46.901376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5154-cfa3-4cbe-b272-d5fff86dd8e7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:46.929069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:46.931573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:47.002475 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:47.003369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.004313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.004694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.005132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.006342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.009746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.047450 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3750/7518] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:46 2022] POST /identity/v3/users => generated 309 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:47.048946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:47.050634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:47.060529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052d502-00a4-47f2-8d31-9dc7daa09f69 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:47.066510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabaf11e-966d-485d-b629-6248eda06c21 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:47.074066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.075119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.075758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.076358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] PATH_INFO: `/v3/users/05c1f10a225e4f14885bf583527e93a0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.077988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c1f10a225e4f14885bf583527e93a0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.082979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.083247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.093461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.093751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.094051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.101206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:47.125714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.127926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.157152 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3769/7519] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:47.159418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:47.175891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9c1d9-bb1e-4d7d-a238-35bd58c88e11 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:47.181938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.182621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.182968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.183308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.184213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.186286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.202922 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3770/7520] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:47.208156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c1f10a225e4f14885bf583527e93a0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.210024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:47.222774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735ee4-2e14-444c-b7b1-6ef5c2d5e9bc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:47.229824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.230520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.230799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.231083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] PATH_INFO: `/v3/projects/979bd7631fdf4313aac67f2502271dfb/users/4129f844c2264fe1b1cf102a5f311b79/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.235751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c1f10a225e4f14885bf583527e93a0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.255328 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:47.262005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c1f10a225e4f14885bf583527e93a0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.263010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c1f10a225e4f14885bf583527e93a0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.274573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979bd7631fdf4313aac67f2502271dfb, user_id=4129f844c2264fe1b1cf102a5f311b79, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.274800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c1f10a225e4f14885bf583527e93a0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.277847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.282589 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3751/7521] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:47 2022] DELETE /identity/v3/users/05c1f10a225e4f14885bf583527e93a0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:47.299080 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3771/7522] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:47 2022] PUT /identity/v3/projects/979bd7631fdf4313aac67f2502271dfb/users/4129f844c2264fe1b1cf102a5f311b79/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:47.312803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:47.314617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:47.477040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bcbb3-c7b8-4766-b50d-8f2188a52aab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:47.586249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.587354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.588192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.588630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.589718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.590808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:47.592837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:47.598618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.613223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac38c6-a705-4420-aa25-776edd352301 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:47.636112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.637018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.637483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.637923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] PATH_INFO: `/v3/projects/522827f3647e4cdfa81257e8a048278b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.647319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3752/7523] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:47.650961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=522827f3647e4cdfa81257e8a048278b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.652902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:47.662152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.667079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f4e79-3f19-441d-ba1c-a452499d62b3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:47.674474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe28ec-c848-4b5d-886c-7408c5cbfc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:47.675216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe28ec-c848-4b5d-886c-7408c5cbfc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.675496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe28ec-c848-4b5d-886c-7408c5cbfc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.676182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe28ec-c848-4b5d-886c-7408c5cbfc98 admin admin] PATH_INFO: `/v3/projects/979bd7631fdf4313aac67f2502271dfb/users/4129f844c2264fe1b1cf102a5f311b79/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.678562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe28ec-c848-4b5d-886c-7408c5cbfc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979bd7631fdf4313aac67f2502271dfb, user_id=4129f844c2264fe1b1cf102a5f311b79, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:47.681693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe28ec-c848-4b5d-886c-7408c5cbfc98 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:47.732189 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3753/7524] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:47 2022] PUT /identity/v3/projects/979bd7631fdf4313aac67f2502271dfb/users/4129f844c2264fe1b1cf102a5f311b79/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:47.774414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522827f3647e4cdfa81257e8a048278b', 'request_id': 'req-562e3586-b984-4f96-af4d-4f4cbc9bf01c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.790649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522827f3647e4cdfa81257e8a048278b', 'request_id': 'req-562e3586-b984-4f96-af4d-4f4cbc9bf01c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.809758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522827f3647e4cdfa81257e8a048278b', 'request_id': 'req-562e3586-b984-4f96-af4d-4f4cbc9bf01c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.837101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] The token cache is being invalidate because project 522827f3647e4cdfa81257e8a048278b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:47.837313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.838027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-562e3586-b984-4f96-af4d-4f4cbc9bf01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:47.847390 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3772/7525] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:47 2022] DELETE /identity/v3/projects/522827f3647e4cdfa81257e8a048278b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:47.849393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240e368-b600-4dd3-85e0-aee15013003c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:47.849742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240e368-b600-4dd3-85e0-aee15013003c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:47.850455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240e368-b600-4dd3-85e0-aee15013003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:47.892276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8240e368-b600-4dd3-85e0-aee15013003c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:47.897425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8240e368-b600-4dd3-85e0-aee15013003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:48.040870 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3754/7526] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:48.049753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b870c-38b4-41a7-b877-69c9036692c2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.050097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b870c-38b4-41a7-b877-69c9036692c2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.050302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b870c-38b4-41a7-b877-69c9036692c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.088858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-168b870c-38b4-41a7-b877-69c9036692c2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:48.090412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-168b870c-38b4-41a7-b877-69c9036692c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:48.114855 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3773/7527] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:48.115765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240e368-b600-4dd3-85e0-aee15013003c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:48.142906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240e368-b600-4dd3-85e0-aee15013003c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:48.154437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:48.156145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.157921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.158220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.161022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:48.161453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:48.165424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:48.198337 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3755/7528] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:48.203538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b870c-38b4-41a7-b877-69c9036692c2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:48.214394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b870c-38b4-41a7-b877-69c9036692c2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:48.220460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:48.221140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.221520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.221849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.222494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:48.224783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:48.304889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3774/7529] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:48 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:48.306740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:48.319338 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:48.337138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7c08-cee5-4ef1-9b12-5bbee11e41fc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:48.433295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:48.434040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.434327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.434606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.435904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:48.438524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:48.477452 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3756/7530] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:48 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:48.481801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:48.493937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d352eb-ade5-48e8-9111-cc721e5cc8b1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:48.500666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:48.501774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.502267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.503710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.504738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:48.506722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:48.523991 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3775/7531] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:48.528481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:48.542905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4065fb-a7fc-4551-a8cb-c9f1eacc8985 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:48.548393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d036-b260-420b-a18d-41a22f7aa7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:48.550424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d036-b260-420b-a18d-41a22f7aa7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.550959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d036-b260-420b-a18d-41a22f7aa7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.551441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d036-b260-420b-a18d-41a22f7aa7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.552829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d036-b260-420b-a18d-41a22f7aa7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:48.554770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d036-b260-420b-a18d-41a22f7aa7e8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:48.596531 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3757/7532] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:48.600704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:48.650757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fd249-af4d-45d8-a641-7e42489cc560 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:48.659725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:48.660457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.660748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.661052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] PATH_INFO: `/v3/projects/13c7ee34d6e346d29e935d1445529b04/users/08632d8469644072abbea0df362b64c7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.678847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c7ee34d6e346d29e935d1445529b04, user_id=08632d8469644072abbea0df362b64c7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:48.681633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:48.717933 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3776/7533] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:48 2022] PUT /identity/v3/projects/13c7ee34d6e346d29e935d1445529b04/users/08632d8469644072abbea0df362b64c7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:48.730153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446633d-a6da-445e-b51b-4c6c48adc650 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.730738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446633d-a6da-445e-b51b-4c6c48adc650 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.730738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446633d-a6da-445e-b51b-4c6c48adc650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:48.768412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d446633d-a6da-445e-b51b-4c6c48adc650 None None] MFA Rules not processed for user `08632d8469644072abbea0df362b64c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:48.769842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d446633d-a6da-445e-b51b-4c6c48adc650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:48.864833 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3758/7534] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:48.868639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:48.889380 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:48.939949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d026a1-4b7d-406a-8fd6-e82226bb1d8a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:48.940238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d026a1-4b7d-406a-8fd6-e82226bb1d8a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:48.940517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d026a1-4b7d-406a-8fd6-e82226bb1d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.025875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-54d026a1-4b7d-406a-8fd6-e82226bb1d8a None None] MFA Rules not processed for user `4129f844c2264fe1b1cf102a5f311b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:49.028652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-54d026a1-4b7d-406a-8fd6-e82226bb1d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:49.035682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a4b9-a581-4313-b058-098c6d4c3f31 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:49.087646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:49.094280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.094701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.095076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.095978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:49.098658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:49.221314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3777/7535] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:48 2022] POST /identity/v3/projects => generated 369 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:49.222230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:49.258853 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:49.283257 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3759/7536] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:49.338313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ec016-bf2d-491c-a73f-c06a4f0d66db admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:49.347563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:49.348498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.348858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.349173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.351736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:49.354263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:49.407549 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3778/7537] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:49 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:49.412085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d026a1-4b7d-406a-8fd6-e82226bb1d8a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:49.438914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d026a1-4b7d-406a-8fd6-e82226bb1d8a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:49.476653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:49.477337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.477614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.477890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.478550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:49.480180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:49.501251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3760/7538] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:49.506474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:49.525371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcfba0-bd12-4cc0-bd20-79c35597942c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:49.531134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:49.531890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.532175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.533842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] PATH_INFO: `/v3/projects/e6cf8a237406434f846a7d198f22f0d4/users/3256e2091210489fac9d954a563bd6e5/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.557865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cf8a237406434f846a7d198f22f0d4, user_id=3256e2091210489fac9d954a563bd6e5, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:49.561118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:49.590725 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3779/7539] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:49 2022] PUT /identity/v3/projects/e6cf8a237406434f846a7d198f22f0d4/users/3256e2091210489fac9d954a563bd6e5/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:49.595449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:49.613849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf57c-aa7f-4193-949d-983126f3a0dc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:49.721436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441d9d9-de3d-4a3e-8528-35105fc0a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:49.722334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441d9d9-de3d-4a3e-8528-35105fc0a601 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.722847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441d9d9-de3d-4a3e-8528-35105fc0a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.723331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441d9d9-de3d-4a3e-8528-35105fc0a601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.724212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441d9d9-de3d-4a3e-8528-35105fc0a601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:49.726270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441d9d9-de3d-4a3e-8528-35105fc0a601 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:49.748375 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3761/7540] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:49.750204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:49.762583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a76f-f903-41df-8fc9-ce96871258fa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:49.768640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:49.769684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.770360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.770852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] PATH_INFO: `/v3/projects/e6cf8a237406434f846a7d198f22f0d4/users/3256e2091210489fac9d954a563bd6e5/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.773305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cf8a237406434f846a7d198f22f0d4, user_id=3256e2091210489fac9d954a563bd6e5, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:49.776239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:49.802824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41906-a27b-4839-90b3-7579179ead86 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.803478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41906-a27b-4839-90b3-7579179ead86 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.804073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41906-a27b-4839-90b3-7579179ead86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.807032 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3780/7541] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:49 2022] PUT /identity/v3/projects/e6cf8a237406434f846a7d198f22f0d4/users/3256e2091210489fac9d954a563bd6e5/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:49.840927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-63e41906-a27b-4839-90b3-7579179ead86 None None] MFA Rules not processed for user `3256e2091210489fac9d954a563bd6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:49.843807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63e41906-a27b-4839-90b3-7579179ead86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:49.952835 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3762/7542] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:49.954148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:49.970718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46133d81-e8cf-45c2-b2f3-39bd78f51940 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:49.976654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:49.977353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:49.977644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:49.977920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:49.979006 n-d-master-1 devstack@keystone.service[81886]: WARNING oslo_log.versionutils [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 21 01:39:49.979504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:49.981156 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:39:49.981156 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:39:49.981156 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:39:49.982127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.035919 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3781/7543] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:39:49 2022] POST /identity/v3/policies => generated 229 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:50.037715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e41906-a27b-4839-90b3-7579179ead86 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.052201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e41906-a27b-4839-90b3-7579179ead86 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.072987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.073655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.073938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.074215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies/842b17478626493eb826cc910ef973db` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.075176 n-d-master-1 devstack@keystone.service[81885]: WARNING oslo_log.versionutils [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 21 01:39:50.075680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=842b17478626493eb826cc910ef973db)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.082763 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:39:50.082763 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:39:50.082763 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:39:50.083930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.145746 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3763/7544] 10.222.0.46 () {60 vars in 1252 bytes} [Sun Aug 21 01:39:50 2022] PATCH /identity/v3/policies/842b17478626493eb826cc910ef973db => generated 236 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:50.147252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.163694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688732-dff6-41f6-be31-1a2fd988aa86 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.177187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.177862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.178144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.178419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies/842b17478626493eb826cc910ef973db` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.179355 n-d-master-1 devstack@keystone.service[81886]: WARNING oslo_log.versionutils [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 21 01:39:50.179931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=842b17478626493eb826cc910ef973db)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.185850 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:39:50.185850 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:39:50.185850 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:39:50.186863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.224651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3782/7545] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:39:50 2022] GET /identity/v3/policies/842b17478626493eb826cc910ef973db => generated 236 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:50.229233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.247055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec91f95-5d4d-4eca-b7db-41bb43b4661e tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.254289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.254991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.255339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.255985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies/842b17478626493eb826cc910ef973db` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.256559 n-d-master-1 devstack@keystone.service[81885]: WARNING oslo_log.versionutils [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 21 01:39:50.257217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=842b17478626493eb826cc910ef973db)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.259037 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:39:50.259037 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:39:50.259037 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:39:50.260389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.307743 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3764/7546] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:50 2022] DELETE /identity/v3/policies/842b17478626493eb826cc910ef973db => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:50.309418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.323384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7686f9-459f-480e-8e99-bbcf0ef8bf85 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.329189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.329821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.330102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.330377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.332041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.334026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.382270 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3783/7547] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:39:50 2022] POST /identity/v3/policies => generated 229 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:50.386620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.413565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c22a0-5df6-43b7-90d7-9c1f78069aba tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.419397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.420740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.421246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.421446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.422417 n-d-master-1 devstack@keystone.service[81885]: WARNING oslo_log.versionutils [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 21 01:39:50.423690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.428128 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:39:50.428128 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:39:50.428128 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:39:50.430368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.468193 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3765/7548] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:39:50 2022] POST /identity/v3/policies => generated 229 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:50.478391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.491675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91796fa-c890-4121-9f42-cb1a61426522 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.497919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.499396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.499681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.500198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.501764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.503936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.557389 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3784/7549] 10.222.0.46 () {60 vars in 1152 bytes} [Sun Aug 21 01:39:50 2022] POST /identity/v3/policies => generated 229 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:50.561705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.581644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdaca-f985-4361-88ef-f8b61b4c3040 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.595158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.595795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.596081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.596352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.597185 n-d-master-1 devstack@keystone.service[81885]: WARNING oslo_log.versionutils [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 21 01:39:50.597732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.599189 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:39:50.599189 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:39:50.599189 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:39:50.600082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.610823 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3766/7550] 10.222.0.46 () {58 vars in 1131 bytes} [Sun Aug 21 01:39:50 2022] GET /identity/v3/policies => generated 763 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:50.615323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.620970 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:50.630960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a06a1-a681-4fbe-8b15-7c6cc614ffb3 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.639442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.640449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.640841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.641196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies/ebc59a73a05c4e48b344354d4c7fdfe6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.642067 n-d-master-1 devstack@keystone.service[81886]: WARNING oslo_log.versionutils [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 21 01:39:50.644428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ebc59a73a05c4e48b344354d4c7fdfe6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.645858 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:39:50.645858 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:39:50.645858 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:39:50.649652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.685313 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3785/7551] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:50 2022] DELETE /identity/v3/policies/ebc59a73a05c4e48b344354d4c7fdfe6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:50.690487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.707611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7fa81-5de5-4b37-8a0b-c4fbbb758039 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.723231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.723928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.724335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.724872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies/2db6ffd298b147ef87c05dca4c917e01` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.728355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=2db6ffd298b147ef87c05dca4c917e01)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.734572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.769461 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:50.788398 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3767/7552] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:50 2022] DELETE /identity/v3/policies/2db6ffd298b147ef87c05dca4c917e01 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:50.792671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:50.815934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aaebe-63da-402c-81e2-f7a4182663f9 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:50.836143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788a8e-9af1-414e-896d-6e10d2d8a391 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3256e2091210489fac9d954a563bd6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cf8a237406434f846a7d198f22f0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:50.836969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788a8e-9af1-414e-896d-6e10d2d8a391 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:50.839843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788a8e-9af1-414e-896d-6e10d2d8a391 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:50.843255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788a8e-9af1-414e-896d-6e10d2d8a391 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] PATH_INFO: `/v3/policies/44504db2181a4f0c9bd9e3d6dd4a7bd3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:50.848417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b788a8e-9af1-414e-896d-6e10d2d8a391 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=44504db2181a4f0c9bd9e3d6dd4a7bd3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:50.851053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b788a8e-9af1-414e-896d-6e10d2d8a391 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:50.890196 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3786/7553] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:50 2022] DELETE /identity/v3/policies/44504db2181a4f0c9bd9e3d6dd4a7bd3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:50.896654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:51.028188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722d50-5b08-45e0-9c55-21a53e363f02 tempest-PoliciesTestJSON-1418716397 tempest-PoliciesTestJSON-1418716397-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:51.040940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:51.042599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:51.043842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:51.045692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] PATH_INFO: `/v3/users/08632d8469644072abbea0df362b64c7` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:51.050435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08632d8469644072abbea0df362b64c7)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:51.055430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:51.162813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08632d8469644072abbea0df362b64c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.173603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08632d8469644072abbea0df362b64c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.202394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08632d8469644072abbea0df362b64c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.205088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08632d8469644072abbea0df362b64c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.230012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08632d8469644072abbea0df362b64c7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.249391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3768/7554] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:50 2022] DELETE /identity/v3/users/08632d8469644072abbea0df362b64c7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:51.251788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:51.252290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:51.252391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:51.264465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:51.267834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:51.299722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:51.301807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:51.428153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb18175-bd38-4f2f-a3d3-dedac51187e4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:51.442294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:51.444507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:51.445755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:51.446887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] PATH_INFO: `/v3/users/9cdec564f0dd427fa3d1cd08bb27bb20` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:51.449614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cdec564f0dd427fa3d1cd08bb27bb20)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:51.451868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:51.453156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3787/7555] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:51.462301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:51.464127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:51.501139 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:51.592285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cdec564f0dd427fa3d1cd08bb27bb20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.611481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cdec564f0dd427fa3d1cd08bb27bb20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.642268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cdec564f0dd427fa3d1cd08bb27bb20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.644092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cdec564f0dd427fa3d1cd08bb27bb20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.644895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c981-5e19-40c4-b623-7af1d71144d1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:51.651818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:51.654090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:51.654497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:51.655392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:51.660507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cdec564f0dd427fa3d1cd08bb27bb20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:51.675934 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3769/7556] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:51 2022] DELETE /identity/v3/users/9cdec564f0dd427fa3d1cd08bb27bb20 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:51.680051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:51.681463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:51.711235 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3788/7557] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:52.080688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:52.082485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:52.214954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:52.216723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:52.257618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ea83-c506-415d-a412-b7e15bda3009 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:52.322414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e0ea9-3e0a-4d23-bfc0-519358cc40ef admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:52.345698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:52.346456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:52.347362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:52.347703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] PATH_INFO: `/v3/projects/b0b93bc387b3412f99dfe57def485319` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:52.351117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b93bc387b3412f99dfe57def485319)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:52.358412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:52.453527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:52.454701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:52.455203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:52.456517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] PATH_INFO: `/v3/users/58faf3c2db8e414ca162b0593dfc9bae` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:52.458176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58faf3c2db8e414ca162b0593dfc9bae)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:52.460366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:52.493943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b93bc387b3412f99dfe57def485319', 'request_id': 'req-43f620d1-eb87-4925-9b81-7d7caa575ba2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.495388 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:52.508749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b93bc387b3412f99dfe57def485319', 'request_id': 'req-43f620d1-eb87-4925-9b81-7d7caa575ba2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.521916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b93bc387b3412f99dfe57def485319', 'request_id': 'req-43f620d1-eb87-4925-9b81-7d7caa575ba2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.540615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] The token cache is being invalidate because project b0b93bc387b3412f99dfe57def485319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:52.541114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.541902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.547629 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3770/7558] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:52 2022] DELETE /identity/v3/projects/b0b93bc387b3412f99dfe57def485319 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:52.547629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:52.549067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:52.568077 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58faf3c2db8e414ca162b0593dfc9bae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.581482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58faf3c2db8e414ca162b0593dfc9bae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.582627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58faf3c2db8e414ca162b0593dfc9bae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.611796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58faf3c2db8e414ca162b0593dfc9bae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.615131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58faf3c2db8e414ca162b0593dfc9bae'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.657573 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3789/7559] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:52 2022] DELETE /identity/v3/users/58faf3c2db8e414ca162b0593dfc9bae => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:52.659183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:52.660973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:52.664618 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:52.758307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f620d1-eb87-4925-9b81-7d7caa575ba2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:52.842017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47735998-c549-4dc6-ac4e-812eb844e6e0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:52.848435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:52.849385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:52.849956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:52.850613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] PATH_INFO: `/v3/users/4129f844c2264fe1b1cf102a5f311b79` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:52.852027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4129f844c2264fe1b1cf102a5f311b79)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:52.854431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:52.873356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:52.874165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:52.874635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:52.874966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] PATH_INFO: `/v3/projects/13c7ee34d6e346d29e935d1445529b04` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:52.876489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c7ee34d6e346d29e935d1445529b04)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:52.879789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:52.919914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4129f844c2264fe1b1cf102a5f311b79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.946975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4129f844c2264fe1b1cf102a5f311b79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.948432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4129f844c2264fe1b1cf102a5f311b79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.960584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4129f844c2264fe1b1cf102a5f311b79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.962411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c7ee34d6e346d29e935d1445529b04', 'request_id': 'req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.962726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dd84365f-cf0c-4711-b5a5-5906d1ed3a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4129f844c2264fe1b1cf102a5f311b79'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.970711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c7ee34d6e346d29e935d1445529b04', 'request_id': 'req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.987864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c7ee34d6e346d29e935d1445529b04', 'request_id': 'req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:52.995325 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3790/7560] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:52 2022] DELETE /identity/v3/users/4129f844c2264fe1b1cf102a5f311b79 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:52.998632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:52.999651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:53.000813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:53.021295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] The token cache is being invalidate because project 13c7ee34d6e346d29e935d1445529b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:53.021718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.024269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.026207 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3771/7561] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:52 2022] DELETE /identity/v3/projects/13c7ee34d6e346d29e935d1445529b04 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:53.030525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:53.031398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:53.033688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:53.035245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:53.051667 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:53.130655 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3791/7562] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:53.137790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:53.140497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:53.236183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f663f7-f7ac-4e67-aa9c-73f2ba8934bc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:53.251652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:53.252318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:53.252593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:53.252885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] PATH_INFO: `/v3/users/3256e2091210489fac9d954a563bd6e5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:53.254234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3256e2091210489fac9d954a563bd6e5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:53.256910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:53.264121 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:53.301724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7256c-fbdb-4ba9-bc18-7f9d6ac7572a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:53.312627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:53.313413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:53.313682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:53.313959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:53.337402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:53.339741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:53.359004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3256e2091210489fac9d954a563bd6e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.367286 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3792/7563] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:53.389116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3256e2091210489fac9d954a563bd6e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.415439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3256e2091210489fac9d954a563bd6e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.416305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3256e2091210489fac9d954a563bd6e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.422372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:53.424889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:53.426597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a877cc82-9971-4660-a0f9-224b6ffe3df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3256e2091210489fac9d954a563bd6e5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.434433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3772/7564] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:53 2022] DELETE /identity/v3/users/3256e2091210489fac9d954a563bd6e5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:53.450420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ec4e-2fbd-4e9f-ac54-f8c3b0f12c20 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:53.623402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:53.624103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:53.624395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:53.624848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] PATH_INFO: `/v3/projects/979bd7631fdf4313aac67f2502271dfb` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:53.626117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979bd7631fdf4313aac67f2502271dfb)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:53.628039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:53.752974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979bd7631fdf4313aac67f2502271dfb', 'request_id': 'req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.771608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979bd7631fdf4313aac67f2502271dfb', 'request_id': 'req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.774705 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:53.778836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979bd7631fdf4313aac67f2502271dfb', 'request_id': 'req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.809963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] The token cache is being invalidate because project 979bd7631fdf4313aac67f2502271dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:53.810257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.811101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cdd44067-ab7f-45a8-ac7e-b68651d5f8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:53.814112 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3793/7565] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:53 2022] DELETE /identity/v3/projects/979bd7631fdf4313aac67f2502271dfb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:53.820635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c377-5b62-471c-a0b6-f34d684b985f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:53.821585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c377-5b62-471c-a0b6-f34d684b985f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:53.822660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c377-5b62-471c-a0b6-f34d684b985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:53.872736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d6d7c377-5b62-471c-a0b6-f34d684b985f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:53.875193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d6d7c377-5b62-471c-a0b6-f34d684b985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:53.975859 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3773/7566] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:53.983857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ccbb3-bffe-4edb-89c4-a509f96795d8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:53.984170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ccbb3-bffe-4edb-89c4-a509f96795d8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:53.984942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ccbb3-bffe-4edb-89c4-a509f96795d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.025593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ba0ccbb3-bffe-4edb-89c4-a509f96795d8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:54.026899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ba0ccbb3-bffe-4edb-89c4-a509f96795d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:54.049130 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3794/7567] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:54.049493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7c377-5b62-471c-a0b6-f34d684b985f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.069391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7c377-5b62-471c-a0b6-f34d684b985f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.082309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.084897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.085169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.085447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.086124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:54.086428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.088161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.114863 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3774/7568] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:54.116958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ccbb3-bffe-4edb-89c4-a509f96795d8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.130400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ccbb3-bffe-4edb-89c4-a509f96795d8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.137962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.139211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.139771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.140258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.141531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.145766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.213475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.215831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:54.243292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442d7b4-67dd-4f44-bb27-a29ef38fe174 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.244613 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3795/7569] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:54 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:54.245884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.349730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72f3e0-7e9e-4f7e-9975-6cd72d87efd4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.355343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.356292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.356635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.357115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.359206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.362018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.419330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.419752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3796/7570] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:54 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:54.420354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.420830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.421250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] PATH_INFO: `/v3/projects/e6cf8a237406434f846a7d198f22f0d4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.421849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.422847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6cf8a237406434f846a7d198f22f0d4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.427184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.440964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f0bc-c864-421d-87ac-4f4790e440db admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.446173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.446810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.447089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.447367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.448237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.450157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.463067 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:54.470133 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3797/7571] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:54.471315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.487383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc232a82-6f06-4226-a5c9-c034444de76f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.496137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.496799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.497087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.497362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.499615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.502121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.526852 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3798/7572] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:54.534421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.537824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6cf8a237406434f846a7d198f22f0d4', 'request_id': 'req-7bad322e-c795-49d4-aca8-c169e31e342c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:54.548565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6cf8a237406434f846a7d198f22f0d4', 'request_id': 'req-7bad322e-c795-49d4-aca8-c169e31e342c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:54.556347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6cf8a237406434f846a7d198f22f0d4', 'request_id': 'req-7bad322e-c795-49d4-aca8-c169e31e342c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:54.559080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89092d-f1b7-4f24-b39c-2f8bd8267f32 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.581579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] The token cache is being invalidate because project e6cf8a237406434f846a7d198f22f0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:54.582183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:54.583708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7bad322e-c795-49d4-aca8-c169e31e342c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:54.586996 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3775/7573] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:54 2022] DELETE /identity/v3/projects/e6cf8a237406434f846a7d198f22f0d4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:54.593485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74684-bbb7-448b-8492-629cb0c096a1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.594178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74684-bbb7-448b-8492-629cb0c096a1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.595085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74684-bbb7-448b-8492-629cb0c096a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.687254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-30f74684-bbb7-448b-8492-629cb0c096a1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:54.689738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-30f74684-bbb7-448b-8492-629cb0c096a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:54.703035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26a1f9-4600-4dae-aafc-bac8ab9ef41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.704171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a1f9-4600-4dae-aafc-bac8ab9ef41a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.704664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a1f9-4600-4dae-aafc-bac8ab9ef41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.706060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a1f9-4600-4dae-aafc-bac8ab9ef41a admin admin] PATH_INFO: `/v3/projects/a1b6d7e031d14aa4b65fd5179bdaa237/users/33824ecd99e9489cab594870a67ea0c0/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.727485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26a1f9-4600-4dae-aafc-bac8ab9ef41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b6d7e031d14aa4b65fd5179bdaa237, user_id=33824ecd99e9489cab594870a67ea0c0, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.735705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26a1f9-4600-4dae-aafc-bac8ab9ef41a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.737907 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3776/7574] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:54.739656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944307-7963-4ec5-a418-54c5b040c22b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.749677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944307-7963-4ec5-a418-54c5b040c22b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.750352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944307-7963-4ec5-a418-54c5b040c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.768565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3799/7575] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:54 2022] PUT /identity/v3/projects/a1b6d7e031d14aa4b65fd5179bdaa237/users/33824ecd99e9489cab594870a67ea0c0/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:54.789893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-64944307-7963-4ec5-a418-54c5b040c22b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:54.790284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.790741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.791138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-64944307-7963-4ec5-a418-54c5b040c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:54.791366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.851071 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:54.876634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] MFA Rules not processed for user `33824ecd99e9489cab594870a67ea0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:54.877984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:54.880857 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3777/7576] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:54.886126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944307-7963-4ec5-a418-54c5b040c22b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.898797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944307-7963-4ec5-a418-54c5b040c22b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.906088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.906740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.907033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.907731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.908724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:54.909091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.911276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:54.941228 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3778/7577] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:54.946834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:54.961078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd54fc-3888-4e63-a030-1ed90c5e4daa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:54.966235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:54.967045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:54.967536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:54.968043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:54.968696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:54.970845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.007834 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3779/7578] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:54 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:55.014795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.065525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3800/7579] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:55.066746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.068363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:55.102153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ca9b3-4e20-45c0-8bd9-1ba0e91450a5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.107741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.108471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.108760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.109058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.109706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.110610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030341-1016-41de-aceb-7c7c7e99a4ae admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.111638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.116920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.118255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.118660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.119060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.121041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.123543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.136266 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:55.164915 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3780/7580] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:55 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:55.166524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.169365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:55.177454 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3801/7581] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:55 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:55.178187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.188564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382742b-9de8-4918-bb21-561570171d86 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.279467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.280260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.280568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.280945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] PATH_INFO: `/v3/projects/29c77149f5394fe1ad4f4f41028d9810` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.282488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c77149f5394fe1ad4f4f41028d9810)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.284956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.287692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fd0a2-8c4d-48ca-8a04-1f77a0555269 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.293775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.294411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.294737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.295017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.298471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.300470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.314300 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3802/7582] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:55.315158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.328539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817eb50-9767-402d-a043-684ea1182c24 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.336592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.339537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.339838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.340111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.340787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.347644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.361775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c77149f5394fe1ad4f4f41028d9810', 'request_id': 'req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.371687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c77149f5394fe1ad4f4f41028d9810', 'request_id': 'req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.380862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c77149f5394fe1ad4f4f41028d9810', 'request_id': 'req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.407281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] The token cache is being invalidate because project 29c77149f5394fe1ad4f4f41028d9810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:55.408032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.409375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.409688 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3803/7583] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:55 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:55.411289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.414628 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3781/7584] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:55 2022] DELETE /identity/v3/projects/29c77149f5394fe1ad4f4f41028d9810 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:55.416042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.418416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:55.433025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d06b5-86df-497d-951d-d9ebe6444ac3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.509392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780618d3-8a21-4cf6-b3a9-a30f2878fb8d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.517330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.518150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.518510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.518880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.519792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.521700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.539173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3782/7585] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:55.540550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.543869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:55.563025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae46353-97ef-4cc7-b60b-04897035b1fb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.571090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.572064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.572558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.573009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] PATH_INFO: `/v3/users/51d51174e7c04072bd145dde71c036ba` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.575098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d51174e7c04072bd145dde71c036ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.577435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.593460 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:55.616709 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:55.637302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.637960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.638289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.638788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.640538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.646761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.675722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d51174e7c04072bd145dde71c036ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.677841 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3804/7586] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:55.679319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.698089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfd866-51bc-4f4f-a4eb-14aff49b7008 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.704493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d51174e7c04072bd145dde71c036ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.712274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:55.714758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:55.715246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:55.715764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] PATH_INFO: `/v3/projects/7e1dd61a5f1e49908bb731e14ae99941/users/1ac73b7319fb4e8ab1372ed29803936c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:55.731510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d51174e7c04072bd145dde71c036ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.734673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d51174e7c04072bd145dde71c036ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.758267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d51174e7c04072bd145dde71c036ba'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:55.768744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1dd61a5f1e49908bb731e14ae99941, user_id=1ac73b7319fb4e8ab1372ed29803936c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:55.770589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:55.793488 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3783/7587] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:55 2022] DELETE /identity/v3/users/51d51174e7c04072bd145dde71c036ba => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:55.797201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.800576 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3805/7588] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:55 2022] PUT /identity/v3/projects/7e1dd61a5f1e49908bb731e14ae99941/users/1ac73b7319fb4e8ab1372ed29803936c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:55.805554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:55.807951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:55.809418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:55.982555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c5cff-ecf0-4a1d-a43c-26f394d9b5a8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:55.998111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68560d-d628-4f26-aa86-2a977823de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:56.000091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68560d-d628-4f26-aa86-2a977823de52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.000401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68560d-d628-4f26-aa86-2a977823de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.002163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68560d-d628-4f26-aa86-2a977823de52 admin admin] PATH_INFO: `/v3/projects/4b9bea811403413c97455a8ac871236f/users/53d880c34d444e7cace01df4e924c636/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.003272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a731ea-4061-41b6-82d1-9652a154b8a9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:56.015027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:56.016314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.016600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.017936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.018689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:56.020481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:56.045141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68560d-d628-4f26-aa86-2a977823de52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9bea811403413c97455a8ac871236f, user_id=53d880c34d444e7cace01df4e924c636, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:56.051968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68560d-d628-4f26-aa86-2a977823de52 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:56.052796 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3806/7589] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:56.054522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:56.104831 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3784/7590] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:55 2022] PUT /identity/v3/projects/4b9bea811403413c97455a8ac871236f/users/53d880c34d444e7cace01df4e924c636/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:56.105066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4b6c-1558-4a92-b279-19ab6755d0dd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:56.109134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce819d-43a3-4223-a210-b1e11f6de77c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.109470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce819d-43a3-4223-a210-b1e11f6de77c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.109694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce819d-43a3-4223-a210-b1e11f6de77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.184157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-76ce819d-43a3-4223-a210-b1e11f6de77c None None] MFA Rules not processed for user `53d880c34d444e7cace01df4e924c636`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:56.187290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-76ce819d-43a3-4223-a210-b1e11f6de77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:56.286297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d971cb-df29-4200-a036-d7ceb2e68e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:56.286996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d971cb-df29-4200-a036-d7ceb2e68e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.287276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d971cb-df29-4200-a036-d7ceb2e68e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.287543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d971cb-df29-4200-a036-d7ceb2e68e15 admin admin] PATH_INFO: `/v3/projects/7e1dd61a5f1e49908bb731e14ae99941/users/1ac73b7319fb4e8ab1372ed29803936c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.294315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d971cb-df29-4200-a036-d7ceb2e68e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1dd61a5f1e49908bb731e14ae99941, user_id=1ac73b7319fb4e8ab1372ed29803936c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:56.297183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d971cb-df29-4200-a036-d7ceb2e68e15 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:56.324994 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3807/7591] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:56 2022] PUT /identity/v3/projects/7e1dd61a5f1e49908bb731e14ae99941/users/1ac73b7319fb4e8ab1372ed29803936c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:56.336294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.336652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.337237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.407355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] MFA Rules not processed for user `1ac73b7319fb4e8ab1372ed29803936c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:56.408983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:56.412415 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:56.435417 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3785/7592] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:56.441144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce819d-43a3-4223-a210-b1e11f6de77c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:56.466379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce819d-43a3-4223-a210-b1e11f6de77c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:56.477326 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:56.509149 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3808/7593] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:56.522033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:56.523710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:56.565119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:56.566298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.566683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.566972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.567812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:56.569676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:56.615858 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3786/7594] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:56 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:56.619994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e6da6-c443-4ac2-bb7d-6cf5bde92468 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:56.620135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:56.705576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:56.706226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.706535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.706811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.738959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade230bb-d27f-4657-95e6-03bb1d07a366 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:56.756861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:56.766269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.766269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.766269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.768514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:56.770689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:56.824152 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3787/7595] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:56 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:39:56.825562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:56.827861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:56.834849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:56.836193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:56.847276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daab71-95c4-4516-a54c-9661f432e38b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:56.855249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:56.856011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:56.856656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:56.858767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] PATH_INFO: `/v3/projects/3abfdeff38084004a68c7286ccae0909` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:56.860367 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3809/7596] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:39:56.860943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abfdeff38084004a68c7286ccae0909)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:56.863681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:56.882591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:56.930794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5329d-c9c9-42b3-911f-3dba5a1688e1 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:56.947727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abfdeff38084004a68c7286ccae0909', 'request_id': 'req-74a40084-0cbb-46c3-b48f-041b2747df7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:56.964103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abfdeff38084004a68c7286ccae0909', 'request_id': 'req-74a40084-0cbb-46c3-b48f-041b2747df7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:56.976470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abfdeff38084004a68c7286ccae0909', 'request_id': 'req-74a40084-0cbb-46c3-b48f-041b2747df7f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:56.991678 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:57.003656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] The token cache is being invalidate because project 3abfdeff38084004a68c7286ccae0909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:57.006096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:57.008107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-74a40084-0cbb-46c3-b48f-041b2747df7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:57.010633 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3788/7597] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:56 2022] DELETE /identity/v3/projects/3abfdeff38084004a68c7286ccae0909 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:57.015580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211da6-b400-420e-b905-9b9705cf5f60 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.018346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211da6-b400-420e-b905-9b9705cf5f60 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.019292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211da6-b400-420e-b905-9b9705cf5f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.074485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-78211da6-b400-420e-b905-9b9705cf5f60 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:57.077289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-78211da6-b400-420e-b905-9b9705cf5f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:57.118070 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:57.178266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.178907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.179186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.179460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.180116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.181882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.208074 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3810/7598] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:57.209508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.213388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:57.237844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a66e1a-766e-458b-aca4-96a141337f9b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.253406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.254114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.254400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.257475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] PATH_INFO: `/v3/projects/c7ce2f5c22454eada48cffa730f46251/users/b20b0049eea44cff8152004b94839ab1/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.289708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ce2f5c22454eada48cffa730f46251, user_id=b20b0049eea44cff8152004b94839ab1, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.292352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.312332 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3789/7599] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:57.314416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ca69-4296-494f-8280-e0222f8c6f33 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.314774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ca69-4296-494f-8280-e0222f8c6f33 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.316125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ca69-4296-494f-8280-e0222f8c6f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.331072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3811/7600] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:57 2022] PUT /identity/v3/projects/c7ce2f5c22454eada48cffa730f46251/users/b20b0049eea44cff8152004b94839ab1/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:57.338852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.357487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-48b5ca69-4296-494f-8280-e0222f8c6f33 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:57.358801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-48b5ca69-4296-494f-8280-e0222f8c6f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:57.518797 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3790/7601] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:57.520363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ca69-4296-494f-8280-e0222f8c6f33 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.542779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ca69-4296-494f-8280-e0222f8c6f33 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.543221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd09876-ce64-475b-9795-d72d8d48b7c3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.550845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.552338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.554071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.554540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.554780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.555239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:39:57.555909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.559607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.559607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.559607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.559607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.559983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.560083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.579098 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3791/7602] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:57.582500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.599607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6fe1-2128-4f7c-bd02-06aab295f49d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.609673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.610212 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3812/7603] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:57.611162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.612689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.613210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.613506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.615720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.621558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.622261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc983a-4eeb-47f3-8e1c-3e56452903c7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.631657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79425afc-e73c-4f91-9278-4c0d31364f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.632330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79425afc-e73c-4f91-9278-4c0d31364f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.632609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79425afc-e73c-4f91-9278-4c0d31364f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.633004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79425afc-e73c-4f91-9278-4c0d31364f3c admin admin] PATH_INFO: `/v3/projects/c7ce2f5c22454eada48cffa730f46251/users/b20b0049eea44cff8152004b94839ab1/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.639244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79425afc-e73c-4f91-9278-4c0d31364f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ce2f5c22454eada48cffa730f46251, user_id=b20b0049eea44cff8152004b94839ab1, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.643961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79425afc-e73c-4f91-9278-4c0d31364f3c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.668382 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3792/7604] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:57 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:57.672544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.675889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3813/7605] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:57 2022] PUT /identity/v3/projects/c7ce2f5c22454eada48cffa730f46251/users/b20b0049eea44cff8152004b94839ab1/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:57.688470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c5e8-f1a3-45c8-86fa-cf84ffb7e757 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.688831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c5e8-f1a3-45c8-86fa-cf84ffb7e757 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.689042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c5e8-f1a3-45c8-86fa-cf84ffb7e757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.761811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6a71c5e8-f1a3-45c8-86fa-cf84ffb7e757 None None] MFA Rules not processed for user `b20b0049eea44cff8152004b94839ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:57.763567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6a71c5e8-f1a3-45c8-86fa-cf84ffb7e757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:57.793960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4442c1c-1c88-4e7e-bdf2-85312bb8755f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.799483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.800344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.800891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.801220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.802160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.804294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.838365 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:57.857679 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3793/7606] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:57 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:57.858506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.862707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:57.893556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d013-0100-499b-ac90-5f6544b2ee81 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.904445 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3814/7607] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:57.905261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71c5e8-f1a3-45c8-86fa-cf84ffb7e757 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.917122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.917803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.921447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.922240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] PATH_INFO: `/v3/users/33824ecd99e9489cab594870a67ea0c0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.925410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33824ecd99e9489cab594870a67ea0c0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.927371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.928010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71c5e8-f1a3-45c8-86fa-cf84ffb7e757 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.935315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.936042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.936322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.936820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.939540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.941439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:57.961193 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3815/7608] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:57.961193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:57.975310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a298-10bb-43ae-adf9-17ab6b0922d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:57.982452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:57.983502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:57.983785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:57.984138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:57.984843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:57.991909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.021452 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:58.028661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33824ecd99e9489cab594870a67ea0c0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:58.044248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33824ecd99e9489cab594870a67ea0c0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:58.052861 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3816/7609] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:57 2022] POST /identity/v3/projects => generated 360 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:58.054329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.072147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33824ecd99e9489cab594870a67ea0c0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:58.072977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33824ecd99e9489cab594870a67ea0c0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:58.082628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33824ecd99e9489cab594870a67ea0c0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:58.094489 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3794/7610] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:39:57 2022] DELETE /identity/v3/users/33824ecd99e9489cab594870a67ea0c0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:58.094489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.094489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:58.164042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3ba48-45ba-45e7-8075-bc4a84bc1bf6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.244002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b0f13-847a-426f-8534-38767c0dcb93 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.257814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.258905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.259737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.260011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-1303663642` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.262699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=5e8d9fafd3514b2eb66ade982795c812, value=tempest-tag-1303663642)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.265558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.279165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b29f5-a824-419d-97a7-75d7f32f7365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.280345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b29f5-a824-419d-97a7-75d7f32f7365 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.287027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b29f5-a824-419d-97a7-75d7f32f7365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.287027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b29f5-a824-419d-97a7-75d7f32f7365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.287027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b29f5-a824-419d-97a7-75d7f32f7365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.291642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b29f5-a824-419d-97a7-75d7f32f7365 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.316949 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3817/7611] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:58.321210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7dae3-730e-41b6-8db0-5fcbdc1cf70a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.322686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7dae3-730e-41b6-8db0-5fcbdc1cf70a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.323035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7dae3-730e-41b6-8db0-5fcbdc1cf70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.336240 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1303663642. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:39:58.336240 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:39:58.336240 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:39:58.345506 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3795/7612] 10.222.0.46 () {60 vars in 1333 bytes} [Sun Aug 21 01:39:58 2022] PUT /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-1303663642 => generated 0 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Aug 21 01:39:58.347573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.350436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:58.367677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a4ec-34d3-4c17-bf0c-a411d4c9fa0c tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.373453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.374151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.374427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.374699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] PATH_INFO: `/v3/projects/2c03603384324f42a93d546eacc53a0b/users/2751475cc4904e3595a81d9c21626704/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.375978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-acb7dae3-730e-41b6-8db0-5fcbdc1cf70a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:58.378119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-acb7dae3-730e-41b6-8db0-5fcbdc1cf70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:58.387784 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3818/7613] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:58.389243 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7dae3-730e-41b6-8db0-5fcbdc1cf70a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.398395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c03603384324f42a93d546eacc53a0b, user_id=2751475cc4904e3595a81d9c21626704, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.401322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.415891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7dae3-730e-41b6-8db0-5fcbdc1cf70a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.424213 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:58.425995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf516c7-fff9-47a3-b783-acbdb8f619f7 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.427349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf516c7-fff9-47a3-b783-acbdb8f619f7 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.427889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf516c7-fff9-47a3-b783-acbdb8f619f7 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.428370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf516c7-fff9-47a3-b783-acbdb8f619f7 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-1303663642` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.430873 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3796/7614] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:58 2022] PUT /identity/v3/projects/2c03603384324f42a93d546eacc53a0b/users/2751475cc4904e3595a81d9c21626704/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:58.432218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.442488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:58.444862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf516c7-fff9-47a3-b783-acbdb8f619f7 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=5e8d9fafd3514b2eb66ade982795c812, value=tempest-tag-1303663642)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.447576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf516c7-fff9-47a3-b783-acbdb8f619f7 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.477510 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3819/7615] 10.222.0.46 () {58 vars in 1314 bytes} [Sun Aug 21 01:39:58 2022] GET /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-1303663642 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:58.479200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d74ef-bbfd-46fe-a4ee-a1c0c78f79fe None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.480579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d74ef-bbfd-46fe-a4ee-a1c0c78f79fe None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.481131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d74ef-bbfd-46fe-a4ee-a1c0c78f79fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.529603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5c3d74ef-bbfd-46fe-a4ee-a1c0c78f79fe None None] MFA Rules not processed for user `2751475cc4904e3595a81d9c21626704`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:58.531033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5c3d74ef-bbfd-46fe-a4ee-a1c0c78f79fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:58.547283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb98272-852e-4aa1-8702-da106f0cb739 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.551862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.552473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.552838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.553117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.616051 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:58.625758 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3820/7616] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:39:58.625758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d74ef-bbfd-46fe-a4ee-a1c0c78f79fe None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.664470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.666120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.679917 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3797/7617] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:39:58.680907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.692562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a05eef-5bd5-45ca-880d-e66b25b5acd5 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.697553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.698325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.698611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.698886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.699638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.702395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.715758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d74ef-bbfd-46fe-a4ee-a1c0c78f79fe None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.722457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.723286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.723591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.723867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.725570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=5e8d9fafd3514b2eb66ade982795c812)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.728284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.746309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3798/7618] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:39:58 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:58.751301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.800989 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3821/7619] 10.222.0.46 () {60 vars in 1265 bytes} [Sun Aug 21 01:39:58 2022] PUT /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags => generated 139 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:39:58.805193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.819417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781422-e766-4c43-aea9-d42680ecfe0b tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.879500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387e6f-3f0b-40d8-b756-86a7ffcbf0fd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.885817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.886926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.887407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.887875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.889019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.891974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.895769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.898849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.899241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.899591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.924267 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3799/7620] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:39:58 2022] POST /identity/v3/users => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:39:58.925547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.928568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=5e8d9fafd3514b2eb66ade982795c812)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.931593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.944648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa74b2-003a-49d2-95e5-a751f6fb18ab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.951753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.953532 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3822/7621] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:39:58 2022] GET /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags => generated 139 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:39:58.953756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.954054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.954326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.955064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.956921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.957525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.973055 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3800/7622] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:39:58.974178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086e027-fd86-4c7e-81d6-04e93c7a6c6d tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:58.976884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:58.980220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:58.981025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:58.981285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:58.981560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-162246844` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:58.983068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=5e8d9fafd3514b2eb66ade982795c812, value=tempest-tag-162246844)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:58.985385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:58.987011 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:58.992406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919dbf3-b012-47d8-8cd1-09088bd9262c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.009109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.009109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.009109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.009109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] PATH_INFO: `/v3/projects/3369d5d2b17744df814181f5cb1803bd/users/e2d86a5d5cb745f9a6f4a2f951b491e3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.030024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3369d5d2b17744df814181f5cb1803bd, user_id=e2d86a5d5cb745f9a6f4a2f951b491e3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.032505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.063083 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3801/7623] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:58 2022] PUT /identity/v3/projects/3369d5d2b17744df814181f5cb1803bd/users/e2d86a5d5cb745f9a6f4a2f951b491e3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:59.067903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.088312 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-162246844. To ensure interoperability, identifiers should be a valid uuid. Aug 21 01:39:59.088312 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 21 01:39:59.088312 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:39:59.105619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3823/7624] 10.222.0.46 () {58 vars in 1314 bytes} [Sun Aug 21 01:39:58 2022] DELETE /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-162246844 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:39:59.105619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.112331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af7c5-d435-49b5-8b81-30f49e2671c6 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.120716 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:59.183407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.184040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.184328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.184713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-162246844` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.199738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=5e8d9fafd3514b2eb66ade982795c812, value=tempest-tag-162246844)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.203497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.209683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b682d50-05f5-4a4f-8cbf-6d8dc50daae7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Could not find project tag: tempest-tag-162246844.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-162246844. Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 21 01:39:59.234835 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 21 01:39:59.236013 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:39:59.236013 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:39:59.236013 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 21 01:39:59.236013 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 21 01:39:59.236013 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-162246844. Aug 21 01:39:59.236013 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:39:59.238776 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3824/7625] 10.222.0.46 () {58 vars in 1311 bytes} [Sun Aug 21 01:39:59 2022] GET /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags/tempest-tag-162246844 => generated 106 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:39:59.241103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.260623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.261290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.261566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.261946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.262486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.264191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.269559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a76f1-defb-4c23-b3f6-e10cb057785e tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.275759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.276532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.276852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.277131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.278364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=5e8d9fafd3514b2eb66ade982795c812)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.282591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.301103 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3802/7626] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:39:59.302024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.327633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e627-4231-4a9c-bb98-0b3160417764 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.342312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c240a-259d-410b-b450-8e46ca9884f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.343756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c240a-259d-410b-b450-8e46ca9884f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.344136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c240a-259d-410b-b450-8e46ca9884f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.345113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c240a-259d-410b-b450-8e46ca9884f7 admin admin] PATH_INFO: `/v3/projects/3369d5d2b17744df814181f5cb1803bd/users/e2d86a5d5cb745f9a6f4a2f951b491e3/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.348889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c240a-259d-410b-b450-8e46ca9884f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3369d5d2b17744df814181f5cb1803bd, user_id=e2d86a5d5cb745f9a6f4a2f951b491e3, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.355212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c240a-259d-410b-b450-8e46ca9884f7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.381157 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3803/7627] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:39:59 2022] PUT /identity/v3/projects/3369d5d2b17744df814181f5cb1803bd/users/e2d86a5d5cb745f9a6f4a2f951b491e3/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:59.394433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47681e-9d1e-45a0-91ab-98fead6b03e1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.394980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47681e-9d1e-45a0-91ab-98fead6b03e1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.395345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47681e-9d1e-45a0-91ab-98fead6b03e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.409931 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3825/7628] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:39:59 2022] DELETE /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:59.414965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.437262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cfdc-6356-4927-8e4d-7a1521285467 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.488758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dd47681e-9d1e-45a0-91ab-98fead6b03e1 None None] MFA Rules not processed for user `e2d86a5d5cb745f9a6f4a2f951b491e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:39:59.490352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dd47681e-9d1e-45a0-91ab-98fead6b03e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:59.575294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.576141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.576922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.577214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.595224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=5e8d9fafd3514b2eb66ade982795c812)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.597790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.612079 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3826/7629] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:39:59 2022] GET /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812/tags => generated 66 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 21 01:39:59.613184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.616311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:59.641574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3804/7630] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:39:59.641574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47681e-9d1e-45a0-91ab-98fead6b03e1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.669450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47681e-9d1e-45a0-91ab-98fead6b03e1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.688672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20b0049eea44cff8152004b94839ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7ce2f5c22454eada48cffa730f46251', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.689884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.690413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.690939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] PATH_INFO: `/v3/projects/5e8d9fafd3514b2eb66ade982795c812` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.693452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e8d9fafd3514b2eb66ade982795c812)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.697849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.733655 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:59.794131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650e9ae-1878-4340-bf57-2e90dc1cebe1 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.815097 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:59.817105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8d9fafd3514b2eb66ade982795c812', 'request_id': 'req-f6dac61a-e4d6-4473-9588-dedd62733319'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:59.828082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8d9fafd3514b2eb66ade982795c812', 'request_id': 'req-f6dac61a-e4d6-4473-9588-dedd62733319'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:59.835468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8d9fafd3514b2eb66ade982795c812', 'request_id': 'req-f6dac61a-e4d6-4473-9588-dedd62733319'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:59.866101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] The token cache is being invalidate because project 5e8d9fafd3514b2eb66ade982795c812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:39:59.866465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:59.867422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:39:59.869781 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3805/7631] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:59 2022] DELETE /identity/v3/projects/5e8d9fafd3514b2eb66ade982795c812 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:39:59.870734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:39:59.874623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:39:59.934547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.935280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.935648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.935648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] PATH_INFO: `/v3/projects/a1b6d7e031d14aa4b65fd5179bdaa237` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:39:59.937364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b6d7e031d14aa4b65fd5179bdaa237)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:39:59.939441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:39:59.990226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dac61a-e4d6-4473-9588-dedd62733319 tempest-IdentityV3ProjectTagsTest-905695079 tempest-IdentityV3ProjectTagsTest-905695079-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:39:59.996171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:39:59.997392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:39:59.997893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:39:59.998259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:00.018728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:00.055131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b6d7e031d14aa4b65fd5179bdaa237', 'request_id': 'req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.080898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b6d7e031d14aa4b65fd5179bdaa237', 'request_id': 'req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.106166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b6d7e031d14aa4b65fd5179bdaa237', 'request_id': 'req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.132542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] The token cache is being invalidate because project a1b6d7e031d14aa4b65fd5179bdaa237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:00.133001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.134538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.136717 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3827/7632] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:39:59 2022] DELETE /identity/v3/projects/a1b6d7e031d14aa4b65fd5179bdaa237 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:00.139015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:00.142835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:00.167889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:00.169652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:00.200515 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3806/7633] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:39:59 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:00.201709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:00.204803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:00.234863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10219531-f20c-448c-8bbc-0377a1eb0dd3 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:00.305430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e46e-e36a-42b8-b98d-6ad7b59e4d14 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:00.324434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:00.325298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:00.325383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:00.325652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] PATH_INFO: `/v3/users/53d880c34d444e7cace01df4e924c636` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:00.333134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d880c34d444e7cace01df4e924c636)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:00.335104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:00.352974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:00.354674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:00.354916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:00.355456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] PATH_INFO: `/v3/users/1ac73b7319fb4e8ab1372ed29803936c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:00.356930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac73b7319fb4e8ab1372ed29803936c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:00.359137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:00.386079 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:00.396470 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:00.446988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d880c34d444e7cace01df4e924c636'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.460466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d880c34d444e7cace01df4e924c636'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.461134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d880c34d444e7cace01df4e924c636'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.478298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d880c34d444e7cace01df4e924c636'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.479357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac73b7319fb4e8ab1372ed29803936c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.481652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d880c34d444e7cace01df4e924c636'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.515486 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3828/7634] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:00 2022] DELETE /identity/v3/users/53d880c34d444e7cace01df4e924c636 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:00.516538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac73b7319fb4e8ab1372ed29803936c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.518391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:00.521358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:00.554042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac73b7319fb4e8ab1372ed29803936c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.556609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac73b7319fb4e8ab1372ed29803936c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.567931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bd814ce0-d5ec-4a65-b360-58e003dc48dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac73b7319fb4e8ab1372ed29803936c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.585844 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3807/7635] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:00 2022] DELETE /identity/v3/users/1ac73b7319fb4e8ab1372ed29803936c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:00.587239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:00.587493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:00.587772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:00.613279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:00.615080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:00.659799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111229f6-44fd-4a75-8a3e-4a0238ff2034 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:00.748134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3808/7636] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:00.763882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:00.765838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:00.786139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:00.787111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:00.787542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:00.802506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] PATH_INFO: `/v3/users/2751475cc4904e3595a81d9c21626704` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:00.807055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2751475cc4904e3595a81d9c21626704)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:00.809611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:00.891678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c8196-3f02-4dbe-9d1f-837392556469 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:00.901117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39d6c2-698a-4152-8fcf-7f234ab9bdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:00.901835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d6c2-698a-4152-8fcf-7f234ab9bdbd service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:00.902124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d6c2-698a-4152-8fcf-7f234ab9bdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:00.902448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d6c2-698a-4152-8fcf-7f234ab9bdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:00.920348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39d6c2-698a-4152-8fcf-7f234ab9bdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:00.922076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39d6c2-698a-4152-8fcf-7f234ab9bdbd service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:00.945874 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3809/7637] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:00.958595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2751475cc4904e3595a81d9c21626704'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.967954 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:00.980123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2751475cc4904e3595a81d9c21626704'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:00.982831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2751475cc4904e3595a81d9c21626704'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.004865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2751475cc4904e3595a81d9c21626704'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.005784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2751475cc4904e3595a81d9c21626704'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.054065 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3829/7638] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:00 2022] DELETE /identity/v3/users/2751475cc4904e3595a81d9c21626704 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:01.060945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.061371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.061709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.075022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:01.076989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:01.137153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:01.141617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:01.230646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac10e-1d97-43c5-9f67-ec51aa7546c3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:01.241850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:01.242523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.242891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.243118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] PATH_INFO: `/v3/projects/7e1dd61a5f1e49908bb731e14ae99941` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.246444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1dd61a5f1e49908bb731e14ae99941)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:01.250647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:01.317949 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:01.351838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1dd61a5f1e49908bb731e14ae99941', 'request_id': 'req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.366283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1dd61a5f1e49908bb731e14ae99941', 'request_id': 'req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.383413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1dd61a5f1e49908bb731e14ae99941', 'request_id': 'req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.395761 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3810/7639] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:01.418445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:01.421558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:01.427159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] The token cache is being invalidate because project 7e1dd61a5f1e49908bb731e14ae99941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:01.427452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.428469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-27d35f42-5d7f-4a63-a1c3-9251b251f0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:01.430597 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3830/7640] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:01 2022] DELETE /identity/v3/projects/7e1dd61a5f1e49908bb731e14ae99941 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:01.435221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44920-8ad2-4de9-8269-a2248a465449 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.436428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44920-8ad2-4de9-8269-a2248a465449 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.437472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44920-8ad2-4de9-8269-a2248a465449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.484883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-13f44920-8ad2-4de9-8269-a2248a465449 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:01.486165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-13f44920-8ad2-4de9-8269-a2248a465449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:01.545530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3441-9e70-48f6-95e3-c0af805e453a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:01.583709 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:01.595709 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3831/7641] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:01.603375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e908ae-3c12-4710-85b3-901cedf4146f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.603882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e908ae-3c12-4710-85b3-901cedf4146f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.605107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e908ae-3c12-4710-85b3-901cedf4146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.642489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-35e908ae-3c12-4710-85b3-901cedf4146f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:01.643864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-35e908ae-3c12-4710-85b3-901cedf4146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:01.660738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:01.661424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.661767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.663622 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3832/7642] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:01.667861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e908ae-3c12-4710-85b3-901cedf4146f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:01.668977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.672855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:01.680084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e908ae-3c12-4710-85b3-901cedf4146f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:01.686400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:01.687168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.687546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.687956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.691233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:01.691679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:01.694099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:01.707440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:01.716093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:01.727038 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3833/7643] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:40:01.728090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:01.751574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3811/7644] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:01.752191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da569dd-44fc-4b07-beb7-944f35e95135 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:01.759109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:01.759833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.760196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.760547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.761380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:01.765415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:01.828015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:01.838027 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3834/7645] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:01 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:01.842686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2a47-c914-4ec7-8f80-bd26db848960 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:01.928518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:01.929421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:01.929840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:01.930334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:01.931224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:01.933773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:01.991151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:02.004216 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3812/7646] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:01 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:02.011204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3693b-863b-4778-ad8d-7df2134a31bd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:02.021306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:02.022934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:02.023221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:02.023498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:02.024198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:02.026017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:02.045945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:02.053687 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3835/7647] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:40:02.062813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be408e-1f05-435f-b0e3-cb3212034e1c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:02.070119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fe28b-3ef0-445b-b027-94586ca6a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:02.070752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fe28b-3ef0-445b-b027-94586ca6a1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:02.071028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fe28b-3ef0-445b-b027-94586ca6a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:02.071298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fe28b-3ef0-445b-b027-94586ca6a1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:02.071956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fe28b-3ef0-445b-b027-94586ca6a1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:02.073853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fe28b-3ef0-445b-b027-94586ca6a1ca admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:02.087124 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3813/7648] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:02.092524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:02.118814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbd9c-a1d4-4309-a333-6d1cc56ad7ca admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:02.131298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:02.132896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:02.134142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:02.134760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] PATH_INFO: `/v3/projects/877892eda00441719379e2a0cf89b9b0/users/38368963df3e4d789c7585f916491084/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:02.167287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877892eda00441719379e2a0cf89b9b0, user_id=38368963df3e4d789c7585f916491084, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:02.171357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:02.208988 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3836/7649] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:02 2022] PUT /identity/v3/projects/877892eda00441719379e2a0cf89b9b0/users/38368963df3e4d789c7585f916491084/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:02.209472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:02.209762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:02.210031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:02.278038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] MFA Rules not processed for user `38368963df3e4d789c7585f916491084`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:02.279590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:02.301536 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:02.421179 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3814/7650] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:02.426392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:02.544151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:02.546496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:02.680150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254813f-b9fb-4122-8468-76869be675a1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:02.714124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:02.714920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:02.715238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:02.715463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:02.716783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:02.719434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:02.742363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461e900-de27-4877-af32-7f340b0e85b7 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:02.759503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:02.761193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:02.761524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:02.766094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] PATH_INFO: `/v3/projects/4b9bea811403413c97455a8ac871236f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:02.769880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9bea811403413c97455a8ac871236f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:02.773533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:02.798498 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3837/7651] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:02 2022] POST /identity/v3/projects => generated 363 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:02.803879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:02.893189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9bea811403413c97455a8ac871236f', 'request_id': 'req-70a03aae-a7f6-47cf-91e7-a34a6f97b068'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:02.903200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9bea811403413c97455a8ac871236f', 'request_id': 'req-70a03aae-a7f6-47cf-91e7-a34a6f97b068'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:02.918391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9bea811403413c97455a8ac871236f', 'request_id': 'req-70a03aae-a7f6-47cf-91e7-a34a6f97b068'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:02.945932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] The token cache is being invalidate because project 4b9bea811403413c97455a8ac871236f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:02.946313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:02.947621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:02.949988 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3815/7652] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:02 2022] DELETE /identity/v3/projects/4b9bea811403413c97455a8ac871236f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:02.953558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:02.955061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:03.050620 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:03.071311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f47d7-6375-47ef-8c41-4a0121c22dbe admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:03.080281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03aae-a7f6-47cf-91e7-a34a6f97b068 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:03.085340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:03.085992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:03.086274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:03.086645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] PATH_INFO: `/v3/projects/2c03603384324f42a93d546eacc53a0b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:03.087704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c03603384324f42a93d546eacc53a0b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:03.089754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:03.097013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:03.097581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:03.097932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:03.098201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:03.099000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:03.106300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:03.145193 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:03.161047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c03603384324f42a93d546eacc53a0b', 'request_id': 'req-96b2c342-e0f4-45af-a558-136bb511a7e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.169387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c03603384324f42a93d546eacc53a0b', 'request_id': 'req-96b2c342-e0f4-45af-a558-136bb511a7e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.170303 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3838/7653] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:02 2022] POST /identity/v3/users => generated 288 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:03.171357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:03.175107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:03.183171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c03603384324f42a93d546eacc53a0b', 'request_id': 'req-96b2c342-e0f4-45af-a558-136bb511a7e1'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.191488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7b5f-a381-40e0-ac92-0d8900a7591e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:03.207669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] The token cache is being invalidate because project 2c03603384324f42a93d546eacc53a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:03.207969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.209350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.211187 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3816/7654] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:02 2022] DELETE /identity/v3/projects/2c03603384324f42a93d546eacc53a0b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:03.215498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:03.217474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:03.288069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:03.288747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:03.289049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:03.294354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] PATH_INFO: `/v3/users/b20b0049eea44cff8152004b94839ab1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:03.296365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20b0049eea44cff8152004b94839ab1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:03.298620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:03.340987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c342-e0f4-45af-a558-136bb511a7e1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:03.350391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:03.351329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:03.351900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:03.352418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:03.353137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:03.355473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:03.375929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3817/7655] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:03.375929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:03.378081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:03.396005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4feb9-1348-4be8-9e38-5c9f5604f011 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:03.401486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:03.402168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:03.402474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:03.402941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] PATH_INFO: `/v3/users/e2d86a5d5cb745f9a6f4a2f951b491e3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:03.404052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d86a5d5cb745f9a6f4a2f951b491e3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:03.406349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:03.434477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20b0049eea44cff8152004b94839ab1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.450304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20b0049eea44cff8152004b94839ab1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.451177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20b0049eea44cff8152004b94839ab1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.464961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20b0049eea44cff8152004b94839ab1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.465662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20b0049eea44cff8152004b94839ab1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.487376 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3839/7656] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:03 2022] DELETE /identity/v3/users/b20b0049eea44cff8152004b94839ab1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:03.492020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:03.493931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:03.499794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d86a5d5cb745f9a6f4a2f951b491e3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.516238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d86a5d5cb745f9a6f4a2f951b491e3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.532379 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:03.545193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d86a5d5cb745f9a6f4a2f951b491e3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.547233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d86a5d5cb745f9a6f4a2f951b491e3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.563722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d86a5d5cb745f9a6f4a2f951b491e3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:03.583509 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3818/7657] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:03 2022] DELETE /identity/v3/users/e2d86a5d5cb745f9a6f4a2f951b491e3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:03.597404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc413629-2b90-4bea-a3c3-713dde547f72 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:03.624390 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:03.686752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:03.687469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:03.687717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:03.688047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] PATH_INFO: `/v3/projects/c48f021fc07a4d66b71d0d1606aa3e6c/users/be66130c79a64cbf9cb50811dbdceffa/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:03.728330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48f021fc07a4d66b71d0d1606aa3e6c, user_id=be66130c79a64cbf9cb50811dbdceffa, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:03.739275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:03.766098 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3840/7658] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:03 2022] PUT /identity/v3/projects/c48f021fc07a4d66b71d0d1606aa3e6c/users/be66130c79a64cbf9cb50811dbdceffa/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:03.771326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:03.775756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:03.828225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107df38a-598c-4f85-b35a-12ef74a72f26 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:03.956177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd0c0f-5b76-4df6-b922-b3023b05533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:03.957430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd0c0f-5b76-4df6-b922-b3023b05533f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:03.958336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd0c0f-5b76-4df6-b922-b3023b05533f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:03.958949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd0c0f-5b76-4df6-b922-b3023b05533f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:03.959875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd0c0f-5b76-4df6-b922-b3023b05533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:03.963786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd0c0f-5b76-4df6-b922-b3023b05533f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:03.990616 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3819/7659] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:03.996593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:04.019745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258cc9-4b3e-4cc4-ba21-ed7944ddaf3b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:04.047042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:04.048212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.048494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.048781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] PATH_INFO: `/v3/projects/c48f021fc07a4d66b71d0d1606aa3e6c/users/be66130c79a64cbf9cb50811dbdceffa/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.051957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48f021fc07a4d66b71d0d1606aa3e6c, user_id=be66130c79a64cbf9cb50811dbdceffa, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:04.054666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:04.086918 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3841/7660] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:03 2022] PUT /identity/v3/projects/c48f021fc07a4d66b71d0d1606aa3e6c/users/be66130c79a64cbf9cb50811dbdceffa/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:04.101657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04475-76b1-4f4a-a72b-803e83591d2b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.101944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04475-76b1-4f4a-a72b-803e83591d2b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.102279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04475-76b1-4f4a-a72b-803e83591d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.139469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b9c04475-76b1-4f4a-a72b-803e83591d2b None None] MFA Rules not processed for user `be66130c79a64cbf9cb50811dbdceffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:04.140713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b9c04475-76b1-4f4a-a72b-803e83591d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.232602 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3820/7661] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:04.245708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:04.247446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.324417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e2148-b324-4f71-9e22-2e9f10500a5d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:04.328567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:04.329242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.329518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.329791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.339670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:04.341149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:04.353026 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3842/7662] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:04.458545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04475-76b1-4f4a-a72b-803e83591d2b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:04.469972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:04.471485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.477982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04475-76b1-4f4a-a72b-803e83591d2b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:04.483077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:04.483783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.484059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.484511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.487068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.575858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:04.577445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:04.592720 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:04.599757 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3821/7663] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:04.600335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf87a3-a841-411c-9447-2429e6d1aba7 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:04.600870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:04.603522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.617773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:04.618601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.618950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.619219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] PATH_INFO: `/v3/projects/c7ce2f5c22454eada48cffa730f46251` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.622675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ce2f5c22454eada48cffa730f46251)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:04.625032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:04.627737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd95e-efb3-47e7-a711-514063d2e059 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:04.633528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:04.634179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.634476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.635137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] PATH_INFO: `/v3/projects/3369d5d2b17744df814181f5cb1803bd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.636859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3369d5d2b17744df814181f5cb1803bd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:04.639343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:04.704709 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:04.715764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ce2f5c22454eada48cffa730f46251', 'request_id': 'req-1f143f40-433b-4684-a4fb-ca2f47512b64'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.728110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ce2f5c22454eada48cffa730f46251', 'request_id': 'req-1f143f40-433b-4684-a4fb-ca2f47512b64'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.739261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ce2f5c22454eada48cffa730f46251', 'request_id': 'req-1f143f40-433b-4684-a4fb-ca2f47512b64'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.752172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] The token cache is being invalidate because project c7ce2f5c22454eada48cffa730f46251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:04.752682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.753845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-1f143f40-433b-4684-a4fb-ca2f47512b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.759273 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3843/7664] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:04 2022] DELETE /identity/v3/projects/c7ce2f5c22454eada48cffa730f46251 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:04.765863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1438a0-95de-43d2-a34c-bdefd16f027b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.767157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1438a0-95de-43d2-a34c-bdefd16f027b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.767157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1438a0-95de-43d2-a34c-bdefd16f027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.777193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3369d5d2b17744df814181f5cb1803bd', 'request_id': 'req-81cb58e2-3900-4cd1-8acd-3fb71afb071b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.792536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3369d5d2b17744df814181f5cb1803bd', 'request_id': 'req-81cb58e2-3900-4cd1-8acd-3fb71afb071b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.808475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0d1438a0-95de-43d2-a34c-bdefd16f027b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:04.810294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d1438a0-95de-43d2-a34c-bdefd16f027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.824892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3369d5d2b17744df814181f5cb1803bd', 'request_id': 'req-81cb58e2-3900-4cd1-8acd-3fb71afb071b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.883749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] The token cache is being invalidate because project 3369d5d2b17744df814181f5cb1803bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:04.884046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.886840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-81cb58e2-3900-4cd1-8acd-3fb71afb071b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:04.894375 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3822/7665] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:04 2022] DELETE /identity/v3/projects/3369d5d2b17744df814181f5cb1803bd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:04.897817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f54c29-92c9-4b48-a7e4-c6383f396da5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.898102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f54c29-92c9-4b48-a7e4-c6383f396da5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.898379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f54c29-92c9-4b48-a7e4-c6383f396da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.933051 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3844/7666] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:04.935443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56212d-d2f4-467d-8644-00a305ec9185 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.935805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56212d-d2f4-467d-8644-00a305ec9185 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.936008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56212d-d2f4-467d-8644-00a305ec9185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.937020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-00f54c29-92c9-4b48-a7e4-c6383f396da5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:04.938635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00f54c29-92c9-4b48-a7e4-c6383f396da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.952811 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3823/7667] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:04.956128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84fb1-9fb9-4e62-b3aa-ce6d4f79ad9a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:04.956621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84fb1-9fb9-4e62-b3aa-ce6d4f79ad9a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:04.957168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84fb1-9fb9-4e62-b3aa-ce6d4f79ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:04.975259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4c56212d-d2f4-467d-8644-00a305ec9185 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:04.977002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c56212d-d2f4-467d-8644-00a305ec9185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.979916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1bf84fb1-9fb9-4e62-b3aa-ce6d4f79ad9a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:04.981126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1bf84fb1-9fb9-4e62-b3aa-ce6d4f79ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:04.986044 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3845/7668] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:04.991198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56212d-d2f4-467d-8644-00a305ec9185 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:04.992264 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3824/7669] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:05.002606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56212d-d2f4-467d-8644-00a305ec9185 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.003088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf84fb1-9fb9-4e62-b3aa-ce6d4f79ad9a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.008615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.009241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.009723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.010219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.011591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:05.011886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.014195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.015711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf84fb1-9fb9-4e62-b3aa-ce6d4f79ad9a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.020655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.021382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.022061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.022383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.023211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:05.023966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.025283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.032290 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3846/7670] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:05.034074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.039418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3825/7671] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:05.043728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.048405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d5bc9-cf79-4cfd-af74-c58f242e6df0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.053809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.054423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bcff9-bf1d-4c82-ae6a-c6a47b5caf7e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.054848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.055289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.055833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.056722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.059207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.059425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.060237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.061406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.061792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.062424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.066260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.101513 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3826/7672] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:05.101743 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3847/7673] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:05.103300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.103813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.176304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ee02b-a05b-4116-932e-a406369c9881 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.176819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416965-279d-4cef-9a48-3b866e9a1e85 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.182376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.183041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.183266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.183414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.183578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.184198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.184641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.185288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.185773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.186590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.186823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.189199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.212798 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3848/7674] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:05.214311 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3827/7675] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:05.218193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.218381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.230725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e453d-329a-4938-aea1-7e83a8d3aa72 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.231705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dda62-06b5-4b8a-ae12-151acdc7507a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.241255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.241375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.241570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.241665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.241747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.241824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.241902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.241978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.242097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.242194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.242194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.242352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.252963 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3849/7676] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:05.256739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.258153 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3828/7677] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:05.261705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.265583 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:05.271725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e54d-7032-4bc1-b476-5f8b0393ae1d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.274855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f588-7aba-4ec3-b419-dfae566a9b5c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.279337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.280117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.280460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.280745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.280923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.281043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.281305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.281432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.281964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.282256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.283901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.284427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.299787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3850/7678] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:40:05.301040 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3829/7679] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:40:05.301172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.302866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.308704 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:05.315607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767d62-4371-4b35-aad7-9b4f43828eb7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.318781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77c9a7-156a-463e-9e8c-6b1ab51eee6b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.320975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3639329-288b-450d-a2c1-726f6e5abdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.321655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639329-288b-450d-a2c1-726f6e5abdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.321934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639329-288b-450d-a2c1-726f6e5abdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.322206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639329-288b-450d-a2c1-726f6e5abdbf admin admin] PATH_INFO: `/v3/projects/5d023b370b52405a9cfd79501b023020/users/1c68a9b6d2cb49548ae55bc5b8455b27/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.324202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785aab2-2cae-49cf-93bb-db5d170452f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.324903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785aab2-2cae-49cf-93bb-db5d170452f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.325181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785aab2-2cae-49cf-93bb-db5d170452f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.325454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785aab2-2cae-49cf-93bb-db5d170452f2 admin admin] PATH_INFO: `/v3/projects/59ced87b27d74b61a60d2bea8a558e90/users/6faf6f750b544f12a40f220359816bbd/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.338761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3639329-288b-450d-a2c1-726f6e5abdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d023b370b52405a9cfd79501b023020, user_id=1c68a9b6d2cb49548ae55bc5b8455b27, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.341416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3639329-288b-450d-a2c1-726f6e5abdbf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.350535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785aab2-2cae-49cf-93bb-db5d170452f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ced87b27d74b61a60d2bea8a558e90, user_id=6faf6f750b544f12a40f220359816bbd, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.354312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785aab2-2cae-49cf-93bb-db5d170452f2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.359093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3851/7680] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:05 2022] PUT /identity/v3/projects/5d023b370b52405a9cfd79501b023020/users/1c68a9b6d2cb49548ae55bc5b8455b27/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:05.369612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7f376-d8f0-43d0-b664-176e040468f6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.369925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7f376-d8f0-43d0-b664-176e040468f6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.370168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7f376-d8f0-43d0-b664-176e040468f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.377897 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3830/7681] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:05 2022] PUT /identity/v3/projects/59ced87b27d74b61a60d2bea8a558e90/users/6faf6f750b544f12a40f220359816bbd/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:05.389597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959691f-2ddc-47db-93a0-93d5a5a2d872 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.389926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959691f-2ddc-47db-93a0-93d5a5a2d872 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.390153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959691f-2ddc-47db-93a0-93d5a5a2d872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.426238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4fb7f376-d8f0-43d0-b664-176e040468f6 None None] MFA Rules not processed for user `1c68a9b6d2cb49548ae55bc5b8455b27`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:05.427624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0959691f-2ddc-47db-93a0-93d5a5a2d872 None None] MFA Rules not processed for user `6faf6f750b544f12a40f220359816bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:05.428064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4fb7f376-d8f0-43d0-b664-176e040468f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:05.429588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0959691f-2ddc-47db-93a0-93d5a5a2d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:05.525460 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3852/7682] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:05.529162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3831/7683] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:05.533887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7f376-d8f0-43d0-b664-176e040468f6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.534075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959691f-2ddc-47db-93a0-93d5a5a2d872 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.608334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7f376-d8f0-43d0-b664-176e040468f6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.614220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.615342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.615689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.616094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.616981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.619002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.654459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959691f-2ddc-47db-93a0-93d5a5a2d872 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.659754 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3853/7684] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:05.660635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.661325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.661632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.661903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.663245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.664131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.665572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.706203 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3832/7685] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:05.712422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.762309 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:05.777937 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:05.791892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f96a-f5b6-460a-a1b4-04f6d42ee0b2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.795535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3f01c-7032-43f4-8b59-995e80590498 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.799254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.800143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.800534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.800657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.801375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.801559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.801826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.802011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.802466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.803037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.804829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.806959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.836184 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3833/7686] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:05.840433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.845416 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3854/7687] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:05 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:05.857424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b72d-82c1-4e85-b3b2-f6d5b57b3afc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.861497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.864172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.865062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.865410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.865889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.866615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.869685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.878251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc60a-8a06-4951-9d95-5e2001bfc1b5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.886098 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3834/7688] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:05.889446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.890483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.890767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.891037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.891320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.892036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.893875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.904152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b04be-f65c-4993-b3bc-42549ce9939a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.911232 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3855/7689] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:05.911398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.911917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.912200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.912479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] PATH_INFO: `/v3/projects/0e657b6443af4b288d4640bafcc1038b/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.912809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.942345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e657b6443af4b288d4640bafcc1038b, user_id=70bfca365298407fb29714dc4083fb45, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.944191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c30c9d-54c2-44ec-938e-076971fd6f6a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:05.945547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:05.954532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:05.955639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:05.956114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:05.956608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] PATH_INFO: `/v3/projects/1ad842aa4aad4c63bb1ef2f9bed53de2/users/575622c633f0467cb8e47116751bdc6a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:05.966524 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3835/7690] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:05 2022] PUT /identity/v3/projects/0e657b6443af4b288d4640bafcc1038b/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:05.971054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:05.989794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad842aa4aad4c63bb1ef2f9bed53de2, user_id=575622c633f0467cb8e47116751bdc6a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:05.994491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.020830 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3856/7691] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:05 2022] PUT /identity/v3/projects/1ad842aa4aad4c63bb1ef2f9bed53de2/users/575622c633f0467cb8e47116751bdc6a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:06.025420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.109032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e224-db4f-45b2-8293-87cfd0bbe8b2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.118319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e78517-4bc7-43b1-add2-56afc18fbb5b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.131806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.132437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.132709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.133011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.133667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.135724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.150343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.151098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.151501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.152174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.153027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.156204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.161906 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3857/7692] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:06.163090 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.179080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ce7f-6970-4fea-aab2-2af444922f69 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.186790 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3836/7693] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:40:06.189062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c18fb-6f2f-4282-bb3b-c3c412399712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.190995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c18fb-6f2f-4282-bb3b-c3c412399712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.191200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.191316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c18fb-6f2f-4282-bb3b-c3c412399712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.191574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c18fb-6f2f-4282-bb3b-c3c412399712 admin admin] PATH_INFO: `/v3/projects/1ad842aa4aad4c63bb1ef2f9bed53de2/users/575622c633f0467cb8e47116751bdc6a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.195821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c18fb-6f2f-4282-bb3b-c3c412399712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad842aa4aad4c63bb1ef2f9bed53de2, user_id=575622c633f0467cb8e47116751bdc6a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.199413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c18fb-6f2f-4282-bb3b-c3c412399712 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.210991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d444436-e8a8-4266-97e5-22c0bb294d6c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.228878 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3858/7694] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:06 2022] PUT /identity/v3/projects/1ad842aa4aad4c63bb1ef2f9bed53de2/users/575622c633f0467cb8e47116751bdc6a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:06.232183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.232786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.233279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.279058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] MFA Rules not processed for user `575622c633f0467cb8e47116751bdc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:06.280343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:06.356669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983abde-aefd-4668-be0c-f1ec0581d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.357476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983abde-aefd-4668-be0c-f1ec0581d00c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.357872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983abde-aefd-4668-be0c-f1ec0581d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.358157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983abde-aefd-4668-be0c-f1ec0581d00c admin admin] PATH_INFO: `/v3/projects/0e657b6443af4b288d4640bafcc1038b/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.367085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983abde-aefd-4668-be0c-f1ec0581d00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e657b6443af4b288d4640bafcc1038b, user_id=70bfca365298407fb29714dc4083fb45, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.369796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983abde-aefd-4668-be0c-f1ec0581d00c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.403021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3837/7695] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:06 2022] PUT /identity/v3/projects/0e657b6443af4b288d4640bafcc1038b/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:06.406564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98420-2a06-4b08-bf55-5f10b4becf1b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.406658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98420-2a06-4b08-bf55-5f10b4becf1b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.406869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98420-2a06-4b08-bf55-5f10b4becf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.412907 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3859/7696] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:06.431028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.435609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:06.442577 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:06.461583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-08e98420-2a06-4b08-bf55-5f10b4becf1b None None] MFA Rules not processed for user `70bfca365298407fb29714dc4083fb45`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:06.463378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08e98420-2a06-4b08-bf55-5f10b4becf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:06.500085 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:06.526093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfbf6c-0c73-4d00-b506-6130398eb6c5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.582987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3838/7697] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:06.589326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98420-2a06-4b08-bf55-5f10b4becf1b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.604146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.604989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.605268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.605543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.703695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98420-2a06-4b08-bf55-5f10b4becf1b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.705283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.706900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.709358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.710006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.710281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.710550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.711186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.713237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.722336 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3860/7698] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:06.776616 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3839/7699] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:06 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:06.780596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.793945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81cd2-d802-4d10-8b37-c21c520f4acf service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.856163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.858683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.859028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.859296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.859963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.862926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.884683 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:06.896402 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3861/7700] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:06 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:06.899150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.917264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cf79-5700-4f55-9892-919b34522e15 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.924418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.925640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.926540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.927297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.928140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.930532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.948345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3840/7701] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:06.949108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:06.961842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89615d4-6e87-47f8-896d-ce520b220666 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:06.970117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85882-a3c6-4fc2-a12f-2729414b2e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:06.970780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85882-a3c6-4fc2-a12f-2729414b2e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:06.971070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85882-a3c6-4fc2-a12f-2729414b2e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:06.971318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85882-a3c6-4fc2-a12f-2729414b2e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:06.972063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c85882-a3c6-4fc2-a12f-2729414b2e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:06.973670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c85882-a3c6-4fc2-a12f-2729414b2e03 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:06.999176 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3862/7702] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:40:07.001159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:07.018016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4ed4-cd68-445b-b5fd-862cdfe0efb1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:07.032000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:07.033327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:07.033809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:07.034876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] PATH_INFO: `/v3/projects/d92a6086794b48108033ea1c3a25f4a3/users/abb23f0b08224977a060142df6e36669/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:07.059391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92a6086794b48108033ea1c3a25f4a3, user_id=abb23f0b08224977a060142df6e36669, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:07.063827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:07.088493 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3841/7703] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:07 2022] PUT /identity/v3/projects/d92a6086794b48108033ea1c3a25f4a3/users/abb23f0b08224977a060142df6e36669/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:07.102099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517113d3-f1f1-4225-9d06-ffd3e024e637 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:07.102455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517113d3-f1f1-4225-9d06-ffd3e024e637 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:07.102787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517113d3-f1f1-4225-9d06-ffd3e024e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:07.186101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-517113d3-f1f1-4225-9d06-ffd3e024e637 None None] MFA Rules not processed for user `abb23f0b08224977a060142df6e36669`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:07.188366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-517113d3-f1f1-4225-9d06-ffd3e024e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:07.355892 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3863/7704] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:07.361204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:07.538232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84038e7-29f2-4e7f-b654-ebbd8f29654d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:07.544809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:07.545540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:07.546483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:07.546963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:07.547877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:07.550152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:07.582991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517113d3-f1f1-4225-9d06-ffd3e024e637 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:07.583133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3842/7705] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:40:07 2022] POST /identity/v3/domains => generated 277 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:07.597358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517113d3-f1f1-4225-9d06-ffd3e024e637 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:07.678176 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:07.679350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:07.680092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:07.680625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:07.681732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:07.684015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:07.716870 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3864/7706] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:40:07 2022] POST /identity/v3/roles => generated 238 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:07.721667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:07.736757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88699e62-d95d-4402-b276-7fee4dd44de4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:07.758500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:07.759189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:07.759479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:07.759764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55/users/abb23f0b08224977a060142df6e36669/roles/39ee3bd96a314fe884667d440854d95c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:07.766850 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:07.787615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e8e20b5851bf4a77a9ab95f4d465fb55, user_id=abb23f0b08224977a060142df6e36669, role_id=39ee3bd96a314fe884667d440854d95c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:07.791528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:07.818738 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3843/7707] 10.222.0.46 () {60 vars in 1480 bytes} [Sun Aug 21 01:40:07 2022] PUT /identity/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55/users/abb23f0b08224977a060142df6e36669/roles/39ee3bd96a314fe884667d440854d95c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:07.822708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:07.838487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf2021-3bce-44f8-b875-a443e7429590 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:07.919011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:07.934621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:07.935806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:07.935951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:07.936152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:07.936841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:07.938892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:07.963623 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3865/7708] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:40:07 2022] POST /identity/v3/domains => generated 277 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:07.967428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:07.979879 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:08.036622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4231a9-7ce5-46ad-99fe-9693f0807641 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.098011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ad0a-a6b3-4e60-be6f-10a7768be829 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.109464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.110202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.110491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.110769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.111447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.113101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:08.117732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.118739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.119082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.119376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] PATH_INFO: `/v3/users/1c68a9b6d2cb49548ae55bc5b8455b27` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.121508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c68a9b6d2cb49548ae55bc5b8455b27)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.132916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:08.168127 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3866/7709] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:40:07 2022] POST /identity/v3/roles => generated 239 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:08.172928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:08.197776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09982ad-85a3-487d-b44d-acd9c389a6f6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.211699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.212356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.212645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.212992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.216324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.220714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:08.232005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c68a9b6d2cb49548ae55bc5b8455b27'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.244795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c68a9b6d2cb49548ae55bc5b8455b27'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.275157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c68a9b6d2cb49548ae55bc5b8455b27'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.275943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c68a9b6d2cb49548ae55bc5b8455b27'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.286924 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-39b552c7-95fb-4c89-baf9-8acd88e6d4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c68a9b6d2cb49548ae55bc5b8455b27'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.295449 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3867/7710] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:40:08 2022] POST /identity/v3/groups => generated 325 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:08.296633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:08.300873 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3844/7711] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:07 2022] DELETE /identity/v3/users/1c68a9b6d2cb49548ae55bc5b8455b27 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:08.305120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.305610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.306102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.308165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.329130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:08.331540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.342143 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:08.358512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702277b2-dd7c-46e3-b64e-0ed11abcf8c5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.433445 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3845/7712] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:08.434561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:08.436315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.452161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d947999-0c22-4909-8ea5-decda2996364 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.458929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.460235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.460699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.461151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] PATH_INFO: `/v3/users/38368963df3e4d789c7585f916491084` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.462714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38368963df3e4d789c7585f916491084)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.465239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:08.477688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.478359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.478637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.478912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups/dd512411a4bc489eb48306c9ac271faa/users/abb23f0b08224977a060142df6e36669` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.486893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dd512411a4bc489eb48306c9ac271faa, user_id=abb23f0b08224977a060142df6e36669)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.487980 n-d-master-1 devstack@keystone.service[81886]: WARNING py.warnings [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:40:08.487980 n-d-master-1 devstack@keystone.service[81886]: warnings.warn(msg) Aug 21 01:40:08.487980 n-d-master-1 devstack@keystone.service[81886]: Aug 21 01:40:08.490191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:08.528984 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3868/7713] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:40:08 2022] PUT /identity/v3/groups/dd512411a4bc489eb48306c9ac271faa/users/abb23f0b08224977a060142df6e36669 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:08.530474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:08.535282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.556124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38368963df3e4d789c7585f916491084'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.570184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38368963df3e4d789c7585f916491084'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.598669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38368963df3e4d789c7585f916491084'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.599464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38368963df3e4d789c7585f916491084'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.609614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38368963df3e4d789c7585f916491084'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:08.621161 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3846/7714] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:08 2022] DELETE /identity/v3/users/38368963df3e4d789c7585f916491084 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:08.622075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:08.623712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.687145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48096f3f-d7ab-4835-a9c4-4875f0a9cbb2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.719055 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:08.719495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56cc6f-0d38-45fe-abb3-be29c3d62827 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.732229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85be51-49e3-4dfb-8e84-6cd3645b62c9 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.733171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85be51-49e3-4dfb-8e84-6cd3645b62c9 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.733454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85be51-49e3-4dfb-8e84-6cd3645b62c9 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.733736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85be51-49e3-4dfb-8e84-6cd3645b62c9 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/dbfbc75433c147ae87293153d0671046/groups/dd512411a4bc489eb48306c9ac271faa/roles/1999b0b5481e45bb85f7ba8af6b7a178` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.737160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85be51-49e3-4dfb-8e84-6cd3645b62c9 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dbfbc75433c147ae87293153d0671046, group_id=dd512411a4bc489eb48306c9ac271faa, role_id=1999b0b5481e45bb85f7ba8af6b7a178)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.739997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85be51-49e3-4dfb-8e84-6cd3645b62c9 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:08.757209 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3847/7715] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:08 2022] PUT /identity/v3/domains/dbfbc75433c147ae87293153d0671046/groups/dd512411a4bc489eb48306c9ac271faa/roles/1999b0b5481e45bb85f7ba8af6b7a178 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:08.760962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.760962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.760962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.778000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.779162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.779506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.780628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.783669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.815496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:08.816794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.842476 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:08.871012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.873596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:08.885472 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3869/7716] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:08.886419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:08.899656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f1211-a3ce-4ee8-86ab-5a9ec59d1253 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:08.917808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3848/7717] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:08.934084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:08.936241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:08.994735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:08.995544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:08.995793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:08.996144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:08.996914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:08.999321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.029461 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3870/7718] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:40:08 2022] POST /identity/v3/domains => generated 275 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:09.033623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.066884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7c19-10e9-44bb-802c-0a089792fbc5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.175910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.178069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.178520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.178969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.207462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e9729-703a-4d10-8c29-d1d702c5b02b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.215854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.217805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.218969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.219454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.220336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.223503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.228640 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:09.252721 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3871/7719] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:40:09 2022] POST /identity/v3/roles => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:09.256628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.270772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aadf9e-36bf-4d98-a09c-8f6ff8dd7c99 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.277365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.278638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.278894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.279732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.280459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/f811cdb33f3e40a5b616a8f4194e1616/users/abb23f0b08224977a060142df6e36669/roles/41f5352e7e3f4968ab48df979b667bc1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.280910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.298362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f811cdb33f3e40a5b616a8f4194e1616, user_id=abb23f0b08224977a060142df6e36669, role_id=41f5352e7e3f4968ab48df979b667bc1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.301681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.307284 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3849/7720] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:09.321131 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3872/7721] 10.222.0.46 () {60 vars in 1480 bytes} [Sun Aug 21 01:40:09 2022] PUT /identity/v3/domains/f811cdb33f3e40a5b616a8f4194e1616/users/abb23f0b08224977a060142df6e36669/roles/41f5352e7e3f4968ab48df979b667bc1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:09.325758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.340836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024d0c5-6b50-42f8-817b-5f26c400049b service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.367553 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:09.420932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.422589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.423061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.423612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.424953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.427368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.456695 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3850/7722] 10.222.0.46 () {60 vars in 1149 bytes} [Sun Aug 21 01:40:09 2022] POST /identity/v3/domains => generated 276 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:09.460524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.473559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35a2c-fb85-4c9e-9ade-9acdb492c8ee tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.532253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.535881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:09.593497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.594368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.594651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.594922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.595842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.597676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.616845 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3873/7723] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:40:09 2022] POST /identity/v3/roles => generated 239 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:09.627204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.653778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a047-9636-439c-be6e-deab1d0bfd41 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.662810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.663754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.664448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.665030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.665849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.671903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a274101-fc09-41aa-a3b6-d14376d1c05c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.679167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.680082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.680462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.680884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] PATH_INFO: `/v3/projects/5d023b370b52405a9cfd79501b023020` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.681165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.683040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d023b370b52405a9cfd79501b023020)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.686814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.723156 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3874/7724] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:40:09 2022] POST /identity/v3/groups => generated 327 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:09.726358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.738871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e740c2e-2a0a-4c5a-9c37-ea936d27891b tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.746604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.748081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.748636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.749278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups/2967805d477d431f9f9a34fce3cf3032/users/abb23f0b08224977a060142df6e36669` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.757945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2967805d477d431f9f9a34fce3cf3032, user_id=abb23f0b08224977a060142df6e36669)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.762029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.775478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d023b370b52405a9cfd79501b023020', 'request_id': 'req-cb697e64-63f6-4b02-bbf0-24f4d6be4968'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:09.786546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d023b370b52405a9cfd79501b023020', 'request_id': 'req-cb697e64-63f6-4b02-bbf0-24f4d6be4968'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:09.793626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d023b370b52405a9cfd79501b023020', 'request_id': 'req-cb697e64-63f6-4b02-bbf0-24f4d6be4968'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:09.793944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3875/7725] 10.222.0.46 () {60 vars in 1360 bytes} [Sun Aug 21 01:40:09 2022] PUT /identity/v3/groups/2967805d477d431f9f9a34fce3cf3032/users/abb23f0b08224977a060142df6e36669 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:09.798548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.813047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] The token cache is being invalidate because project 5d023b370b52405a9cfd79501b023020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:09.813387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:09.814060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:09.815984 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3851/7726] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:09 2022] DELETE /identity/v3/projects/5d023b370b52405a9cfd79501b023020 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:09.819858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.821290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:09.878292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f1c18-175e-48ac-b81c-b5b7c4df8f89 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.883717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:09.884425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:09.884733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:09.885048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/802d8ba620d74ec5879b7ee26c51e70b/groups/2967805d477d431f9f9a34fce3cf3032/roles/f84d06526d764ab2abe1b7398361f9d2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:09.887664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=802d8ba620d74ec5879b7ee26c51e70b, group_id=2967805d477d431f9f9a34fce3cf3032, role_id=f84d06526d764ab2abe1b7398361f9d2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:09.887912 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:09.890864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:09.912457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e64-63f6-4b02-bbf0-24f4d6be4968 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:09.917723 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3876/7727] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:09 2022] PUT /identity/v3/domains/802d8ba620d74ec5879b7ee26c51e70b/groups/2967805d477d431f9f9a34fce3cf3032/roles/f84d06526d764ab2abe1b7398361f9d2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:09.923380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:09.930485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:09.951776 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:10.009027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:10.009953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:10.010543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:10.010795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] PATH_INFO: `/v3/users/575622c633f0467cb8e47116751bdc6a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:10.016674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575622c633f0467cb8e47116751bdc6a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:10.021060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:10.077932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765126ee-cd4a-46c8-865e-07f1d3aef64e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:10.089950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb23f0b08224977a060142df6e36669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd92a6086794b48108033ea1c3a25f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:10.091139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:10.092674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:10.093163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] PATH_INFO: `/v3/auth/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:10.094629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:10.096432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:10.100106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575622c633f0467cb8e47116751bdc6a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.114152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575622c633f0467cb8e47116751bdc6a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.147005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575622c633f0467cb8e47116751bdc6a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.152586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575622c633f0467cb8e47116751bdc6a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.167068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575622c633f0467cb8e47116751bdc6a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.180298 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3852/7728] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:09 2022] DELETE /identity/v3/users/575622c633f0467cb8e47116751bdc6a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:10.186292 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3877/7729] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:40:09 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:10.194345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:10.198456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:10.284915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:10.287083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:10.319922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f596-beaf-4ebb-8ab5-7d14f3116105 tempest-TokensV3TestJSON-363157166 tempest-TokensV3TestJSON-363157166-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:10.337263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03fcc8-fafc-459d-a454-87b872bb6587 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:10.359301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:10.363318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:10.363670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:10.364023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/802d8ba620d74ec5879b7ee26c51e70b/groups/2967805d477d431f9f9a34fce3cf3032/roles/f84d06526d764ab2abe1b7398361f9d2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:10.373977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=802d8ba620d74ec5879b7ee26c51e70b, group_id=2967805d477d431f9f9a34fce3cf3032, role_id=f84d06526d764ab2abe1b7398361f9d2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:10.390550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:10.407221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role f84d06526d764ab2abe1b7398361f9d2 was removed from group 2967805d477d431f9f9a34fce3cf3032 on domain 802d8ba620d74ec5879b7ee26c51e70b. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:10.407528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.409007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.441134 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3853/7730] 10.222.0.46 () {58 vars in 1467 bytes} [Sun Aug 21 01:40:10 2022] DELETE /identity/v3/domains/802d8ba620d74ec5879b7ee26c51e70b/groups/2967805d477d431f9f9a34fce3cf3032/roles/f84d06526d764ab2abe1b7398361f9d2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:10.444530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:10.446019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:10.464294 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:10.491982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:10.492841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:10.493213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:10.493763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] PATH_INFO: `/v3/projects/877892eda00441719379e2a0cf89b9b0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:10.496757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=877892eda00441719379e2a0cf89b9b0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:10.499388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:10.573640 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:10.581337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c304dfc-45cb-41d8-b639-77981a23deda tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:10.603119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877892eda00441719379e2a0cf89b9b0', 'request_id': 'req-4b3e748a-32b2-46f6-9c41-584aa6770e7c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.617542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877892eda00441719379e2a0cf89b9b0', 'request_id': 'req-4b3e748a-32b2-46f6-9c41-584aa6770e7c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.635829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877892eda00441719379e2a0cf89b9b0', 'request_id': 'req-4b3e748a-32b2-46f6-9c41-584aa6770e7c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.655198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] The token cache is being invalidate because project 877892eda00441719379e2a0cf89b9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:10.655481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.656188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.662450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3878/7731] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:10 2022] DELETE /identity/v3/projects/877892eda00441719379e2a0cf89b9b0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:10.663783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:10.665173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:10.685395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:10.686155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:10.686436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:10.687160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups/2967805d477d431f9f9a34fce3cf3032/users/abb23f0b08224977a060142df6e36669` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:10.689481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2967805d477d431f9f9a34fce3cf3032, user_id=abb23f0b08224977a060142df6e36669)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:10.691745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:10.703668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'abb23f0b08224977a060142df6e36669'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.732067 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3854/7732] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:40:10 2022] DELETE /identity/v3/groups/2967805d477d431f9f9a34fce3cf3032/users/abb23f0b08224977a060142df6e36669 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:10.737148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:10.741779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:10.775099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e748a-32b2-46f6-9c41-584aa6770e7c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:10.861270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:10.861955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:10.862232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:10.862503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] PATH_INFO: `/v3/users/be66130c79a64cbf9cb50811dbdceffa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:10.863752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be66130c79a64cbf9cb50811dbdceffa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:10.866030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:10.881309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ccb51-d420-4609-a93e-fdd92ec5ad1e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:10.897981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:10.899092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:10.899989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:10.900507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups/2967805d477d431f9f9a34fce3cf3032` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:10.902759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2967805d477d431f9f9a34fce3cf3032)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:10.915012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:10.936016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be66130c79a64cbf9cb50811dbdceffa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.948912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be66130c79a64cbf9cb50811dbdceffa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.950558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be66130c79a64cbf9cb50811dbdceffa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.961678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be66130c79a64cbf9cb50811dbdceffa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.963101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be66130c79a64cbf9cb50811dbdceffa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:10.966859 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:10.998513 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3879/7733] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:10 2022] DELETE /identity/v3/users/be66130c79a64cbf9cb50811dbdceffa => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:10.999564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.001080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.017929 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:11.041859 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3855/7734] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:40:10 2022] DELETE /identity/v3/groups/2967805d477d431f9f9a34fce3cf3032 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:11.043174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.045866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.128854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088fdb-8b0c-40ad-ac56-79eb1afefd63 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.185351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb242-03c7-4e28-b9bd-7603bb79abe5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.191362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.192388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.192733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.193706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles/f84d06526d764ab2abe1b7398361f9d2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.195389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f84d06526d764ab2abe1b7398361f9d2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.197152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.255244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role f84d06526d764ab2abe1b7398361f9d2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:11.256371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.256579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.257429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.257908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.258326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.258650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] PATH_INFO: `/v3/projects/1ad842aa4aad4c63bb1ef2f9bed53de2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.259918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad842aa4aad4c63bb1ef2f9bed53de2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.260849 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3856/7735] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:11 2022] DELETE /identity/v3/roles/f84d06526d764ab2abe1b7398361f9d2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:11.265778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.266449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.269857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.327152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad842aa4aad4c63bb1ef2f9bed53de2', 'request_id': 'req-112ffac6-3777-4bcd-80da-f163221c10c7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.347716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad842aa4aad4c63bb1ef2f9bed53de2', 'request_id': 'req-112ffac6-3777-4bcd-80da-f163221c10c7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.358551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad842aa4aad4c63bb1ef2f9bed53de2', 'request_id': 'req-112ffac6-3777-4bcd-80da-f163221c10c7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.362312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82750bc-bf00-4719-a326-671b3ae677b0 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.373347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] The token cache is being invalidate because project 1ad842aa4aad4c63bb1ef2f9bed53de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:11.373658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.375200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.377377 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3880/7736] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:10 2022] DELETE /identity/v3/projects/1ad842aa4aad4c63bb1ef2f9bed53de2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:11.378278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.379690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.413898 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:11.443081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.443544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.443831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.444104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/802d8ba620d74ec5879b7ee26c51e70b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.445352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=802d8ba620d74ec5879b7ee26c51e70b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.447078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.462409 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:11.462915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ffac6-3777-4bcd-80da-f163221c10c7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.468882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.470180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.470180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.470180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] PATH_INFO: `/v3/projects/c48f021fc07a4d66b71d0d1606aa3e6c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.472091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48f021fc07a4d66b71d0d1606aa3e6c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.473529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.476197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.477317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.508617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.509557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-099706c9-94ea-4d86-a00f-8c75361fcaaa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.513453 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3857/7737] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:11 2022] PATCH /identity/v3/domains/802d8ba620d74ec5879b7ee26c51e70b => generated 277 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:11.515721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f74ec-2a90-48b1-a3b8-e23e6f9ce3af None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.516207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f74ec-2a90-48b1-a3b8-e23e6f9ce3af None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.516688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f74ec-2a90-48b1-a3b8-e23e6f9ce3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.530369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48f021fc07a4d66b71d0d1606aa3e6c', 'request_id': 'req-2f1a9884-7afc-49d1-a9b6-888e358480c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.540412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7d1f74ec-2a90-48b1-a3b8-e23e6f9ce3af None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:11.541965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d1f74ec-2a90-48b1-a3b8-e23e6f9ce3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.544407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48f021fc07a4d66b71d0d1606aa3e6c', 'request_id': 'req-2f1a9884-7afc-49d1-a9b6-888e358480c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.551555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48f021fc07a4d66b71d0d1606aa3e6c', 'request_id': 'req-2f1a9884-7afc-49d1-a9b6-888e358480c3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.564044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] The token cache is being invalidate because project c48f021fc07a4d66b71d0d1606aa3e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:11.564304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.565232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.566817 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3881/7738] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:11 2022] DELETE /identity/v3/projects/c48f021fc07a4d66b71d0d1606aa3e6c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:11.567578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.568902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.613966 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3858/7739] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:11.615693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226a62-bbfe-4352-a76c-72656112bc10 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.616120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226a62-bbfe-4352-a76c-72656112bc10 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.616426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226a62-bbfe-4352-a76c-72656112bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.637756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a7226a62-bbfe-4352-a76c-72656112bc10 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:11.639072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a7226a62-bbfe-4352-a76c-72656112bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.649077 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3859/7740] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:11.657046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad820e8-689e-492f-b75c-db88fb89885c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.657046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad820e8-689e-492f-b75c-db88fb89885c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.657046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad820e8-689e-492f-b75c-db88fb89885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.665772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a9884-7afc-49d1-a9b6-888e358480c3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.671004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.671847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.672127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.672408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/802d8ba620d74ec5879b7ee26c51e70b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.682053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1ad820e8-689e-492f-b75c-db88fb89885c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:11.683684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1ad820e8-689e-492f-b75c-db88fb89885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.686212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=802d8ba620d74ec5879b7ee26c51e70b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.688353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.693704 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3860/7741] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:11.695233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685719-d7b3-448a-86d4-18d51ee8c072 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.695660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685719-d7b3-448a-86d4-18d51ee8c072 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.696076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685719-d7b3-448a-86d4-18d51ee8c072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.722466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.724350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f4685719-d7b3-448a-86d4-18d51ee8c072 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:11.725751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f4685719-d7b3-448a-86d4-18d51ee8c072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.740032 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3861/7742] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:11.740032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685719-d7b3-448a-86d4-18d51ee8c072 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.742374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.763081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685719-d7b3-448a-86d4-18d51ee8c072 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.769018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.769726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.770008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.770281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.770456 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:11.770946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:11.771808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.773631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.791242 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3862/7743] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:11.793152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.805906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d696a93-a180-4a6d-8f6b-8a8eb47bbf8d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.817071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b', 'request_id': 'req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.830658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b', 'request_id': 'req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.839076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b', 'request_id': 'req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.855973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] The token cache is being invalidate because project 802d8ba620d74ec5879b7ee26c51e70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:11.856382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.857462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.873103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b', 'request_id': 'req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.874458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b', 'request_id': 'req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.875989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '802d8ba620d74ec5879b7ee26c51e70b', 'request_id': 'req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:11.888042 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3882/7744] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:40:11 2022] DELETE /identity/v3/domains/802d8ba620d74ec5879b7ee26c51e70b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:11.889306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.892356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.901573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.902574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.903043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.903654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.904665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:11.905217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.907384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.910054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7f8d8-2b4a-4374-87f3-b33c3e5e2f2c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:11.918157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:11.918619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:11.919068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:11.919478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:11.920914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:11.923769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:11.928891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3863/7745] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:11.930178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.933741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:11.972860 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3883/7746] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:11 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:11.972860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:11.973482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.005492 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:12.041114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b76c-cf4d-4ec3-8ff1-e8f248c0cfe0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.059832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607995e-2592-4576-a7ea-d3594c157837 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.066179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.066915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.067202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.067474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.068106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.070355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.113658 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3884/7747] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:11 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:12.113905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.114424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.114706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.114982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/f811cdb33f3e40a5b616a8f4194e1616/users/abb23f0b08224977a060142df6e36669/roles/41f5352e7e3f4968ab48df979b667bc1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.115848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.117405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f811cdb33f3e40a5b616a8f4194e1616, user_id=abb23f0b08224977a060142df6e36669, role_id=41f5352e7e3f4968ab48df979b667bc1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.120613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.128321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role 41f5352e7e3f4968ab48df979b667bc1 was removed from user abb23f0b08224977a060142df6e36669 on domain f811cdb33f3e40a5b616a8f4194e1616. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:12.128879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.129623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.152480 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3864/7748] 10.222.0.46 () {58 vars in 1464 bytes} [Sun Aug 21 01:40:11 2022] DELETE /identity/v3/domains/f811cdb33f3e40a5b616a8f4194e1616/users/abb23f0b08224977a060142df6e36669/roles/41f5352e7e3f4968ab48df979b667bc1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:12.153552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.156310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.206360 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:12.215487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0535bf6-4b73-45d9-a69f-9b7d0d2b1be2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.255218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100d30-7f99-4a37-b91e-bb34c274a056 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.260879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.261521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.261801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.262073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.262704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.264812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.289133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.290047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.290335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.290607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.291238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.295309 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3865/7749] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:12 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:12.295309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.295574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.296750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.318130 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3885/7750] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:12 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:12.319342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.329724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520c008-1fad-4018-829c-30b32c05b2c9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.334665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.335268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.335613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.336677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.336677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.338353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.352918 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3886/7751] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:12 2022] GET /identity/v3/roles => generated 2110 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:12.352918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.352918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.366007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c8ade-9cfc-4da0-93b7-237295148336 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.370919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.371534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.371814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.372085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.373102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.374706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.381164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78482e-fc95-4186-9c09-e4c141f04f3c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.385964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.386603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.386858 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3887/7752] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:12 2022] GET /identity/v3/roles => generated 2110 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:12.386976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.387169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles/41f5352e7e3f4968ab48df979b667bc1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.388274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.388679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_role(role_id=41f5352e7e3f4968ab48df979b667bc1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.390633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.394531 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:12.413806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9c9c-e005-440f-bc2f-13c412aa4122 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.419386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.420213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.420495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.420761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.421498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.423213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.436465 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3888/7753] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:12 2022] GET /identity/v3/roles => generated 2110 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:12.437118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role 41f5352e7e3f4968ab48df979b667bc1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:12.437372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.438410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.439265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.442719 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3866/7754] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:12 2022] DELETE /identity/v3/roles/41f5352e7e3f4968ab48df979b667bc1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:12.443620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.446941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.450521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a21b6-d92c-45ac-a0c4-b16ed4dddccd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.515265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.516048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.516336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.516729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.517421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.519035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.520142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4a273-cf0a-457e-ac0f-fbd74974c06a tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.525008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.525709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.525981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.526252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] PATH_INFO: `/v3/projects/cbcb4a66735346949b0c708101d8f9bb/users/51dec3800e144036819e0cb6ed6699ac/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.534759 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3889/7755] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:12 2022] GET /identity/v3/roles => generated 1879 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:12.534759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.537886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.542241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbcb4a66735346949b0c708101d8f9bb, user_id=51dec3800e144036819e0cb6ed6699ac, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.544954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.563969 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3867/7756] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:12 2022] PUT /identity/v3/projects/cbcb4a66735346949b0c708101d8f9bb/users/51dec3800e144036819e0cb6ed6699ac/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:12.564709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.566481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.602862 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:12.621124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452b7f2-33d4-40c6-b0ff-8be19eb929a7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.641313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296ad8-61c0-4a4c-abec-4998fcd95585 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.649902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147771c5-21be-4ba9-a11e-76918d0eee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.650586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147771c5-21be-4ba9-a11e-76918d0eee25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.651645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147771c5-21be-4ba9-a11e-76918d0eee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.651997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147771c5-21be-4ba9-a11e-76918d0eee25 admin admin] PATH_INFO: `/v3/projects/4d17d705402549dc94e6fdd36e917823/users/6a5f1b1c768b43be80f4e2a89694a811/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.668748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147771c5-21be-4ba9-a11e-76918d0eee25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d17d705402549dc94e6fdd36e917823, user_id=6a5f1b1c768b43be80f4e2a89694a811, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.671790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147771c5-21be-4ba9-a11e-76918d0eee25 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.688929 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3868/7757] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:12 2022] PUT /identity/v3/projects/4d17d705402549dc94e6fdd36e917823/users/6a5f1b1c768b43be80f4e2a89694a811/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:12.689196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.690404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.690748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.691082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.694020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.694674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.695493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/f811cdb33f3e40a5b616a8f4194e1616` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.697984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f811cdb33f3e40a5b616a8f4194e1616)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.702033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.724151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] MFA Rules not processed for user `51dec3800e144036819e0cb6ed6699ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:12.725507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.739975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.741585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.750743 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:12.778484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.780183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-48929d7a-632b-485c-8e8f-6328de24e0f2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:12.787124 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3890/7758] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:12 2022] PATCH /identity/v3/domains/f811cdb33f3e40a5b616a8f4194e1616 => generated 276 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:12.787124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.787124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.787479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.805862 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3869/7759] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:12.806828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.808249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.820637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] MFA Rules not processed for user `6a5f1b1c768b43be80f4e2a89694a811`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:12.821803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.883813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaea14f-c833-4adc-aa26-839b3e56bfc2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.897497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3891/7760] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:12.898265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:12.899943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:12.955717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.956547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.956896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.957396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/f811cdb33f3e40a5b616a8f4194e1616` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.961028 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:12.969424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f811cdb33f3e40a5b616a8f4194e1616)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.971120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.977578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8dd3-2e9b-47b5-9937-fc3a77feec2a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:12.983052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:12.983791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:12.983976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:12.984209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:12.984870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:12.986756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:12.996674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.000687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.019059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3892/7761] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:12 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:13.019059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.022266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:13.049305 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:13.067049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616', 'request_id': 'req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.076314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616', 'request_id': 'req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.085477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616', 'request_id': 'req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.100796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] The token cache is being invalidate because project f811cdb33f3e40a5b616a8f4194e1616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:13.101305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.102045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.111343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616', 'request_id': 'req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.112096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616', 'request_id': 'req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.112712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f811cdb33f3e40a5b616a8f4194e1616', 'request_id': 'req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.121018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40076f7-9bd4-4633-9970-256521dd1cf6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.122490 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3870/7762] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:40:12 2022] DELETE /identity/v3/domains/f811cdb33f3e40a5b616a8f4194e1616 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:13.126337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.127732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:13.189776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.190511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.190775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.191117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.191748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.193692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.213436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d462d2-96ae-4bfe-96bc-acc07f767fc4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.219222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.219935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.220368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.220651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.221447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.223690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.241670 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3893/7763] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:13 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:13.245652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.247751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:13.271702 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3871/7764] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:13 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:13.272534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.274237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:13.288095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813de0f2-2e49-48b0-bd2b-6ee361c14ff4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.346100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34daabd-6cb1-4399-a3db-7c4170443c56 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.354990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.355636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.355913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.356181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.356938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.359053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.359817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.361168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.361667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.362305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/dbfbc75433c147ae87293153d0671046/groups/dd512411a4bc489eb48306c9ac271faa/roles/1999b0b5481e45bb85f7ba8af6b7a178` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.365274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dbfbc75433c147ae87293153d0671046, group_id=dd512411a4bc489eb48306c9ac271faa, role_id=1999b0b5481e45bb85f7ba8af6b7a178)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.370388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.382141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role 1999b0b5481e45bb85f7ba8af6b7a178 was removed from group dd512411a4bc489eb48306c9ac271faa on domain dbfbc75433c147ae87293153d0671046. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:13.382901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.384934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.403830 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3872/7765] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:13 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:13.404736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.405353 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:13.406639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:13.422174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3894/7766] 10.222.0.46 () {58 vars in 1467 bytes} [Sun Aug 21 01:40:13 2022] DELETE /identity/v3/domains/dbfbc75433c147ae87293153d0671046/groups/dd512411a4bc489eb48306c9ac271faa/roles/1999b0b5481e45bb85f7ba8af6b7a178 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:13.422619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.428459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:13.436532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d084f-98e5-458a-aa06-19fd3268aa2b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.469764 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=8,keystone:INSERT=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:13.510898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d451e-d502-4dc0-a52b-c556c5b616aa tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.517757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.518881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.519049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.519548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.519666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.520174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.520833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.520960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.521110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.521769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.522755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.524672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.535589 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3895/7767] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:13 2022] GET /identity/v3/roles => generated 1879 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:13.536643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.538586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:13.541216 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3873/7768] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:13 2022] GET /identity/v3/roles => generated 1879 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:13.543069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.554876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75616cbf-a438-4d7e-8a3b-b8ad1e5c644c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.559898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.560810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.561074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.561474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] PATH_INFO: `/v3/projects/98fd605c1535426d8c55a2aab5035335/users/1bff082a56ab4740aa1b0eafd0cf0c04/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.583214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fd605c1535426d8c55a2aab5035335, user_id=1bff082a56ab4740aa1b0eafd0cf0c04, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.587131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.611036 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3874/7769] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:13 2022] PUT /identity/v3/projects/98fd605c1535426d8c55a2aab5035335/users/1bff082a56ab4740aa1b0eafd0cf0c04/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:13.611973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.634019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a084d-e0d2-4474-9b71-7feeaa0e44b7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.716437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44433ce-8c35-4b2e-82d9-fca536e4c4cf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.723537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.724348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.725054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.725275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.725421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.725843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.725992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups/dd512411a4bc489eb48306c9ac271faa/users/abb23f0b08224977a060142df6e36669` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.726406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.727237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.727790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dd512411a4bc489eb48306c9ac271faa, user_id=abb23f0b08224977a060142df6e36669)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.729411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.729852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.743311 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3875/7770] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:13 2022] GET /identity/v3/roles => generated 1879 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:13.744898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.760277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'abb23f0b08224977a060142df6e36669'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:13.760422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c5520-747b-4b2f-bcd8-3d9962989295 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.767748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.768369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.768655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.769111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.769756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.771555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.781648 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3896/7771] 10.222.0.46 () {58 vars in 1344 bytes} [Sun Aug 21 01:40:13 2022] DELETE /identity/v3/groups/dd512411a4bc489eb48306c9ac271faa/users/abb23f0b08224977a060142df6e36669 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:13.783423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.797647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3876/7772] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:13 2022] GET /identity/v3/roles => generated 1879 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:13.797647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:13.810466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101c1d-76ca-4e5b-9bde-b80657599b17 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.829211 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:13.891192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecfc78-8eb6-4e9b-826d-97653bdc646e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:13.897753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.898512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.898789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.899061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] PATH_INFO: `/v3/projects/f8f63538169a42b5a6368f95b6be45ae/users/c742b00d206249288f1534377ce8043c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.903415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:13.904585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:13.905042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:13.905333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/groups/dd512411a4bc489eb48306c9ac271faa` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:13.907313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dd512411a4bc489eb48306c9ac271faa)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.909653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.923169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f63538169a42b5a6368f95b6be45ae, user_id=c742b00d206249288f1534377ce8043c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:13.926764 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:13.946641 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:13.960872 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3897/7773] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:13 2022] PUT /identity/v3/projects/f8f63538169a42b5a6368f95b6be45ae/users/c742b00d206249288f1534377ce8043c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:13.960872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.020093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3877/7774] 10.222.0.46 () {58 vars in 1227 bytes} [Sun Aug 21 01:40:13 2022] DELETE /identity/v3/groups/dd512411a4bc489eb48306c9ac271faa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:14.024509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.082521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0943626-a7c7-4c19-ac87-d55039bca9a9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:14.134631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea424b-761b-4446-9f1b-be453a71f298 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:14.139742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:14.140400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.140685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.140993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles/1999b0b5481e45bb85f7ba8af6b7a178` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.142457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1999b0b5481e45bb85f7ba8af6b7a178)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:14.144084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:14.172983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc0738-967e-4415-aa6a-0fce25e0aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:14.173747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc0738-967e-4415-aa6a-0fce25e0aaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.174027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc0738-967e-4415-aa6a-0fce25e0aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.174300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc0738-967e-4415-aa6a-0fce25e0aaa7 admin admin] PATH_INFO: `/v3/projects/98fd605c1535426d8c55a2aab5035335/users/1bff082a56ab4740aa1b0eafd0cf0c04/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.178192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc0738-967e-4415-aa6a-0fce25e0aaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fd605c1535426d8c55a2aab5035335, user_id=1bff082a56ab4740aa1b0eafd0cf0c04, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:14.182209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc0738-967e-4415-aa6a-0fce25e0aaa7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:14.192858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role 1999b0b5481e45bb85f7ba8af6b7a178 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:14.193334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.194131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-5bfab996-1af3-4cc3-9ed8-69ca1e0356bf tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.196158 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3878/7776] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:14 2022] DELETE /identity/v3/roles/1999b0b5481e45bb85f7ba8af6b7a178 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:14.196849 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3898/7776] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:13 2022] PUT /identity/v3/projects/98fd605c1535426d8c55a2aab5035335/users/1bff082a56ab4740aa1b0eafd0cf0c04/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:14.197754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.198251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.198667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.208973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.209541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.210712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.236041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] MFA Rules not processed for user `c742b00d206249288f1534377ce8043c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:14.245005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.253276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] MFA Rules not processed for user `1bff082a56ab4740aa1b0eafd0cf0c04`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:14.254520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.320193 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:14.345464 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3879/7777] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:14.346324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.347747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.361528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3899/7778] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:14.363499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.365625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.415946 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:14.445146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e081-504d-461b-b2a5-39420ee69301 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:14.451754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:14.451754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.451754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.452101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/dbfbc75433c147ae87293153d0671046` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.452620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dbfbc75433c147ae87293153d0671046)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:14.454282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:14.478587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dbfbc75433c147ae87293153d0671046'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.479315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dbfbc75433c147ae87293153d0671046'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.499920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785f32-4fbd-4fa5-a668-8b472f7b6d39 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:14.510478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dbfbc75433c147ae87293153d0671046'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.511183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dbfbc75433c147ae87293153d0671046'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.514838 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3880/7779] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:14 2022] PATCH /identity/v3/domains/dbfbc75433c147ae87293153d0671046 => generated 278 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:14.515927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.517694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.574726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:14.575886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.576258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.576551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.579644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.594733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd83b1e-7c94-4544-9390-0818fbefe122 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:14.595477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:14.597311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:14.600425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:14.601218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.601585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.601944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.603024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:14.604871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:14.620617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3900/7780] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:14.621575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.624618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.645429 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3881/7781] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:14 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:14.645429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.645429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.719080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5ae0e-fced-4285-a522-64b0be802204 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:14.724701 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:14.749686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b3f9-e4d0-4809-8f41-ae2ba9c41e92 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:14.757634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:14.758293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.758650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.759073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/dbfbc75433c147ae87293153d0671046` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.773075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dbfbc75433c147ae87293153d0671046)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:14.775012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:14.800916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dbfbc75433c147ae87293153d0671046'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.802231 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:14.805068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dbfbc75433c147ae87293153d0671046'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.809597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:14.810769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:14.811221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:14.811500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:14.813483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.863658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfbc75433c147ae87293153d0671046', 'request_id': 'req-f541764e-e3c2-45a8-a5dc-244c1279a3a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.871129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfbc75433c147ae87293153d0671046', 'request_id': 'req-f541764e-e3c2-45a8-a5dc-244c1279a3a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.878726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfbc75433c147ae87293153d0671046', 'request_id': 'req-f541764e-e3c2-45a8-a5dc-244c1279a3a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.879561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:14.881457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:14.892963 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3901/7782] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:14.894120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.897087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] The token cache is being invalidate because project dbfbc75433c147ae87293153d0671046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:14.897406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.905616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.917349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dbfbc75433c147ae87293153d0671046', 'request_id': 'req-f541764e-e3c2-45a8-a5dc-244c1279a3a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.918510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dbfbc75433c147ae87293153d0671046', 'request_id': 'req-f541764e-e3c2-45a8-a5dc-244c1279a3a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.919358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dbfbc75433c147ae87293153d0671046', 'request_id': 'req-f541764e-e3c2-45a8-a5dc-244c1279a3a7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:14.934962 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3882/7783] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:40:14 2022] DELETE /identity/v3/domains/dbfbc75433c147ae87293153d0671046 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:14.939161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:14.940804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:14.986625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424bc0a-b42c-4092-8dd5-504b311b068d service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.037774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541764e-e3c2-45a8-a5dc-244c1279a3a7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.043252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.045172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.045585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.045928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55/users/abb23f0b08224977a060142df6e36669/roles/39ee3bd96a314fe884667d440854d95c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.048322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e8e20b5851bf4a77a9ab95f4d465fb55, user_id=abb23f0b08224977a060142df6e36669, role_id=39ee3bd96a314fe884667d440854d95c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.051263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.057755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role 39ee3bd96a314fe884667d440854d95c was removed from user abb23f0b08224977a060142df6e36669 on domain e8e20b5851bf4a77a9ab95f4d465fb55. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:15.058045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.058887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.064852 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:15.079426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.080622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.081183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.081828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.082657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.084277 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3883/7784] 10.222.0.46 () {58 vars in 1464 bytes} [Sun Aug 21 01:40:14 2022] DELETE /identity/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55/users/abb23f0b08224977a060142df6e36669/roles/39ee3bd96a314fe884667d440854d95c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:15.085880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.088886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.091024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.120905 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3902/7785] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:14 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:15.123258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.149746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.169611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1432-5171-46a4-80f4-caf9aaaa802b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.194188 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:15.201679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032d1d-ec62-4d8d-a469-23017cb375b6 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.210084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.211582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.212359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.213016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles/39ee3bd96a314fe884667d440854d95c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.216002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_role(role_id=39ee3bd96a314fe884667d440854d95c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.217752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.240648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.241434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.241715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.241986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.243744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.246407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.258213 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3903/7786] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:15 2022] GET /identity/v3/roles => generated 1649 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:15.259196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role 39ee3bd96a314fe884667d440854d95c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:15.259488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.261805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.262846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.264786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.265436 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3884/7787] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:15 2022] DELETE /identity/v3/roles/39ee3bd96a314fe884667d440854d95c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:15.269188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.271345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.281694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7484-bdae-41d9-891f-c2afba47a637 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.356776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.357681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.357842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.358143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] PATH_INFO: `/v3/projects/b7e813128314472aac5ee705b52e9583/users/3e947d42d0fd4a139cc111b76adbaa1c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.367557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faf5aa-4e91-4ca4-a7ba-9d95163e7451 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.374967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.375990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.376458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.376880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.378782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e8e20b5851bf4a77a9ab95f4d465fb55)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.379462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e813128314472aac5ee705b52e9583, user_id=3e947d42d0fd4a139cc111b76adbaa1c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.381395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.383538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.412314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3904/7788] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:15 2022] PUT /identity/v3/projects/b7e813128314472aac5ee705b52e9583/users/3e947d42d0fd4a139cc111b76adbaa1c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:15.415145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.415433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.416326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.467096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.467949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.471113 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3885/7789] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:15 2022] PATCH /identity/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55 => generated 278 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:15.477810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.479773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.496382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e5ea1-1a10-4815-b123-e13faa588e6f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.502337 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:15.575832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3468-76bd-411c-b67c-8989036656a3 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.582043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.582823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.583221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.583607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.587895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.588639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.589009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.589394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.590189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.592236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.600323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e8e20b5851bf4a77a9ab95f4d465fb55)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.602177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.609679 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3905/7790] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:15.614095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.616154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.635882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b1f9-1847-4d16-8d0d-2c85ad195954 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.643475 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:15.651355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff692102-43dc-452d-8c7c-de048cc83669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.652400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692102-43dc-452d-8c7c-de048cc83669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.652652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692102-43dc-452d-8c7c-de048cc83669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.652955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692102-43dc-452d-8c7c-de048cc83669 admin admin] PATH_INFO: `/v3/projects/b7e813128314472aac5ee705b52e9583/users/3e947d42d0fd4a139cc111b76adbaa1c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.656050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff692102-43dc-452d-8c7c-de048cc83669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e813128314472aac5ee705b52e9583, user_id=3e947d42d0fd4a139cc111b76adbaa1c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.658098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.664426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff692102-43dc-452d-8c7c-de048cc83669 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:15.666899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.706429 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3906/7791] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:15 2022] PUT /identity/v3/projects/b7e813128314472aac5ee705b52e9583/users/3e947d42d0fd4a139cc111b76adbaa1c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:15.708734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.709040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.709311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.754905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] MFA Rules not processed for user `3e947d42d0fd4a139cc111b76adbaa1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:15.756619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.780966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55', 'request_id': 'req-2bb8cb77-3f32-45dc-8546-3243eb189d64'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.794500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55', 'request_id': 'req-2bb8cb77-3f32-45dc-8546-3243eb189d64'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.811307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55', 'request_id': 'req-2bb8cb77-3f32-45dc-8546-3243eb189d64'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.834438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] The token cache is being invalidate because project e8e20b5851bf4a77a9ab95f4d465fb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:15.834765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.835545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.847699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55', 'request_id': 'req-2bb8cb77-3f32-45dc-8546-3243eb189d64'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.848684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55', 'request_id': 'req-2bb8cb77-3f32-45dc-8546-3243eb189d64'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.849378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e8e20b5851bf4a77a9ab95f4d465fb55', 'request_id': 'req-2bb8cb77-3f32-45dc-8546-3243eb189d64'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:15.862443 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3886/7792] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:40:15 2022] DELETE /identity/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:15.873196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.875047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.885959 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3907/7793] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:15.896068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:15.897628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:15.978552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8cb77-3f32-45dc-8546-3243eb189d64 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.979922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fb547-b6d8-4741-945c-82fe25909d2f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:15.985840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.986122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:15.986577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.987314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:15.987437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.987813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.988134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:15.988666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:15.990316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:15.991377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.008722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.010697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.019598 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3887/7794] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:16.023632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.027071 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3908/7795] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:16.038256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493231a5-0cdc-44a0-915c-a9a1562b3506 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.044868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.046394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.046895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.047413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects/59ced87b27d74b61a60d2bea8a558e90/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.050130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_grant(project_id=59ced87b27d74b61a60d2bea8a558e90, user_id=70bfca365298407fb29714dc4083fb45, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.054596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.090342 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3888/7796] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:16 2022] PUT /identity/v3/projects/59ced87b27d74b61a60d2bea8a558e90/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:16.094660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.108375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df3dd2-f71b-48c1-985b-86535a664180 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.141914 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:16.206554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.207429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.207713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.208226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.208848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.210515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.277393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.279830 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3909/7797] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:40:16 2022] GET /identity/v3/auth/projects => generated 826 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:16.291572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755bc64-19b0-43eb-b2fa-d2d77d9dd31d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.298955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.299662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.299950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.300225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects/59ced87b27d74b61a60d2bea8a558e90/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.302279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=59ced87b27d74b61a60d2bea8a558e90, user_id=70bfca365298407fb29714dc4083fb45, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.305034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.313423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role fd13fde432a246499375976d02e43d56 was removed from user 70bfca365298407fb29714dc4083fb45 on project 59ced87b27d74b61a60d2bea8a558e90. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:16.313787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:16.314627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:16.342218 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3889/7798] 10.222.0.46 () {58 vars in 1467 bytes} [Sun Aug 21 01:40:16 2022] DELETE /identity/v3/projects/59ced87b27d74b61a60d2bea8a558e90/users/70bfca365298407fb29714dc4083fb45/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:16.349460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.350795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:16.368232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f66e2-dda5-46a2-a614-b48a9f609ce4 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.462074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.463398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.463929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.464439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.467415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.470074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.509101 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3910/7799] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:16 2022] POST /identity/v3/users => generated 321 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:16.513367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.525496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8648e51-eeb6-404d-8a62-0e4222bd2477 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.530490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.531098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.531717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.531717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.533410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.535391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.584354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.585135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3890/7800] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:16 2022] POST /identity/v3/projects => generated 364 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:16.609964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b602f0-9bf4-4081-a341-f764751afb7f tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.722126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.723184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.723479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.723771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.725053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.727333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.749974 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:16.771947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3911/7801] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:16 2022] POST /identity/v3/projects => generated 363 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:16.775866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.790506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba16cd3-0875-47c7-a0a6-ba2e3f09c410 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.795656 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:16.818166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.820208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:16.877229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.877865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.878147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.878498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.879192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.881321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.900828 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bba9d-367b-43f1-8aaf-2becd81ee88e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.903898 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3891/7802] 10.222.0.46 () {60 vars in 1143 bytes} [Sun Aug 21 01:40:16 2022] POST /identity/v3/roles => generated 239 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:16.906282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:16.913298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a19aec-1128-4bfd-9cad-70fb7733b062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.914141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19aec-1128-4bfd-9cad-70fb7733b062 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.914389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19aec-1128-4bfd-9cad-70fb7733b062 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.914770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19aec-1128-4bfd-9cad-70fb7733b062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.919408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-89a19aec-1128-4bfd-9cad-70fb7733b062 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:16.924123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6f339-ac7e-4495-81b2-07caf8780a51 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:16.930720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:16.932636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:16.933111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:16.933605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects/db7927ca905c4e61af7247b4fc7104e1/users/6668f74bf7a84036a92417327f97f911/roles/572e7335f65145088c3da8cd31483864` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:16.962229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_grant(project_id=db7927ca905c4e61af7247b4fc7104e1, user_id=6668f74bf7a84036a92417327f97f911, role_id=572e7335f65145088c3da8cd31483864)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:16.965835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:16.989599 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3892/7803] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:16 2022] PUT /identity/v3/projects/db7927ca905c4e61af7247b4fc7104e1/users/6668f74bf7a84036a92417327f97f911/roles/572e7335f65145088c3da8cd31483864 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:16.992530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:17.006371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a19aec-1128-4bfd-9cad-70fb7733b062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:17.008628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a19aec-1128-4bfd-9cad-70fb7733b062 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:17.060479 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3912/7804] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:17.086488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5e80e-d67b-49ee-bd37-611daa05433c tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:17.095632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef52e0-a003-4ce6-89ad-34d46c0193fc tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:17.096633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef52e0-a003-4ce6-89ad-34d46c0193fc tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:17.097097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef52e0-a003-4ce6-89ad-34d46c0193fc tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:17.097549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef52e0-a003-4ce6-89ad-34d46c0193fc tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects/c484a6f40be444b6b532c0edd53908a2/users/6668f74bf7a84036a92417327f97f911/roles/572e7335f65145088c3da8cd31483864` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:17.101691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef52e0-a003-4ce6-89ad-34d46c0193fc tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c484a6f40be444b6b532c0edd53908a2, user_id=6668f74bf7a84036a92417327f97f911, role_id=572e7335f65145088c3da8cd31483864)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:17.105244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef52e0-a003-4ce6-89ad-34d46c0193fc tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:17.144979 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3893/7805] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:16 2022] PUT /identity/v3/projects/c484a6f40be444b6b532c0edd53908a2/users/6668f74bf7a84036a92417327f97f911/roles/572e7335f65145088c3da8cd31483864 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:17.150374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd5bb8-3fcc-4c70-a803-016e8cd4ffe1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:17.150880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd5bb8-3fcc-4c70-a803-016e8cd4ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:17.150980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd5bb8-3fcc-4c70-a803-016e8cd4ffe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:17.210167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4ddd5bb8-3fcc-4c70-a803-016e8cd4ffe1 None None] MFA Rules not processed for user `6668f74bf7a84036a92417327f97f911`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:17.211752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4ddd5bb8-3fcc-4c70-a803-016e8cd4ffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:17.215651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3913/7806] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:17 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 01:40:17.220681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78c05-6783-44a7-a9be-8402a8a09118 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:17.221082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78c05-6783-44a7-a9be-8402a8a09118 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:17.221455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78c05-6783-44a7-a9be-8402a8a09118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:17.241286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fbf78c05-6783-44a7-a9be-8402a8a09118 None None] MFA Rules not processed for user `6668f74bf7a84036a92417327f97f911`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:17.243597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fbf78c05-6783-44a7-a9be-8402a8a09118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:17.392016 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3894/7807] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 21 01:40:17.396204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd5bb8-3fcc-4c70-a803-016e8cd4ffe1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:17.536911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd5bb8-3fcc-4c70-a803-016e8cd4ffe1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:17.554375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:17.556118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:17.557845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:17.558209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:17.579918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:17.586643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:17.611677 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3914/7808] 10.222.0.46 () {56 vars in 1308 bytes} [Sun Aug 21 01:40:17 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:17.616040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7fc82-154f-471d-90ce-29aaf7b97dff None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:17.616542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7fc82-154f-471d-90ce-29aaf7b97dff None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:17.617008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7fc82-154f-471d-90ce-29aaf7b97dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:17.639377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d1b7fc82-154f-471d-90ce-29aaf7b97dff None None] MFA Rules not processed for user `6668f74bf7a84036a92417327f97f911`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:17.640821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1b7fc82-154f-471d-90ce-29aaf7b97dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:17.665623 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:17.794458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3895/7809] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 21 01:40:17.798385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:17.811798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639421a-485d-424d-8e7b-f49e084ddd24 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:17.817861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:17.818821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:17.819338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:17.819842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/roles/572e7335f65145088c3da8cd31483864` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:17.822089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_role(role_id=572e7335f65145088c3da8cd31483864)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:17.824275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:17.855398 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:17.890990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invalidating the token cache because role 572e7335f65145088c3da8cd31483864 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:17.891671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:17.892606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:17.895853 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3915/7810] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:17 2022] DELETE /identity/v3/roles/572e7335f65145088c3da8cd31483864 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:17.899665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7fc82-154f-471d-90ce-29aaf7b97dff None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:17.918274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7fc82-154f-471d-90ce-29aaf7b97dff None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:18.005587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:18.006629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:18.007421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:18.007860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects/c484a6f40be444b6b532c0edd53908a2` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:18.010864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c484a6f40be444b6b532c0edd53908a2)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:18.014033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:18.098932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c484a6f40be444b6b532c0edd53908a2', 'request_id': 'req-cb571755-7635-4480-9aff-c83f3bb7cb4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.110237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c484a6f40be444b6b532c0edd53908a2', 'request_id': 'req-cb571755-7635-4480-9aff-c83f3bb7cb4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.117484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c484a6f40be444b6b532c0edd53908a2', 'request_id': 'req-cb571755-7635-4480-9aff-c83f3bb7cb4e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.141817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] The token cache is being invalidate because project c484a6f40be444b6b532c0edd53908a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:18.142137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.145834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.148146 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3896/7811] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:17 2022] DELETE /identity/v3/projects/c484a6f40be444b6b532c0edd53908a2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:18.152254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:18.154340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:18.170928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2728ab5-4d97-4d21-98fb-ad0156181536 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:18.296721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:18.297427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:18.297709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:18.297981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects/c484a6f40be444b6b532c0edd53908a2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:18.324053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c484a6f40be444b6b532c0edd53908a2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:18.327054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Could not find project: c484a6f40be444b6b532c0edd53908a2.: keystone.exception.ProjectNotFound: Could not find project: c484a6f40be444b6b532c0edd53908a2. Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 21 01:40:18.352954 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c484a6f40be444b6b532c0edd53908a2. Aug 21 01:40:18.354048 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:40:18.358667 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3916/7812] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:18 2022] DELETE /identity/v3/projects/c484a6f40be444b6b532c0edd53908a2 => generated 113 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:40:18.359245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:18.360854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:18.383955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571755-7635-4480-9aff-c83f3bb7cb4e tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:18.390755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:18.392448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:18.393030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:18.393030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/projects/db7927ca905c4e61af7247b4fc7104e1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:18.394519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_project(project_id=db7927ca905c4e61af7247b4fc7104e1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:18.396649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:18.490560 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:18.511817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7927ca905c4e61af7247b4fc7104e1', 'request_id': 'req-777e2683-da0f-4270-86db-6cefd70ca1f5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.534165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7927ca905c4e61af7247b4fc7104e1', 'request_id': 'req-777e2683-da0f-4270-86db-6cefd70ca1f5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.544577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7927ca905c4e61af7247b4fc7104e1', 'request_id': 'req-777e2683-da0f-4270-86db-6cefd70ca1f5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.569151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] The token cache is being invalidate because project db7927ca905c4e61af7247b4fc7104e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:18.569692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.571206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.574376 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3897/7813] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:18 2022] DELETE /identity/v3/projects/db7927ca905c4e61af7247b4fc7104e1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:18.578786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:18.581704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:18.611351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e031-13fb-4594-9c01-5dc10ff183b2 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:18.769930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:18.770692 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:18.771074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:18.771926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/users/6668f74bf7a84036a92417327f97f911` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:18.772673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6668f74bf7a84036a92417327f97f911)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:18.774726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:18.829651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6668f74bf7a84036a92417327f97f911'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.842414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6668f74bf7a84036a92417327f97f911'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.843145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6668f74bf7a84036a92417327f97f911'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.863013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6668f74bf7a84036a92417327f97f911'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.864106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6668f74bf7a84036a92417327f97f911'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:18.892567 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:18.902258 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3917/7814] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:18 2022] DELETE /identity/v3/users/6668f74bf7a84036a92417327f97f911 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:18.911478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:18.925003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e2683-da0f-4270-86db-6cefd70ca1f5 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:19.010275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:19.011258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:19.011653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:19.011981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/802d8ba620d74ec5879b7ee26c51e70b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:19.021194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Could not find domain: 802d8ba620d74ec5879b7ee26c51e70b.: keystone.exception.DomainNotFound: Could not find domain: 802d8ba620d74ec5879b7ee26c51e70b. Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 802d8ba620d74ec5879b7ee26c51e70b. Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:40:19.026520 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:40:19.027806 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 802d8ba620d74ec5879b7ee26c51e70b. Aug 21 01:40:19.029355 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:40:19.035135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3898/7815] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:18 2022] PATCH /identity/v3/domains/802d8ba620d74ec5879b7ee26c51e70b => generated 112 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:40:19.035291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:19.035907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:19.053610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df953ea-a84b-41b7-bc8c-49fcc68375cb tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:19.059860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:19.060545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:19.060920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:19.061196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/f811cdb33f3e40a5b616a8f4194e1616` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:19.071333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Could not find domain: f811cdb33f3e40a5b616a8f4194e1616.: keystone.exception.DomainNotFound: Could not find domain: f811cdb33f3e40a5b616a8f4194e1616. Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f811cdb33f3e40a5b616a8f4194e1616. Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:40:19.077276 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:40:19.078559 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f811cdb33f3e40a5b616a8f4194e1616. Aug 21 01:40:19.083428 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:40:19.085138 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3918/7816] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:19 2022] PATCH /identity/v3/domains/f811cdb33f3e40a5b616a8f4194e1616 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 21 01:40:19.085220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:19.097428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f692-0b4b-472b-8a15-15489992676d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:19.104858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:19.105873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:19.106201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:19.106721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/dbfbc75433c147ae87293153d0671046` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:19.118838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Could not find domain: dbfbc75433c147ae87293153d0671046.: keystone.exception.DomainNotFound: Could not find domain: dbfbc75433c147ae87293153d0671046. Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dbfbc75433c147ae87293153d0671046. Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:40:19.129549 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:40:19.130851 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application with Lock( Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dbfbc75433c147ae87293153d0671046. Aug 21 01:40:19.131940 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:40:19.139574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3899/7817] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:19 2022] PATCH /identity/v3/domains/dbfbc75433c147ae87293153d0671046 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:40:19.139759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:19.155558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9846e8-3d63-4b09-8eb9-5fa3a372c970 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:19.163100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702968f7-d581-43ca-b2a9-e24ecb17a9c7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70bfca365298407fb29714dc4083fb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e657b6443af4b288d4640bafcc1038b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:19.164295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702968f7-d581-43ca-b2a9-e24ecb17a9c7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:19.164574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702968f7-d581-43ca-b2a9-e24ecb17a9c7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:19.164914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702968f7-d581-43ca-b2a9-e24ecb17a9c7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] PATH_INFO: `/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:19.179770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702968f7-d581-43ca-b2a9-e24ecb17a9c7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application [None req-702968f7-d581-43ca-b2a9-e24ecb17a9c7 tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Could not find domain: e8e20b5851bf4a77a9ab95f4d465fb55.: keystone.exception.DomainNotFound: Could not find domain: e8e20b5851bf4a77a9ab95f4d465fb55. Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e8e20b5851bf4a77a9ab95f4d465fb55. Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:40:19.185750 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:40:19.186858 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application with Lock( Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self._enter() Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application return self.creator() Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application created_value = creator( Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e8e20b5851bf4a77a9ab95f4d465fb55. Aug 21 01:40:19.191456 n-d-master-1 devstack@keystone.service[81886]: ERROR keystone.server.flask.application Aug 21 01:40:19.193012 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3919/7818] 10.222.0.46 () {60 vars in 1249 bytes} [Sun Aug 21 01:40:19 2022] PATCH /identity/v3/domains/e8e20b5851bf4a77a9ab95f4d465fb55 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:40:19.194902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:19.197193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:19.293179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffadfe-44da-4de6-b067-c113d577ff9d tempest-TokensV3TestJSON-1493605465 tempest-TokensV3TestJSON-1493605465-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:19.298910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:19.299805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:19.300201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:19.300796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] PATH_INFO: `/v3/users/6faf6f750b544f12a40f220359816bbd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:19.302116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faf6f750b544f12a40f220359816bbd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:19.304232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:19.371261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faf6f750b544f12a40f220359816bbd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:19.381858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faf6f750b544f12a40f220359816bbd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:19.391076 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:19.402462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faf6f750b544f12a40f220359816bbd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:19.404211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faf6f750b544f12a40f220359816bbd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:19.414186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faf6f750b544f12a40f220359816bbd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:19.422010 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3900/7819] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:19 2022] DELETE /identity/v3/users/6faf6f750b544f12a40f220359816bbd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:19.426256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f97a8-4961-4273-be14-1c7793dab88c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:19.426657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f97a8-4961-4273-be14-1c7793dab88c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:19.427021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f97a8-4961-4273-be14-1c7793dab88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:19.450891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c49f97a8-4961-4273-be14-1c7793dab88c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:19.452299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c49f97a8-4961-4273-be14-1c7793dab88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:19.539523 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3920/7820] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:19.552674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:19.557431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:19.742601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624de3-9009-4d59-aedf-9f7ccd634bab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:19.765805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:19.766569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:19.766939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:19.767355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:19.793028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:19.797115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:19.813314 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3901/7821] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:20.198203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f97a8-4961-4273-be14-1c7793dab88c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:20.217436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f97a8-4961-4273-be14-1c7793dab88c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:20.223468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:20.224416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:20.224897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:20.225331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:20.229620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:20.321332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:20.330110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:20.358187 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3921/7822] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:20.902394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:20.906653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:20.944813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970b033-0e7a-4adb-bffd-37288cf7ba8a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:20.980729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:20.981850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:20.982354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:20.982820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] PATH_INFO: `/v3/projects/59ced87b27d74b61a60d2bea8a558e90` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:20.988055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ced87b27d74b61a60d2bea8a558e90)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:20.994078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:21.118368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ced87b27d74b61a60d2bea8a558e90', 'request_id': 'req-61adbe84-0444-48f4-86e3-1648547436d5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.144848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ced87b27d74b61a60d2bea8a558e90', 'request_id': 'req-61adbe84-0444-48f4-86e3-1648547436d5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.161895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ced87b27d74b61a60d2bea8a558e90', 'request_id': 'req-61adbe84-0444-48f4-86e3-1648547436d5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.182040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] The token cache is being invalidate because project 59ced87b27d74b61a60d2bea8a558e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:21.182040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.182542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.184014 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3902/7823] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:20 2022] DELETE /identity/v3/projects/59ced87b27d74b61a60d2bea8a558e90 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:21.188825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:21.210792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae2f4-07c6-433a-9a23-c5498a0efbca service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:21.365950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:21.366716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:21.367137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:21.367420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] PATH_INFO: `/v3/users/70bfca365298407fb29714dc4083fb45` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:21.369542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bfca365298407fb29714dc4083fb45)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:21.374508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:21.415976 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:21.519264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bfca365298407fb29714dc4083fb45'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.548412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bfca365298407fb29714dc4083fb45'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.549507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bfca365298407fb29714dc4083fb45'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.565145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bfca365298407fb29714dc4083fb45'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.567279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bfca365298407fb29714dc4083fb45'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:21.666015 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3922/7824] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:21 2022] DELETE /identity/v3/users/70bfca365298407fb29714dc4083fb45 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:23.628237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:23.629855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:23.667562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adbe84-0444-48f4-86e3-1648547436d5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:23.802238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:23.803033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:23.803321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:23.803607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] PATH_INFO: `/v3/projects/0e657b6443af4b288d4640bafcc1038b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:23.810300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e657b6443af4b288d4640bafcc1038b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:23.812857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:23.827103 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:23.954623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e657b6443af4b288d4640bafcc1038b', 'request_id': 'req-8d026f17-2708-49c5-818f-bc7e1e21dd53'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:23.989032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e657b6443af4b288d4640bafcc1038b', 'request_id': 'req-8d026f17-2708-49c5-818f-bc7e1e21dd53'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.006370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e657b6443af4b288d4640bafcc1038b', 'request_id': 'req-8d026f17-2708-49c5-818f-bc7e1e21dd53'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.065969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] The token cache is being invalidate because project 0e657b6443af4b288d4640bafcc1038b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:24.066411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.069931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.086750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3903/7825] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:23 2022] DELETE /identity/v3/projects/0e657b6443af4b288d4640bafcc1038b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:24.087175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:24.088983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:24.129756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84994cc3-528a-43fd-b287-866f53757b0a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:24.311983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:24.313441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:24.313726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:24.313994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] PATH_INFO: `/v3/users/abb23f0b08224977a060142df6e36669` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:24.317061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb23f0b08224977a060142df6e36669)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:24.321885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:24.486914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb23f0b08224977a060142df6e36669'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.505576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb23f0b08224977a060142df6e36669'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.507449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb23f0b08224977a060142df6e36669'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.534619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb23f0b08224977a060142df6e36669'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.536813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ed9f178f-d7e2-4c74-85cc-25b853d57c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb23f0b08224977a060142df6e36669'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:24.591750 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3923/7826] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:24 2022] DELETE /identity/v3/users/abb23f0b08224977a060142df6e36669 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:25.378665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:25.381045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:25.406223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d026f17-2708-49c5-818f-bc7e1e21dd53 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:25.603529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:25.604666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:25.605160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:25.605644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] PATH_INFO: `/v3/users/e753a93c57084def908027d17dcb8ad3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:25.615647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e753a93c57084def908027d17dcb8ad3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:25.618313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:25.767859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e753a93c57084def908027d17dcb8ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:25.806972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e753a93c57084def908027d17dcb8ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:25.859503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e753a93c57084def908027d17dcb8ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:25.861819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e753a93c57084def908027d17dcb8ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:25.899470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e753a93c57084def908027d17dcb8ad3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:25.916415 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3904/7827] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:25 2022] DELETE /identity/v3/users/e753a93c57084def908027d17dcb8ad3 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:25.921315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:25.922306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:25.922802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:25.983193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:25.991724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:26.016236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:26.017753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:26.022099 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:26.050653 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:26.187921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb1016-6fcc-415e-ab81-8894d10fb422 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:26.202586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:26.203406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:26.204863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:26.205298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] PATH_INFO: `/v3/projects/d92a6086794b48108033ea1c3a25f4a3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:26.207164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92a6086794b48108033ea1c3a25f4a3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:26.209139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:26.240126 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3924/7828] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:26.249473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:26.251125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:26.358780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92a6086794b48108033ea1c3a25f4a3', 'request_id': 'req-b4db6ea1-783e-4de9-ad15-f0840e889c53'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:26.378253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92a6086794b48108033ea1c3a25f4a3', 'request_id': 'req-b4db6ea1-783e-4de9-ad15-f0840e889c53'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:26.395061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92a6086794b48108033ea1c3a25f4a3', 'request_id': 'req-b4db6ea1-783e-4de9-ad15-f0840e889c53'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:26.427050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] The token cache is being invalidate because project d92a6086794b48108033ea1c3a25f4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:26.427342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:26.431624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b4db6ea1-783e-4de9-ad15-f0840e889c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:26.439079 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3905/7829] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:26 2022] DELETE /identity/v3/projects/d92a6086794b48108033ea1c3a25f4a3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:26.445149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824294ff-e8cf-4c7f-a1d6-b836df98a081 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:26.445425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824294ff-e8cf-4c7f-a1d6-b836df98a081 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:26.445954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824294ff-e8cf-4c7f-a1d6-b836df98a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:26.459748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0b033-9549-402f-a5b6-acf4dd111f9f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:26.510802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-824294ff-e8cf-4c7f-a1d6-b836df98a081 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:26.512727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-824294ff-e8cf-4c7f-a1d6-b836df98a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:26.605890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed2011-f907-4dda-9636-bd44d40b489c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:26.608409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2011-f907-4dda-9636-bd44d40b489c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:26.610395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2011-f907-4dda-9636-bd44d40b489c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:26.610940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2011-f907-4dda-9636-bd44d40b489c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:26.616548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-64ed2011-f907-4dda-9636-bd44d40b489c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:26.625493 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3906/7830] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:26.627173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657be40a-5761-4447-8bd7-9ff24f05b27d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:26.627742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657be40a-5761-4447-8bd7-9ff24f05b27d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:26.628265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657be40a-5761-4447-8bd7-9ff24f05b27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:26.656802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed2011-f907-4dda-9636-bd44d40b489c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:26.657758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-657be40a-5761-4447-8bd7-9ff24f05b27d None None] MFA Rules not processed for user `6a5f1b1c768b43be80f4e2a89694a811`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:26.658670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed2011-f907-4dda-9636-bd44d40b489c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:26.659370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-657be40a-5761-4447-8bd7-9ff24f05b27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:26.701791 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3925/7831] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:26.708736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114b89-f330-4426-b338-ee53fd0b8ea5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:26.709060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114b89-f330-4426-b338-ee53fd0b8ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:26.712024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114b89-f330-4426-b338-ee53fd0b8ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:26.720477 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:26.769644 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3907/7832] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:26.771653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-15114b89-f330-4426-b338-ee53fd0b8ea5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:26.781341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-15114b89-f330-4426-b338-ee53fd0b8ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:26.805949 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3926/7833] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:26.812031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657be40a-5761-4447-8bd7-9ff24f05b27d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:26.830720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657be40a-5761-4447-8bd7-9ff24f05b27d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:26.844973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:26.846947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:26.847615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:26.848404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:26.849930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:26.851089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:26.854725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:26.888593 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3908/7834] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:26.888879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15114b89-f330-4426-b338-ee53fd0b8ea5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:26.900435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15114b89-f330-4426-b338-ee53fd0b8ea5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:26.915134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:26.915788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:26.918234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:26.918548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:26.921110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:26.927093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:27.010753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.023443 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3927/7835] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:26 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:27.026919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719c989-8c9c-4f09-8b23-d7ceacd1d0d8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:27.160419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:27.161553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.161969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.162245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:27.162906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:27.167096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:27.214186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.226233 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3909/7836] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:27 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:27.229993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc8ac1-c793-42e5-ba9a-97833092be66 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:27.249559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:27.252217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.253127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.253633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:27.257135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:27.264511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:27.302678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.310703 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3928/7837] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:27.315279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd4fbb-8c08-49e0-a3c8-abdcb25b24df admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:27.326563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de079913-af40-43d5-a600-e1e3b27251c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:27.327215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079913-af40-43d5-a600-e1e3b27251c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.327498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079913-af40-43d5-a600-e1e3b27251c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.327773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079913-af40-43d5-a600-e1e3b27251c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:27.328440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de079913-af40-43d5-a600-e1e3b27251c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:27.330148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de079913-af40-43d5-a600-e1e3b27251c4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:27.368985 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3910/7838] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:27.372632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.387059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979959c-64c0-422a-8983-dc58a1e54690 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:27.395336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:27.396754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.397319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.397613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] PATH_INFO: `/v3/projects/fdc4cda921404be0b4f7f653387f451e/users/9a41c6607297435ebc6394c85571a7ba/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:27.426607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc4cda921404be0b4f7f653387f451e, user_id=9a41c6607297435ebc6394c85571a7ba, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:27.430209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:27.481530 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3929/7839] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:27 2022] PUT /identity/v3/projects/fdc4cda921404be0b4f7f653387f451e/users/9a41c6607297435ebc6394c85571a7ba/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:27.483225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029878f-0570-471c-a234-22f319639cce None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.483699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029878f-0570-471c-a234-22f319639cce None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.483699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029878f-0570-471c-a234-22f319639cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:27.498747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.501122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:27.516203 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:27.563693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5029878f-0570-471c-a234-22f319639cce None None] MFA Rules not processed for user `9a41c6607297435ebc6394c85571a7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:27.565308 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5029878f-0570-471c-a234-22f319639cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:27.656205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3911/7840] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:27.658108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029878f-0570-471c-a234-22f319639cce None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.669517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029878f-0570-471c-a234-22f319639cce None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:27.674505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:27.675177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.675458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.675736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:27.676399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:create_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:27.677623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:27.699488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139545-a871-4bb1-8ba1-68961efd8765 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:27.716075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:27.716753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.717050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.717322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] PATH_INFO: `/v3/projects/a51c2ed6a0e0416aa4a7cc74dfd46f6b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:27.720453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51c2ed6a0e0416aa4a7cc74dfd46f6b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:27.722409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:27.764976 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:27.813025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51c2ed6a0e0416aa4a7cc74dfd46f6b', 'request_id': 'req-08bb6fc2-15a1-46ab-a493-7abb34547468'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:27.827793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51c2ed6a0e0416aa4a7cc74dfd46f6b', 'request_id': 'req-08bb6fc2-15a1-46ab-a493-7abb34547468'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:27.830835 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3912/7841] 10.222.0.46 () {60 vars in 1314 bytes} [Sun Aug 21 01:40:27 2022] POST /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 789 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:27.835395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.839121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51c2ed6a0e0416aa4a7cc74dfd46f6b', 'request_id': 'req-08bb6fc2-15a1-46ab-a493-7abb34547468'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:27.846759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fd4e-c908-44d3-9e47-818b147ae97c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:27.857475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] The token cache is being invalidate because project a51c2ed6a0e0416aa4a7cc74dfd46f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:27.858495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:27.860032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:27.866094 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3930/7842] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:27 2022] DELETE /identity/v3/projects/a51c2ed6a0e0416aa4a7cc74dfd46f6b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:27.868002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:27.870188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:27.980690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496370f-a3e0-4c5e-a511-6bdcae4780f0 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:27.981853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496370f-a3e0-4c5e-a511-6bdcae4780f0 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:27.983194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496370f-a3e0-4c5e-a511-6bdcae4780f0 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:27.984935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496370f-a3e0-4c5e-a511-6bdcae4780f0 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/af3fc1ff014b460c908f696a88f45915` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.007624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6fc2-15a1-46ab-a493-7abb34547468 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:28.012739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496370f-a3e0-4c5e-a511-6bdcae4780f0 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:get_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=af3fc1ff014b460c908f696a88f45915)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:28.015395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496370f-a3e0-4c5e-a511-6bdcae4780f0 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:28.026058 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3913/7843] 10.222.0.46 () {58 vars in 1392 bytes} [Sun Aug 21 01:40:27 2022] GET /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/af3fc1ff014b460c908f696a88f45915 => generated 689 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:28.027736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.028078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.028352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.030849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:28.032373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.035087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.035853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] PATH_INFO: `/v3/users/8f23abcbd8ce4e5a8297fd9882db979f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.043251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f23abcbd8ce4e5a8297fd9882db979f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:28.046534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:28.059013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] MFA Rules not processed for user `9a41c6607297435ebc6394c85571a7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:28.067464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:28.114451 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:28.132180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f23abcbd8ce4e5a8297fd9882db979f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:28.147647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f23abcbd8ce4e5a8297fd9882db979f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:28.148839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f23abcbd8ce4e5a8297fd9882db979f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:28.173265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f23abcbd8ce4e5a8297fd9882db979f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:28.174125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f23abcbd8ce4e5a8297fd9882db979f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:28.204099 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3931/7844] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:27 2022] DELETE /identity/v3/users/8f23abcbd8ce4e5a8297fd9882db979f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:28.224375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:28.226144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:28.290580 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3914/7845] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 21 01:40:28.295006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:28.296432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:28.352538 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:28.356588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c2464-32d4-4369-b5d1-007580e36b2a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:28.366431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:28.367119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.367596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.368616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.376701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:28.384297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8d56-8246-425a-8e19-390e3aa6156c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:28.389414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:28.390296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.390577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.390853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/af3fc1ff014b460c908f696a88f45915` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.393870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=af3fc1ff014b460c908f696a88f45915)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:28.393870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:28.399852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:28.401044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:28.423821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3932/7846] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:28.430119 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3915/7847] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:40:28 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/af3fc1ff014b460c908f696a88f45915 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:28.434137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:28.455267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dda150-4dec-4982-8f68-d10158d64759 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:28.461392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:28.464008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.464632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.465089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.466205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:create_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:28.467608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:28.598605 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3933/7848] 10.222.0.46 () {60 vars in 1315 bytes} [Sun Aug 21 01:40:28 2022] POST /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 921 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:28.599572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:28.613535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff565-cada-43b5-a842-ae01fcc4e72c tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:28.623060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:28.625228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.625549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.626022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/f180761b09db4b1ba2c3571ddb8e5e68` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.656598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=f180761b09db4b1ba2c3571ddb8e5e68)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:28.662528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:28.716021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3916/7849] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:40:28 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/f180761b09db4b1ba2c3571ddb8e5e68 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:28.723208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:28.744925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504c4ae-17b6-4b12-95de-e820b9cd2b10 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:28.759058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:28.760287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.760855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.761368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.762457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:create_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:28.765445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:28.769250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:28.771169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:28.857483 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:28.874264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302e6b0-7a49-4d81-81ff-c03dcd01e3f7 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:28.881115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:28.882301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:28.882735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:28.883587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:28.900864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:28.912938 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3934/7850] 10.222.0.46 () {60 vars in 1315 bytes} [Sun Aug 21 01:40:28 2022] POST /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 813 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:28.913947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:28.923763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:29.010666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.012953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.037801 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3917/7851] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:29.038584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.053556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5628-3a51-4284-b93c-b0485c629c22 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.062385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.063423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.064003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.064663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/434645be10924d4ea6b30105155939cc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.072458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2743cb-047a-44ec-938d-537418603046 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.079736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=434645be10924d4ea6b30105155939cc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.081635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.088154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.090474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.092656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.093068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] PATH_INFO: `/v3/projects/3ae0cd46b7294a439f539becad9499cd` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.095883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae0cd46b7294a439f539becad9499cd)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.102387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.129656 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3918/7852] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:40:29 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/434645be10924d4ea6b30105155939cc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:29.136454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.153738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57e1b-e62d-43ed-8cf1-eb3c72cf4a65 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.160295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.161631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.162270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.162876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.163802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:create_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.166290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.179893 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:29.239833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae0cd46b7294a439f539becad9499cd', 'request_id': 'req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:29.257442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae0cd46b7294a439f539becad9499cd', 'request_id': 'req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:29.288217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae0cd46b7294a439f539becad9499cd', 'request_id': 'req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:29.313808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] The token cache is being invalidate because project 3ae0cd46b7294a439f539becad9499cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:29.314109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:29.314810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e1322ef1-e07b-4c22-8bea-3e1cfaab8c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:29.316376 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3935/7853] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:28 2022] DELETE /identity/v3/projects/3ae0cd46b7294a439f539becad9499cd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:29.327358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.327763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.328410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.360316 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3919/7854] 10.222.0.46 () {60 vars in 1314 bytes} [Sun Aug 21 01:40:29 2022] POST /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 789 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:29.362599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.383243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:29.387531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:29.391512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:29.424387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08018f6d-2573-41b4-bb0b-3fb9e55f56fa tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.545473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3936/7855] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:29.547196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.548651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:29.558456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dadf7b-389c-450f-b55d-956d634cc3b8 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.561116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dadf7b-389c-450f-b55d-956d634cc3b8 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.562537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dadf7b-389c-450f-b55d-956d634cc3b8 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.562994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dadf7b-389c-450f-b55d-956d634cc3b8 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.564801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dadf7b-389c-450f-b55d-956d634cc3b8 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:create_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.566147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dadf7b-389c-450f-b55d-956d634cc3b8 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.580613 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:29.747574 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3920/7856] 10.222.0.46 () {60 vars in 1314 bytes} [Sun Aug 21 01:40:29 2022] POST /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 789 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:29.747574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f04b-2bd5-4465-9dbb-1b8ad77bebd3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.747574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f04b-2bd5-4465-9dbb-1b8ad77bebd3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.747574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f04b-2bd5-4465-9dbb-1b8ad77bebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.762715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcb21d-c4d5-4552-ad9e-f5d057c2c8d5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.772073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.773047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.773492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.774123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.777674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:29.794370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-98d7f04b-2bd5-4465-9dbb-1b8ad77bebd3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:29.798213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-98d7f04b-2bd5-4465-9dbb-1b8ad77bebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:29.800450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.803238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.816845 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3921/7857] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:29.818360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7f04b-2bd5-4465-9dbb-1b8ad77bebd3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.841813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7f04b-2bd5-4465-9dbb-1b8ad77bebd3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.846635 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3937/7858] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:29.847430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.850672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.851684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.852172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.852745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.853975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.856173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.883882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3922/7859] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:40:29 2022] GET /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 1502 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:29.887364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53f57-04d2-449f-93a4-5235993dfd20 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.890083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.913634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f8d1-3eb1-401a-9e81-317b96b82f26 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.918005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.923702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.924050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.924292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.924948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.925150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:29.925346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.927011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.927499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.929499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.930048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/e4570716c6ec45108375a0599d063c51` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.944470 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3938/7860] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:29.948556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=e4570716c6ec45108375a0599d063c51)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:29.949785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:29.953678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:29.972642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e9b60-2a78-4742-a5ff-a4e258e682c9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:29.986486 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:29.989702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:29.990468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:29.990901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:29.991215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:29.991966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.001204 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3923/7861] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:40:29 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/e4570716c6ec45108375a0599d063c51 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:30.004996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.005739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.034705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b56bd-1111-44e7-98e5-70547b46408a tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.045048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.045419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.045704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.046087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/5f045630eaf0486b9640eb83005ffc2a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.055578 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3939/7862] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:29 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:30.059609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.072706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=5f045630eaf0486b9640eb83005ffc2a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.074254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.105629 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3924/7863] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:40:30 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/5f045630eaf0486b9640eb83005ffc2a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:30.114814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.149898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee94f5-08c7-4276-a049-b650a5353380 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.248761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d490-e798-4eb2-b45a-9dfee7fbe796 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.253528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.254203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.254490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.254769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.255465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:create_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.257757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.266212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.266856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.267131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.267406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.268151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.270180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.324125 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3940/7864] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:30 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:30.325125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.354558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ad817-b115-41a9-bc98-1506b196a2f3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.378529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.379279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.379594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.379873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.382032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.383861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.451206 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3925/7865] 10.222.0.46 () {60 vars in 1314 bytes} [Sun Aug 21 01:40:30 2022] POST /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 788 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:30.453815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.465227 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3941/7866] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:30.469437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.483612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4beac-ab1a-4d9c-a7b6-2d8f75f6f5a2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.499803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c357-7d4d-4993-b5ad-b9cfd3b30889 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.510046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.511505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.511790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.514223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.515214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.515936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:create_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.516637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.516963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.517239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.518305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.521370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.521977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.551719 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3942/7867] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:40:30.556487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.573873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fc5f9-36c4-4650-841c-acb52f2b8d19 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.584059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c942ad2-baf3-490e-98ff-b36d8b356f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.584988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942ad2-baf3-490e-98ff-b36d8b356f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.585428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942ad2-baf3-490e-98ff-b36d8b356f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.585888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942ad2-baf3-490e-98ff-b36d8b356f0e admin admin] PATH_INFO: `/v3/projects/21614fa0a9614fb69b279fb8ed92c613/users/d7d99a5134c74cd8865fa61528ee1a1b/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.605553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c942ad2-baf3-490e-98ff-b36d8b356f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21614fa0a9614fb69b279fb8ed92c613, user_id=d7d99a5134c74cd8865fa61528ee1a1b, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.609020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c942ad2-baf3-490e-98ff-b36d8b356f0e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.639420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3943/7868] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:30 2022] PUT /identity/v3/projects/21614fa0a9614fb69b279fb8ed92c613/users/d7d99a5134c74cd8865fa61528ee1a1b/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:30.649642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172635-3e85-4a61-a23e-9a643ad52169 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.649906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172635-3e85-4a61-a23e-9a643ad52169 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.650513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172635-3e85-4a61-a23e-9a643ad52169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.679625 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:30.700300 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3926/7869] 10.222.0.46 () {60 vars in 1314 bytes} [Sun Aug 21 01:40:30 2022] POST /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials => generated 789 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:30.703901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.712172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-be172635-3e85-4a61-a23e-9a643ad52169 None None] MFA Rules not processed for user `d7d99a5134c74cd8865fa61528ee1a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:30.714167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-be172635-3e85-4a61-a23e-9a643ad52169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:30.726386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c38b8-6c13-4ef8-a14e-38ad1ff414e2 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.749273 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:30.823778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.823778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.823778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.824280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.824280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Adding query filter params (name=tempest-application_credential-1528319198) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:30.824280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.827371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.852823 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3927/7870] 10.222.0.46 () {58 vars in 1386 bytes} [Sun Aug 21 01:40:30 2022] GET /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials?name=tempest-application_credential-1528319198 => generated 887 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:30.853688 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3944/7871] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:30.858258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.859564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be172635-3e85-4a61-a23e-9a643ad52169 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.875386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be172635-3e85-4a61-a23e-9a643ad52169 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.889657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.890343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.890625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.891022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/0a644d447198400597e5d4cb2d5b959d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.908970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=0a644d447198400597e5d4cb2d5b959d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.910510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.947352 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3945/7872] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:40:30 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/0a644d447198400597e5d4cb2d5b959d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:30.949180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:30.961183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18e7cc-1fea-4a05-b9e5-a8d7a1d0da49 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:30.966727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a41c6607297435ebc6394c85571a7ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdc4cda921404be0b4f7f653387f451e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:30.967910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:30.968503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:30.969036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/797797686584432e803e7aa37f099505` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:30.981733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9a41c6607297435ebc6394c85571a7ba, application_credential_id=797797686584432e803e7aa37f099505)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:30.984186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:30.999331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b8f1a-4d6f-4e4a-a732-ae356531bc82 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.007020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.010185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.010640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.011078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.011902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.014855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.030875 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3946/7873] 10.222.0.46 () {58 vars in 1395 bytes} [Sun Aug 21 01:40:30 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba/application_credentials/797797686584432e803e7aa37f099505 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:31.032603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:31.035153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:31.065924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db339c1-80c7-4d34-b977-d0e22b117c95 tempest-ApplicationCredentialsV3Test-1194498910 tempest-ApplicationCredentialsV3Test-1194498910-project] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.078481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.079206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.079428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3928/7874] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:30 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:31.079662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.080039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] PATH_INFO: `/v3/users/9a41c6607297435ebc6394c85571a7ba` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.080376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:31.084401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a41c6607297435ebc6394c85571a7ba)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.086511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.193320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c358c-d6b5-4a7e-800f-c6a5eaf5a33b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.199209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.200046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.200475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.200638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a41c6607297435ebc6394c85571a7ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:31.201128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.201862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.204952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.237883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a41c6607297435ebc6394c85571a7ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:31.238660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a41c6607297435ebc6394c85571a7ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:31.257090 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3929/7875] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:31 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:31.257407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a41c6607297435ebc6394c85571a7ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:31.259655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5628e026-1d63-4a40-a367-aa6a24b790d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a41c6607297435ebc6394c85571a7ba'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:31.265932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:31.272694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:31.311337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726b47e-9941-4a2e-8d9a-a5e9191eb915 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.323206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.326176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.326723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.326941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.327713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.332470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.332581 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3947/7876] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:31 2022] DELETE /identity/v3/users/9a41c6607297435ebc6394c85571a7ba => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:31.336578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.337197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.337480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.361829 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:31.364650 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3930/7877] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:40:31.370335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:31.388273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b950c4-5f37-434a-9309-bd3e4b1b6b9f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.388900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:31.395653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:31.407428 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:31.513431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.514186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.514466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.515493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] PATH_INFO: `/v3/projects/95308894408b4ad0a5ccd1da18c1aae0/users/6f263bef91f04d069df763ac19357b48/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.526244 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3948/7878] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:31.535419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:31.537290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:31.554872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95308894408b4ad0a5ccd1da18c1aae0, user_id=6f263bef91f04d069df763ac19357b48, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.557796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.587867 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3931/7879] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:31 2022] PUT /identity/v3/projects/95308894408b4ad0a5ccd1da18c1aae0/users/6f263bef91f04d069df763ac19357b48/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:31.592257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:31.693113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d7fe8-366d-49de-a28e-7a3219bb23cf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.713788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28331956-070d-4db5-8983-aa2613df551d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.719494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.720312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.720665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.721153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.721880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.723955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.739623 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3932/7880] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:31.743505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:31.757859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3d8a-4550-4452-929d-91926c4568a0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:31.779599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981eec0-8689-4cc8-8784-95efd376471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.784120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981eec0-8689-4cc8-8784-95efd376471b admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.784646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981eec0-8689-4cc8-8784-95efd376471b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.787034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981eec0-8689-4cc8-8784-95efd376471b admin admin] PATH_INFO: `/v3/projects/95308894408b4ad0a5ccd1da18c1aae0/users/6f263bef91f04d069df763ac19357b48/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.792625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981eec0-8689-4cc8-8784-95efd376471b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95308894408b4ad0a5ccd1da18c1aae0, user_id=6f263bef91f04d069df763ac19357b48, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.800135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981eec0-8689-4cc8-8784-95efd376471b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.816823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:31.817448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.817732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.818628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.827075 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3933/7881] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:31 2022] PUT /identity/v3/projects/95308894408b4ad0a5ccd1da18c1aae0/users/6f263bef91f04d069df763ac19357b48/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:31.838288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:31.839374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:31.839581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:31.840734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:31.841128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:31.863560 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3949/7882] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:31.897765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] MFA Rules not processed for user `6f263bef91f04d069df763ac19357b48`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:31.899115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:32.096530 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3934/7883] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:32.137808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:32.156016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca06ae-0ad1-4309-94c1-4f896bc33b42 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:32.249126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fba1a4-9dfc-4e63-b640-90edc56dcfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:32.250308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba1a4-9dfc-4e63-b640-90edc56dcfdd service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:32.250675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba1a4-9dfc-4e63-b640-90edc56dcfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:32.251719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba1a4-9dfc-4e63-b640-90edc56dcfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:32.268331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fba1a4-9dfc-4e63-b640-90edc56dcfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:32.270385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fba1a4-9dfc-4e63-b640-90edc56dcfdd service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:32.282588 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3950/7884] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:32.714558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:32.718423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:32.733349 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:32.934604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c939-5c33-4ad1-a02b-b4c57966ca0b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:32.944919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:32.947451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:32.948660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:32.949152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] PATH_INFO: `/v3/projects/fdc4cda921404be0b4f7f653387f451e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:32.951619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc4cda921404be0b4f7f653387f451e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:32.954652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:33.118776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc4cda921404be0b4f7f653387f451e', 'request_id': 'req-87c03219-e0dd-4302-b56c-db5dfe1fedce'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:33.126693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc4cda921404be0b4f7f653387f451e', 'request_id': 'req-87c03219-e0dd-4302-b56c-db5dfe1fedce'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:33.135562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc4cda921404be0b4f7f653387f451e', 'request_id': 'req-87c03219-e0dd-4302-b56c-db5dfe1fedce'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:33.167883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] The token cache is being invalidate because project fdc4cda921404be0b4f7f653387f451e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:33.167883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:33.170171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87c03219-e0dd-4302-b56c-db5dfe1fedce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:33.174704 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3935/7885] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:32 2022] DELETE /identity/v3/projects/fdc4cda921404be0b4f7f653387f451e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:33.180368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87882d-680e-43c1-95cf-680ddbd87641 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:33.180705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87882d-680e-43c1-95cf-680ddbd87641 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:33.184711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87882d-680e-43c1-95cf-680ddbd87641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:33.230304 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:33.251714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-df87882d-680e-43c1-95cf-680ddbd87641 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:33.257220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df87882d-680e-43c1-95cf-680ddbd87641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:33.380868 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3951/7886] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:33.476462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316558-1f31-48e4-9410-885988dd27ac None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:33.476859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316558-1f31-48e4-9410-885988dd27ac None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:33.477066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316558-1f31-48e4-9410-885988dd27ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:33.500638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0e316558-1f31-48e4-9410-885988dd27ac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:33.502329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0e316558-1f31-48e4-9410-885988dd27ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:33.525549 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3936/7887] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:33.527811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87882d-680e-43c1-95cf-680ddbd87641 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:33.545940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87882d-680e-43c1-95cf-680ddbd87641 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:33.576079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:33.576998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:33.577660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:33.579030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:33.582548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:33.582992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:33.586136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:33.621358 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3952/7888] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:33.626126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e316558-1f31-48e4-9410-885988dd27ac None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:33.641986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e316558-1f31-48e4-9410-885988dd27ac None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:33.657462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:33.658105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:33.658438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:33.658710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:33.659346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:33.661313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:33.721851 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3937/7889] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:33 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:33.725938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:33.740270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab07af-d36d-48fd-a1c4-92da687bf72b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:33.861745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:33.862379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:33.862658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:33.862931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:33.863571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:33.865927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:33.906482 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3953/7890] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:33 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:40:33.909589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:33.927133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318b7f-1599-43f9-9f03-1c3567856d03 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:33.939963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:33.942743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:33.942897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:33.944016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:33.944742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:33.950352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:33.980426 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3938/7891] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:33.982832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:34.004260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105f55f-980d-4c0c-b918-4ad2d0e7eece admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:34.031645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:34.036791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:34.037154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:34.038286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] PATH_INFO: `/v3/projects/ad1b2369844c40d8bc97278bf76f98de/users/407928866ca44af0a2627dae2eee40bb/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:34.122105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1b2369844c40d8bc97278bf76f98de, user_id=407928866ca44af0a2627dae2eee40bb, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:34.154465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:34.223338 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3954/7892] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:33 2022] PUT /identity/v3/projects/ad1b2369844c40d8bc97278bf76f98de/users/407928866ca44af0a2627dae2eee40bb/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:34.224587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:34.242459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ed17-3634-43da-89d9-a93fe72fab0b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:34.370637 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:34.385699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8946c-3c28-4efb-9625-78ba874dec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:34.386625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8946c-3c28-4efb-9625-78ba874dec23 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:34.387210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8946c-3c28-4efb-9625-78ba874dec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:34.388512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8946c-3c28-4efb-9625-78ba874dec23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:34.390972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8946c-3c28-4efb-9625-78ba874dec23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:34.393844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8946c-3c28-4efb-9625-78ba874dec23 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:34.407143 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3939/7893] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:34.412047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:34.426819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d3470-7bbd-43ab-a714-17e78f62f1b6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:34.433837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:34.437682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:34.438093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:34.438628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] PATH_INFO: `/v3/projects/ad1b2369844c40d8bc97278bf76f98de/users/407928866ca44af0a2627dae2eee40bb/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:34.442169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1b2369844c40d8bc97278bf76f98de, user_id=407928866ca44af0a2627dae2eee40bb, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:34.445306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:34.459759 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3955/7894] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:34 2022] PUT /identity/v3/projects/ad1b2369844c40d8bc97278bf76f98de/users/407928866ca44af0a2627dae2eee40bb/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:34.470252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:34.470518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:34.470800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:34.508142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] MFA Rules not processed for user `407928866ca44af0a2627dae2eee40bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:34.509836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:34.688918 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3940/7895] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:34.690446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:34.735844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:34.742070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:34.800169 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:34.830035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de095-79f2-40f3-963e-047627f947d8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:34.851675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:34.851956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:34.852065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:34.852335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:34.853009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:34.855561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:34.895864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4aa16-8e36-4049-8c83-0f3fb72a75a1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:34.901540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:34.902444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:34.903123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:34.903430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] PATH_INFO: `/v3/users/51dec3800e144036819e0cb6ed6699ac` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:34.904974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51dec3800e144036819e0cb6ed6699ac)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:34.907812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:34.910690 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3956/7896] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:34 2022] POST /identity/v3/projects => generated 391 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:34.914898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:34.991234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51dec3800e144036819e0cb6ed6699ac'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:35.009940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51dec3800e144036819e0cb6ed6699ac'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:35.038734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51dec3800e144036819e0cb6ed6699ac'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:35.040087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51dec3800e144036819e0cb6ed6699ac'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:35.043608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2078-6a30-4900-b510-41e5e61fa5f4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:35.051025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:35.052273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.052840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.053278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.054630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:35.055118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d91321d2-f57e-4937-926c-4ce817f804a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51dec3800e144036819e0cb6ed6699ac'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:35.057019 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:35.061498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:35.068866 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3941/7897] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:34 2022] DELETE /identity/v3/users/51dec3800e144036819e0cb6ed6699ac => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:35.070660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ade3c5-41a1-4b1a-8747-30aaab5bdd6b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.071174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ade3c5-41a1-4b1a-8747-30aaab5bdd6b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.071819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ade3c5-41a1-4b1a-8747-30aaab5bdd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.098231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-02ade3c5-41a1-4b1a-8747-30aaab5bdd6b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:35.100253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-02ade3c5-41a1-4b1a-8747-30aaab5bdd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:35.110051 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3957/7898] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:34 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:35.116298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:35.120502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:35.153230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdcbd5-d799-42ca-8afd-eb24b28f7edc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:35.242687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:35.243319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.243599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.243870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.244525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:35.246290 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:35.255671 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3942/7899] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:35.262020 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3958/7900] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:35.263284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ade3c5-41a1-4b1a-8747-30aaab5bdd6b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:35.289625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ade3c5-41a1-4b1a-8747-30aaab5bdd6b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:35.306044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:35.306731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:35.308467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.308998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:35.309167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.310267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.312427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:35.316490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:35.348946 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3943/7901] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:35.352564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:35.387486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fbb78-40ba-423f-b11e-54daf525fbb3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:35.394502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d73a7-f11f-411e-9229-cd16f2dcdc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:35.394829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8d25-4ef4-434b-b6ce-da6ac234b46b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:35.395169 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d73a7-f11f-411e-9229-cd16f2dcdc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.395462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d73a7-f11f-411e-9229-cd16f2dcdc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.395735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d73a7-f11f-411e-9229-cd16f2dcdc39 admin admin] PATH_INFO: `/v3/projects/cd717604ff024dbeb31f4393200c2c02/users/97d5b7e0903246259b141a9b06672aaa/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.408858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:35.410726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.412878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.414020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.418401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d73a7-f11f-411e-9229-cd16f2dcdc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd717604ff024dbeb31f4393200c2c02, user_id=97d5b7e0903246259b141a9b06672aaa, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:35.421989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d73a7-f11f-411e-9229-cd16f2dcdc39 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:35.439057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:35.441733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:35.448817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3944/7902] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:35 2022] PUT /identity/v3/projects/cd717604ff024dbeb31f4393200c2c02/users/97d5b7e0903246259b141a9b06672aaa/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:35.452883 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:35.455095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.455423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.455634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.465888 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3959/7903] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:35.490229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] MFA Rules not processed for user `97d5b7e0903246259b141a9b06672aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:35.491604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:35.599638 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3945/7904] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:35.616904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:35.618763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:35.691634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4216b-40aa-41ac-be58-391d1d12f9c8 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:35.755583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:35.756422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:35.756846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:35.757215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:35.759179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:35.859984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:35.861413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:35.876529 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3960/7905] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:36.169639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:36.172809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:36.264442 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:36.283865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc109b9-d463-49bc-806c-591a73c3fc7e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:36.289732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:36.290440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:36.290707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:36.290984 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] PATH_INFO: `/v3/projects/cbcb4a66735346949b0c708101d8f9bb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:36.292159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbcb4a66735346949b0c708101d8f9bb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:36.295181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:36.385560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbcb4a66735346949b0c708101d8f9bb', 'request_id': 'req-4916d363-9cee-49ca-a990-0bf8b03acddc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.396476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbcb4a66735346949b0c708101d8f9bb', 'request_id': 'req-4916d363-9cee-49ca-a990-0bf8b03acddc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.408111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbcb4a66735346949b0c708101d8f9bb', 'request_id': 'req-4916d363-9cee-49ca-a990-0bf8b03acddc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.434249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] The token cache is being invalidate because project cbcb4a66735346949b0c708101d8f9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:36.434548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.435672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.438128 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3946/7906] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:36 2022] DELETE /identity/v3/projects/cbcb4a66735346949b0c708101d8f9bb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:36.441416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:36.465514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d42a3f-6e66-4638-a461-0278064ed86d service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:36.558490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:36.559601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:36.559892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:36.560194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] PATH_INFO: `/v3/users/c742b00d206249288f1534377ce8043c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:36.561619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c742b00d206249288f1534377ce8043c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:36.563730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:36.576382 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:36.658607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c742b00d206249288f1534377ce8043c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.669069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c742b00d206249288f1534377ce8043c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.669920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c742b00d206249288f1534377ce8043c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.680413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c742b00d206249288f1534377ce8043c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.681186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c742b00d206249288f1534377ce8043c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:36.718294 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3961/7907] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:36 2022] DELETE /identity/v3/users/c742b00d206249288f1534377ce8043c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:36.889973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:36.891844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:36.930896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916d363-9cee-49ca-a990-0bf8b03acddc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:37.019967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:37.020948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:37.021429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:37.021862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] PATH_INFO: `/v3/users/407928866ca44af0a2627dae2eee40bb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:37.023567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=407928866ca44af0a2627dae2eee40bb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:37.025723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:37.061944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:37.063704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:37.090268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828216f1-67d5-4510-a287-f7fd595471a1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:37.097356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:37.098062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:37.098345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:37.098619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] PATH_INFO: `/v3/projects/f8f63538169a42b5a6368f95b6be45ae` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:37.100327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f63538169a42b5a6368f95b6be45ae)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:37.102529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:37.120501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407928866ca44af0a2627dae2eee40bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.137195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407928866ca44af0a2627dae2eee40bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.160191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407928866ca44af0a2627dae2eee40bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.161373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407928866ca44af0a2627dae2eee40bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.170629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ce631845-93e8-443f-8f2d-dcb04e52da8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407928866ca44af0a2627dae2eee40bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.182191 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3947/7908] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:36 2022] DELETE /identity/v3/users/407928866ca44af0a2627dae2eee40bb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:37.184804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:37.184804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:37.184804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:37.190320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f63538169a42b5a6368f95b6be45ae', 'request_id': 'req-619f49a0-84c5-447d-9c02-12499ae74bbf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.193893 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:37.207369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f63538169a42b5a6368f95b6be45ae', 'request_id': 'req-619f49a0-84c5-447d-9c02-12499ae74bbf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.209632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:37.211667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:37.220815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f63538169a42b5a6368f95b6be45ae', 'request_id': 'req-619f49a0-84c5-447d-9c02-12499ae74bbf'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.234743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] The token cache is being invalidate because project f8f63538169a42b5a6368f95b6be45ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:37.235152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.236140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.240616 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3962/7909] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:37 2022] DELETE /identity/v3/projects/f8f63538169a42b5a6368f95b6be45ae => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:37.242087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:37.243735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:37.310493 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3948/7910] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:37.328416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:37.330290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:37.340015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f49a0-84c5-447d-9c02-12499ae74bbf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:37.364197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:37.365023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:37.365815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:37.366339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] PATH_INFO: `/v3/users/3e947d42d0fd4a139cc111b76adbaa1c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:37.372041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e947d42d0fd4a139cc111b76adbaa1c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:37.374904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:37.392876 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:37.462249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e947d42d0fd4a139cc111b76adbaa1c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.480300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e947d42d0fd4a139cc111b76adbaa1c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.482459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e947d42d0fd4a139cc111b76adbaa1c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.489816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ad2e-b300-48fb-baa5-6709d6cb09f8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:37.494489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e947d42d0fd4a139cc111b76adbaa1c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.494827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:37.495435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e947d42d0fd4a139cc111b76adbaa1c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:37.495834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:37.496474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:37.496951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:37.499413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:37.517345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:37.520686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:37.522605 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3963/7911] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:37 2022] DELETE /identity/v3/users/3e947d42d0fd4a139cc111b76adbaa1c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:37.535410 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3949/7912] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:38.504132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:38.505712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:38.533796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:38.535820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:38.566965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3b8d1-bfc6-4061-941e-2096390da2cf service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:38.697758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc992-1a81-4f23-a1c7-f83e0bca289f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:38.718892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:38.720539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:38.720851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:38.721144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] PATH_INFO: `/v3/projects/b7e813128314472aac5ee705b52e9583` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:38.723943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e813128314472aac5ee705b52e9583)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:38.726908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:38.733555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:38.737587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:38.737958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:38.738423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] PATH_INFO: `/v3/projects/ad1b2369844c40d8bc97278bf76f98de` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:38.753867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1b2369844c40d8bc97278bf76f98de)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:38.758389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:38.831483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e813128314472aac5ee705b52e9583', 'request_id': 'req-a76b12db-113a-4396-a64c-771e795612ac'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.858034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e813128314472aac5ee705b52e9583', 'request_id': 'req-a76b12db-113a-4396-a64c-771e795612ac'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.878319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e813128314472aac5ee705b52e9583', 'request_id': 'req-a76b12db-113a-4396-a64c-771e795612ac'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.911744 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:38.912097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] The token cache is being invalidate because project b7e813128314472aac5ee705b52e9583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:38.912396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.915045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a76b12db-113a-4396-a64c-771e795612ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.916100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1b2369844c40d8bc97278bf76f98de', 'request_id': 'req-dc891adf-bb3c-4eae-a277-6d4a12790b6d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.920029 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3964/7913] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:38 2022] DELETE /identity/v3/projects/b7e813128314472aac5ee705b52e9583 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:38.930509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50196a4-fd1f-4cdf-bcca-5fad31ab866c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:38.930801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50196a4-fd1f-4cdf-bcca-5fad31ab866c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:38.931505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1b2369844c40d8bc97278bf76f98de', 'request_id': 'req-dc891adf-bb3c-4eae-a277-6d4a12790b6d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.932549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50196a4-fd1f-4cdf-bcca-5fad31ab866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:38.942644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1b2369844c40d8bc97278bf76f98de', 'request_id': 'req-dc891adf-bb3c-4eae-a277-6d4a12790b6d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.969620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] The token cache is being invalidate because project ad1b2369844c40d8bc97278bf76f98de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:38.970417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.971601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:38.975456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3950/7914] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:38 2022] DELETE /identity/v3/projects/ad1b2369844c40d8bc97278bf76f98de => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:38.980048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:38.983503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:38.990364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c50196a4-fd1f-4cdf-bcca-5fad31ab866c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:38.994925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c50196a4-fd1f-4cdf-bcca-5fad31ab866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:39.022942 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:39.128298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc891adf-bb3c-4eae-a277-6d4a12790b6d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.139747 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3965/7915] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:39.148653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.149388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.149662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.151368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] PATH_INFO: `/v3/users/97d5b7e0903246259b141a9b06672aaa` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.151515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f420f-1150-42ce-8da2-38c858ea9dc5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.153168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f420f-1150-42ce-8da2-38c858ea9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.153336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d5b7e0903246259b141a9b06672aaa)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.153623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f420f-1150-42ce-8da2-38c858ea9dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.155236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.194938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c86f420f-1150-42ce-8da2-38c858ea9dc5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:39.197885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c86f420f-1150-42ce-8da2-38c858ea9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:39.213165 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3966/7916] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:39.219315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f420f-1150-42ce-8da2-38c858ea9dc5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:39.232606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f420f-1150-42ce-8da2-38c858ea9dc5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.252397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d5b7e0903246259b141a9b06672aaa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:39.259188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.262310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.263071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.263071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.264711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:39.265044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.266735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d5b7e0903246259b141a9b06672aaa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:39.266927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.291324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d5b7e0903246259b141a9b06672aaa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:39.292247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d5b7e0903246259b141a9b06672aaa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:39.301851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3967/7917] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:39.306702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:39.313897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d5b7e0903246259b141a9b06672aaa'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:39.323925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964efa53-ddec-4c11-9ae4-9c3b1e5edc1e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.328045 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3951/7918] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:38 2022] DELETE /identity/v3/users/97d5b7e0903246259b141a9b06672aaa => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:39.431879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.434501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.434794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.436906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.438007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.442913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.516814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3968/7919] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:39 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:39.521126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:39.522723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:39.548085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c95fc2-648f-4310-a5bb-0c08e3afc377 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.662511 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:39.674156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.675293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.675811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.676907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.677471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.680166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.724499 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3952/7920] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:39 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:39.738483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:39.755059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe2923-480d-4036-b4c1-57dd53490ff7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.772411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.775841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.775841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.775841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.775841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.784049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.834573 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3969/7921] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:39.835884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:39.848215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072021d-8d94-4ce9-8601-6be3f66ec83f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.855124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.856022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.856447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.857200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.857575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.859210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.871544 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3953/7922] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:39.875880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:39.889407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62a2d9-5a40-4483-a72b-077928fe153e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.899409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311b6d-594c-4b7d-8d36-af215240ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.901396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311b6d-594c-4b7d-8d36-af215240ffa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.901863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311b6d-594c-4b7d-8d36-af215240ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.902251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311b6d-594c-4b7d-8d36-af215240ffa3 admin admin] PATH_INFO: `/v3/projects/80714967f868419fa75307662aca3a19/users/5a18d05ad96b490b80e80e3012d51126/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.915627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:39.917703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:39.944923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080a33b-5d25-4347-aac1-839ec2661e4f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:39.948156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51311b6d-594c-4b7d-8d36-af215240ffa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80714967f868419fa75307662aca3a19, user_id=5a18d05ad96b490b80e80e3012d51126, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.950974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51311b6d-594c-4b7d-8d36-af215240ffa3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.964676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:39.965597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.965879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.966156 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] PATH_INFO: `/v3/projects/cd717604ff024dbeb31f4393200c2c02` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:39.967470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd717604ff024dbeb31f4393200c2c02)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:39.969732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:39.969992 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3970/7923] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:39 2022] PUT /identity/v3/projects/80714967f868419fa75307662aca3a19/users/5a18d05ad96b490b80e80e3012d51126/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:39.975315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:39.981457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:39.983887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.037135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:40.038529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:40.071709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd717604ff024dbeb31f4393200c2c02', 'request_id': 'req-8b8266c4-79de-4d44-8929-1eefba50f94c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:40.079872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd717604ff024dbeb31f4393200c2c02', 'request_id': 'req-8b8266c4-79de-4d44-8929-1eefba50f94c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:40.090424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd717604ff024dbeb31f4393200c2c02', 'request_id': 'req-8b8266c4-79de-4d44-8929-1eefba50f94c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:40.111879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] The token cache is being invalidate because project cd717604ff024dbeb31f4393200c2c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:40.112172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:40.113671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8b8266c4-79de-4d44-8929-1eefba50f94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:40.115576 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3954/7924] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:39 2022] DELETE /identity/v3/projects/cd717604ff024dbeb31f4393200c2c02 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:40.120218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634e301-c8ad-4f28-a359-0bd4321e1f31 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.120499 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634e301-c8ad-4f28-a359-0bd4321e1f31 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.120805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634e301-c8ad-4f28-a359-0bd4321e1f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.167351 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:40.169274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7634e301-c8ad-4f28-a359-0bd4321e1f31 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:40.172805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7634e301-c8ad-4f28-a359-0bd4321e1f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:40.196521 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3971/7925] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:40.207625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.209317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:40.329787 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3955/7926] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:40.340367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28196-9271-450f-bff2-5eff81ebc030 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.341642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28196-9271-450f-bff2-5eff81ebc030 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.341931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28196-9271-450f-bff2-5eff81ebc030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.342668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460de52-81ab-4efd-ba27-df34a739561b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.407105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-50b28196-9271-450f-bff2-5eff81ebc030 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:40.409963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-50b28196-9271-450f-bff2-5eff81ebc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:40.436301 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3956/7927] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:40.445685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28196-9271-450f-bff2-5eff81ebc030 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.475864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28196-9271-450f-bff2-5eff81ebc030 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.489707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:40.490356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.490634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.490905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.491575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:40.491873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:40.497523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:40.511896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:40.512675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.512835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.513079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.562197 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3957/7928] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:40.564080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.567127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:40.569122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:40.591853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7dcbd-3d82-4692-8e66-4b7f20fe8f39 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.593664 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3972/7929] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:40.594704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.598379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:40.601164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:40.602779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.603243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.603780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.604578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:40.607377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:40.670338 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3958/7930] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:40 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:40.674595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.719191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d6827-b4b0-4934-9712-923ca13c734b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.728692 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:40.815350 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:40.832991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a6da-cfaa-4263-8f08-064552c1b0f7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.842751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f263bef91f04d069df763ac19357b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95308894408b4ad0a5ccd1da18c1aae0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:40.843723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.844067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.844440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.845214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:40.845593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:40.847902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:40.848605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:40.850823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.851153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.851440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.852087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:40.859104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:40.870328 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3973/7931] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:40.878035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.903826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2cb4-d12d-45d6-9d03-361a35c0d4b7 tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.910533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f263bef91f04d069df763ac19357b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95308894408b4ad0a5ccd1da18c1aae0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:40.911183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.911463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.911732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.912486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:40.915343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:40.928641 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3959/7932] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:40 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:40.929590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.950809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826fb57-1745-417a-b71e-9b9dc707d41c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.959143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:40.959784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:40.960109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:40.960402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:40.961075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:40.962782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:40.975887 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3960/7933] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:40.980336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:40.993498 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3974/7934] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:40 2022] POST /identity/v3/projects => generated 347 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:40.997336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc56f98-774b-415b-a28b-67cc2d7168fc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:40.999780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:41.129858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:41.131572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:41.132670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:41.133561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:41.135703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:41.138772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:41.157206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fb07a-171b-4321-b4e5-c44b68c203bf tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:41.167153 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3961/7935] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:41.170136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:41.174404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345279cc-d35c-471f-b236-83867e8ae7be tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f263bef91f04d069df763ac19357b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95308894408b4ad0a5ccd1da18c1aae0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:41.175394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345279cc-d35c-471f-b236-83867e8ae7be tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:41.175694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345279cc-d35c-471f-b236-83867e8ae7be tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:41.175977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345279cc-d35c-471f-b236-83867e8ae7be tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:41.177414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345279cc-d35c-471f-b236-83867e8ae7be tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:41.177735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345279cc-d35c-471f-b236-83867e8ae7be tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:41.180914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345279cc-d35c-471f-b236-83867e8ae7be tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:41.184172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd677898-0902-4b11-9fdd-974708766f43 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:41.190379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:41.191397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:41.191741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:41.192710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] PATH_INFO: `/v3/projects/2df91c10e5b443eaac8f0ae0cdcc3373/users/8b850a87a70e415795b9816f1729e691/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:41.208965 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3975/7936] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:41.225974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df91c10e5b443eaac8f0ae0cdcc3373, user_id=8b850a87a70e415795b9816f1729e691, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:41.229878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:41.275912 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3962/7937] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:41 2022] PUT /identity/v3/projects/2df91c10e5b443eaac8f0ae0cdcc3373/users/8b850a87a70e415795b9816f1729e691/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:41.278545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac125560-2075-49d1-a1df-96166afe4b2e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:41.278842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac125560-2075-49d1-a1df-96166afe4b2e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:41.279197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac125560-2075-49d1-a1df-96166afe4b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:41.370332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ac125560-2075-49d1-a1df-96166afe4b2e None None] MFA Rules not processed for user `8b850a87a70e415795b9816f1729e691`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:41.374362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac125560-2075-49d1-a1df-96166afe4b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:41.506774 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3976/7938] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:41.522435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:41.524191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:41.662212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3b002-7c49-40e3-b611-4494cb575479 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:41.674496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939692e2-851f-49f2-8ce1-b7a4fb25693c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:41.675153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939692e2-851f-49f2-8ce1-b7a4fb25693c service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:41.675440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939692e2-851f-49f2-8ce1-b7a4fb25693c service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:41.675717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939692e2-851f-49f2-8ce1-b7a4fb25693c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:41.694972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939692e2-851f-49f2-8ce1-b7a4fb25693c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:41.696667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939692e2-851f-49f2-8ce1-b7a4fb25693c service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:41.725893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3963/7939] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:41.811515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1aae7-c8da-4648-b5d0-7f5c1ed11ad2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:41.812389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1aae7-c8da-4648-b5d0-7f5c1ed11ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:41.812870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1aae7-c8da-4648-b5d0-7f5c1ed11ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:41.897766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d9d1aae7-c8da-4648-b5d0-7f5c1ed11ad2 None None] MFA Rules not processed for user `5a18d05ad96b490b80e80e3012d51126`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:41.900463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d9d1aae7-c8da-4648-b5d0-7f5c1ed11ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:41.994743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:41.995014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:41.995289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.000648 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:42.040475 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:42.063017 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3977/7940] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:42.067058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1aae7-c8da-4648-b5d0-7f5c1ed11ad2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.108191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:42.110411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:42.166486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1aae7-c8da-4648-b5d0-7f5c1ed11ad2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:42.173277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f263bef91f04d069df763ac19357b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95308894408b4ad0a5ccd1da18c1aae0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:42.174660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:42.175011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:42.175355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] PATH_INFO: `/v3/projects/4a01c8e06bb94e9c90f2b64d06bed2a6` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.176654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a01c8e06bb94e9c90f2b64d06bed2a6)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:42.178712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:42.197809 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3964/7941] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:42.198557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.200100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:42.269279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a01c8e06bb94e9c90f2b64d06bed2a6', 'request_id': 'req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:42.282793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a01c8e06bb94e9c90f2b64d06bed2a6', 'request_id': 'req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:42.290130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a01c8e06bb94e9c90f2b64d06bed2a6', 'request_id': 'req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:42.294478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09445ca2-2372-4b37-b99f-adb1b4680231 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:42.303912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] The token cache is being invalidate because project 4a01c8e06bb94e9c90f2b64d06bed2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:42.304268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:42.305043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:42.307229 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3978/7942] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:42 2022] DELETE /identity/v3/projects/4a01c8e06bb94e9c90f2b64d06bed2a6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:42.308082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.310911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:42.361041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:42.361659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:42.361935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:42.362233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.363215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:42.365590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:42.395853 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3965/7943] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:42 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:42.396699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8efbd5-b21e-483d-acdd-fc93c6f0580d tempest-RoutersIpV6AdminTest-357928487 tempest-RoutersIpV6AdminTest-357928487-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:42.397039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.400457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:42.411176 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:42.417654 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:42.472822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:42.473446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:42.473721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:42.473997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.474663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fd84a-e764-4bec-9680-a02f9a0686a4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:42.475901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:42.478854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:42.479818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:42.480134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:42.480504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.482534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:42.537829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:42.539446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:42.548890 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3979/7944] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:40:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:42.549623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.550358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:42.550975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:42.551911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:42.569856 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3966/7945] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:42.642903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b967e9-70ec-4f88-996c-851c474f125d service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:42.653780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:42.654542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:42.654965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:42.655276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.656875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:42.659007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:42.696388 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3980/7946] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:42 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:42.696604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.709962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a6904-63d4-4f6e-a392-ed6d901ee5fd service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:42.715479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:42.716398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:42.717402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:42.717808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.718687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:42.722216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:42.745762 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.752528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3967/7947] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:42.760098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82df0a-2192-4059-b147-14a95aca383a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:42.766695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:42.767449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:42.767911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:42.768047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] PATH_INFO: `/v3/projects/e8149c330a47427b8b02a80f1a13c553/users/8b9d617f968f41a4867f41f42a9e406c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:42.809765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8149c330a47427b8b02a80f1a13c553, user_id=8b9d617f968f41a4867f41f42a9e406c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:42.812713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:42.839965 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3981/7948] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:42 2022] PUT /identity/v3/projects/e8149c330a47427b8b02a80f1a13c553/users/8b9d617f968f41a4867f41f42a9e406c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:42.844233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:42.856179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d431f-6b04-4174-abf2-76747e6da530 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:43.027936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63d465-031c-483f-a4e9-ebff8d9df3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:43.028656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d465-031c-483f-a4e9-ebff8d9df3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:43.029024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d465-031c-483f-a4e9-ebff8d9df3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:43.029356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d465-031c-483f-a4e9-ebff8d9df3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:43.030078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63d465-031c-483f-a4e9-ebff8d9df3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:43.032175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63d465-031c-483f-a4e9-ebff8d9df3c3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:43.048009 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3968/7949] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:43.049248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:43.065301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb6d33-4fed-47d5-8a30-60d1a46d5505 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:43.072117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209bdc2-7605-4984-a379-4f23e00626b7 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:43.072472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209bdc2-7605-4984-a379-4f23e00626b7 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:43.072795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209bdc2-7605-4984-a379-4f23e00626b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:43.073647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:43.075454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:43.075754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:43.076050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] PATH_INFO: `/v3/projects/e8149c330a47427b8b02a80f1a13c553/users/8b9d617f968f41a4867f41f42a9e406c/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:43.079533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8149c330a47427b8b02a80f1a13c553, user_id=8b9d617f968f41a4867f41f42a9e406c, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:43.081472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:43.102603 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3982/7950] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:43 2022] PUT /identity/v3/projects/e8149c330a47427b8b02a80f1a13c553/users/8b9d617f968f41a4867f41f42a9e406c/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:43.105528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b209bdc2-7605-4984-a379-4f23e00626b7 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:43.107106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b209bdc2-7605-4984-a379-4f23e00626b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:43.181987 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:43.193388 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3969/7951] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:40:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:43.208540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:43.223403 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:43.313398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4b69-998d-40f9-8a54-78d1dec29951 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:43.320528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:43.321336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:43.321713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:43.322590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:43.336161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:43.337944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:43.386450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3983/7952] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:40:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:43.933594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d7a4-53f6-410e-8f3f-3daa295ce974 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:43.935012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d7a4-53f6-410e-8f3f-3daa295ce974 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:43.935567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d7a4-53f6-410e-8f3f-3daa295ce974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:43.969332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f778d7a4-53f6-410e-8f3f-3daa295ce974 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:43.970878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f778d7a4-53f6-410e-8f3f-3daa295ce974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:43.987682 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3970/7953] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:40:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:44.006605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:44.030340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad1272-7281-4ee8-a4e7-d82cfa0afbb0 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:44.040466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85784c0-173b-49c1-b5eb-742061bee7a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:44.040587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85784c0-173b-49c1-b5eb-742061bee7a7 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:44.041191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85784c0-173b-49c1-b5eb-742061bee7a7 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:44.041476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85784c0-173b-49c1-b5eb-742061bee7a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:44.067080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85784c0-173b-49c1-b5eb-742061bee7a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:44.069776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85784c0-173b-49c1-b5eb-742061bee7a7 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:44.095729 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3984/7954] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:44.105077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635dbec-d4a4-49dc-9fd2-625f0bf8742a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:44.105387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635dbec-d4a4-49dc-9fd2-625f0bf8742a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:44.106465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635dbec-d4a4-49dc-9fd2-625f0bf8742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:44.177375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c635dbec-d4a4-49dc-9fd2-625f0bf8742a None None] MFA Rules not processed for user `8b9d617f968f41a4867f41f42a9e406c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:44.178625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c635dbec-d4a4-49dc-9fd2-625f0bf8742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:44.325675 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3971/7955] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:44.331605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:44.331885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:44.332258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:44.357905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7798-8f06-4ded-bab2-f4c6f80c68f4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:44.358249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7798-8f06-4ded-bab2-f4c6f80c68f4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:44.358481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7798-8f06-4ded-bab2-f4c6f80c68f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:44.369978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] MFA Rules not processed for user `5a18d05ad96b490b80e80e3012d51126`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:44.371222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:44.431712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b3ae7798-8f06-4ded-bab2-f4c6f80c68f4 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:44.432997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b3ae7798-8f06-4ded-bab2-f4c6f80c68f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:44.473898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3985/7956] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:44.474494 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3972/7957] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:44.489749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:44.491280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:44.496522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7798-8f06-4ded-bab2-f4c6f80c68f4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:44.516851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7798-8f06-4ded-bab2-f4c6f80c68f4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:44.524576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f2f8e-646a-4ceb-a9ea-6883a435fd98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:44.525244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2f8e-646a-4ceb-a9ea-6883a435fd98 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:44.525519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2f8e-646a-4ceb-a9ea-6883a435fd98 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:44.525787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2f8e-646a-4ceb-a9ea-6883a435fd98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:44.537281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f2f8e-646a-4ceb-a9ea-6883a435fd98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:44.539342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f2f8e-646a-4ceb-a9ea-6883a435fd98 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:44.549240 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3973/7958] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:44.664600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e9446-665f-4d4c-8b15-7c559a8b58ad None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:44.673351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:44.674125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:44.674514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:44.674873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:44.677249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:44.689970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:44.691987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:44.708025 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3986/7959] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:45.077304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6273-9bf5-4d74-8016-26bc247881ea None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:45.077831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6273-9bf5-4d74-8016-26bc247881ea None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:45.078365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6273-9bf5-4d74-8016-26bc247881ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:45.113117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e78d6273-9bf5-4d74-8016-26bc247881ea None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:45.114610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e78d6273-9bf5-4d74-8016-26bc247881ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:45.124124 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3974/7960] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:40:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:45.147556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:45.189748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18c465-d061-49f3-a9c0-ab76dc395232 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:45.204217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:45.205757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:45.206235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:45.207107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:45.229135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:45.231889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:45.247058 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:45.258913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3987/7961] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:40:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:45.525630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:45.526368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:45.526894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:45.552703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:45.555338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:45.566560 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3975/7962] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:40:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:45.583900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:45.602609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a6ac4-0ad5-47d9-a124-ce97d6dfcaf4 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:45.616753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7106613-7154-437d-a62c-44e6edcf10d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:45.617548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106613-7154-437d-a62c-44e6edcf10d6 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:45.617886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106613-7154-437d-a62c-44e6edcf10d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:45.618220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106613-7154-437d-a62c-44e6edcf10d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:45.629500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7106613-7154-437d-a62c-44e6edcf10d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:45.631197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7106613-7154-437d-a62c-44e6edcf10d6 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:45.649000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3988/7963] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:40:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:45.845176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:45.846824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:45.941765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57842fd8-4e62-48b5-82a3-5b9ecded2ec8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:45.946616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:45.947274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:45.948085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:45.948372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] PATH_INFO: `/v3/users/8b850a87a70e415795b9816f1729e691` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:45.951331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b850a87a70e415795b9816f1729e691)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:45.954631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:46.022594 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:46.024322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b850a87a70e415795b9816f1729e691'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:46.038598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b850a87a70e415795b9816f1729e691'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:46.055766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b850a87a70e415795b9816f1729e691'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:46.056732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b850a87a70e415795b9816f1729e691'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:46.065928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b850a87a70e415795b9816f1729e691'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:46.083967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3976/7964] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:45 2022] DELETE /identity/v3/users/8b850a87a70e415795b9816f1729e691 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:46.088495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:46.089007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:46.089506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:46.115394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:46.117164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:46.205462 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3989/7965] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:46.216448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:46.217968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:46.310346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29622-372f-4861-abb7-357ac87e6ccf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:46.315854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a2647-a6b4-4036-aa55-65540ec89a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:46.316661 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2647-a6b4-4036-aa55-65540ec89a24 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:46.318107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2647-a6b4-4036-aa55-65540ec89a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:46.318107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2647-a6b4-4036-aa55-65540ec89a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:46.331396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a2647-a6b4-4036-aa55-65540ec89a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:46.333273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a2647-a6b4-4036-aa55-65540ec89a24 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:46.353965 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3977/7966] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:47.251236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:47.252853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:47.277068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346775-5564-4de8-8188-1b4cd1cfe8d3 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:47.286198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:47.286868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:47.287155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:47.288016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] PATH_INFO: `/v3/projects/2df91c10e5b443eaac8f0ae0cdcc3373` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:47.289903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df91c10e5b443eaac8f0ae0cdcc3373)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:47.291905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:47.391489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df91c10e5b443eaac8f0ae0cdcc3373', 'request_id': 'req-e678817d-d65e-4b72-bdd5-3c4a65bacfad'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:47.405516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df91c10e5b443eaac8f0ae0cdcc3373', 'request_id': 'req-e678817d-d65e-4b72-bdd5-3c4a65bacfad'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:47.417984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df91c10e5b443eaac8f0ae0cdcc3373', 'request_id': 'req-e678817d-d65e-4b72-bdd5-3c4a65bacfad'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:47.442944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] The token cache is being invalidate because project 2df91c10e5b443eaac8f0ae0cdcc3373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:47.443495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:47.453355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e678817d-d65e-4b72-bdd5-3c4a65bacfad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:47.456662 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3990/7967] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:47 2022] DELETE /identity/v3/projects/2df91c10e5b443eaac8f0ae0cdcc3373 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:47.461300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4232614-bb50-4de9-8f86-1a32df0f08eb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:47.461792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4232614-bb50-4de9-8f86-1a32df0f08eb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:47.461885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4232614-bb50-4de9-8f86-1a32df0f08eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:47.505113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f4232614-bb50-4de9-8f86-1a32df0f08eb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:47.508379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f4232614-bb50-4de9-8f86-1a32df0f08eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:47.632460 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3978/7968] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:47.640033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c904b09-95ec-4b98-ab15-1fb2e9ddc41d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:47.640320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c904b09-95ec-4b98-ab15-1fb2e9ddc41d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:47.640832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c904b09-95ec-4b98-ab15-1fb2e9ddc41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:47.673374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0c904b09-95ec-4b98-ab15-1fb2e9ddc41d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:47.674977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0c904b09-95ec-4b98-ab15-1fb2e9ddc41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:47.690520 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3991/7969] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:47.694377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4232614-bb50-4de9-8f86-1a32df0f08eb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:47.717999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4232614-bb50-4de9-8f86-1a32df0f08eb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:47.746326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:47.747081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:47.747357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:47.747631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:47.748462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:47.748981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:47.751909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:47.774552 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3979/7970] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:47.779329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c904b09-95ec-4b98-ab15-1fb2e9ddc41d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:47.793775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c904b09-95ec-4b98-ab15-1fb2e9ddc41d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:47.811217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:47.811893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:47.814758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:47.815042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:47.815751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:47.817796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:47.873223 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3992/7971] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:47 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:47.878415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:47.894241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec298b-9fa4-455f-9d41-3046012116f0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:47.991595 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:48.013468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:48.014352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:48.014865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:48.016752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:48.018069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:48.028815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:48.063988 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3980/7972] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:47 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:48.068300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:48.086660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dc754-ca13-4923-bb86-f4b8df64dc65 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:48.112258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:48.113076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:48.113463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:48.113740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:48.114717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:48.117185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:48.138633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3993/7973] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:48.142191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:48.158031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475fbf-21d6-48bb-be95-66bd7116fc3e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:48.164032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ce738-19dc-4d88-ad81-ed3cf924cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:48.164577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce738-19dc-4d88-ad81-ed3cf924cb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:48.164919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce738-19dc-4d88-ad81-ed3cf924cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:48.165212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce738-19dc-4d88-ad81-ed3cf924cb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:48.165858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ce738-19dc-4d88-ad81-ed3cf924cb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:48.168325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ce738-19dc-4d88-ad81-ed3cf924cb3e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:48.184922 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3981/7974] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:48.188009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:48.207898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb0055-eb8e-4928-b71e-e63f2fd5918b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:48.217168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:48.218486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:48.219555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:48.220841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] PATH_INFO: `/v3/projects/c9fdb3bb44ec4d8bb6603c109259d440/users/8a9752a3d76849278eb0ec464a4d62b3/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:48.253339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9fdb3bb44ec4d8bb6603c109259d440, user_id=8a9752a3d76849278eb0ec464a4d62b3, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:48.257096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:48.286842 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3994/7975] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:48 2022] PUT /identity/v3/projects/c9fdb3bb44ec4d8bb6603c109259d440/users/8a9752a3d76849278eb0ec464a4d62b3/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:48.303187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144d18-bea7-417d-aceb-dc243fafe7d0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:48.303581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144d18-bea7-417d-aceb-dc243fafe7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:48.303908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144d18-bea7-417d-aceb-dc243fafe7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:48.349086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9d144d18-bea7-417d-aceb-dc243fafe7d0 None None] MFA Rules not processed for user `8a9752a3d76849278eb0ec464a4d62b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:48.351186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d144d18-bea7-417d-aceb-dc243fafe7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:48.477143 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3982/7976] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:48.492153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:48.494642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:48.514594 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:48.591137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc693c6b-09f7-4e99-8caf-bfa0b134fa03 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:48.597718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1b16-c276-4e07-a961-2e40543ff14a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:48.598393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1b16-c276-4e07-a961-2e40543ff14a service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:48.598905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1b16-c276-4e07-a961-2e40543ff14a service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:48.599046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1b16-c276-4e07-a961-2e40543ff14a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:48.611348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1b16-c276-4e07-a961-2e40543ff14a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:48.613277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1b16-c276-4e07-a961-2e40543ff14a service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:48.626121 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3995/7977] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:40:49.820466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144d18-bea7-417d-aceb-dc243fafe7d0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:49.939207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144d18-bea7-417d-aceb-dc243fafe7d0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:49.944886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:49.945934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:49.946498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:49.947016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] PATH_INFO: `/v3/users/8a9752a3d76849278eb0ec464a4d62b3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:49.948540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9752a3d76849278eb0ec464a4d62b3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:49.955297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:50.026881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9752a3d76849278eb0ec464a4d62b3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:50.040223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9752a3d76849278eb0ec464a4d62b3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:50.053092 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:50.066249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9752a3d76849278eb0ec464a4d62b3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:50.068022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9752a3d76849278eb0ec464a4d62b3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:50.095605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9752a3d76849278eb0ec464a4d62b3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:50.112628 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3983/7978] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:49 2022] DELETE /identity/v3/users/8a9752a3d76849278eb0ec464a4d62b3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:50.114541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:50.115004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:50.115124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:50.167521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:50.168850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:50.286511 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3996/7979] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:50.329394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:50.330917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:50.416515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc593-91c7-4572-b012-e86017feced9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:50.426277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05bb5c-2912-4217-bda4-4b0cb1846441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:50.427011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05bb5c-2912-4217-bda4-4b0cb1846441 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:50.427358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05bb5c-2912-4217-bda4-4b0cb1846441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:50.427694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05bb5c-2912-4217-bda4-4b0cb1846441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:50.438818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05bb5c-2912-4217-bda4-4b0cb1846441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:50.440393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05bb5c-2912-4217-bda4-4b0cb1846441 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:50.451791 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3984/7980] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:51.425964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:51.429492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:51.464224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6700-2308-4274-b620-289a7b6208d0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:51.481548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:51.482168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:51.482447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:51.482724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] PATH_INFO: `/v3/projects/c9fdb3bb44ec4d8bb6603c109259d440` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:51.485171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9fdb3bb44ec4d8bb6603c109259d440)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:51.487114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:51.593289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9fdb3bb44ec4d8bb6603c109259d440', 'request_id': 'req-141f592e-8ba4-457b-9688-a9f07630313f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:51.608340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9fdb3bb44ec4d8bb6603c109259d440', 'request_id': 'req-141f592e-8ba4-457b-9688-a9f07630313f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:51.629128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9fdb3bb44ec4d8bb6603c109259d440', 'request_id': 'req-141f592e-8ba4-457b-9688-a9f07630313f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:51.665234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] The token cache is being invalidate because project c9fdb3bb44ec4d8bb6603c109259d440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:51.665529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:51.668244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-141f592e-8ba4-457b-9688-a9f07630313f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:51.670106 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3997/7981] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:51 2022] DELETE /identity/v3/projects/c9fdb3bb44ec4d8bb6603c109259d440 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:51.676143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87243f42-a5be-478b-b416-881f7f1643d2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:51.677027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87243f42-a5be-478b-b416-881f7f1643d2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:51.677463 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87243f42-a5be-478b-b416-881f7f1643d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:51.718282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-87243f42-a5be-478b-b416-881f7f1643d2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:51.719797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-87243f42-a5be-478b-b416-881f7f1643d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:51.838051 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3985/7982] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:51.846247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a54319-560e-4f89-a079-f6775e64c5f6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:51.846823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a54319-560e-4f89-a079-f6775e64c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:51.847270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a54319-560e-4f89-a079-f6775e64c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:51.888408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c8a54319-560e-4f89-a079-f6775e64c5f6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:51.890293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c8a54319-560e-4f89-a079-f6775e64c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:51.904167 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3998/7983] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:51.908788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87243f42-a5be-478b-b416-881f7f1643d2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:51.922359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87243f42-a5be-478b-b416-881f7f1643d2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:51.935809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:51.936430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:51.936701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:51.937012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:51.937667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:51.937964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:51.939834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:51.965643 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3986/7984] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:51.970460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a54319-560e-4f89-a079-f6775e64c5f6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:51.984860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a54319-560e-4f89-a079-f6775e64c5f6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.000320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.001006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.001285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.001549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.002395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.004632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:52.067742 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 3999/7985] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:51 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:52.078778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:52.096399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d85ffb-651e-4242-b1de-b44ac11a3ca6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.196379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.197296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.197574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.197845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.198490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.200745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:52.239230 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:52.252742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:52.255761 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3987/7986] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:52 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:52.260830 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:52.268186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3bb7b-fa13-41fa-bec9-ecb67a7722d4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.277237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.278355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.278913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.279578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.280575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.284475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:52.302466 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4000/7987] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:52.304517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:52.332791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b253-e90f-48c9-9158-7a85b122256f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.340014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fc5d-9529-4648-a5f7-8638b696e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.340251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fc5d-9529-4648-a5f7-8638b696e9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.340456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fc5d-9529-4648-a5f7-8638b696e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.340725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fc5d-9529-4648-a5f7-8638b696e9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.342447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62fc5d-9529-4648-a5f7-8638b696e9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.343716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62fc5d-9529-4648-a5f7-8638b696e9c6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:52.360698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:52.363969 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3988/7988] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:52.373198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c886345-53e7-45c8-9053-6d015e40f678 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.388257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.389140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.389433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.389784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] PATH_INFO: `/v3/projects/1c46b6d964bd43d0889d7586c30240a1/users/c18f460662f640388a924f064ffa1aa1/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.420438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c46b6d964bd43d0889d7586c30240a1, user_id=c18f460662f640388a924f064ffa1aa1, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.425002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:52.448433 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4001/7989] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:52 2022] PUT /identity/v3/projects/1c46b6d964bd43d0889d7586c30240a1/users/c18f460662f640388a924f064ffa1aa1/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:52.460678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad4588-b192-440b-8a3f-f67c867cd407 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.461366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad4588-b192-440b-8a3f-f67c867cd407 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.461366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad4588-b192-440b-8a3f-f67c867cd407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.501944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8cad4588-b192-440b-8a3f-f67c867cd407 None None] MFA Rules not processed for user `c18f460662f640388a924f064ffa1aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:52.503340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8cad4588-b192-440b-8a3f-f67c867cd407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:52.601220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3989/7990] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:52.609680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:52.708297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1c5ab-93e2-4834-b47e-dd04fea12fe8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.713962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.714937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.715443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.715722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.717817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.719997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:52.773909 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4002/7991] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:52 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:52.783676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad4588-b192-440b-8a3f-f67c867cd407 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:52.796976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad4588-b192-440b-8a3f-f67c867cd407 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.878522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.879730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.880166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.880611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.881568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.883943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:52.920656 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3990/7992] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:52 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:52.921561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:52.933681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e38ad-e7e3-486e-873f-36ca7b085f9b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:52.939277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:52.939987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:52.940252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:52.940520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:52.942953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:52.951311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.005959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:53.008902 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4003/7993] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:53.031451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40fc3-c3ac-49ca-890f-775fa6395662 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:53.037222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:53.037916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.038200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.038660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] PATH_INFO: `/v3/projects/ca7ba72f3f624b02bbc7d2e5de756d75/users/f332acdfa6344073b0be5e900490ed03/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.060614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7ba72f3f624b02bbc7d2e5de756d75, user_id=f332acdfa6344073b0be5e900490ed03, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:53.063479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.084975 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3991/7994] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:53 2022] PUT /identity/v3/projects/ca7ba72f3f624b02bbc7d2e5de756d75/users/f332acdfa6344073b0be5e900490ed03/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:53.086296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:53.097401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12870e73-5f28-4f81-be9b-ece5977f7c43 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:53.211583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69916242-6e63-4bf7-ada4-9483413b4505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:53.213396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69916242-6e63-4bf7-ada4-9483413b4505 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.213837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69916242-6e63-4bf7-ada4-9483413b4505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.214288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69916242-6e63-4bf7-ada4-9483413b4505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.215240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69916242-6e63-4bf7-ada4-9483413b4505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:53.217143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69916242-6e63-4bf7-ada4-9483413b4505 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.229389 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4004/7995] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:40:53.233343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:53.245695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d316-9105-4f84-a7b0-3c54369f190c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:53.252340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:53.253715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.254074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.254418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] PATH_INFO: `/v3/projects/ca7ba72f3f624b02bbc7d2e5de756d75/users/f332acdfa6344073b0be5e900490ed03/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.257250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7ba72f3f624b02bbc7d2e5de756d75, user_id=f332acdfa6344073b0be5e900490ed03, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:53.260938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.280997 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3992/7996] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:40:53 2022] PUT /identity/v3/projects/ca7ba72f3f624b02bbc7d2e5de756d75/users/f332acdfa6344073b0be5e900490ed03/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:53.291994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f4bc-3ee9-4604-9932-8286f2368093 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.292572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f4bc-3ee9-4604-9932-8286f2368093 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.293103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f4bc-3ee9-4604-9932-8286f2368093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.333030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4678f4bc-3ee9-4604-9932-8286f2368093 None None] MFA Rules not processed for user `f332acdfa6344073b0be5e900490ed03`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:53.334647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4678f4bc-3ee9-4604-9932-8286f2368093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:53.378577 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:53.455586 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4005/7997] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:53.456954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:53.475575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2358-5272-4d5a-bdd3-7a421034817f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:53.491139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332acdfa6344073b0be5e900490ed03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca7ba72f3f624b02bbc7d2e5de756d75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:53.491880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.492253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.492619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.493405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:53.493804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:53.495535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.524889 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3993/7998] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:53.526357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678f4bc-3ee9-4604-9932-8286f2368093 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:53.547265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678f4bc-3ee9-4604-9932-8286f2368093 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:53.556052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332acdfa6344073b0be5e900490ed03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca7ba72f3f624b02bbc7d2e5de756d75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:53.557046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.557334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.557611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.558351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:53.560529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.612839 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4006/7999] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:53 2022] POST /identity/v3/projects => generated 348 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:53.614722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:53.629050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b52c01-915f-4a74-a5ad-35f140ce3517 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:53.662566 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:53.764831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332acdfa6344073b0be5e900490ed03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca7ba72f3f624b02bbc7d2e5de756d75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:53.765435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.765806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.766180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.766933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:53.767325 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:53.769068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.784639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3994/8000] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:40:53.806655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:53.812871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:53.951831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b649f6-ad9c-4da9-8bfa-071020a62b82 tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:53.958028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:53.958992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:53.959439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:53.960201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:53.971389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:53.973355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:53.986202 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4007/8001] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:56.707907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:56.734387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08e62-1b7e-4f30-9324-f3690c8ced9c tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:56.740843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332acdfa6344073b0be5e900490ed03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca7ba72f3f624b02bbc7d2e5de756d75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:56.741768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:56.742877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:56.743234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] PATH_INFO: `/v3/projects/8b20ff0d7bed4e07a3cc224c6bebb035` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:56.745716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b20ff0d7bed4e07a3cc224c6bebb035)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:56.748780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:56.853199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b20ff0d7bed4e07a3cc224c6bebb035', 'request_id': 'req-4429c8a7-0e02-459a-bf94-90d2daa2841b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:56.863699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b20ff0d7bed4e07a3cc224c6bebb035', 'request_id': 'req-4429c8a7-0e02-459a-bf94-90d2daa2841b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:56.871059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b20ff0d7bed4e07a3cc224c6bebb035', 'request_id': 'req-4429c8a7-0e02-459a-bf94-90d2daa2841b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:56.898643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] The token cache is being invalidate because project 8b20ff0d7bed4e07a3cc224c6bebb035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:56.899013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:56.899620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4429c8a7-0e02-459a-bf94-90d2daa2841b tempest-QuotasNegativeTest-1552374016 tempest-QuotasNegativeTest-1552374016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:56.901419 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3995/8002] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:56 2022] DELETE /identity/v3/projects/8b20ff0d7bed4e07a3cc224c6bebb035 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:56.909388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:56.986491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf60187-fa75-472f-a979-fb31147014d0 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:57.048449 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:57.067805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:57.068754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:57.068941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:57.069225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] PATH_INFO: `/v3/users/c18f460662f640388a924f064ffa1aa1` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:57.070443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18f460662f640388a924f064ffa1aa1)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:57.072643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:57.139883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18f460662f640388a924f064ffa1aa1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:57.153786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18f460662f640388a924f064ffa1aa1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:57.155413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18f460662f640388a924f064ffa1aa1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:57.169494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18f460662f640388a924f064ffa1aa1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:57.169494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18f460662f640388a924f064ffa1aa1'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:57.189059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4008/8003] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:56 2022] DELETE /identity/v3/users/c18f460662f640388a924f064ffa1aa1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:57.192298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:57.193223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:57.193665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:57.220236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:57.221715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:57.307946 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3996/8004] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:40:57.314798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:57.316300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:57.532954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675d5e-e343-4a8c-9cd5-1ccb76b86cad admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:57.545862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:57.546610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:57.546897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:57.547170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:57.569945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:57.571479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:57.589913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4009/8005] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:40:58.231035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:58.232583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:58.252297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116e4b-13e9-477c-8354-20e2a6ca97cc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:58.262029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:58.263178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:58.263761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:58.264196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] PATH_INFO: `/v3/projects/1c46b6d964bd43d0889d7586c30240a1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:58.268822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c46b6d964bd43d0889d7586c30240a1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:58.269405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:58.339989 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:58.395221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c46b6d964bd43d0889d7586c30240a1', 'request_id': 'req-20b76dde-5ac5-4978-8005-d6ce3d290cea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.406284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c46b6d964bd43d0889d7586c30240a1', 'request_id': 'req-20b76dde-5ac5-4978-8005-d6ce3d290cea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.415318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c46b6d964bd43d0889d7586c30240a1', 'request_id': 'req-20b76dde-5ac5-4978-8005-d6ce3d290cea'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.447590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] The token cache is being invalidate because project 1c46b6d964bd43d0889d7586c30240a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:58.447917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.448658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.450647 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3997/8006] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:58 2022] DELETE /identity/v3/projects/1c46b6d964bd43d0889d7586c30240a1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:58.455015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:58.468272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568bd3e-a959-4c49-a635-252036cb405b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:58.545664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:58.546434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:58.547377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:58.547873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] PATH_INFO: `/v3/users/f332acdfa6344073b0be5e900490ed03` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:58.549893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f332acdfa6344073b0be5e900490ed03)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:58.551892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:58.569499 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:58.608320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f332acdfa6344073b0be5e900490ed03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.618502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f332acdfa6344073b0be5e900490ed03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.619548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f332acdfa6344073b0be5e900490ed03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.629296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f332acdfa6344073b0be5e900490ed03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.630028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-15d716a1-8e5f-4532-a0ba-c58eb61d8785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f332acdfa6344073b0be5e900490ed03'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:58.650880 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4010/8007] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:40:58 2022] DELETE /identity/v3/users/f332acdfa6344073b0be5e900490ed03 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:40:59.235770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:59.237905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:59.263696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b76dde-5ac5-4978-8005-d6ce3d290cea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:59.384354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:59.386093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:59.386659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:59.387097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] PATH_INFO: `/v3/projects/ca7ba72f3f624b02bbc7d2e5de756d75` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:59.389398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7ba72f3f624b02bbc7d2e5de756d75)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:59.391528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:59.493490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7ba72f3f624b02bbc7d2e5de756d75', 'request_id': 'req-91963cea-6773-44b7-880f-9076cacbc26e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:59.500720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7ba72f3f624b02bbc7d2e5de756d75', 'request_id': 'req-91963cea-6773-44b7-880f-9076cacbc26e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:59.508653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7ba72f3f624b02bbc7d2e5de756d75', 'request_id': 'req-91963cea-6773-44b7-880f-9076cacbc26e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:59.528990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] The token cache is being invalidate because project ca7ba72f3f624b02bbc7d2e5de756d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:40:59.530042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:59.530333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91963cea-6773-44b7-880f-9076cacbc26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:40:59.533205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3998/8008] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:40:59 2022] DELETE /identity/v3/projects/ca7ba72f3f624b02bbc7d2e5de756d75 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:40:59.538507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e1a2-58d2-4a4a-b4d4-22ea88e7de14 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:59.539458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e1a2-58d2-4a4a-b4d4-22ea88e7de14 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:59.539946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e1a2-58d2-4a4a-b4d4-22ea88e7de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:59.581468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4903e1a2-58d2-4a4a-b4d4-22ea88e7de14 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:59.583087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4903e1a2-58d2-4a4a-b4d4-22ea88e7de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:59.690651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4011/8009] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:59.698773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d7dd-a0b0-40a5-b4e3-5c8ce0c81017 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:59.699416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d7dd-a0b0-40a5-b4e3-5c8ce0c81017 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:59.699876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d7dd-a0b0-40a5-b4e3-5c8ce0c81017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:59.742482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2ac9d7dd-a0b0-40a5-b4e3-5c8ce0c81017 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:40:59.743990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ac9d7dd-a0b0-40a5-b4e3-5c8ce0c81017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:40:59.756453 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 3999/8010] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:40:59.757333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e1a2-58d2-4a4a-b4d4-22ea88e7de14 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:59.772174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e1a2-58d2-4a4a-b4d4-22ea88e7de14 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:59.785517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:59.786216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:59.786497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:59.786766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:59.787429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:40:59.787727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:59.789444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:59.816266 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4012/8011] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:40:59.820625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9d7dd-a0b0-40a5-b4e3-5c8ce0c81017 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:59.831361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9d7dd-a0b0-40a5-b4e3-5c8ce0c81017 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:40:59.836348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:40:59.836996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:40:59.837272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:40:59.837663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:40:59.838310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:40:59.840864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:40:59.881234 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4000/8012] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:40:59 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:40:59.882444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:40:59.895894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7ed07-39b6-43db-a258-43d6ae097ecc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.063131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.063875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.064267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.064794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.065505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.067661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.113135 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4013/8013] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:40:59 2022] POST /identity/v3/users => generated 304 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:41:00.116959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.134815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e429a-6c42-44fc-87b6-8a1e291fea93 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.152090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.153479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.153956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.154496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.155347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.157852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.172133 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4001/8014] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:00.176652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.190201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81374d3-8f73-4782-88ac-84f05092274b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.195815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e31747-57aa-40db-b0f0-4e211f470425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.196582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e31747-57aa-40db-b0f0-4e211f470425 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.197787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e31747-57aa-40db-b0f0-4e211f470425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.197787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e31747-57aa-40db-b0f0-4e211f470425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.198261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e31747-57aa-40db-b0f0-4e211f470425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.200447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e31747-57aa-40db-b0f0-4e211f470425 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.208823 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:00.218472 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4014/8015] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:00.224760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.239048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a34d-32ea-44b5-94f5-8376ef763d74 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.245005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.246376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.246756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.247138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] PATH_INFO: `/v3/projects/532eb3d3d7e04e4db25efb5cd1b6e386/users/a5f42b03148b4f839bd7957dc528c6ee/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.251007 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:00.266815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532eb3d3d7e04e4db25efb5cd1b6e386, user_id=a5f42b03148b4f839bd7957dc528c6ee, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.269630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.286890 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4002/8016] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:00 2022] PUT /identity/v3/projects/532eb3d3d7e04e4db25efb5cd1b6e386/users/a5f42b03148b4f839bd7957dc528c6ee/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:00.299125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becff2-fb3e-4062-984b-ecce8305f4f1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.299536 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becff2-fb3e-4062-984b-ecce8305f4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.299902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becff2-fb3e-4062-984b-ecce8305f4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.329778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a5becff2-fb3e-4062-984b-ecce8305f4f1 None None] MFA Rules not processed for user `a5f42b03148b4f839bd7957dc528c6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:00.331316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a5becff2-fb3e-4062-984b-ecce8305f4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:00.421374 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4015/8017] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:00 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:00.426195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.525036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cd748-3be9-44e6-b436-2054a27dcdf9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.532878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.533895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.534329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.534727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.535501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.537870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.574279 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4003/8018] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:00 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:00.575303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5becff2-fb3e-4062-984b-ecce8305f4f1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.588185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5becff2-fb3e-4062-984b-ecce8305f4f1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.662915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.663685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.664016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.664363 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.665144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.667161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.693574 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4016/8019] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:00 2022] POST /identity/v3/users => generated 309 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:00.697459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.708736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdba9a-51cd-4ca4-9e0f-8cd9cf7a7a19 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.714271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.714880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.715150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.715418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.716181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.717830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.732041 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4004/8020] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:41:00.736278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.749211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc60b7-ca23-454b-975f-65e3e2eda679 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.754727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.755788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.756280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.756757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] PATH_INFO: `/v3/projects/67561f03bf6a4627ab2e5f85f3d8a5cc/users/a0fa309a740a4936aea566d3c7217089/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.775398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67561f03bf6a4627ab2e5f85f3d8a5cc, user_id=a0fa309a740a4936aea566d3c7217089, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.779112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.799750 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4017/8021] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:00 2022] PUT /identity/v3/projects/67561f03bf6a4627ab2e5f85f3d8a5cc/users/a0fa309a740a4936aea566d3c7217089/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:41:00.805277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.817544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83300be8-f5b0-4732-86f9-ad5266723ba2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.894600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7785-4b7e-43d7-ab93-2cd35fd70882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.894600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7785-4b7e-43d7-ab93-2cd35fd70882 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.894600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7785-4b7e-43d7-ab93-2cd35fd70882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.894600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7785-4b7e-43d7-ab93-2cd35fd70882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.895184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da7785-4b7e-43d7-ab93-2cd35fd70882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.896818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da7785-4b7e-43d7-ab93-2cd35fd70882 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.914528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4005/8022] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:41:00.915890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:00.929874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ae07-4f52-42cb-9e43-24ea9d12b83f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:00.935481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:00.936386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.936676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.937033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] PATH_INFO: `/v3/projects/67561f03bf6a4627ab2e5f85f3d8a5cc/users/a0fa309a740a4936aea566d3c7217089/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:00.940440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67561f03bf6a4627ab2e5f85f3d8a5cc, user_id=a0fa309a740a4936aea566d3c7217089, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:00.943935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:00.956940 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4018/8023] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:00 2022] PUT /identity/v3/projects/67561f03bf6a4627ab2e5f85f3d8a5cc/users/a0fa309a740a4936aea566d3c7217089/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:00.967256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:00.968194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:00.969125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:01.001523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] MFA Rules not processed for user `a0fa309a740a4936aea566d3c7217089`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:01.002762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:01.107787 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:01.212011 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4006/8024] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:01.220945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:01.223013 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:01.327621 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:01.356665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ccdf-d04a-4851-8c5a-06323be6fbc2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:01.361324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:01.362132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:01.362630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:01.363197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:01.492254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:01.494251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:01.506004 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4019/8025] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:01 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:01.607542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:01.608866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:01.681653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6df81-4dae-47b5-8886-fc88c196dec9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:01.690569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:01.691288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:01.691568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:01.691885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:01.694342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:01.789344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:01.791375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:01.810292 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4007/8026] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:02.088806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:02.091076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:02.306782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c614901-d710-4a9c-966e-d5d92c221648 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:02.318984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fc7d8-fc15-4c38-b20d-3a82deb7ce7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:02.319626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fc7d8-fc15-4c38-b20d-3a82deb7ce7b service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:02.319900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fc7d8-fc15-4c38-b20d-3a82deb7ce7b service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:02.320168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fc7d8-fc15-4c38-b20d-3a82deb7ce7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:02.344879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fc7d8-fc15-4c38-b20d-3a82deb7ce7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:02.346626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fc7d8-fc15-4c38-b20d-3a82deb7ce7b service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:02.357272 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4020/8027] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:02 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:09.952108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:10.049565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0d26-a159-40ec-9c71-d6e5070590f9 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:10.055995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:10.057476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:10.057846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:10.058128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] PATH_INFO: `/v3/users/a5f42b03148b4f839bd7957dc528c6ee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:10.059486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f42b03148b4f839bd7957dc528c6ee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:10.062520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:10.113768 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:10.133866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f42b03148b4f839bd7957dc528c6ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.148730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f42b03148b4f839bd7957dc528c6ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.165906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f42b03148b4f839bd7957dc528c6ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.168181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f42b03148b4f839bd7957dc528c6ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.178688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f42b03148b4f839bd7957dc528c6ee'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.191505 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4008/8028] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:09 2022] DELETE /identity/v3/users/a5f42b03148b4f839bd7957dc528c6ee => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:10.193192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:10.193575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:10.193774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:10.225454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:10.226833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:10.312666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:10.314260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:10.321947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4021/8029] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:41:10.410485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feba8c7-31eb-4e5a-baa0-562cedd9001e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:10.414511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:10.415240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:10.415576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:10.415969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:10.427383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:10.429016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:10.440029 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4009/8030] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:41:10.739631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:10.742718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:10.776646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0ef88-2302-4a99-8d04-bd2755781cac None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:10.786477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:10.787645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:10.788139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:10.788579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] PATH_INFO: `/v3/projects/532eb3d3d7e04e4db25efb5cd1b6e386` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:10.791413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532eb3d3d7e04e4db25efb5cd1b6e386)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:10.793516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:10.826802 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:10.880269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532eb3d3d7e04e4db25efb5cd1b6e386', 'request_id': 'req-cb29b10d-b8e6-4f92-a565-8766f26c30d9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.893057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532eb3d3d7e04e4db25efb5cd1b6e386', 'request_id': 'req-cb29b10d-b8e6-4f92-a565-8766f26c30d9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.902917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532eb3d3d7e04e4db25efb5cd1b6e386', 'request_id': 'req-cb29b10d-b8e6-4f92-a565-8766f26c30d9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.919438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] The token cache is being invalidate because project 532eb3d3d7e04e4db25efb5cd1b6e386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:10.919800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.920634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:10.922757 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4022/8031] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:10 2022] DELETE /identity/v3/projects/532eb3d3d7e04e4db25efb5cd1b6e386 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:10.926757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:10.943229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2faa3-797b-491e-8944-ec3d80d4352a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:11.029091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:11.029936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:11.030190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:11.030794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] PATH_INFO: `/v3/users/a0fa309a740a4936aea566d3c7217089` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:11.032319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fa309a740a4936aea566d3c7217089)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:11.034827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:11.100915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fa309a740a4936aea566d3c7217089'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.122772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fa309a740a4936aea566d3c7217089'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.124948 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:11.162190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fa309a740a4936aea566d3c7217089'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.163210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fa309a740a4936aea566d3c7217089'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.172353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-caef150a-f223-4c50-888e-631a9b44596f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fa309a740a4936aea566d3c7217089'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.183076 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4010/8032] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:10 2022] DELETE /identity/v3/users/a0fa309a740a4936aea566d3c7217089 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:11.403060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:11.404624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:11.441003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29b10d-b8e6-4f92-a565-8766f26c30d9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:11.531820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:11.532475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:11.533419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:11.533693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] PATH_INFO: `/v3/projects/67561f03bf6a4627ab2e5f85f3d8a5cc` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:11.535459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67561f03bf6a4627ab2e5f85f3d8a5cc)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:11.537960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:11.622559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67561f03bf6a4627ab2e5f85f3d8a5cc', 'request_id': 'req-a478a6e0-8711-4925-8da6-56e70e34a463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.634260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67561f03bf6a4627ab2e5f85f3d8a5cc', 'request_id': 'req-a478a6e0-8711-4925-8da6-56e70e34a463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.642936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67561f03bf6a4627ab2e5f85f3d8a5cc', 'request_id': 'req-a478a6e0-8711-4925-8da6-56e70e34a463'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.657292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] The token cache is being invalidate because project 67561f03bf6a4627ab2e5f85f3d8a5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:11.657780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.658598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a478a6e0-8711-4925-8da6-56e70e34a463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:11.661113 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4023/8033] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:11 2022] DELETE /identity/v3/projects/67561f03bf6a4627ab2e5f85f3d8a5cc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:11.666565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72016-5b34-4619-b5c5-30779e24201a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:11.667286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72016-5b34-4619-b5c5-30779e24201a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:11.667656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72016-5b34-4619-b5c5-30779e24201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:11.701369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1ad72016-5b34-4619-b5c5-30779e24201a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:11.704438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1ad72016-5b34-4619-b5c5-30779e24201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:11.789840 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4011/8034] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:11.800720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5a469-dd5c-4a02-8dd6-a7b92fc34e3b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:11.801141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5a469-dd5c-4a02-8dd6-a7b92fc34e3b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:11.801495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5a469-dd5c-4a02-8dd6-a7b92fc34e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:11.830815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4ee5a469-dd5c-4a02-8dd6-a7b92fc34e3b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:11.832172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4ee5a469-dd5c-4a02-8dd6-a7b92fc34e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:11.849480 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4024/8035] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:11.850827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad72016-5b34-4619-b5c5-30779e24201a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:11.866941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad72016-5b34-4619-b5c5-30779e24201a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:11.881009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:11.881800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:11.882178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:11.882552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:11.883574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:11.883980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:11.886230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:11.915495 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4012/8036] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:41:11.916074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5a469-dd5c-4a02-8dd6-a7b92fc34e3b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:11.929722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5a469-dd5c-4a02-8dd6-a7b92fc34e3b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:11.941770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:11.951213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:11.951600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:11.951829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:11.952425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:11.958804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.046357 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4025/8037] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:11 2022] POST /identity/v3/projects => generated 357 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:41:12.050581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.064393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc19841-0a39-44a2-8516-aaa52d86ceba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:12.188588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:12.189465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.189865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.190240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.191056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:12.193742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.231743 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4013/8038] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:12 2022] POST /identity/v3/users => generated 279 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:12.236324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.250981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c68c23-1b0b-4e97-92ef-cbf6ad4ebebf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:12.268606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:12.269291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.269569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.269848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.270512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:12.272163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.273953 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:12.299262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.305035 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4026/8039] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:41:12.317481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a31d47-ce63-40f2-856e-e07ee3dd51e8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:12.327621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e18a9-fefd-4eac-9186-440db88b9191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:12.328933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e18a9-fefd-4eac-9186-440db88b9191 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.332501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e18a9-fefd-4eac-9186-440db88b9191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.332928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e18a9-fefd-4eac-9186-440db88b9191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.333841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e18a9-fefd-4eac-9186-440db88b9191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:12.335936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e18a9-fefd-4eac-9186-440db88b9191 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.356605 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4014/8040] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:12.360780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.373118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863bb1-2161-4eba-b1e0-6874071ad414 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:12.378446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:12.379333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.379675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.380010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] PATH_INFO: `/v3/projects/30695f998acb4e02b7fb4d76989b0b19/users/79f0f119ba41424bb9b84db146a7a35c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.397267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30695f998acb4e02b7fb4d76989b0b19, user_id=79f0f119ba41424bb9b84db146a7a35c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:12.400283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.422175 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4027/8041] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:12 2022] PUT /identity/v3/projects/30695f998acb4e02b7fb4d76989b0b19/users/79f0f119ba41424bb9b84db146a7a35c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:41:12.433792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253415-fbc1-4975-8b06-8ae2ec005b0e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.434178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253415-fbc1-4975-8b06-8ae2ec005b0e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.434513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253415-fbc1-4975-8b06-8ae2ec005b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.494054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9a253415-fbc1-4975-8b06-8ae2ec005b0e None None] MFA Rules not processed for user `79f0f119ba41424bb9b84db146a7a35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:12.495773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9a253415-fbc1-4975-8b06-8ae2ec005b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:12.533166 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:12.633061 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4015/8042] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:12.637320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.731410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b767874-97b7-4d31-8a0b-25327e586547 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:12.736496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:12.737330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.737874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.738308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.739154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:12.741303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.778404 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4028/8043] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:12 2022] POST /identity/v3/projects => generated 353 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:12.782809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253415-fbc1-4975-8b06-8ae2ec005b0e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.799329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253415-fbc1-4975-8b06-8ae2ec005b0e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:12.879017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:12.879982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.880428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.880700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.881352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:12.883558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.926664 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4016/8044] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:12 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:12.930656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.941826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda727-2352-4d47-9968-5b06a741607f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:12.946604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:12.947244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:12.947580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:12.947854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:12.948653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:12.950997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:12.969636 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4029/8045] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:12.975121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:12.999424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399aff3-8e7e-4b6c-a5b6-154d16a9ca3e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.005333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.006098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.006363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.006648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] PATH_INFO: `/v3/projects/0232815995f442f9988d8f31f56e3368/users/7eb23b46f44e451aa97e021790abe395/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.038020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0232815995f442f9988d8f31f56e3368, user_id=7eb23b46f44e451aa97e021790abe395, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.041993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.066044 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4017/8046] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:12 2022] PUT /identity/v3/projects/0232815995f442f9988d8f31f56e3368/users/7eb23b46f44e451aa97e021790abe395/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:13.070196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:13.096701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899597f-45ca-4bda-920c-d2e043610d66 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.219276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa94288-6235-493b-9aa8-a35320fe0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.220550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94288-6235-493b-9aa8-a35320fe0d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.220966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94288-6235-493b-9aa8-a35320fe0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.221331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94288-6235-493b-9aa8-a35320fe0d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.222140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa94288-6235-493b-9aa8-a35320fe0d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.223907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa94288-6235-493b-9aa8-a35320fe0d82 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.237135 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4030/8047] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:41:13.240921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:13.253536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fd6a-5b36-4de8-9986-75d96a2e2f97 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.259437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.260203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.260631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.261024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] PATH_INFO: `/v3/projects/0232815995f442f9988d8f31f56e3368/users/7eb23b46f44e451aa97e021790abe395/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.264553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0232815995f442f9988d8f31f56e3368, user_id=7eb23b46f44e451aa97e021790abe395, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.267136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.281528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4018/8048] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:13 2022] PUT /identity/v3/projects/0232815995f442f9988d8f31f56e3368/users/7eb23b46f44e451aa97e021790abe395/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:13.291332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715163c2-6fe6-48c4-b9db-9757dd6ad40f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.291711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715163c2-6fe6-48c4-b9db-9757dd6ad40f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.292136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715163c2-6fe6-48c4-b9db-9757dd6ad40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.324080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-715163c2-6fe6-48c4-b9db-9757dd6ad40f None None] MFA Rules not processed for user `7eb23b46f44e451aa97e021790abe395`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:13.325597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-715163c2-6fe6-48c4-b9db-9757dd6ad40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:13.358392 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:13.403756 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4031/8049] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:41:13.409089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:13.420613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138609f-d83e-4b93-8091-78d2b5a5f57a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.425630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb23b46f44e451aa97e021790abe395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0232815995f442f9988d8f31f56e3368', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.426228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.427059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.427059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.427384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:13.427682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.429303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.446405 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4019/8050] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:41:13.448732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715163c2-6fe6-48c4-b9db-9757dd6ad40f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:13.462792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715163c2-6fe6-48c4-b9db-9757dd6ad40f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.464962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb23b46f44e451aa97e021790abe395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0232815995f442f9988d8f31f56e3368', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.465642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.466014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.466378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.467113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.469273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.504633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4032/8051] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:13 2022] POST /identity/v3/projects => generated 350 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:13.508540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:13.520086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e25555-fa30-4dd7-a1b1-39f114f37f13 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.588852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb23b46f44e451aa97e021790abe395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0232815995f442f9988d8f31f56e3368', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.589778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.590124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.591745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.592425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:13.592895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.594551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.606903 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:13.614018 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4020/8052] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:41:13.626401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:13.627875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:13.699471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514ca0-c3fb-4230-9e87-17e1c7fa13bb tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.703608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.704346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.704721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.705234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.717769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.719403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.731123 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4033/8053] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:13.873603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:13.884246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddd344-c21c-4a31-a971-3e39fa4a46bd tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:13.889124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb23b46f44e451aa97e021790abe395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0232815995f442f9988d8f31f56e3368', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:13.889761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:13.890035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:13.890329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] PATH_INFO: `/v3/projects/ddddec7e0e924c298c64afbe65bbfc48` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:13.891408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ddddec7e0e924c298c64afbe65bbfc48)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:13.893607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:13.952523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddddec7e0e924c298c64afbe65bbfc48', 'request_id': 'req-081c4822-bcdd-4220-b8be-7f47d7aa4462'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:13.959542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddddec7e0e924c298c64afbe65bbfc48', 'request_id': 'req-081c4822-bcdd-4220-b8be-7f47d7aa4462'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:13.965614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddddec7e0e924c298c64afbe65bbfc48', 'request_id': 'req-081c4822-bcdd-4220-b8be-7f47d7aa4462'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:13.980888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] The token cache is being invalidate because project ddddec7e0e924c298c64afbe65bbfc48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:13.981255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:13.981956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-081c4822-bcdd-4220-b8be-7f47d7aa4462 tempest-QuotasTest-47461831 tempest-QuotasTest-47461831-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:13.983797 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4021/8054] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:13 2022] DELETE /identity/v3/projects/ddddec7e0e924c298c64afbe65bbfc48 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:14.097179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:14.198020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda841-2ed5-47b0-9e8a-d97cf2707ae3 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:14.261038 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:14.270307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:14.271151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:14.271491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:14.271826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] PATH_INFO: `/v3/users/79f0f119ba41424bb9b84db146a7a35c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:14.274112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f0f119ba41424bb9b84db146a7a35c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:14.277524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:14.342902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f0f119ba41424bb9b84db146a7a35c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:14.353349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f0f119ba41424bb9b84db146a7a35c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:14.354366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f0f119ba41424bb9b84db146a7a35c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:14.363906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f0f119ba41424bb9b84db146a7a35c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:14.364901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f0f119ba41424bb9b84db146a7a35c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:14.401595 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4034/8055] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:14 2022] DELETE /identity/v3/users/79f0f119ba41424bb9b84db146a7a35c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:14.418936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:14.420165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:14.420681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:14.446487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:14.448111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:14.525808 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4022/8056] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:14.533631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:14.535625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:14.606587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f6486-0c5e-435c-a8b9-0dd5000ec345 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:14.610633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:14.611460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:14.611919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:14.612372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:14.624131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:14.625887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:14.639826 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4035/8057] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:15.328429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:15.330480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:15.347594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f75cc-c8e0-44bd-8ed1-eca794e9944b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:15.353076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:15.354063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:15.355415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:15.355929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] PATH_INFO: `/v3/projects/30695f998acb4e02b7fb4d76989b0b19` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:15.357353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30695f998acb4e02b7fb4d76989b0b19)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:15.360031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:15.472171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30695f998acb4e02b7fb4d76989b0b19', 'request_id': 'req-03de5699-72a6-4caf-8dee-fa640fb6c09e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.481168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30695f998acb4e02b7fb4d76989b0b19', 'request_id': 'req-03de5699-72a6-4caf-8dee-fa640fb6c09e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.488083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30695f998acb4e02b7fb4d76989b0b19', 'request_id': 'req-03de5699-72a6-4caf-8dee-fa640fb6c09e'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.506612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] The token cache is being invalidate because project 30695f998acb4e02b7fb4d76989b0b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:15.506898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.507559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.509516 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4023/8058] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:15 2022] DELETE /identity/v3/projects/30695f998acb4e02b7fb4d76989b0b19 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:15.514288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:15.526371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01d23-2558-42d0-8ae4-d28da1594e3d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:15.601212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:15.602022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:15.602403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:15.602679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] PATH_INFO: `/v3/users/7eb23b46f44e451aa97e021790abe395` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:15.604067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb23b46f44e451aa97e021790abe395)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:15.606580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:15.658023 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:15.694946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb23b46f44e451aa97e021790abe395'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.710753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb23b46f44e451aa97e021790abe395'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.711428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb23b46f44e451aa97e021790abe395'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.724739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb23b46f44e451aa97e021790abe395'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.725991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8f6c003e-9107-4c97-a4bc-7673bb9091f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb23b46f44e451aa97e021790abe395'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:15.754620 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4036/8059] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:15 2022] DELETE /identity/v3/users/7eb23b46f44e451aa97e021790abe395 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:16.111759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:16.113536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:16.158226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de5699-72a6-4caf-8dee-fa640fb6c09e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:16.163226 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:16.242726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:16.243388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.243669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.243949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] PATH_INFO: `/v3/projects/0232815995f442f9988d8f31f56e3368` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.247760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0232815995f442f9988d8f31f56e3368)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:16.249853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:16.324520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0232815995f442f9988d8f31f56e3368', 'request_id': 'req-3091df7a-fc71-4346-908f-f8342418b27f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:16.336695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0232815995f442f9988d8f31f56e3368', 'request_id': 'req-3091df7a-fc71-4346-908f-f8342418b27f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:16.343152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0232815995f442f9988d8f31f56e3368', 'request_id': 'req-3091df7a-fc71-4346-908f-f8342418b27f'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:16.361653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] The token cache is being invalidate because project 0232815995f442f9988d8f31f56e3368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:16.361879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:16.362505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3091df7a-fc71-4346-908f-f8342418b27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:16.368693 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4024/8060] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:16 2022] DELETE /identity/v3/projects/0232815995f442f9988d8f31f56e3368 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:16.371923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b6ef-12b5-4273-9558-39dae123ab6e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.372397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b6ef-12b5-4273-9558-39dae123ab6e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.372928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b6ef-12b5-4273-9558-39dae123ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.430213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d1d8b6ef-12b5-4273-9558-39dae123ab6e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:16.431213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d1d8b6ef-12b5-4273-9558-39dae123ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:16.517908 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4037/8061] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:16.527008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8f5e-56e6-49e4-9d15-7b66f57ed54d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.527691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8f5e-56e6-49e4-9d15-7b66f57ed54d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.528027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8f5e-56e6-49e4-9d15-7b66f57ed54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.551332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1f8e8f5e-56e6-49e4-9d15-7b66f57ed54d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:16.552698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1f8e8f5e-56e6-49e4-9d15-7b66f57ed54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:16.562747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4025/8062] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:16.566852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b6ef-12b5-4273-9558-39dae123ab6e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:16.579646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b6ef-12b5-4273-9558-39dae123ab6e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:16.595514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:16.596318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.596661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.597030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.597769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:16.598287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:16.599995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:16.618959 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4038/8063] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:41:16.620339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8f5e-56e6-49e4-9d15-7b66f57ed54d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:16.630365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8f5e-56e6-49e4-9d15-7b66f57ed54d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:16.636212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:16.636925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.637196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.637459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.638207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:16.640290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:16.685356 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4026/8064] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:16 2022] POST /identity/v3/projects => generated 397 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:16.687423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:16.699702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3ab5-e504-4c0d-80c8-c1a634ccda9a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:16.812540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:16.813258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.813586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.813856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.817903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:16.820815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:16.850174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4039/8065] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:16 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:16.853860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:16.867251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674774-cea6-47e8-8f23-65c1478cedba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:16.873874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:16.874439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.874711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.874982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.875758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:16.878414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:16.894444 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4027/8066] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:16.895669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:16.907469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb542073-9775-4b37-b0b3-b0ab16ace525 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:16.912653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65347c-bf18-482e-8d06-c2497f0ce17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:16.913320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65347c-bf18-482e-8d06-c2497f0ce17b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.913595 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65347c-bf18-482e-8d06-c2497f0ce17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.913864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65347c-bf18-482e-8d06-c2497f0ce17b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.914508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65347c-bf18-482e-8d06-c2497f0ce17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:16.916169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65347c-bf18-482e-8d06-c2497f0ce17b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:16.936691 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4040/8067] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:16.937961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:16.949732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f514-4aa9-4e85-985b-1ecf35b007e1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:16.955596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:16.956266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:16.956542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:16.956850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] PATH_INFO: `/v3/projects/7fb04df7224746769f2025df6270b2ec/users/b78566694fd84e36a37b54e2ee08b910/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:16.973283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb04df7224746769f2025df6270b2ec, user_id=b78566694fd84e36a37b54e2ee08b910, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:16.976036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:17.001837 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4028/8068] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:16 2022] PUT /identity/v3/projects/7fb04df7224746769f2025df6270b2ec/users/b78566694fd84e36a37b54e2ee08b910/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:17.004680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:17.005150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:17.005557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:17.016655 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:17.045454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] MFA Rules not processed for user `b78566694fd84e36a37b54e2ee08b910`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:17.046673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:17.123543 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4041/8069] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:41:17.130640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:17.132985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:17.177591 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:17.207311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00899831-3451-41ec-a507-a57ea38b3126 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:17.211568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a42d4f-f6bb-4da1-ab66-9a1f93d6f1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:17.212360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42d4f-f6bb-4da1-ab66-9a1f93d6f1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:17.213184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42d4f-f6bb-4da1-ab66-9a1f93d6f1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:17.213619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42d4f-f6bb-4da1-ab66-9a1f93d6f1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:17.223760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a42d4f-f6bb-4da1-ab66-9a1f93d6f1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:17.225633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a42d4f-f6bb-4da1-ab66-9a1f93d6f1ad service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:17.236339 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4029/8070] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:20.250849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:20.253203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:20.353241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92899061-2fc0-4f0e-894a-75b449b19ae0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:20.362615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:20.363389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:20.363727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:20.364145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] PATH_INFO: `/v3/users/d7d99a5134c74cd8865fa61528ee1a1b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:20.366049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d99a5134c74cd8865fa61528ee1a1b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:20.368297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:20.455965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d99a5134c74cd8865fa61528ee1a1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:20.471872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d99a5134c74cd8865fa61528ee1a1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:20.472883 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d99a5134c74cd8865fa61528ee1a1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:20.483845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d99a5134c74cd8865fa61528ee1a1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:20.484716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d99a5134c74cd8865fa61528ee1a1b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:20.506825 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4042/8071] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:20 2022] DELETE /identity/v3/users/d7d99a5134c74cd8865fa61528ee1a1b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:20.511402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:20.511936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:20.511936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:20.535818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:20.537065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:20.613896 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4030/8072] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:41:20.630789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:20.632804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:20.677586 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:20.767276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c22683-3c05-4fa5-ac82-cbdc83af14be admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:20.775409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:20.776666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:20.777069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:20.777548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:20.798195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:20.800314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:20.816982 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4043/8073] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:21.835955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:21.837470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:21.866162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06462a-6714-4534-a19b-f430f5a8425a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:21.880397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:21.881120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:21.881398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:21.881669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] PATH_INFO: `/v3/projects/21614fa0a9614fb69b279fb8ed92c613` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:21.894998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=21614fa0a9614fb69b279fb8ed92c613)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:21.896985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:22.014091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21614fa0a9614fb69b279fb8ed92c613', 'request_id': 'req-21102f90-bdd8-4dd8-824a-76da881bcc5d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.029489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21614fa0a9614fb69b279fb8ed92c613', 'request_id': 'req-21102f90-bdd8-4dd8-824a-76da881bcc5d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.044820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21614fa0a9614fb69b279fb8ed92c613', 'request_id': 'req-21102f90-bdd8-4dd8-824a-76da881bcc5d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.067182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] The token cache is being invalidate because project 21614fa0a9614fb69b279fb8ed92c613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:22.067466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.068197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.075742 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4031/8074] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:21 2022] DELETE /identity/v3/projects/21614fa0a9614fb69b279fb8ed92c613 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:22.076757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:22.091134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270018-0bc8-44d2-9d5c-d3b38a65873e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:22.263239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:22.263917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:22.264197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:22.264475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] PATH_INFO: `/v3/users/6f263bef91f04d069df763ac19357b48` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:22.265818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f263bef91f04d069df763ac19357b48)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:22.267859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:22.397773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f263bef91f04d069df763ac19357b48'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.415625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f263bef91f04d069df763ac19357b48'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.416666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f263bef91f04d069df763ac19357b48'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.444011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f263bef91f04d069df763ac19357b48'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.445163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4d86da11-c56b-403f-b1f0-822507365743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f263bef91f04d069df763ac19357b48'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:22.484425 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4044/8075] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:22 2022] DELETE /identity/v3/users/6f263bef91f04d069df763ac19357b48 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:22.965583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:22.967038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:23.001295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21102f90-bdd8-4dd8-824a-76da881bcc5d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:23.144301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:23.144987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.145267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.145865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] PATH_INFO: `/v3/projects/95308894408b4ad0a5ccd1da18c1aae0` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.147314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95308894408b4ad0a5ccd1da18c1aae0)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:23.152791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:23.154987 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:23.254196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95308894408b4ad0a5ccd1da18c1aae0', 'request_id': 'req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:23.263624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95308894408b4ad0a5ccd1da18c1aae0', 'request_id': 'req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:23.286172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95308894408b4ad0a5ccd1da18c1aae0', 'request_id': 'req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:23.311624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] The token cache is being invalidate because project 95308894408b4ad0a5ccd1da18c1aae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:23.313240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:23.314391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-241a7c5d-bd49-4aaf-8eb9-62e7e6845583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:23.317479 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4032/8076] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:22 2022] DELETE /identity/v3/projects/95308894408b4ad0a5ccd1da18c1aae0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:23.322872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3bdaf-1b5a-4544-b0c3-438db11840af None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.323969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3bdaf-1b5a-4544-b0c3-438db11840af None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.324240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3bdaf-1b5a-4544-b0c3-438db11840af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.346218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-aee3bdaf-1b5a-4544-b0c3-438db11840af None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:23.347712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-aee3bdaf-1b5a-4544-b0c3-438db11840af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:23.398716 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:23.466355 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4045/8077] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:23.475340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8883-90fe-4e49-9f2b-370cfac2239d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.475727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8883-90fe-4e49-9f2b-370cfac2239d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.475875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8883-90fe-4e49-9f2b-370cfac2239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.499322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-717f8883-90fe-4e49-9f2b-370cfac2239d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:23.501350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-717f8883-90fe-4e49-9f2b-370cfac2239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:23.513801 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4033/8078] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:41:23.524370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3bdaf-1b5a-4544-b0c3-438db11840af None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:23.538302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3bdaf-1b5a-4544-b0c3-438db11840af None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:23.557614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:23.558417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.558795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.559166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.559930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:23.560337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:23.562098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:23.588207 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4046/8079] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:41:23.592448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8883-90fe-4e49-9f2b-370cfac2239d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:23.604038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8883-90fe-4e49-9f2b-370cfac2239d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:23.610527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:23.611276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.611591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.611951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.613304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:23.615227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:23.654713 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4034/8080] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:23 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:23.659057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:23.672132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e504ad-ff76-4ca3-9aeb-9cd31b71373d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:23.761396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:23.762165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.763287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.763593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.764305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:23.767877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:23.811485 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4047/8081] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:23 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:23.811943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:23.838058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3783499-030a-49be-acd2-3554435e2ea2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:23.862503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:23.862503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.862503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.862503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.863052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:23.864659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:23.883879 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4035/8082] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:41:23.889821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:23.906511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dcd3a-6d13-4e06-bd56-45d8fe17cc60 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:23.916634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e72a7a-a528-4a9f-9b78-35b535a7c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:23.918408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72a7a-a528-4a9f-9b78-35b535a7c7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.918786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72a7a-a528-4a9f-9b78-35b535a7c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.919216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72a7a-a528-4a9f-9b78-35b535a7c7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.920068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e72a7a-a528-4a9f-9b78-35b535a7c7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:23.921947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e72a7a-a528-4a9f-9b78-35b535a7c7bf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:23.940832 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4048/8083] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:23.941369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:23.954392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195347-7811-436a-a970-4b7bbfe7c63e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:23.960106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:23.960945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:23.961323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:23.962125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] PATH_INFO: `/v3/projects/1739d4e6f6144c2d9e85e54fb1de373a/users/3bc32a2b399149a4b751d906d8707d69/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:23.979146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1739d4e6f6144c2d9e85e54fb1de373a, user_id=3bc32a2b399149a4b751d906d8707d69, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:23.982899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:24.013894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c163-fa68-4998-9586-38353cd41484 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:24.014417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c163-fa68-4998-9586-38353cd41484 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:24.014869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c163-fa68-4998-9586-38353cd41484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:24.023837 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4036/8084] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:23 2022] PUT /identity/v3/projects/1739d4e6f6144c2d9e85e54fb1de373a/users/3bc32a2b399149a4b751d906d8707d69/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:41:24.049920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b7e8c163-fa68-4998-9586-38353cd41484 None None] MFA Rules not processed for user `3bc32a2b399149a4b751d906d8707d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:24.051600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7e8c163-fa68-4998-9586-38353cd41484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:24.158962 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4049/8085] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:41:24.168288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:24.170288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:24.281166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed651101-1a51-4548-a65e-fa5f711c2f17 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:24.291073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76d52b-164b-4078-9f7b-e42751f938ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:24.292421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76d52b-164b-4078-9f7b-e42751f938ad service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:24.292720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76d52b-164b-4078-9f7b-e42751f938ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:24.293031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76d52b-164b-4078-9f7b-e42751f938ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:24.313006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76d52b-164b-4078-9f7b-e42751f938ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:24.315447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76d52b-164b-4078-9f7b-e42751f938ad service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:24.336215 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4037/8086] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:25.257096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c163-fa68-4998-9586-38353cd41484 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:25.291005 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:25.330507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c163-fa68-4998-9586-38353cd41484 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:25.336897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:25.338035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:25.338653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:25.339213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] PATH_INFO: `/v3/users/3bc32a2b399149a4b751d906d8707d69` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:25.340656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc32a2b399149a4b751d906d8707d69)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:25.343128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:25.426498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc32a2b399149a4b751d906d8707d69'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:25.445000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc32a2b399149a4b751d906d8707d69'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:25.446234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc32a2b399149a4b751d906d8707d69'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:25.462190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc32a2b399149a4b751d906d8707d69'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:25.463317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc32a2b399149a4b751d906d8707d69'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:25.487947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4050/8087] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:25 2022] DELETE /identity/v3/users/3bc32a2b399149a4b751d906d8707d69 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:25.492283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:25.492758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:25.492870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:25.529090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:25.530860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:25.561939 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:25.617877 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4038/8088] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:25.628029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:25.629464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:25.752524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10243-0409-4c0a-8856-807a2d553512 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:25.758580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e328a-db7a-4398-b746-adfa53876a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:25.759736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e328a-db7a-4398-b746-adfa53876a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:25.760171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e328a-db7a-4398-b746-adfa53876a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:25.761583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e328a-db7a-4398-b746-adfa53876a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:25.785634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e328a-db7a-4398-b746-adfa53876a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:25.787474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e328a-db7a-4398-b746-adfa53876a2d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:25.799691 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4051/8089] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:26.315530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:26.317172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:26.335218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83a165-2729-4091-a437-2901b8d87c33 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:26.341565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:26.342829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.343226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.343602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] PATH_INFO: `/v3/projects/1739d4e6f6144c2d9e85e54fb1de373a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.345276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1739d4e6f6144c2d9e85e54fb1de373a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:26.347929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:26.411958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1739d4e6f6144c2d9e85e54fb1de373a', 'request_id': 'req-3344b3ff-c014-4378-bc6a-593d8750ea83'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:26.427916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1739d4e6f6144c2d9e85e54fb1de373a', 'request_id': 'req-3344b3ff-c014-4378-bc6a-593d8750ea83'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:26.438954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1739d4e6f6144c2d9e85e54fb1de373a', 'request_id': 'req-3344b3ff-c014-4378-bc6a-593d8750ea83'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:26.458496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] The token cache is being invalidate because project 1739d4e6f6144c2d9e85e54fb1de373a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:26.459327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:26.460389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3344b3ff-c014-4378-bc6a-593d8750ea83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:26.463888 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4039/8090] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:26 2022] DELETE /identity/v3/projects/1739d4e6f6144c2d9e85e54fb1de373a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:26.469673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452407-e7a3-431a-9d3b-22febf81400e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.470232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452407-e7a3-431a-9d3b-22febf81400e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.470232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452407-e7a3-431a-9d3b-22febf81400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.495955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-21452407-e7a3-431a-9d3b-22febf81400e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:26.497544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-21452407-e7a3-431a-9d3b-22febf81400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:26.554966 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:26.580125 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4052/8091] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:26.580916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811557d-de24-4f71-8f32-dcf7d5c2ecf9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.581699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811557d-de24-4f71-8f32-dcf7d5c2ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.582167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811557d-de24-4f71-8f32-dcf7d5c2ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.606080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6811557d-de24-4f71-8f32-dcf7d5c2ecf9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:26.607687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6811557d-de24-4f71-8f32-dcf7d5c2ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:26.618421 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4040/8092] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:26.623152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452407-e7a3-431a-9d3b-22febf81400e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:26.638540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452407-e7a3-431a-9d3b-22febf81400e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:26.644978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:26.645615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.645891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.646162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.646825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:26.647128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:26.648741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:26.662673 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4053/8093] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:41:26.667257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811557d-de24-4f71-8f32-dcf7d5c2ecf9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:26.677464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811557d-de24-4f71-8f32-dcf7d5c2ecf9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:26.683814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:26.684522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.684830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.685106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.685749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:26.687688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:26.724329 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4041/8094] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:26 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:26.725809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:26.737491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713db15-1520-4261-a35a-de7da09be2c9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:26.814951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:26.815717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.816096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.816467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.817390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:26.820083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:26.886209 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4054/8095] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:26 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:26.887411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:26.906306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfdfd3-86ef-47b2-82a5-a337a30ae430 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:26.913645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:26.914421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.914816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.915347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.916438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:26.919267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:26.936556 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4042/8096] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:26.937851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:26.962725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f20d84-a190-4775-aea7-8b9f5f7aff7a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:26.969832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c445b85-40d1-4a41-973a-d73f0371d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:26.970685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c445b85-40d1-4a41-973a-d73f0371d0fc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:26.971131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c445b85-40d1-4a41-973a-d73f0371d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:26.971805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c445b85-40d1-4a41-973a-d73f0371d0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:26.973005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c445b85-40d1-4a41-973a-d73f0371d0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:26.974787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c445b85-40d1-4a41-973a-d73f0371d0fc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:26.997181 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4055/8097] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:26.997715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:27.015909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032856c8-3639-4cb6-9fe9-4cac4a0c7ba5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:27.022988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:27.023919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:27.024435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:27.025122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] PATH_INFO: `/v3/projects/7ffa628f4273460c89db93fe85622941/users/d49d671ee09545ea8db500e226f672b4/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:27.047037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffa628f4273460c89db93fe85622941, user_id=d49d671ee09545ea8db500e226f672b4, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:27.050906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:27.075935 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4043/8098] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:26 2022] PUT /identity/v3/projects/7ffa628f4273460c89db93fe85622941/users/d49d671ee09545ea8db500e226f672b4/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:41:27.088609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:27.089427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:27.089427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:27.220029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] MFA Rules not processed for user `d49d671ee09545ea8db500e226f672b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:27.221227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:27.364467 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4056/8099] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:27.377951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:27.379899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:27.484830 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:27.501025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c374-497e-4578-8ecc-eb93030a5dab admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:27.510832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:27.513565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:27.514598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:27.515755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:27.540235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:27.542450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:27.553644 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4044/8100] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:32.635693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:32.637797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:32.706592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:32.708103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:32.727793 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:32.766021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b5c78-5f8f-495e-a0db-ee651349d878 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:32.782120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c28e8-7969-49a6-b992-00c4fc0f2cab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:32.783059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c28e8-7969-49a6-b992-00c4fc0f2cab service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:32.783533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c28e8-7969-49a6-b992-00c4fc0f2cab service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:32.784055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c28e8-7969-49a6-b992-00c4fc0f2cab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:32.786261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-869c28e8-7969-49a6-b992-00c4fc0f2cab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:32.797879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78439-a54e-4f69-8190-fcb0b54eea7d service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:32.804742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c28e8-7969-49a6-b992-00c4fc0f2cab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:32.805124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:32.805862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:32.806229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:32.806589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] PATH_INFO: `/v3/users/b78566694fd84e36a37b54e2ee08b910` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:32.808102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78566694fd84e36a37b54e2ee08b910)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:32.808698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c28e8-7969-49a6-b992-00c4fc0f2cab service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:32.810426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:32.828896 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4057/8101] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:32.886722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78566694fd84e36a37b54e2ee08b910'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:32.896388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78566694fd84e36a37b54e2ee08b910'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:32.911383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78566694fd84e36a37b54e2ee08b910'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:32.912283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78566694fd84e36a37b54e2ee08b910'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:32.919935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78566694fd84e36a37b54e2ee08b910'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:32.929728 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4045/8102] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:32 2022] DELETE /identity/v3/users/b78566694fd84e36a37b54e2ee08b910 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:41:32.931732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:32.931973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:32.932356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:32.952670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:32.954037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:33.027814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4058/8103] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:33.038646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:33.040281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:33.112496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be308-1f05-412d-a9ac-087e53260614 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:33.117245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004db553-8d98-46a8-ba3b-0cf53b7af1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:33.118103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db553-8d98-46a8-ba3b-0cf53b7af1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:33.118777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db553-8d98-46a8-ba3b-0cf53b7af1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:33.118979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db553-8d98-46a8-ba3b-0cf53b7af1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:33.141770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004db553-8d98-46a8-ba3b-0cf53b7af1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:33.147008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004db553-8d98-46a8-ba3b-0cf53b7af1a7 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:33.163599 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4046/8104] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:33.444438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:33.445930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:33.461168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4407-8de3-4915-8414-f86938bbc8e7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:33.467461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:33.467971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:33.468249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:33.469275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] PATH_INFO: `/v3/projects/7fb04df7224746769f2025df6270b2ec` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:33.470773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb04df7224746769f2025df6270b2ec)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:33.473004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:33.564732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb04df7224746769f2025df6270b2ec', 'request_id': 'req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:33.577627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb04df7224746769f2025df6270b2ec', 'request_id': 'req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:33.585213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb04df7224746769f2025df6270b2ec', 'request_id': 'req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:33.602015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] The token cache is being invalidate because project 7fb04df7224746769f2025df6270b2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:33.602311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:33.603285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3c6ccdc3-aa4b-4bdd-8b7a-b87297ff6893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:33.606528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4059/8105] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:33 2022] DELETE /identity/v3/projects/7fb04df7224746769f2025df6270b2ec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:33.611512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187cf4d-7c16-42ee-9be1-5974b10f132d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:33.611798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187cf4d-7c16-42ee-9be1-5974b10f132d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:33.612072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187cf4d-7c16-42ee-9be1-5974b10f132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:33.641048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2187cf4d-7c16-42ee-9be1-5974b10f132d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:33.642284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2187cf4d-7c16-42ee-9be1-5974b10f132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:33.652614 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:33.739197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611de91-2bee-47a1-96c2-b57313d065f6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:33.739756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611de91-2bee-47a1-96c2-b57313d065f6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:33.739756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611de91-2bee-47a1-96c2-b57313d065f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:33.743918 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4047/8106] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:33.764629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7611de91-2bee-47a1-96c2-b57313d065f6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:33.765959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7611de91-2bee-47a1-96c2-b57313d065f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:33.785948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187cf4d-7c16-42ee-9be1-5974b10f132d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:33.793119 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4060/8107] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:33.799654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187cf4d-7c16-42ee-9be1-5974b10f132d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:33.813934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:33.814571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:33.814847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:33.815117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:33.815794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:33.816092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:33.817730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:33.846466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611de91-2bee-47a1-96c2-b57313d065f6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:33.858433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611de91-2bee-47a1-96c2-b57313d065f6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:33.864923 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4048/8108] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:41:33.866952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:33.867942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:33.868315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:33.868677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:33.869782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:33.873068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:33.936780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4061/8109] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:33 2022] POST /identity/v3/projects => generated 359 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:41:33.938642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:33.956955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c734be-944c-4b50-ae2b-e0a91d04fdef admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:34.052416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:34.055350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:34.055816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:34.056098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:34.057361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:34.060371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:34.111796 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4049/8110] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:33 2022] POST /identity/v3/users => generated 280 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:41:34.118628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:34.136551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0992f5-8e4a-46ec-a337-21c92757611f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:34.147233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:34.147855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:34.148181 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:34.148455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:34.149140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:34.150931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:34.168194 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4062/8111] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:34.169466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:34.180247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3d5dd-a89c-4fa4-8c0a-e8a022910d45 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:34.187505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a544b-9f67-4896-a852-151521b21a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:34.188138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a544b-9f67-4896-a852-151521b21a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:34.188586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a544b-9f67-4896-a852-151521b21a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:34.189141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a544b-9f67-4896-a852-151521b21a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:34.189687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a544b-9f67-4896-a852-151521b21a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:34.191295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a544b-9f67-4896-a852-151521b21a59 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:34.203794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4050/8112] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:34.207624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:34.221012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165170-8291-4430-8f41-c0566dbe781e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:34.227426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:34.228454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:34.229105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:34.229564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] PATH_INFO: `/v3/projects/08fabbf481a849f5adab42c5095c07c4/users/e7c7275fcd4c429693f41619b780d48e/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:34.249576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fabbf481a849f5adab42c5095c07c4, user_id=e7c7275fcd4c429693f41619b780d48e, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:34.253139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:34.256898 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:34.287385 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4063/8113] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:34 2022] PUT /identity/v3/projects/08fabbf481a849f5adab42c5095c07c4/users/e7c7275fcd4c429693f41619b780d48e/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:34.288698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:34.289006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:34.289278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:34.331038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] MFA Rules not processed for user `e7c7275fcd4c429693f41619b780d48e`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:34.332346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:34.414390 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4051/8114] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:41:34.424903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:34.426757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:34.527513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d1f2f-0eb3-4533-a30c-f18233c48a08 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:34.532271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:34.533201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:34.533596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:34.533967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:34.548962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:34.550916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:34.564359 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4064/8115] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:44.417359 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:44.513318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:44.515787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:44.557889 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=28 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:44.609336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224850a4-5d78-4e4c-b9d9-9bb81b63edcf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:44.615264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:44.616044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:44.616420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:44.616970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] PATH_INFO: `/v3/users/5a18d05ad96b490b80e80e3012d51126` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:44.619151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a18d05ad96b490b80e80e3012d51126)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:44.621417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:44.689745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a18d05ad96b490b80e80e3012d51126'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:44.700182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a18d05ad96b490b80e80e3012d51126'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:44.721767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a18d05ad96b490b80e80e3012d51126'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:44.722883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a18d05ad96b490b80e80e3012d51126'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:44.731362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a18d05ad96b490b80e80e3012d51126'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:44.739760 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4052/8116] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:44 2022] DELETE /identity/v3/users/5a18d05ad96b490b80e80e3012d51126 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:45.142256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:45.163979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8aa5-a6b3-4f3d-bf8d-23d9b8c96891 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:45.249734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:45.250699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:45.251021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:45.251826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] PATH_INFO: `/v3/projects/80714967f868419fa75307662aca3a19` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:45.255672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=80714967f868419fa75307662aca3a19)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:45.257770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:45.351882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80714967f868419fa75307662aca3a19', 'request_id': 'req-867989de-a405-4c32-933c-f8d3892737fc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.368405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80714967f868419fa75307662aca3a19', 'request_id': 'req-867989de-a405-4c32-933c-f8d3892737fc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.377456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80714967f868419fa75307662aca3a19', 'request_id': 'req-867989de-a405-4c32-933c-f8d3892737fc'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.391421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] The token cache is being invalidate because project 80714967f868419fa75307662aca3a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:45.391712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.392432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.394342 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4065/8117] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:45 2022] DELETE /identity/v3/projects/80714967f868419fa75307662aca3a19 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:45.398154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:45.399686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:45.414714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d71f-61dc-4a94-b1fd-a400da5a1244 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:45.555350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:45.556097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:45.556513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:45.556695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] PATH_INFO: `/v3/users/8b9d617f968f41a4867f41f42a9e406c` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:45.557958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9d617f968f41a4867f41f42a9e406c)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:45.559914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:45.604382 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:45.647439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9d617f968f41a4867f41f42a9e406c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.667160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9d617f968f41a4867f41f42a9e406c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.689909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9d617f968f41a4867f41f42a9e406c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.693393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9d617f968f41a4867f41f42a9e406c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.715475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7f21d056-e29f-423d-8cb7-e43f4eb54dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9d617f968f41a4867f41f42a9e406c'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:45.731177 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4053/8118] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:41:45 2022] DELETE /identity/v3/users/8b9d617f968f41a4867f41f42a9e406c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:46.146846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:46.148239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:46.169857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867989de-a405-4c32-933c-f8d3892737fc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:46.280464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:46.281314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.283704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.284298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] PATH_INFO: `/v3/projects/e8149c330a47427b8b02a80f1a13c553` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.287411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8149c330a47427b8b02a80f1a13c553)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:46.292660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:46.353149 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:46.374148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8149c330a47427b8b02a80f1a13c553', 'request_id': 'req-62256230-e2be-4a0b-8b97-9906d88a7e1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:46.387872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8149c330a47427b8b02a80f1a13c553', 'request_id': 'req-62256230-e2be-4a0b-8b97-9906d88a7e1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:46.396799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8149c330a47427b8b02a80f1a13c553', 'request_id': 'req-62256230-e2be-4a0b-8b97-9906d88a7e1e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:46.414455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] The token cache is being invalidate because project e8149c330a47427b8b02a80f1a13c553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:41:46.414753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:46.415425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-62256230-e2be-4a0b-8b97-9906d88a7e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:41:46.418339 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4066/8119] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:41:46 2022] DELETE /identity/v3/projects/e8149c330a47427b8b02a80f1a13c553 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:46.423177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ef29-36f5-4f18-adcb-77a840d8b13a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.423462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ef29-36f5-4f18-adcb-77a840d8b13a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.423735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ef29-36f5-4f18-adcb-77a840d8b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.448446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5ff4ef29-36f5-4f18-adcb-77a840d8b13a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:46.452048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ff4ef29-36f5-4f18-adcb-77a840d8b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:46.533498 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4054/8120] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:46.542201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bdbd4-8141-4310-ac28-9116c4ae5c46 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.542482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bdbd4-8141-4310-ac28-9116c4ae5c46 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.542758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bdbd4-8141-4310-ac28-9116c4ae5c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.572451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-358bdbd4-8141-4310-ac28-9116c4ae5c46 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:46.573706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-358bdbd4-8141-4310-ac28-9116c4ae5c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:46.583111 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4067/8121] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:46.587122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ef29-36f5-4f18-adcb-77a840d8b13a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:46.599079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ef29-36f5-4f18-adcb-77a840d8b13a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:46.608265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:46.609215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.609532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.609810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.610599 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:41:46.610932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:46.612786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:46.628101 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4055/8122] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:41:46.632393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bdbd4-8141-4310-ac28-9116c4ae5c46 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:46.642797 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bdbd4-8141-4310-ac28-9116c4ae5c46 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:46.647820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:46.648556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.648978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.649375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.650170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:46.652245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:46.686849 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4068/8123] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:46 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:46.690784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:46.702237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72069b85-9c3b-4f49-bad9-76d53e92c7a6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:46.770528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:46.771723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.771723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.772233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.773869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:46.778267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:46.811825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4056/8124] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:46 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:46.812933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:46.825049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9f4f-50a0-49a7-a767-ebdb4725a9e7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:46.831799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:46.832573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.833028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.833405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.834652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:46.836404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:46.850468 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4069/8125] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:46.854795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:46.867628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859a38b-235e-41b2-b4dd-39e089a228b8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:46.875368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24341cf-0388-4a82-94aa-2f1aedd4d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:46.878104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24341cf-0388-4a82-94aa-2f1aedd4d4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.878396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24341cf-0388-4a82-94aa-2f1aedd4d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.878669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24341cf-0388-4a82-94aa-2f1aedd4d4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.879657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24341cf-0388-4a82-94aa-2f1aedd4d4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:46.881745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24341cf-0388-4a82-94aa-2f1aedd4d4fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:46.903220 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4057/8126] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:46.905240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:46.918688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6117ef3-5133-4879-9772-bca0259a963f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:46.924292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:46.925500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.926019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.926399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] PATH_INFO: `/v3/projects/3adba6f592254fff966ec56c2fab1208/users/5277d7e41508465983a7b02121ee6096/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.946102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adba6f592254fff966ec56c2fab1208, user_id=5277d7e41508465983a7b02121ee6096, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:46.949282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:46.967473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4070/8127] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:46 2022] PUT /identity/v3/projects/3adba6f592254fff966ec56c2fab1208/users/5277d7e41508465983a7b02121ee6096/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:41:46.978339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21939-1533-4670-bf82-3b580d2a1a7d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:46.978625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21939-1533-4670-bf82-3b580d2a1a7d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:46.978899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21939-1533-4670-bf82-3b580d2a1a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:46.987742 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:47.018113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a5a21939-1533-4670-bf82-3b580d2a1a7d None None] MFA Rules not processed for user `5277d7e41508465983a7b02121ee6096`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:47.019689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a5a21939-1533-4670-bf82-3b580d2a1a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:47.117024 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4058/8128] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:47.119088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:47.219840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266772-7431-4e69-8097-94bc96133876 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:47.227886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:47.229237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:47.230045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:47.230544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:47.231796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:47.243542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:47.294410 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4071/8129] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:41:47 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:41:47.295653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21939-1533-4670-bf82-3b580d2a1a7d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:47.329983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21939-1533-4670-bf82-3b580d2a1a7d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:47.468356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:47.469071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:47.469356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:47.469622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:47.470277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:47.472907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:47.510872 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4059/8130] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:41:47 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:41:47.513521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:47.582566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ba73-c908-456e-8ab1-d2c3de24b2c4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:47.596866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:47.598278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:47.599412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:47.604826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:47.607120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:47.610671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:47.637028 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4072/8131] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:47.637776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:47.659831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f534fd-528a-48f2-8502-8fd91d1a0847 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:47.664707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:47.665406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:47.665787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:47.666072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] PATH_INFO: `/v3/projects/0586a15b339848748b4bdfdcfaf43b06/users/9651eeec08ac4eee83799d20dd515252/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:47.683254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0586a15b339848748b4bdfdcfaf43b06, user_id=9651eeec08ac4eee83799d20dd515252, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:47.685743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:47.728211 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4060/8132] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:47 2022] PUT /identity/v3/projects/0586a15b339848748b4bdfdcfaf43b06/users/9651eeec08ac4eee83799d20dd515252/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:41:47.730032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:47.742520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5354d-8afc-4a1a-bf98-67ac2f3f575e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:47.816739 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:47.873353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745f98c-cff4-4aae-8f4e-778909545f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:47.874236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f98c-cff4-4aae-8f4e-778909545f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:47.874714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f98c-cff4-4aae-8f4e-778909545f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:47.875168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f98c-cff4-4aae-8f4e-778909545f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:47.876356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745f98c-cff4-4aae-8f4e-778909545f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:47.879089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745f98c-cff4-4aae-8f4e-778909545f5f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:47.896656 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4073/8133] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:41:47.900856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:47.913784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dbc63-5cbf-419d-922a-4800c28afa4e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:47.920511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:47.921985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:47.922429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:47.923036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] PATH_INFO: `/v3/projects/0586a15b339848748b4bdfdcfaf43b06/users/9651eeec08ac4eee83799d20dd515252/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:47.925466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0586a15b339848748b4bdfdcfaf43b06, user_id=9651eeec08ac4eee83799d20dd515252, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:47.930784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:47.945943 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4061/8134] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:41:47 2022] PUT /identity/v3/projects/0586a15b339848748b4bdfdcfaf43b06/users/9651eeec08ac4eee83799d20dd515252/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:41:47.956511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:47.957644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:47.958196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:47.997612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] MFA Rules not processed for user `9651eeec08ac4eee83799d20dd515252`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:41:47.999478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:48.087466 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4074/8135] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:41:48.100047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:48.101930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:48.191138 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:48.199932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9659c1-5217-4261-bf45-cd0ddfece421 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:48.204885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:48.205560 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:48.205839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:48.206108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:48.267773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:48.269414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:48.282488 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4062/8136] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:50.292357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:50.293889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:50.360823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680df69f-63b6-4a22-9130-d6be899087f2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:50.364956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:50.365808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:50.366221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:50.366641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:50.369430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:50.459828 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:50.473997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:50.475572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:50.495363 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4075/8137] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:51.250991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:51.252466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:51.282823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d1a17-5dba-4253-84cb-7d324a881b7b service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:51.288681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:51.289817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:51.290438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:51.290945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:51.300054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:51.318885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:51.320975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:51.340449 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4063/8138] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:52.355640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:52.372447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7060e-d3e7-413d-aa1d-8aab131b9378 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:52.389610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:52.390256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:52.390531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:52.391002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:52.402394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:52.423053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:52.424850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:52.449384 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4076/8139] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:52.501699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:52.503150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:52.614797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6656-56ab-41b6-9023-28052a6a7ab6 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:52.622963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:52.623921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:52.624412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:52.624962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:52.628447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:52.649253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:52.652527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:52.684662 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4064/8140] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:53.074328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:53.091304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef28fd-3895-4166-af46-488ed2cd039c service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:53.099796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:53.099796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:53.099796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:53.100256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:53.106529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:53.140923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:53.140923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:53.161827 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4077/8141] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:41:53.503659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:53.505782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:53.546163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de7da-9132-4568-845f-3c297cefb4d3 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:53.552490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:53.553518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:53.554003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:53.554461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:53.556903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:53.588728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:53.590690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:53.625866 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4065/8142] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:41:53.968083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:41:53.985142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b895-f606-43a5-8ea0-9bd2d5f1576e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:41:54.005803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:41:54.007305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:41:54.007809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:41:54.008323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:41:54.022795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:41:54.061111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:41:54.062686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:41:54.094394 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4078/8143] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:41:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:42:01.063186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:01.065232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:01.151830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3dbc0-ae59-48aa-a436-9480764e675b service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:01.158482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbc81a-b1f9-466e-8cb9-69ea3d46a2d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:01.159589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbc81a-b1f9-466e-8cb9-69ea3d46a2d0 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:01.160118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbc81a-b1f9-466e-8cb9-69ea3d46a2d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:01.160604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbc81a-b1f9-466e-8cb9-69ea3d46a2d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:01.167094 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:01.171660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbc81a-b1f9-466e-8cb9-69ea3d46a2d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:01.173840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbc81a-b1f9-466e-8cb9-69ea3d46a2d0 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:01.219349 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4066/8144] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:42:04.082103 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=21 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:11.185376 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:38.624041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:38.625596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:38.782064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412a63-b151-4de4-88db-e54baf480d5d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:38.787362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:38.789480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:38.789984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:38.794834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] PATH_INFO: `/v3/users/d49d671ee09545ea8db500e226f672b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:38.796847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49d671ee09545ea8db500e226f672b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:38.799268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:38.896968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49d671ee09545ea8db500e226f672b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:38.921766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49d671ee09545ea8db500e226f672b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:38.922489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49d671ee09545ea8db500e226f672b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:38.936040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49d671ee09545ea8db500e226f672b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:38.937193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49d671ee09545ea8db500e226f672b4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:38.959811 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4079/8145] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:42:38 2022] DELETE /identity/v3/users/d49d671ee09545ea8db500e226f672b4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:42:38.965015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:38.967021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:38.967641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:38.996507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:42:38.998236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:39.117132 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4067/8146] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:42:39.150644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:39.154138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:39.274180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204051-dfb1-4c21-b256-dccba9e28f08 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:39.280924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadec69-6a1a-4dd2-896a-d6f7670176ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:39.280924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadec69-6a1a-4dd2-896a-d6f7670176ca service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:39.281255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadec69-6a1a-4dd2-896a-d6f7670176ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:39.281370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadec69-6a1a-4dd2-896a-d6f7670176ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:39.302525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadec69-6a1a-4dd2-896a-d6f7670176ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:39.305048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadec69-6a1a-4dd2-896a-d6f7670176ca service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:39.327646 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4080/8147] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:42:39.676634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:39.679548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:39.697695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c36e8-6fe2-49f0-b3e4-1480598fa46c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:39.704744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:39.705808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:39.706319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:39.707097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] PATH_INFO: `/v3/projects/7ffa628f4273460c89db93fe85622941` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:39.709364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffa628f4273460c89db93fe85622941)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:39.712660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:39.857930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffa628f4273460c89db93fe85622941', 'request_id': 'req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:39.880072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffa628f4273460c89db93fe85622941', 'request_id': 'req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:39.905522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffa628f4273460c89db93fe85622941', 'request_id': 'req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:39.930991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] The token cache is being invalidate because project 7ffa628f4273460c89db93fe85622941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:42:39.931342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:39.936787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3ab8bf97-a7c2-4b11-a7a7-5532743f3b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:42:39.942070 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4068/8148] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:42:39 2022] DELETE /identity/v3/projects/7ffa628f4273460c89db93fe85622941 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:42:39.948040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6170-162d-49c3-b86c-0065b5065ddb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:39.949042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6170-162d-49c3-b86c-0065b5065ddb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:39.949539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6170-162d-49c3-b86c-0065b5065ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:39.977646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f39d6170-162d-49c3-b86c-0065b5065ddb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:42:39.986804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f39d6170-162d-49c3-b86c-0065b5065ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:40.022354 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:40.102115 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4081/8149] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:42:40.103998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c64a93-1c44-4419-9c92-059ef02c8d32 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:40.104513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c64a93-1c44-4419-9c92-059ef02c8d32 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:40.104513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c64a93-1c44-4419-9c92-059ef02c8d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:40.140626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-80c64a93-1c44-4419-9c92-059ef02c8d32 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:42:40.147348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-80c64a93-1c44-4419-9c92-059ef02c8d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:40.206961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6170-162d-49c3-b86c-0065b5065ddb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:40.221380 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4069/8150] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:42:40.225581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6170-162d-49c3-b86c-0065b5065ddb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:40.237457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:40.237934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:40.238371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:40.240718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:40.240718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:42:40.240718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:40.242695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:40.270579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c64a93-1c44-4419-9c92-059ef02c8d32 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:40.278162 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4082/8151] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:42:40.282471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c64a93-1c44-4419-9c92-059ef02c8d32 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:40.295580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:40.297064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:40.297685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:40.298206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:40.299099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:40.301586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:40.410494 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4070/8152] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:42:40 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:42:40.415091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:40.436618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9989ada-c1e3-43fa-bf8d-09306070501f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:40.641354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:40.642019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:40.642314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:40.642727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:40.643444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:40.649731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:40.702489 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4083/8153] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:42:40 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:42:40.703524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:40.735522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf08a7d-12ef-4dea-8b6c-1009768cfbd9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:40.752371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:40.771201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:40.771556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:40.774608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:40.780286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:40.790794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:40.849826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:40.859606 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4071/8154] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:42:40.865476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e6f0-d6a2-4bdc-a3eb-531977adb0d0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:40.890051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911f0ed-36de-4143-8240-5df8cb713464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:40.890051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f0ed-36de-4143-8240-5df8cb713464 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:40.890051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f0ed-36de-4143-8240-5df8cb713464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:40.890051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f0ed-36de-4143-8240-5df8cb713464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:40.890640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911f0ed-36de-4143-8240-5df8cb713464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:40.890640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911f0ed-36de-4143-8240-5df8cb713464 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:40.912193 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4084/8155] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:42:40.918126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:40.961886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b175c-64be-4105-8363-f4239e5987bc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:40.983439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:40.984072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:40.984375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:40.984619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] PATH_INFO: `/v3/projects/578601c1ca43479698cf9f15826f2c42/users/1ee3cbfc1ea34cb294307e23ffb3be37/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:41.039591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578601c1ca43479698cf9f15826f2c42, user_id=1ee3cbfc1ea34cb294307e23ffb3be37, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:41.078903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:41.108232 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4072/8156] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:42:40 2022] PUT /identity/v3/projects/578601c1ca43479698cf9f15826f2c42/users/1ee3cbfc1ea34cb294307e23ffb3be37/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:42:41.119845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:41.120852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:41.121356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:41.221610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] MFA Rules not processed for user `1ee3cbfc1ea34cb294307e23ffb3be37`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:42:41.224421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:41.414857 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4085/8157] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:42:41.428086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:41.431136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:41.471563 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:41.563952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b22a8-3ae0-47f7-bd3c-96db17f95e46 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:41.569065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:41.571241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:41.571821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:41.572341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:41.583848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:41.586807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:41.612433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4073/8158] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:42:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:42:49.983967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:49.986511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:50.031210 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:50.169078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ebc2f-11db-468e-a413-04ba1a3e66b2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:50.182331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:50.183366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:50.183980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:50.184490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:50.186671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:50.226609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:50.230153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:50.266903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4086/8159] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:42:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:42:51.300137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:51.319205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c4111-6fdf-4cbc-8305-12eb55c5092e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:51.331500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:51.332570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:51.333048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:51.333489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:51.339065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:51.373247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:51.375073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:51.391056 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4074/8160] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:42:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:42:53.984505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:42:53.986925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:54.206880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc92d3-a8f8-4668-bb57-454c55bfb552 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:42:54.211721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149b2e-6ef4-4f83-8716-84139aeb0a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:42:54.213249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149b2e-6ef4-4f83-8716-84139aeb0a1a service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:42:54.213718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149b2e-6ef4-4f83-8716-84139aeb0a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:42:54.214185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149b2e-6ef4-4f83-8716-84139aeb0a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:42:54.216988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40149b2e-6ef4-4f83-8716-84139aeb0a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:42:54.383600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149b2e-6ef4-4f83-8716-84139aeb0a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:42:54.387624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149b2e-6ef4-4f83-8716-84139aeb0a1a service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:42:54.401730 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4087/8161] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:42:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:43:01.381343 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=23 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:04.396299 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=76 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:06.965517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:06.980387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406157-86da-494c-9eac-cfe4026406c4 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:06.984915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:06.985557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:06.985898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:06.986237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:06.988753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:07.066935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:07.068497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:07.094682 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4075/8162] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:43:17.090975 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=32 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:24.257734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:24.263463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:24.263859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:24.322732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] MFA Rules not processed for user `6a5f1b1c768b43be80f4e2a89694a811`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:24.326665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:24.433094 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4088/8163] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:26.425614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:26.427679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:26.660218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a4192-e799-44ea-bb3b-9de1ea68c1a1 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:26.669506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df675d4-b0dd-456a-8f19-c34c5071262f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:26.671304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df675d4-b0dd-456a-8f19-c34c5071262f service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:26.671894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df675d4-b0dd-456a-8f19-c34c5071262f service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:26.672357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df675d4-b0dd-456a-8f19-c34c5071262f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:26.675284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0df675d4-b0dd-456a-8f19-c34c5071262f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:26.708420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df675d4-b0dd-456a-8f19-c34c5071262f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:26.710989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df675d4-b0dd-456a-8f19-c34c5071262f service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:26.743798 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4076/8164] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:43:27.104913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:27.107406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:27.260340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748e7e1-2f94-4b32-bc97-d4a9491bd7ea None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:27.265549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:27.266221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:27.266503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:27.267670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] PATH_INFO: `/v3/users/e7c7275fcd4c429693f41619b780d48e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:27.269145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c7275fcd4c429693f41619b780d48e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:27.273097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:27.384995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c7275fcd4c429693f41619b780d48e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:27.397847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c7275fcd4c429693f41619b780d48e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:27.398836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c7275fcd4c429693f41619b780d48e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:27.413488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c7275fcd4c429693f41619b780d48e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:27.422284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c7275fcd4c429693f41619b780d48e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:27.473255 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4089/8165] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:43:27 2022] DELETE /identity/v3/users/e7c7275fcd4c429693f41619b780d48e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:27.478093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:27.479076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:27.479570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:27.513967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:27.515597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:27.639084 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4077/8166] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:27.649447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:27.651232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:27.706126 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:27.855299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec0ca-1989-41a3-b1f9-6ad65f944d59 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:27.868352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a693b3-0e92-4319-abb8-e728d9e64e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:27.869016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a693b3-0e92-4319-abb8-e728d9e64e9c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:27.872677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a693b3-0e92-4319-abb8-e728d9e64e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:27.872990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a693b3-0e92-4319-abb8-e728d9e64e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:27.906055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a693b3-0e92-4319-abb8-e728d9e64e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:27.936035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a693b3-0e92-4319-abb8-e728d9e64e9c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:27.970868 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4090/8167] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:43:28.376662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:28.378655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:28.407003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba316e1-c0a1-4857-b9e4-da76ca80d643 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:28.419484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:28.420469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:28.421186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:28.421621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] PATH_INFO: `/v3/projects/08fabbf481a849f5adab42c5095c07c4` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:28.423134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fabbf481a849f5adab42c5095c07c4)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:28.426558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:28.527949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fabbf481a849f5adab42c5095c07c4', 'request_id': 'req-1bb620cd-9a38-4940-9201-840d7022be5d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:28.538094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fabbf481a849f5adab42c5095c07c4', 'request_id': 'req-1bb620cd-9a38-4940-9201-840d7022be5d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:28.546691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fabbf481a849f5adab42c5095c07c4', 'request_id': 'req-1bb620cd-9a38-4940-9201-840d7022be5d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:28.602760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] The token cache is being invalidate because project 08fabbf481a849f5adab42c5095c07c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:43:28.606448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:28.609122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1bb620cd-9a38-4940-9201-840d7022be5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:28.616923 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4078/8168] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:43:28 2022] DELETE /identity/v3/projects/08fabbf481a849f5adab42c5095c07c4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:43:28.621960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7d09-7ce4-4299-9326-c67e0d37786a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:28.622440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7d09-7ce4-4299-9326-c67e0d37786a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:28.622528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7d09-7ce4-4299-9326-c67e0d37786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:28.668706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-48aa7d09-7ce4-4299-9326-c67e0d37786a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:28.670296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48aa7d09-7ce4-4299-9326-c67e0d37786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:28.771633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4091/8169] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:28.781027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2cd6-69f4-468f-b32a-1c63d44ffa3c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:28.781488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2cd6-69f4-468f-b32a-1c63d44ffa3c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:28.781488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2cd6-69f4-468f-b32a-1c63d44ffa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:28.813139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e95f2cd6-69f4-468f-b32a-1c63d44ffa3c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:28.814143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e95f2cd6-69f4-468f-b32a-1c63d44ffa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:28.825604 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4079/8170] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:28.829505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa7d09-7ce4-4299-9326-c67e0d37786a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:28.840297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa7d09-7ce4-4299-9326-c67e0d37786a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:28.857058 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:28.857718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:28.858000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:28.858269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:28.859026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:43:28.859331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:28.860994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:28.878556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4092/8171] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:43:28.879723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2cd6-69f4-468f-b32a-1c63d44ffa3c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:28.890020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2cd6-69f4-468f-b32a-1c63d44ffa3c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:28.898172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:28.898882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:28.899170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:28.899443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:28.900102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:28.903067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:28.910648 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:28.985300 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4080/8172] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:43:28 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:43:28.989191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:28.999959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcded5b-3704-47e9-9988-6a230571d77d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:29.148403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:29.148911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:29.149708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:29.149982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:29.151024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:29.153558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:29.221341 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4093/8173] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:43:28 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:43:29.222006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:29.237966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8aa746-a15b-48d6-bcaa-ec5bb0513b9d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:29.248064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:29.248794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:29.249339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:29.249682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:29.250860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:29.253058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:29.270093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4081/8174] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:43:29.274443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:29.286430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0657-36c9-4312-adc1-fa2b8ce57932 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:29.300253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1482765-b8bd-4c87-a036-cb2ea03d69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:29.301666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1482765-b8bd-4c87-a036-cb2ea03d69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:29.302071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1482765-b8bd-4c87-a036-cb2ea03d69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:29.302611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1482765-b8bd-4c87-a036-cb2ea03d69d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:29.304096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1482765-b8bd-4c87-a036-cb2ea03d69d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:29.306948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1482765-b8bd-4c87-a036-cb2ea03d69d4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:29.328459 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4094/8175] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:43:29.329613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:29.357808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7efac2-8a89-4ced-953c-f04e598155fd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:29.368008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:29.368885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:29.369531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:29.370086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] PATH_INFO: `/v3/projects/03c51cdbfaa44a58a3dbae2b1dd4e32f/users/7557e79a8419488781c13d2f2403d00d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:29.407183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c51cdbfaa44a58a3dbae2b1dd4e32f, user_id=7557e79a8419488781c13d2f2403d00d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:29.411273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:29.442110 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4082/8176] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:43:29 2022] PUT /identity/v3/projects/03c51cdbfaa44a58a3dbae2b1dd4e32f/users/7557e79a8419488781c13d2f2403d00d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:29.453074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a37e-b4cc-4c06-a547-f9f2fc21f17f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:29.453331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a37e-b4cc-4c06-a547-f9f2fc21f17f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:29.453539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a37e-b4cc-4c06-a547-f9f2fc21f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:29.526845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2191a37e-b4cc-4c06-a547-f9f2fc21f17f None None] MFA Rules not processed for user `7557e79a8419488781c13d2f2403d00d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:29.530331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2191a37e-b4cc-4c06-a547-f9f2fc21f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:29.582251 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:29.674617 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4095/8177] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:29.689994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:29.693706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:29.825842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991a700-2ded-423a-8002-1a6c927a7146 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:29.837425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:29.847327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:29.847621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:29.847901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:29.868647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:29.870420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:29.899922 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4083/8178] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:43:32.242320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a37e-b4cc-4c06-a547-f9f2fc21f17f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:32.263910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a37e-b4cc-4c06-a547-f9f2fc21f17f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:32.275676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119fd7-992a-41eb-af0c-298f8a8c9cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:32.276500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119fd7-992a-41eb-af0c-298f8a8c9cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:32.276882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119fd7-992a-41eb-af0c-298f8a8c9cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:32.277064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119fd7-992a-41eb-af0c-298f8a8c9cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:32.285988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8c119fd7-992a-41eb-af0c-298f8a8c9cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:32.326295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119fd7-992a-41eb-af0c-298f8a8c9cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:32.327978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119fd7-992a-41eb-af0c-298f8a8c9cd0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:32.346342 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4096/8179] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:43:38.090707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:38.092194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:38.277103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e4315-d920-4504-af44-cb1e1cebfea3 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:38.291181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:38.291862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:38.292146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:38.292424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] PATH_INFO: `/v3/users/1ee3cbfc1ea34cb294307e23ffb3be37` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:38.295512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee3cbfc1ea34cb294307e23ffb3be37)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:38.304078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:38.404851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee3cbfc1ea34cb294307e23ffb3be37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:38.417830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee3cbfc1ea34cb294307e23ffb3be37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:38.420175 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:38.443141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee3cbfc1ea34cb294307e23ffb3be37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:38.445950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee3cbfc1ea34cb294307e23ffb3be37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:38.462060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee3cbfc1ea34cb294307e23ffb3be37'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:38.476872 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4084/8180] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:43:38 2022] DELETE /identity/v3/users/1ee3cbfc1ea34cb294307e23ffb3be37 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:38.477327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:38.477773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:38.478697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:38.514802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:38.516597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:38.609046 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4097/8181] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:43:38.623707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:38.628347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:38.741977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d1154-0304-4c4b-887d-dabefb693575 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:38.746870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2920e-4753-4c36-a8a9-9d8141d553fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:38.747525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2920e-4753-4c36-a8a9-9d8141d553fe service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:38.747799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2920e-4753-4c36-a8a9-9d8141d553fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:38.748077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2920e-4753-4c36-a8a9-9d8141d553fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:38.796487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2920e-4753-4c36-a8a9-9d8141d553fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:38.797379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2920e-4753-4c36-a8a9-9d8141d553fe service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:38.823501 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4085/8182] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:43:39.216156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:39.217661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:39.247599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7d42-7c38-42a1-af11-9aeef48f254a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:39.270724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:39.271661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:39.272083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:39.272506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] PATH_INFO: `/v3/projects/578601c1ca43479698cf9f15826f2c42` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:39.273923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=578601c1ca43479698cf9f15826f2c42)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:39.276340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:39.390119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578601c1ca43479698cf9f15826f2c42', 'request_id': 'req-19950f33-59e7-4ff7-a7e5-14294a3b63ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:39.404532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578601c1ca43479698cf9f15826f2c42', 'request_id': 'req-19950f33-59e7-4ff7-a7e5-14294a3b63ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:39.419412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578601c1ca43479698cf9f15826f2c42', 'request_id': 'req-19950f33-59e7-4ff7-a7e5-14294a3b63ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:39.452166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] The token cache is being invalidate because project 578601c1ca43479698cf9f15826f2c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:43:39.452456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:39.453156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-19950f33-59e7-4ff7-a7e5-14294a3b63ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:39.454784 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4098/8183] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:43:39 2022] DELETE /identity/v3/projects/578601c1ca43479698cf9f15826f2c42 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:39.459920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34fb4e-4498-4b27-9ad5-a4855f1721a4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:39.460493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34fb4e-4498-4b27-9ad5-a4855f1721a4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:39.460493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34fb4e-4498-4b27-9ad5-a4855f1721a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:39.487913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1f34fb4e-4498-4b27-9ad5-a4855f1721a4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:39.489265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1f34fb4e-4498-4b27-9ad5-a4855f1721a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:39.613020 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4086/8184] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:43:39.617091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36cab-c031-4588-9a4d-60202c99f6f8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:39.617540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36cab-c031-4588-9a4d-60202c99f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:39.617742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36cab-c031-4588-9a4d-60202c99f6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:39.664253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-17a36cab-c031-4588-9a4d-60202c99f6f8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:39.666203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-17a36cab-c031-4588-9a4d-60202c99f6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:39.696461 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4099/8185] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:43:39.697754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34fb4e-4498-4b27-9ad5-a4855f1721a4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:39.714253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34fb4e-4498-4b27-9ad5-a4855f1721a4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:39.720475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:39.721294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:39.721671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:39.722053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:39.722826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:43:39.723224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:39.725838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:39.741200 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4087/8186] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:43:39.745680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a36cab-c031-4588-9a4d-60202c99f6f8 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:39.762571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a36cab-c031-4588-9a4d-60202c99f6f8 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:39.774720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:39.775705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:39.775984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:39.776255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:39.776953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:39.779025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:39.835538 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4100/8187] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:43:39.840597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:39.857561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d0d9f-c7cb-48f3-b13e-46b8af46b0ae admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:39.934740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:39.935382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:39.935664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:39.935937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:39.936584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:39.938629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:39.949051 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:39.978662 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4088/8188] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:43:39 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:43:39.982739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:39.992581 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:39.997102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db6f25-f99b-4e81-bf81-1ca5df0e00ac admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:40.015305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:40.016193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:40.016478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:40.016750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:40.017470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:40.019089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:40.038269 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4101/8189] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:43:40.042228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:40.058075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6a9c7-69f3-4a50-8abf-209f6c661ccc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:40.064612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cee94-baa1-464f-8415-96862c2bb0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:40.066201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cee94-baa1-464f-8415-96862c2bb0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:40.066765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cee94-baa1-464f-8415-96862c2bb0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:40.067191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cee94-baa1-464f-8415-96862c2bb0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:40.068613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cee94-baa1-464f-8415-96862c2bb0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:40.070589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cee94-baa1-464f-8415-96862c2bb0b8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:40.086447 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4089/8190] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:43:40.090394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:40.103160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c40ac-e644-4e9c-b1d5-25f4bb160746 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:40.109360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:40.110049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:40.110484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:40.110917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] PATH_INFO: `/v3/projects/2244627ee7754e4e8c97e3a9ae270809/users/adb404264c3e41038f88a673d2558f2b/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:40.139240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2244627ee7754e4e8c97e3a9ae270809, user_id=adb404264c3e41038f88a673d2558f2b, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:40.143163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:40.169787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4102/8191] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:43:40 2022] PUT /identity/v3/projects/2244627ee7754e4e8c97e3a9ae270809/users/adb404264c3e41038f88a673d2558f2b/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:40.180516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128181-f3b3-47f8-a39b-49a52b73b00e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:40.181343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128181-f3b3-47f8-a39b-49a52b73b00e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:40.181805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128181-f3b3-47f8-a39b-49a52b73b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:40.247790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cb128181-f3b3-47f8-a39b-49a52b73b00e None None] MFA Rules not processed for user `adb404264c3e41038f88a673d2558f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:40.249287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb128181-f3b3-47f8-a39b-49a52b73b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:40.376065 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4090/8192] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:40.389772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:40.391675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:40.487571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e89479-f0f0-4be8-9d7d-0dc6c5f6d179 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:40.491660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf31f9-32ee-4492-9e4a-8c9ae265b489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:40.492302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf31f9-32ee-4492-9e4a-8c9ae265b489 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:40.492590 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf31f9-32ee-4492-9e4a-8c9ae265b489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:40.492888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf31f9-32ee-4492-9e4a-8c9ae265b489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:40.503285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf31f9-32ee-4492-9e4a-8c9ae265b489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:40.505322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf31f9-32ee-4492-9e4a-8c9ae265b489 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:40.516715 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4103/8193] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:43:40.926323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128181-f3b3-47f8-a39b-49a52b73b00e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:41.023719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128181-f3b3-47f8-a39b-49a52b73b00e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:41.030303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:41.031382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:41.031899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:41.032724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] PATH_INFO: `/v3/users/adb404264c3e41038f88a673d2558f2b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:41.034335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb404264c3e41038f88a673d2558f2b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:41.036596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:41.128102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb404264c3e41038f88a673d2558f2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:41.139742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb404264c3e41038f88a673d2558f2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:41.158849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb404264c3e41038f88a673d2558f2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:41.159761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb404264c3e41038f88a673d2558f2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:41.161669 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:41.170655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb404264c3e41038f88a673d2558f2b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:41.179966 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4091/8194] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:43:40 2022] DELETE /identity/v3/users/adb404264c3e41038f88a673d2558f2b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:41.184412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:41.185257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:41.185998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:41.207345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:41.208803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:41.282409 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4104/8195] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:41.293037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:41.294883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:41.367930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab95c0-6dc1-4f56-9fbd-903c030308c5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:41.372230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ae075-5f0c-4b0d-9bc1-ea7198102b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:41.373003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae075-5f0c-4b0d-9bc1-ea7198102b43 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:41.373394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae075-5f0c-4b0d-9bc1-ea7198102b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:41.373753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae075-5f0c-4b0d-9bc1-ea7198102b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:41.385523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ae075-5f0c-4b0d-9bc1-ea7198102b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:41.386454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ae075-5f0c-4b0d-9bc1-ea7198102b43 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:41.397980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4092/8196] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:43:41.845623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:41.847373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:41.877675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43ae14-a322-49dc-9564-475742b6d024 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:41.901515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:41.902451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:41.902866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:41.903855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] PATH_INFO: `/v3/projects/2244627ee7754e4e8c97e3a9ae270809` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:41.905460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2244627ee7754e4e8c97e3a9ae270809)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:41.908843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:41.996114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2244627ee7754e4e8c97e3a9ae270809', 'request_id': 'req-f9481ac7-981e-4761-bf71-265f42cdc6fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:42.008223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2244627ee7754e4e8c97e3a9ae270809', 'request_id': 'req-f9481ac7-981e-4761-bf71-265f42cdc6fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:42.018834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2244627ee7754e4e8c97e3a9ae270809', 'request_id': 'req-f9481ac7-981e-4761-bf71-265f42cdc6fb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:42.022971 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:42.038996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] The token cache is being invalidate because project 2244627ee7754e4e8c97e3a9ae270809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:43:42.040109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:42.041967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:43:42.050128 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4105/8197] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:43:41 2022] DELETE /identity/v3/projects/2244627ee7754e4e8c97e3a9ae270809 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:42.050512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f739b-62e2-4035-8e18-33add8708f26 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.051040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f739b-62e2-4035-8e18-33add8708f26 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.051040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f739b-62e2-4035-8e18-33add8708f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.075264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7f3f739b-62e2-4035-8e18-33add8708f26 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:42.077028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7f3f739b-62e2-4035-8e18-33add8708f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:42.185318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.187130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:42.213788 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4093/8198] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:42.215363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc551-4881-4708-a603-3c4e12b4e554 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.215653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc551-4881-4708-a603-3c4e12b4e554 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.215929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc551-4881-4708-a603-3c4e12b4e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.237785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-637bc551-4881-4708-a603-3c4e12b4e554 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:42.239016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-637bc551-4881-4708-a603-3c4e12b4e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:42.250543 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4094/8199] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:42.257296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc551-4881-4708-a603-3c4e12b4e554 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.281865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc551-4881-4708-a603-3c4e12b4e554 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:42.288751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:42.291632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.291902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.292176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.292856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:43:42.293166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:42.294805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:42.314873 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4095/8200] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:43:42.315856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.325442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481ac7-981e-4761-bf71-265f42cdc6fb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:42.329624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f013a-4742-4d52-849a-b8315d709cdc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:42.334507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:42.335143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.335419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.335690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.335994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:42.336351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:42.336660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.336965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.337239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.338301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:42.344238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:42.363788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:42.365838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:42.384214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4096/8201] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:43:42 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:43:42.385558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.387969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4106/8202] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:43:42.455458 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:42.471157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8919f-1e2d-4c67-af2a-54376177e32a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:42.476511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:42.477464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.477800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.478084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.478727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:42.481540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:42.512817 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4097/8203] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:43:42 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:43:42.515023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.538093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9918f-8b81-4883-98ee-2b2749dee3b8 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:42.543687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:42.544803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.544803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.545233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.545887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:42.547784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:42.564613 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4107/8204] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:43:42.565894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.579203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499e108-0922-49a6-8bcf-1698de83ad8a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:42.584513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79181b-441c-4273-89cb-fef5302c2392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:42.585177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79181b-441c-4273-89cb-fef5302c2392 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.585462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79181b-441c-4273-89cb-fef5302c2392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.585733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79181b-441c-4273-89cb-fef5302c2392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.586415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79181b-441c-4273-89cb-fef5302c2392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:42.588042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79181b-441c-4273-89cb-fef5302c2392 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:42.602751 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4098/8205] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:43:42.604261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.614852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e9676-50ae-4b5a-a0a7-006c8e7cfb60 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:42.620969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:42.621741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.622084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.622429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] PATH_INFO: `/v3/projects/8e2d79ae10e44446990d8a06ca5ce0ad/users/b9cf037b5506485a81e6359310a9398d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.645356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2d79ae10e44446990d8a06ca5ce0ad, user_id=b9cf037b5506485a81e6359310a9398d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:42.651620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:42.681930 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4108/8206] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:43:42 2022] PUT /identity/v3/projects/8e2d79ae10e44446990d8a06ca5ce0ad/users/b9cf037b5506485a81e6359310a9398d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:43:42.683831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:42.689388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:42.689835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:42.743438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] MFA Rules not processed for user `b9cf037b5506485a81e6359310a9398d`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:43:42.746827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:42.925307 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4099/8207] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:43:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:43:42.937890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:42.940615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:43.020336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7932-3518-43fe-afc1-40d2675fca42 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:43.024973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:43.025927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:43.026448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:43.026815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:43.040386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:43.042018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:43.054498 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4109/8208] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:43:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:43:43.499673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:43:43.501712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:43.640008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163be245-5eb0-4b15-ab78-34b06d5daf3a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:43:43.648425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a5008-1fb2-40c0-adeb-d3161defac72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:43:43.649428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5008-1fb2-40c0-adeb-d3161defac72 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:43:43.649813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5008-1fb2-40c0-adeb-d3161defac72 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:43:43.650641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5008-1fb2-40c0-adeb-d3161defac72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:43:43.654982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b14a5008-1fb2-40c0-adeb-d3161defac72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:43:43.755056 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:43.758454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a5008-1fb2-40c0-adeb-d3161defac72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:43:43.760441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a5008-1fb2-40c0-adeb-d3161defac72 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:43:43.774347 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4100/8209] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:43:53.048064 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:53.775371 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:01.103500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:01.105106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:01.250409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa920-57f1-49ca-ada8-381412bbd439 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:01.274877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:01.277098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:01.278970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:01.281565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] PATH_INFO: `/v3/users/7557e79a8419488781c13d2f2403d00d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:01.286311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7557e79a8419488781c13d2f2403d00d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:01.293843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:01.412294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7557e79a8419488781c13d2f2403d00d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:01.427114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7557e79a8419488781c13d2f2403d00d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:01.427643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7557e79a8419488781c13d2f2403d00d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:01.438913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7557e79a8419488781c13d2f2403d00d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:01.439669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7557e79a8419488781c13d2f2403d00d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:01.471119 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4110/8210] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:44:01 2022] DELETE /identity/v3/users/7557e79a8419488781c13d2f2403d00d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:01.475485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:01.476328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:01.476794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:01.537921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:01.539382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:01.664990 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4101/8211] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:01.677389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:01.678909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:01.783580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614439db-c43e-4ba0-b537-030edb3da4a0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:01.788570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13016e4-77b3-44c4-bf96-93427407181f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:01.790053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13016e4-77b3-44c4-bf96-93427407181f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:01.790407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13016e4-77b3-44c4-bf96-93427407181f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:01.791670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13016e4-77b3-44c4-bf96-93427407181f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:01.803096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13016e4-77b3-44c4-bf96-93427407181f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:01.804639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13016e4-77b3-44c4-bf96-93427407181f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:01.815914 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4111/8212] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:44:02.195903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:02.199052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:02.227743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf224ff-bbfa-4fad-888b-333634dc73da None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:02.257472 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:02.258416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:02.258714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:02.258995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] PATH_INFO: `/v3/projects/03c51cdbfaa44a58a3dbae2b1dd4e32f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:02.261899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c51cdbfaa44a58a3dbae2b1dd4e32f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:02.268670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:02.412274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c51cdbfaa44a58a3dbae2b1dd4e32f', 'request_id': 'req-87281214-abf4-4548-a0bf-cca2d618e970'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:02.423652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c51cdbfaa44a58a3dbae2b1dd4e32f', 'request_id': 'req-87281214-abf4-4548-a0bf-cca2d618e970'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:02.477773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c51cdbfaa44a58a3dbae2b1dd4e32f', 'request_id': 'req-87281214-abf4-4548-a0bf-cca2d618e970'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:02.502195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] The token cache is being invalidate because project 03c51cdbfaa44a58a3dbae2b1dd4e32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:44:02.502480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:02.503329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-87281214-abf4-4548-a0bf-cca2d618e970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:02.505734 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4102/8213] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:44:02 2022] DELETE /identity/v3/projects/03c51cdbfaa44a58a3dbae2b1dd4e32f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:02.510851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef478ef-f80f-4b7f-84ce-3efa181abeeb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:02.511661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef478ef-f80f-4b7f-84ce-3efa181abeeb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:02.511937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef478ef-f80f-4b7f-84ce-3efa181abeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:02.586427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9ef478ef-f80f-4b7f-84ce-3efa181abeeb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:02.590222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9ef478ef-f80f-4b7f-84ce-3efa181abeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:02.673267 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:02.795365 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4112/8214] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:44:02.797432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277659-6e63-4a61-9ebc-3c4faa7f1ad4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:02.800029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277659-6e63-4a61-9ebc-3c4faa7f1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:02.800029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277659-6e63-4a61-9ebc-3c4faa7f1ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:02.833185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dc277659-6e63-4a61-9ebc-3c4faa7f1ad4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:02.834741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dc277659-6e63-4a61-9ebc-3c4faa7f1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:02.858356 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4103/8215] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:02.864422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef478ef-f80f-4b7f-84ce-3efa181abeeb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:02.876914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef478ef-f80f-4b7f-84ce-3efa181abeeb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:02.886887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:02.887779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:02.888124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:02.888476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:02.889588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:44:02.889982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:02.892597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:02.915976 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4113/8216] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:44:02.917432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277659-6e63-4a61-9ebc-3c4faa7f1ad4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:02.934377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277659-6e63-4a61-9ebc-3c4faa7f1ad4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:02.954413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:02.955056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:02.955331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:02.955597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:02.956229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:02.958368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:03.056963 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4104/8217] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:44:02 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:03.061806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:03.079550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ab75-bc7d-4b88-94a3-bed7af4ae353 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:03.212967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:03.213677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:03.213950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:03.214215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:03.216979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:03.219044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:03.255434 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4114/8218] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:44:03 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:03.266601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:03.284481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8ebe-33ef-463c-98c5-8179565d795f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:03.291565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:03.297360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:03.297360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:03.297360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:03.297360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:03.297360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:03.314803 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4105/8219] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:03.316228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:03.331457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68079950-20e0-4c36-b38f-5043b1914f56 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:03.340900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72aa9-9495-4c19-9637-f6e07e370475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:03.341658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72aa9-9495-4c19-9637-f6e07e370475 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:03.341999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72aa9-9495-4c19-9637-f6e07e370475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:03.342328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72aa9-9495-4c19-9637-f6e07e370475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:03.343050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b72aa9-9495-4c19-9637-f6e07e370475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:03.344954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b72aa9-9495-4c19-9637-f6e07e370475 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:03.378600 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4115/8220] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:03.380281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:03.395976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945ae6a-5c53-4a43-bb03-0c6f6aa731f0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:03.405672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:03.406713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:03.407085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:03.407433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] PATH_INFO: `/v3/projects/3aa2a73bb0624619abbe3508e9b9a26b/users/3231c0827c0742d4af48d2e13f442d25/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:03.450497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa2a73bb0624619abbe3508e9b9a26b, user_id=3231c0827c0742d4af48d2e13f442d25, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:03.453427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:03.474467 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4106/8221] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:03 2022] PUT /identity/v3/projects/3aa2a73bb0624619abbe3508e9b9a26b/users/3231c0827c0742d4af48d2e13f442d25/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:03.484497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:03.485046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:03.485471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:03.517773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] MFA Rules not processed for user `3231c0827c0742d4af48d2e13f442d25`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:03.519801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:03.595862 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4116/8222] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:44:03.623113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:03.625059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:03.667799 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:03.730742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea581-eb24-4879-9835-617470a1a54d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:03.735716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:03.737055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:03.737566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:03.738141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:03.754949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:03.756901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:03.768967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4107/8223] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:08.704687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:08.706457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:08.796550 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:08.886678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3c539-0278-4edf-8bb1-7eaddff7c5b5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:08.897315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8b39-5eae-4cf3-bf14-3de6e2d049e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:08.897940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8b39-5eae-4cf3-bf14-3de6e2d049e1 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:08.898222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8b39-5eae-4cf3-bf14-3de6e2d049e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:08.898539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8b39-5eae-4cf3-bf14-3de6e2d049e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:08.900729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9c7c8b39-5eae-4cf3-bf14-3de6e2d049e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:08.993287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8b39-5eae-4cf3-bf14-3de6e2d049e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:08.995584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8b39-5eae-4cf3-bf14-3de6e2d049e1 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:09.008147 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4117/8224] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:44:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 655 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:44:13.764073 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=17 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:16.921888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:17.041109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923a65a-6dd0-48c0-bfc6-f5f043482274 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:17.051852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:17.053825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:17.054108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:17.061670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] PATH_INFO: `/v3/users/3231c0827c0742d4af48d2e13f442d25` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:17.061670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3231c0827c0742d4af48d2e13f442d25)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:17.061670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:17.159929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3231c0827c0742d4af48d2e13f442d25'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:17.175286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3231c0827c0742d4af48d2e13f442d25'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:17.198174 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3231c0827c0742d4af48d2e13f442d25'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:17.198921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3231c0827c0742d4af48d2e13f442d25'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:17.210847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3231c0827c0742d4af48d2e13f442d25'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:17.220375 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4108/8225] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:44:16 2022] DELETE /identity/v3/users/3231c0827c0742d4af48d2e13f442d25 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:17.221375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:17.221842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:17.221916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:17.257788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:17.259248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:17.361015 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4118/8226] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:44:17.377854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:17.381649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:17.497721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec12b-989c-4132-afae-021f5f6fd347 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:17.518604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf366b3-69d8-4403-970c-329ab3d42327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:17.519873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf366b3-69d8-4403-970c-329ab3d42327 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:17.520360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf366b3-69d8-4403-970c-329ab3d42327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:17.520796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf366b3-69d8-4403-970c-329ab3d42327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:17.542549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf366b3-69d8-4403-970c-329ab3d42327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:17.544376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf366b3-69d8-4403-970c-329ab3d42327 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:17.572393 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4109/8227] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:17.977915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:17.979353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:18.002685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989046d4-4a81-4be5-87af-a8944b35c9f1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:18.008497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:18.009367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.009796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.010300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] PATH_INFO: `/v3/projects/3aa2a73bb0624619abbe3508e9b9a26b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.012041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa2a73bb0624619abbe3508e9b9a26b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:18.015707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:18.113781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa2a73bb0624619abbe3508e9b9a26b', 'request_id': 'req-5d2fd762-158d-4dd3-a624-338148bcc16a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:18.124410 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:18.143238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa2a73bb0624619abbe3508e9b9a26b', 'request_id': 'req-5d2fd762-158d-4dd3-a624-338148bcc16a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:18.156376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa2a73bb0624619abbe3508e9b9a26b', 'request_id': 'req-5d2fd762-158d-4dd3-a624-338148bcc16a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:18.178614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] The token cache is being invalidate because project 3aa2a73bb0624619abbe3508e9b9a26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:44:18.179678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:18.180887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5d2fd762-158d-4dd3-a624-338148bcc16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:18.183459 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4119/8228] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:44:17 2022] DELETE /identity/v3/projects/3aa2a73bb0624619abbe3508e9b9a26b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:18.188173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef64bc-81e6-44ff-8a84-d4620883a529 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.188675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef64bc-81e6-44ff-8a84-d4620883a529 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.188973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef64bc-81e6-44ff-8a84-d4620883a529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.237419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b6ef64bc-81e6-44ff-8a84-d4620883a529 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:18.240342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6ef64bc-81e6-44ff-8a84-d4620883a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:18.273340 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:18.434397 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4110/8229] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:18.443728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f3fb-07b0-42e7-94f2-69889de457a7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.450819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f3fb-07b0-42e7-94f2-69889de457a7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.451353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f3fb-07b0-42e7-94f2-69889de457a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.493040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3485f3fb-07b0-42e7-94f2-69889de457a7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:18.498348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3485f3fb-07b0-42e7-94f2-69889de457a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:18.536641 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4120/8230] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:18.536907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef64bc-81e6-44ff-8a84-d4620883a529 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:18.541849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef64bc-81e6-44ff-8a84-d4620883a529 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:18.554480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:18.555138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.555414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.555685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.556357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:44:18.556656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:18.562709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:18.596793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f3fb-07b0-42e7-94f2-69889de457a7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:18.597139 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4111/8231] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:44:18.615812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f3fb-07b0-42e7-94f2-69889de457a7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:18.641025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:18.642913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.643462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.643893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.645564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:18.647704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:18.711358 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4121/8232] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:44:18 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:18.715484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:18.730867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f36913-a2b9-4874-825f-65b2e0ff1ea3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:18.819036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:18.819938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.820284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.820635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.822327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:18.823672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:18.861881 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4112/8233] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:44:18 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:18.866152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:18.884163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0775-1261-4d4c-b9e3-31f8880ca6ce admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:18.900571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:18.901311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.901840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.901958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.902571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:18.904334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:18.934227 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4122/8234] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:18.936530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:18.949106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5568b9-fc9c-4f34-b933-adad0272fb44 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:18.954528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ebf62-b8ba-4bdc-8c4e-022cd240967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:18.955226 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebf62-b8ba-4bdc-8c4e-022cd240967c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:18.955515 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebf62-b8ba-4bdc-8c4e-022cd240967c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:18.955791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ebf62-b8ba-4bdc-8c4e-022cd240967c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:18.956456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ebf62-b8ba-4bdc-8c4e-022cd240967c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:18.961091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ebf62-b8ba-4bdc-8c4e-022cd240967c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:18.979802 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4113/8235] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:18.980710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:19.009012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc875d-b82e-49d7-b240-07470d6a19b4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:19.016922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:19.018142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:19.018612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:19.019462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] PATH_INFO: `/v3/projects/73c926ff993443faad21da1a2cd1e105/users/d232fa747b7b4b768af245e03219865a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:19.049449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c926ff993443faad21da1a2cd1e105, user_id=d232fa747b7b4b768af245e03219865a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:19.052620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:19.076998 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4123/8236] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:18 2022] PUT /identity/v3/projects/73c926ff993443faad21da1a2cd1e105/users/d232fa747b7b4b768af245e03219865a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:19.087658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99312188-8be0-40e0-a5b4-55ac78d38701 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:19.088413 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99312188-8be0-40e0-a5b4-55ac78d38701 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:19.088695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99312188-8be0-40e0-a5b4-55ac78d38701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:19.147038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-99312188-8be0-40e0-a5b4-55ac78d38701 None None] MFA Rules not processed for user `d232fa747b7b4b768af245e03219865a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:19.148293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-99312188-8be0-40e0-a5b4-55ac78d38701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:19.355748 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4114/8237] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:19.371971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:19.377423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:19.490995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069691a-f760-4f63-abde-526c2b59e0bf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:19.495885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de794a9d-2c2b-4c98-a232-10ea4eeb43d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:19.497115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de794a9d-2c2b-4c98-a232-10ea4eeb43d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:19.497458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de794a9d-2c2b-4c98-a232-10ea4eeb43d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:19.497739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de794a9d-2c2b-4c98-a232-10ea4eeb43d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:19.516093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de794a9d-2c2b-4c98-a232-10ea4eeb43d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:19.517640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de794a9d-2c2b-4c98-a232-10ea4eeb43d8 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:19.531868 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4124/8238] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:27.335370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99312188-8be0-40e0-a5b4-55ac78d38701 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:27.363599 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:27.446809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99312188-8be0-40e0-a5b4-55ac78d38701 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:27.455145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:27.456236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:27.456620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:27.456956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] PATH_INFO: `/v3/users/d232fa747b7b4b768af245e03219865a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:27.458786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d232fa747b7b4b768af245e03219865a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:27.463736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:27.559457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd232fa747b7b4b768af245e03219865a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:27.585952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd232fa747b7b4b768af245e03219865a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:27.609994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd232fa747b7b4b768af245e03219865a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:27.610776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd232fa747b7b4b768af245e03219865a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:27.622559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd232fa747b7b4b768af245e03219865a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:27.631324 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4115/8239] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:44:27 2022] DELETE /identity/v3/users/d232fa747b7b4b768af245e03219865a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:27.635375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:27.635894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:27.635991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:27.684334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:27.685648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:27.859007 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4125/8240] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:27.865390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:27.867283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:27.956360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d429120-d38d-40d2-8a48-414b4b027ff0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:27.961295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6730f0-23ea-4515-a7e4-b3543277ecb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:27.962259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6730f0-23ea-4515-a7e4-b3543277ecb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:27.963137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6730f0-23ea-4515-a7e4-b3543277ecb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:27.963137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6730f0-23ea-4515-a7e4-b3543277ecb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:27.974916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6730f0-23ea-4515-a7e4-b3543277ecb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:27.976805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6730f0-23ea-4515-a7e4-b3543277ecb9 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:27.988969 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4116/8241] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:44:28.265330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:28.267851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:28.297154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98f680-0579-4756-83a5-2ca7ac7de29c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:28.307059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:28.307728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:28.308126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:28.308403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] PATH_INFO: `/v3/projects/73c926ff993443faad21da1a2cd1e105` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:28.309755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c926ff993443faad21da1a2cd1e105)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:28.312435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:28.334969 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:28.379575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c926ff993443faad21da1a2cd1e105', 'request_id': 'req-2c48ea27-7faf-4c50-9188-7b4e51192191'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:28.389124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c926ff993443faad21da1a2cd1e105', 'request_id': 'req-2c48ea27-7faf-4c50-9188-7b4e51192191'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:28.396594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c926ff993443faad21da1a2cd1e105', 'request_id': 'req-2c48ea27-7faf-4c50-9188-7b4e51192191'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:28.411808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] The token cache is being invalidate because project 73c926ff993443faad21da1a2cd1e105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:44:28.412099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:28.413779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c48ea27-7faf-4c50-9188-7b4e51192191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:28.419967 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4126/8242] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:44:28 2022] DELETE /identity/v3/projects/73c926ff993443faad21da1a2cd1e105 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:28.422542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823e7bd-1c9a-4627-aca9-132a01e24965 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:28.423055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823e7bd-1c9a-4627-aca9-132a01e24965 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:28.423055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823e7bd-1c9a-4627-aca9-132a01e24965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:28.446826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8823e7bd-1c9a-4627-aca9-132a01e24965 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:28.448099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8823e7bd-1c9a-4627-aca9-132a01e24965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:28.543675 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:28.588319 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4117/8243] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:28.596327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aec99-0ec5-457d-b1b0-b1f97afb3270 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:28.596686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aec99-0ec5-457d-b1b0-b1f97afb3270 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:28.597134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aec99-0ec5-457d-b1b0-b1f97afb3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:28.636690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7d6aec99-0ec5-457d-b1b0-b1f97afb3270 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:28.638078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7d6aec99-0ec5-457d-b1b0-b1f97afb3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:28.661902 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4127/8244] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:28.663986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823e7bd-1c9a-4627-aca9-132a01e24965 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:28.681568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823e7bd-1c9a-4627-aca9-132a01e24965 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:28.688653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:28.689802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:28.691134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:28.691735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:28.693106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:44:28.694832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:28.698483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:28.746147 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4118/8245] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:44:28.750525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6aec99-0ec5-457d-b1b0-b1f97afb3270 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:28.770563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6aec99-0ec5-457d-b1b0-b1f97afb3270 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:28.782600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:28.783802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:28.784511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:28.785037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:28.785857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:28.788453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:28.834400 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4128/8246] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:44:28 2022] POST /identity/v3/projects => generated 355 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:28.838570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:28.853745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd16d1-cc93-48a1-9e09-991a6f6ad4ea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:29.015775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:29.016432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:29.016711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:29.017006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:29.017662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:29.019749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:29.074378 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4119/8247] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:44:28 2022] POST /identity/v3/users => generated 278 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:29.075599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:29.088621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f7e0-cbf7-44d1-9573-7f308f2ccba2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:29.097810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:29.098774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:29.099238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:29.100493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:29.101384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:29.103934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:29.131619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:29.138731 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4129/8248] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:44:29.143486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df28a8-92b3-4fa7-a837-0123d7a59780 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:29.150789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c5400-9b15-40fa-a7e0-213c8fc12852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:29.151794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5400-9b15-40fa-a7e0-213c8fc12852 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:29.152129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5400-9b15-40fa-a7e0-213c8fc12852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:29.152417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5400-9b15-40fa-a7e0-213c8fc12852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:29.153317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c5400-9b15-40fa-a7e0-213c8fc12852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:29.155021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c5400-9b15-40fa-a7e0-213c8fc12852 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:29.175677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:29.186397 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4120/8249] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:29.211920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715d07-75e0-4b7c-8800-484260639037 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:29.230326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:29.231441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:29.231921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:29.232472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] PATH_INFO: `/v3/projects/5d30a4d65d474c668ad0c6972e129218/users/a77398ee4afd421880564ae1fcd6b5fa/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:29.251527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d30a4d65d474c668ad0c6972e129218, user_id=a77398ee4afd421880564ae1fcd6b5fa, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:29.255081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:29.292234 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4130/8250] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:29 2022] PUT /identity/v3/projects/5d30a4d65d474c668ad0c6972e129218/users/a77398ee4afd421880564ae1fcd6b5fa/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:29.304628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712dba-0e95-415e-851b-c940c5a5dc61 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:29.304939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712dba-0e95-415e-851b-c940c5a5dc61 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:29.305213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712dba-0e95-415e-851b-c940c5a5dc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:29.383224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-89712dba-0e95-415e-851b-c940c5a5dc61 None None] MFA Rules not processed for user `a77398ee4afd421880564ae1fcd6b5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:29.384520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-89712dba-0e95-415e-851b-c940c5a5dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:29.592690 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4121/8251] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:29.593866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:29.789223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fccbd-863c-4ba3-8b2b-450fcf888213 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:29.801838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:29.802484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:29.802934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:29.803350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:29.804152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:29.806294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:29.845832 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:29.864654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89712dba-0e95-415e-851b-c940c5a5dc61 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:29.871233 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4131/8252] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:44:29 2022] POST /identity/v3/projects => generated 357 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:44:29.880012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89712dba-0e95-415e-851b-c940c5a5dc61 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:29.921534 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:29.997241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:29.998205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:29.999824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:30.000202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:30.002575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:30.004756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:30.063271 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4122/8253] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:44:29 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:44:30.065178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:30.078564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a04c-1b01-4c5f-b033-82ee9285e830 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:30.083807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:30.084452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:30.084730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:30.085037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:30.085747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:30.087600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:30.104914 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4132/8254] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:30.106507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:30.130041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc63cb-8085-4716-b07f-97be1ef028ea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:30.136395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:30.137162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:30.137460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:30.137752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] PATH_INFO: `/v3/projects/579d137c57d5444a9e3be49d6756dfd2/users/a6127613afd64ba291652e4a85bb339d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:30.194792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579d137c57d5444a9e3be49d6756dfd2, user_id=a6127613afd64ba291652e4a85bb339d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:30.197817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:30.230558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:30.231391 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4123/8255] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:30 2022] PUT /identity/v3/projects/579d137c57d5444a9e3be49d6756dfd2/users/a6127613afd64ba291652e4a85bb339d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:30.244436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee0ad-e3a7-492d-90e4-201b64cc4e9d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:30.401004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d443f2-2f54-4d2d-adec-26cf2750e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:30.401770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d443f2-2f54-4d2d-adec-26cf2750e4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:30.402114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d443f2-2f54-4d2d-adec-26cf2750e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:30.402455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d443f2-2f54-4d2d-adec-26cf2750e4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:30.403196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d443f2-2f54-4d2d-adec-26cf2750e4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:30.405065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d443f2-2f54-4d2d-adec-26cf2750e4fe admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:30.443376 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4133/8256] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:30.447929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:30.461056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868399-e346-48b8-bede-1bc1ba8c42a8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:30.471056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:30.472214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:30.472214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:30.472430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] PATH_INFO: `/v3/projects/579d137c57d5444a9e3be49d6756dfd2/users/a6127613afd64ba291652e4a85bb339d/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:30.474974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579d137c57d5444a9e3be49d6756dfd2, user_id=a6127613afd64ba291652e4a85bb339d, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:30.478589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:30.517456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4124/8257] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:30 2022] PUT /identity/v3/projects/579d137c57d5444a9e3be49d6756dfd2/users/a6127613afd64ba291652e4a85bb339d/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:44:30.517796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:30.518085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:30.518359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:30.592283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] MFA Rules not processed for user `a6127613afd64ba291652e4a85bb339d`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:30.593639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:30.721766 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4134/8258] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:44:30.734435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:30.737615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:30.850552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b2426-5ec1-4d47-98df-e1be95d6a5d8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:30.854683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:30.855402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:30.855749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:30.856104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:30.879435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:30.881047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:30.893493 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4125/8259] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:44:31.007752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:31.009365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:31.033291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147d422-4782-48eb-a332-d9d2509b549f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:31.042775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:31.043437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:31.043718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:31.043991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:31.123949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:31.126994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:31.150969 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4135/8260] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:40.888125 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=70,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:41.151868 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:52.800299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:52.801923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:52.889917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:52.895124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:52.959846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72b56f-44d0-4368-97ab-59be7843c7b4 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:52.965847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:52.966679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:52.967106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:52.967767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:52.969988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:53.001676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:53.004510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:53.022322 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4126/8261] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:53.023877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:53.026219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:53.093575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480a2c-633e-4237-b46c-859b2056c11d service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:53.102773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389d40-e96b-45ac-82fc-3e9b26104ded service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:53.103765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389d40-e96b-45ac-82fc-3e9b26104ded service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:53.104205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389d40-e96b-45ac-82fc-3e9b26104ded service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:53.104726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389d40-e96b-45ac-82fc-3e9b26104ded service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:53.108912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d1389d40-e96b-45ac-82fc-3e9b26104ded service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:53.129550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1389d40-e96b-45ac-82fc-3e9b26104ded service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:53.131943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1389d40-e96b-45ac-82fc-3e9b26104ded service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:53.154640 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4136/8262] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:53.164199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733175f8-0745-430f-9237-4bfac5631725 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:53.172971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:53.173976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:53.174601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:53.175010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] PATH_INFO: `/v3/users/b9cf037b5506485a81e6359310a9398d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:53.182378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cf037b5506485a81e6359310a9398d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:53.184462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:53.304484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cf037b5506485a81e6359310a9398d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:53.325910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cf037b5506485a81e6359310a9398d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:53.357806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cf037b5506485a81e6359310a9398d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:53.358747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cf037b5506485a81e6359310a9398d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:53.372550 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:53.381066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cf037b5506485a81e6359310a9398d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:53.391280 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4127/8263] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:44:53 2022] DELETE /identity/v3/users/b9cf037b5506485a81e6359310a9398d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:53.403207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:53.403207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:53.404356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:53.448356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:53.449639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:53.556870 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4137/8264] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:53.598516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:53.603026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:53.747830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d565d1e-bd34-47b0-b874-6dd868e610e5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:53.764672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d367676-cde9-4af5-859b-7a09bd45846f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:53.765219 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d367676-cde9-4af5-859b-7a09bd45846f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:53.765455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d367676-cde9-4af5-859b-7a09bd45846f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:53.765784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d367676-cde9-4af5-859b-7a09bd45846f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:53.785468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d367676-cde9-4af5-859b-7a09bd45846f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:53.787749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d367676-cde9-4af5-859b-7a09bd45846f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:53.801900 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4128/8265] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:54.108158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:54.110298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:54.133452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1a140-69ab-4f9e-a8c6-b6815c3c1cd6 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:54.155326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:54.156057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.156337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.156948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] PATH_INFO: `/v3/projects/8e2d79ae10e44446990d8a06ca5ce0ad` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.158933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2d79ae10e44446990d8a06ca5ce0ad)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:54.165555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:54.242106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2d79ae10e44446990d8a06ca5ce0ad', 'request_id': 'req-fc97fcff-7474-444f-9f63-65c96f945ea7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:54.261812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2d79ae10e44446990d8a06ca5ce0ad', 'request_id': 'req-fc97fcff-7474-444f-9f63-65c96f945ea7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:54.270952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2d79ae10e44446990d8a06ca5ce0ad', 'request_id': 'req-fc97fcff-7474-444f-9f63-65c96f945ea7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:54.288653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] The token cache is being invalidate because project 8e2d79ae10e44446990d8a06ca5ce0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:44:54.289257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:54.290118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc97fcff-7474-444f-9f63-65c96f945ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:54.291961 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4138/8266] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:44:54 2022] DELETE /identity/v3/projects/8e2d79ae10e44446990d8a06ca5ce0ad => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:54.298074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c1ca-10e9-4ca3-9938-8bcbd71ea7e9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.298694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c1ca-10e9-4ca3-9938-8bcbd71ea7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.299280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c1ca-10e9-4ca3-9938-8bcbd71ea7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.359065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-39a4c1ca-10e9-4ca3-9938-8bcbd71ea7e9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:54.360290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-39a4c1ca-10e9-4ca3-9938-8bcbd71ea7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:54.465502 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4129/8267] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:44:54.474894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2a041-d686-43ae-bc87-4981843ec502 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.475261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2a041-d686-43ae-bc87-4981843ec502 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.475602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2a041-d686-43ae-bc87-4981843ec502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.493489 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:54.506054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d9b2a041-d686-43ae-bc87-4981843ec502 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:54.507299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d9b2a041-d686-43ae-bc87-4981843ec502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:54.517349 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4139/8268] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:44:54.522078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c1ca-10e9-4ca3-9938-8bcbd71ea7e9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:54.532407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c1ca-10e9-4ca3-9938-8bcbd71ea7e9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:54.537300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:54.537909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.538179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.538443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.539083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:44:54.539378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:54.541131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:54.553528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4130/8269] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:44:54.558072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2a041-d686-43ae-bc87-4981843ec502 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:54.571977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2a041-d686-43ae-bc87-4981843ec502 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:54.578819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:54.579494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.579779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.580052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.580837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:54.582855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:54.618666 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4140/8270] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:44:54 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:54.622440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:54.634044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336ac9-9fc8-4f2d-aa2c-62b0237252a9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:54.744040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:54.744801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.745222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.746310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.747042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:54.749094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:54.782409 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4131/8271] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:44:54 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:54.786483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:54.803676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8cbb0-c04d-41fa-b997-5d810e209993 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:54.819477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:54.820684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.820684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.820684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.821098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:54.822803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:54.853185 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4141/8272] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:54.855399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:54.863648 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:54.870965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df947dc-afd5-4a7b-85ae-227f02a1e116 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:54.887615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1f33e-3afd-46ab-a32c-c27f19b82a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:54.888270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f33e-3afd-46ab-a32c-c27f19b82a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.888552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f33e-3afd-46ab-a32c-c27f19b82a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.888857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f33e-3afd-46ab-a32c-c27f19b82a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.889816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1f33e-3afd-46ab-a32c-c27f19b82a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:54.891443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1f33e-3afd-46ab-a32c-c27f19b82a67 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:54.924806 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4132/8273] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:54.930301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:54.945931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107f9a-5c17-424e-bef0-77b44cc07dec admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:54.951827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:54.962408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:54.964930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:54.964930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] PATH_INFO: `/v3/projects/4b0c6f00aed8405da4ebf7fab38e0179/users/064145871b724f619c782453aaf1b4be/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:54.998226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0c6f00aed8405da4ebf7fab38e0179, user_id=064145871b724f619c782453aaf1b4be, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:55.003493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:55.026396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4142/8274] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:54 2022] PUT /identity/v3/projects/4b0c6f00aed8405da4ebf7fab38e0179/users/064145871b724f619c782453aaf1b4be/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:55.038872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb367-44fc-4bf2-a7e2-2fdb02b8fa32 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:55.039349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb367-44fc-4bf2-a7e2-2fdb02b8fa32 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:55.039793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb367-44fc-4bf2-a7e2-2fdb02b8fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:55.075372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5fabb367-44fc-4bf2-a7e2-2fdb02b8fa32 None None] MFA Rules not processed for user `064145871b724f619c782453aaf1b4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:55.076841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5fabb367-44fc-4bf2-a7e2-2fdb02b8fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:55.169327 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4133/8275] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:55.181869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:55.183655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:55.254896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e339-caa1-49ba-8285-1f3137d94865 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:55.270614 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd70363-02aa-45fc-8b4a-83e0a5b317cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:55.271679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70363-02aa-45fc-8b4a-83e0a5b317cf service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:55.272159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70363-02aa-45fc-8b4a-83e0a5b317cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:55.273055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70363-02aa-45fc-8b4a-83e0a5b317cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:55.290379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd70363-02aa-45fc-8b4a-83e0a5b317cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:55.292478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd70363-02aa-45fc-8b4a-83e0a5b317cf service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:55.314148 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4143/8276] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:55.331606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb367-44fc-4bf2-a7e2-2fdb02b8fa32 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:55.464377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb367-44fc-4bf2-a7e2-2fdb02b8fa32 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:55.469959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:55.470671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:55.471283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:55.471427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] PATH_INFO: `/v3/users/064145871b724f619c782453aaf1b4be` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:55.472558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] RBAC: Authorizing `identity:delete_user(user_id=064145871b724f619c782453aaf1b4be)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:55.474601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:55.558991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064145871b724f619c782453aaf1b4be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:55.573751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064145871b724f619c782453aaf1b4be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:55.608303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064145871b724f619c782453aaf1b4be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:55.609239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064145871b724f619c782453aaf1b4be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:55.628686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064145871b724f619c782453aaf1b4be'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:55.639174 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4134/8277] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:44:55 2022] DELETE /identity/v3/users/064145871b724f619c782453aaf1b4be => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:44:55.640926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:55.641100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:55.641747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:55.667618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:55.668880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:55.745282 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4144/8278] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:55.754949 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:55.756376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:55.762027 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:55.850573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6b7e7-2f15-45dc-a267-941ed5d3903e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:55.857930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3700-2cf6-4e7c-8f8e-fd60fe4e620c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:55.859792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3700-2cf6-4e7c-8f8e-fd60fe4e620c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:55.860324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3700-2cf6-4e7c-8f8e-fd60fe4e620c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:55.861790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3700-2cf6-4e7c-8f8e-fd60fe4e620c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:55.876223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3700-2cf6-4e7c-8f8e-fd60fe4e620c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:55.878529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3700-2cf6-4e7c-8f8e-fd60fe4e620c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:55.893532 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4135/8279] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:56.413780 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:56.415222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:56.439507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0b02-5689-4ca7-a511-22bba359a02e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:56.448605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:56.449274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:56.449556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:56.449911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] PATH_INFO: `/v3/projects/4b0c6f00aed8405da4ebf7fab38e0179` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:56.451813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0c6f00aed8405da4ebf7fab38e0179)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:56.454428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:56.560167 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:56.581153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0c6f00aed8405da4ebf7fab38e0179', 'request_id': 'req-76a10512-3d64-48ca-b4ab-d823a333b80c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:56.593652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0c6f00aed8405da4ebf7fab38e0179', 'request_id': 'req-76a10512-3d64-48ca-b4ab-d823a333b80c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:56.602681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0c6f00aed8405da4ebf7fab38e0179', 'request_id': 'req-76a10512-3d64-48ca-b4ab-d823a333b80c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:56.620272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] The token cache is being invalidate because project 4b0c6f00aed8405da4ebf7fab38e0179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:44:56.620792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:56.621774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76a10512-3d64-48ca-b4ab-d823a333b80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:56.627200 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4145/8280] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:44:56 2022] DELETE /identity/v3/projects/4b0c6f00aed8405da4ebf7fab38e0179 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:56.629057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eab2f-56b0-474f-a919-88f8491d1cf4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:56.629433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eab2f-56b0-474f-a919-88f8491d1cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:56.629809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eab2f-56b0-474f-a919-88f8491d1cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:56.671392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-580eab2f-56b0-474f-a919-88f8491d1cf4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:56.672706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-580eab2f-56b0-474f-a919-88f8491d1cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:56.806324 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4136/8281] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:56.813937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd90e2-794b-407f-9f31-9e41234131a1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:56.814221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd90e2-794b-407f-9f31-9e41234131a1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:56.814703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd90e2-794b-407f-9f31-9e41234131a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:56.846394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3ccd90e2-794b-407f-9f31-9e41234131a1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:56.847984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3ccd90e2-794b-407f-9f31-9e41234131a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:56.864953 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4146/8282] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:56.865957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eab2f-56b0-474f-a919-88f8491d1cf4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:56.879163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eab2f-56b0-474f-a919-88f8491d1cf4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:56.889830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:56.893802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:56.894282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:56.894647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:56.895475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:44:56.896025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:56.898426 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:56.921263 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4137/8283] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:44:56.921901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd90e2-794b-407f-9f31-9e41234131a1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:56.934581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd90e2-794b-407f-9f31-9e41234131a1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:56.940977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:56.943012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:56.943715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:56.944135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:56.945200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:56.947138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:56.999203 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4147/8284] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:44:56 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:57.003910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:57.021669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dde455-1688-4462-82d7-d761bf917d0c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:57.107297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:57.108142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:57.108491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:57.108897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:57.110095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:57.113137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:57.165959 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4138/8285] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:44:57 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:57.170277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:57.183802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e9d2-c4a1-4464-8d08-6c81ba0cf6f6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:57.206801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:57.207533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:57.207977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:57.208201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:57.208950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:57.210663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:57.257008 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4148/8286] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:44:57.258416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:57.288037 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa65f-e6b1-4104-8e85-8f03bc997208 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:57.296462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e571d13-2d7a-456d-850d-3601f9a4ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:57.297306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571d13-2d7a-456d-850d-3601f9a4ae4e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:57.297650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571d13-2d7a-456d-850d-3601f9a4ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:57.298883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571d13-2d7a-456d-850d-3601f9a4ae4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:57.299763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e571d13-2d7a-456d-850d-3601f9a4ae4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:57.302710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e571d13-2d7a-456d-850d-3601f9a4ae4e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:57.327486 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4139/8287] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:57.331841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:57.343898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a7a0-9460-4f5f-837b-97793f41c2ba admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:57.354560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:57.355804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:57.356252 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:57.382294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] PATH_INFO: `/v3/projects/a135eda580e94ddda8df08b6c1580ac9/users/81324383edaf441895f566c013dca6f3/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:57.434475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a135eda580e94ddda8df08b6c1580ac9, user_id=81324383edaf441895f566c013dca6f3, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:57.437189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:57.484895 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4149/8288] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:57 2022] PUT /identity/v3/projects/a135eda580e94ddda8df08b6c1580ac9/users/81324383edaf441895f566c013dca6f3/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:57.493355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67613c60-97b8-4354-a962-2416eff4cc87 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:57.493735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67613c60-97b8-4354-a962-2416eff4cc87 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:57.494098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67613c60-97b8-4354-a962-2416eff4cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:57.554621 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:57.582776 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-67613c60-97b8-4354-a962-2416eff4cc87 None None] MFA Rules not processed for user `81324383edaf441895f566c013dca6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:57.584048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-67613c60-97b8-4354-a962-2416eff4cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:57.773748 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4140/8289] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:57.777428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:57.956236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6330b-3369-4d1d-9f39-a14af715bc61 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:57.967838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:57.968900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:57.969381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:57.969796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:57.970562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:57.979428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.041114 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4150/8290] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:44:57 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:58.045064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67613c60-97b8-4354-a962-2416eff4cc87 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.063980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67613c60-97b8-4354-a962-2416eff4cc87 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.226991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.227968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.228468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.228974 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.229983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:58.232205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.267189 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4141/8291] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:44:58 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:44:58.271384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.291294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110179-f96e-43a5-ab91-ba3050e37137 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.299846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.300582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.300920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.302304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.303052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:58.306517 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.335077 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4151/8292] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:58.337147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.359197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758c971-a39d-44d1-b0d8-602f02c667b6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.376360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.377185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.377571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.377752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] PATH_INFO: `/v3/projects/9c2142a0bce34b3c8e14e2e343471700/users/721271ee014844eb966c52251a1675af/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.398265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.400289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:58.409065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2142a0bce34b3c8e14e2e343471700, user_id=721271ee014844eb966c52251a1675af, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:58.411755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.419551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bd34f-d6b9-4408-9cbb-4445fd7884af admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.427453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.429398 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.441427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.442056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] PATH_INFO: `/v3/users/a77398ee4afd421880564ae1fcd6b5fa` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.442168 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4142/8293] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:58 2022] PUT /identity/v3/projects/9c2142a0bce34b3c8e14e2e343471700/users/721271ee014844eb966c52251a1675af/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:58.443095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.449658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77398ee4afd421880564ae1fcd6b5fa)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:58.452372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.517345 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:58.547323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307db86-ba84-419c-9f30-35aa1735c481 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.548611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77398ee4afd421880564ae1fcd6b5fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:58.554955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.555914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.556311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.556731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.557919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:58.559951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.562617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77398ee4afd421880564ae1fcd6b5fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:58.563475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77398ee4afd421880564ae1fcd6b5fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:58.578518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77398ee4afd421880564ae1fcd6b5fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:58.579494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a997d64-e6bb-46ab-9fed-4624c2ff8e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77398ee4afd421880564ae1fcd6b5fa'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:58.587016 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4143/8294] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:44:58.589046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.591409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:58.603024 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:58.608643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e83732-7fc3-44ca-a645-63d7df9f6358 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.617269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed970-eb20-42b2-83ee-36ff7de7bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.617269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed970-eb20-42b2-83ee-36ff7de7bc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.617269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed970-eb20-42b2-83ee-36ff7de7bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.617269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed970-eb20-42b2-83ee-36ff7de7bc67 admin admin] PATH_INFO: `/v3/projects/9c2142a0bce34b3c8e14e2e343471700/users/721271ee014844eb966c52251a1675af/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.619508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed970-eb20-42b2-83ee-36ff7de7bc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2142a0bce34b3c8e14e2e343471700, user_id=721271ee014844eb966c52251a1675af, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:58.620936 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4152/8295] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:44:58 2022] DELETE /identity/v3/users/a77398ee4afd421880564ae1fcd6b5fa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:44:58.623051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.623506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed970-eb20-42b2-83ee-36ff7de7bc67 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.623939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.624438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.640122 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4144/8296] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:44:58 2022] PUT /identity/v3/projects/9c2142a0bce34b3c8e14e2e343471700/users/721271ee014844eb966c52251a1675af/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:58.655451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.655753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.656036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.658990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:58.660858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:58.691080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] MFA Rules not processed for user `721271ee014844eb966c52251a1675af`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:44:58.692563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:58.760508 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4153/8297] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:44:58.777492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.780646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:58.814968 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4145/8298] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:44:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:44:58.823395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:58.824958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:58.873872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65a576-18bc-448a-912a-ae6d735f0fbf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.879509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.880358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.881292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.881908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.899124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:58.900911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:58.921726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a18c9-9a06-4e20-831c-3a9843dd079c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:58.929652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4154/8299] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:44:58.933638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:58.934291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:58.934569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:58.934836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:58.939256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:59.039259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:59.041259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:59.053455 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4146/8300] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:44:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:44:59.306878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:59.309986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:44:59.351301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d5d8f-62c6-4922-b36b-a63940f9fa04 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:59.357144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:59.357802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:59.358126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:59.358394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] PATH_INFO: `/v3/projects/5d30a4d65d474c668ad0c6972e129218` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:59.359543 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d30a4d65d474c668ad0c6972e129218)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:59.361687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:59.435847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d30a4d65d474c668ad0c6972e129218', 'request_id': 'req-58792f43-47f9-48d1-8bb6-cb0bc085035e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.438823 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:59.450630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d30a4d65d474c668ad0c6972e129218', 'request_id': 'req-58792f43-47f9-48d1-8bb6-cb0bc085035e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.459618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d30a4d65d474c668ad0c6972e129218', 'request_id': 'req-58792f43-47f9-48d1-8bb6-cb0bc085035e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.475324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] The token cache is being invalidate because project 5d30a4d65d474c668ad0c6972e129218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:44:59.475679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.476395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.478567 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4155/8301] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:44:59 2022] DELETE /identity/v3/projects/5d30a4d65d474c668ad0c6972e129218 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:44:59.482811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:44:59.504316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065081f-2caa-4d80-a8a3-73e34fd8528b service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:44:59.551009 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:59.635831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:44:59.638044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:44:59.638955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:44:59.639387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] PATH_INFO: `/v3/users/a6127613afd64ba291652e4a85bb339d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:44:59.641278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6127613afd64ba291652e4a85bb339d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:44:59.643761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:44:59.719000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6127613afd64ba291652e4a85bb339d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.732430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6127613afd64ba291652e4a85bb339d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.756286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6127613afd64ba291652e4a85bb339d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.757333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6127613afd64ba291652e4a85bb339d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.769880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-4d5118bc-09fe-4117-9cdd-a445295fa910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6127613afd64ba291652e4a85bb339d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:44:59.777120 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4147/8302] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:44:59 2022] DELETE /identity/v3/users/a6127613afd64ba291652e4a85bb339d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:00.665185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:00.666914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:00.714468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58792f43-47f9-48d1-8bb6-cb0bc085035e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:00.794283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:00.795043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:00.795259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:00.795508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] PATH_INFO: `/v3/projects/579d137c57d5444a9e3be49d6756dfd2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:00.796969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579d137c57d5444a9e3be49d6756dfd2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:00.800025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:00.873684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579d137c57d5444a9e3be49d6756dfd2', 'request_id': 'req-33ad1569-6917-4d27-a64d-09f1ce7cfc62'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:00.885623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579d137c57d5444a9e3be49d6756dfd2', 'request_id': 'req-33ad1569-6917-4d27-a64d-09f1ce7cfc62'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:00.892198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579d137c57d5444a9e3be49d6756dfd2', 'request_id': 'req-33ad1569-6917-4d27-a64d-09f1ce7cfc62'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:00.904729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] The token cache is being invalidate because project 579d137c57d5444a9e3be49d6756dfd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:00.905177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:00.905947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-33ad1569-6917-4d27-a64d-09f1ce7cfc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:00.907638 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4156/8303] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:00 2022] DELETE /identity/v3/projects/579d137c57d5444a9e3be49d6756dfd2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:00.914349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5d9b-120a-4cbf-995a-07f1cd65f39e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:00.914820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5d9b-120a-4cbf-995a-07f1cd65f39e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:00.914925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5d9b-120a-4cbf-995a-07f1cd65f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:00.938859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-df4f5d9b-120a-4cbf-995a-07f1cd65f39e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:00.940300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-df4f5d9b-120a-4cbf-995a-07f1cd65f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:01.013792 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4148/8304] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:01.142371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523fbd6-a249-4e40-9e22-f2f478f23f75 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.143072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523fbd6-a249-4e40-9e22-f2f478f23f75 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.143569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523fbd6-a249-4e40-9e22-f2f478f23f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.176341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c523fbd6-a249-4e40-9e22-f2f478f23f75 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:01.177782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c523fbd6-a249-4e40-9e22-f2f478f23f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:01.192025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f5d9b-120a-4cbf-995a-07f1cd65f39e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.192955 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4157/8305] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:01.207462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f5d9b-120a-4cbf-995a-07f1cd65f39e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:01.213715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:01.214431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.214710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.215714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.216859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:45:01.217167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:01.218848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:01.236862 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4149/8306] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:45:01.253777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523fbd6-a249-4e40-9e22-f2f478f23f75 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.267105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523fbd6-a249-4e40-9e22-f2f478f23f75 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:01.275141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:01.275989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.276421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.276867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.277666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:01.280261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:01.320025 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4158/8307] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:01 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:01.324491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.340273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4702a7-99fd-4b9a-a898-ca612dfac1c2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:01.407876 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:01.454176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:01.454176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.454176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.454176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.456534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:01.456534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:01.516943 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4150/8308] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:01 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:01.519603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.535802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e06e6-4ffe-462d-8dc1-dd7897e78825 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:01.556005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:01.556790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.557156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.557521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.558316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:01.560500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:01.573503 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4159/8309] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:01.577233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.589833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa14713-1342-4894-8aa1-c7cd449b3e70 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:01.595038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041aca3f-bb4e-4810-b135-4c14025930e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:01.596250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aca3f-bb4e-4810-b135-4c14025930e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.596784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aca3f-bb4e-4810-b135-4c14025930e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.597138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aca3f-bb4e-4810-b135-4c14025930e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.597895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041aca3f-bb4e-4810-b135-4c14025930e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:01.599664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041aca3f-bb4e-4810-b135-4c14025930e8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:01.620069 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4151/8310] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:45:01.625978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.640933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9568ca-002d-46a8-925d-2a58492b3e39 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:01.646431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:01.648059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.648329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.648602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] PATH_INFO: `/v3/projects/a8b7791cd2474b4a8bbfc8f9a069024e/users/c89ec4d04ba54e54a1d844a3566f3821/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.669164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b7791cd2474b4a8bbfc8f9a069024e, user_id=c89ec4d04ba54e54a1d844a3566f3821, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:01.672944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:01.704188 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4160/8311] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:01 2022] PUT /identity/v3/projects/a8b7791cd2474b4a8bbfc8f9a069024e/users/c89ec4d04ba54e54a1d844a3566f3821/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:45:01.706101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.706727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.707107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.735611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:01.737275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:01.814032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.815943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:01.827063 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:01.921253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4152/8312] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:01.933136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:01.934593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:01.943840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf2be-57ce-4177-8c8b-9fbbd74fbb07 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:01.952003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:01.953231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:01.953749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:01.954393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:01.958102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:02.040831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7774f-440a-44eb-875e-85d518b5c7b1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:02.045242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa40ed7-d569-4b41-9175-56f8e96b4391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:02.046167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa40ed7-d569-4b41-9175-56f8e96b4391 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:02.046694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa40ed7-d569-4b41-9175-56f8e96b4391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:02.047127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa40ed7-d569-4b41-9175-56f8e96b4391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:02.058616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa40ed7-d569-4b41-9175-56f8e96b4391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:02.060236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa40ed7-d569-4b41-9175-56f8e96b4391 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:02.080660 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4153/8313] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:45:02.101879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:02.104075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:02.143679 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4161/8314] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:45:10.024533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505fc2-f08b-4b5f-9e7b-220adb36b11f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:10.025090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505fc2-f08b-4b5f-9e7b-220adb36b11f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:10.025090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505fc2-f08b-4b5f-9e7b-220adb36b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:10.088250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b6505fc2-f08b-4b5f-9e7b-220adb36b11f None None] MFA Rules not processed for user `c89ec4d04ba54e54a1d844a3566f3821`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:10.089902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6505fc2-f08b-4b5f-9e7b-220adb36b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:10.185457 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:10.234188 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4154/8315] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:10.239136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:10.257544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb62f-e4e1-4393-bfb1-643649a380e4 service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:10.268585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:10.269626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:10.269996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:10.270359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:10.271460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:10.273816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:10.330461 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4162/8316] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:10 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:10.334464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505fc2-f08b-4b5f-9e7b-220adb36b11f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:10.346395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505fc2-f08b-4b5f-9e7b-220adb36b11f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:10.534919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:10.535574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:10.535902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:10.536177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:10.536834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:10.541081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:10.616273 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4155/8317] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:10 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:10.624352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:10.651514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eeeff-a447-4c15-a6bd-bd10aa4a99a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:10.661127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:10.661754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:10.662030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:10.662297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:10.662981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:10.668825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:10.691777 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4163/8318] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:10.696253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:10.717015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db03f-9305-4ebe-9e32-0f3a22f1cca1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:10.731752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:10.732693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:10.733008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:10.733279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] PATH_INFO: `/v3/projects/474e6a08031c46f58db6f0d21f941bfd/users/c62d0152e89c461290120d94572ae7e4/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:10.750415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] RBAC: Authorizing `identity:create_grant(project_id=474e6a08031c46f58db6f0d21f941bfd, user_id=c62d0152e89c461290120d94572ae7e4, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:10.753697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:10.781588 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4156/8319] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:10 2022] PUT /identity/v3/projects/474e6a08031c46f58db6f0d21f941bfd/users/c62d0152e89c461290120d94572ae7e4/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:10.783952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:10.803646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298a77-dda7-4070-8533-cc05caff9c79 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:10.950812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:10.951620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:10.952062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:10.952583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:10.953561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:10.955951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:10.983927 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4164/8320] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:10.989301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:11.006324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68411e1-4941-431f-993d-9bd5df9c075c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:11.016554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46cf75-834e-4f59-a565-9fd05d12acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:11.019624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46cf75-834e-4f59-a565-9fd05d12acbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:11.019624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46cf75-834e-4f59-a565-9fd05d12acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:11.021315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46cf75-834e-4f59-a565-9fd05d12acbd admin admin] PATH_INFO: `/v3/projects/474e6a08031c46f58db6f0d21f941bfd/users/c62d0152e89c461290120d94572ae7e4/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:11.027054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46cf75-834e-4f59-a565-9fd05d12acbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=474e6a08031c46f58db6f0d21f941bfd, user_id=c62d0152e89c461290120d94572ae7e4, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:11.033792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46cf75-834e-4f59-a565-9fd05d12acbd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:11.089996 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4157/8321] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:10 2022] PUT /identity/v3/projects/474e6a08031c46f58db6f0d21f941bfd/users/c62d0152e89c461290120d94572ae7e4/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:11.676369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:11.680188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:11.704089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce4c6e-fbe6-4b11-ae7c-1a9e1c9ae7d5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:11.729567 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:12.066867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:12.067825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:12.068255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:12.068675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] PATH_INFO: `/v3/users/5277d7e41508465983a7b02121ee6096` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:12.070817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5277d7e41508465983a7b02121ee6096)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:12.074574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:12.137940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5277d7e41508465983a7b02121ee6096'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.154380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5277d7e41508465983a7b02121ee6096'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.156844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5277d7e41508465983a7b02121ee6096'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.174561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5277d7e41508465983a7b02121ee6096'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.175703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5277d7e41508465983a7b02121ee6096'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.215731 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4165/8322] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:11 2022] DELETE /identity/v3/users/5277d7e41508465983a7b02121ee6096 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:12.220193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:12.220810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:12.220928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:12.274486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:12.275748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:12.281305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:12.282732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:12.473340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd86de5-d90a-4069-81c2-db92d1491c5b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:12.503865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:12.504716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:12.505012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:12.505579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] PATH_INFO: `/v3/users/81324383edaf441895f566c013dca6f3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:12.513672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=81324383edaf441895f566c013dca6f3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:12.515952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:12.550795 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4158/8323] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:12.603282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:12.605420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:12.666046 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:12.694561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81324383edaf441895f566c013dca6f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.708701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81324383edaf441895f566c013dca6f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.709442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81324383edaf441895f566c013dca6f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.721909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81324383edaf441895f566c013dca6f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.723159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-dac09578-61e3-496f-8115-35111f403fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81324383edaf441895f566c013dca6f3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:12.768007 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4166/8324] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:12 2022] DELETE /identity/v3/users/81324383edaf441895f566c013dca6f3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:45:12.772868 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:12.773159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:12.773674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:12.792567 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:12.838010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4992f0-168b-4eba-b4db-b8acd749e99f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:12.842053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:12.843274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:12.998504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:13.005446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:13.005731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:13.006188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:13.011572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:13.073365 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4167/8325] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:13.094093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:13.095938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:13.120662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87a0b4-5cdb-42a0-8d6d-22fb142ae97d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:13.139202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:13.140325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:13.140756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:13.141198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:13.169203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:13.174022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:13.214332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:13.215807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:13.216672 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4168/8326] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:45:13.251757 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4159/8327] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:45:15.184087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:15.190884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:15.212286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68eb75-7389-445f-b689-7fb8152253ff service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:15.226187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:15.226859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:15.227143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:15.227408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] PATH_INFO: `/v3/projects/3adba6f592254fff966ec56c2fab1208` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:15.228574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adba6f592254fff966ec56c2fab1208)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:15.230995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:15.231137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:15.233193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:15.255404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47636581-24c9-4ebc-9e6a-e18bc24ec80b service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:15.274844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:15.275874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:15.279157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:15.279864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] PATH_INFO: `/v3/projects/a135eda580e94ddda8df08b6c1580ac9` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:15.281899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a135eda580e94ddda8df08b6c1580ac9)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:15.289368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:15.385184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adba6f592254fff966ec56c2fab1208', 'request_id': 'req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.400025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a135eda580e94ddda8df08b6c1580ac9', 'request_id': 'req-e6de2758-cd01-4e48-a180-db739e935dcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.405531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adba6f592254fff966ec56c2fab1208', 'request_id': 'req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.415410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a135eda580e94ddda8df08b6c1580ac9', 'request_id': 'req-e6de2758-cd01-4e48-a180-db739e935dcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.428309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adba6f592254fff966ec56c2fab1208', 'request_id': 'req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.434772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a135eda580e94ddda8df08b6c1580ac9', 'request_id': 'req-e6de2758-cd01-4e48-a180-db739e935dcc'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.451793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] The token cache is being invalidate because project 3adba6f592254fff966ec56c2fab1208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:15.452408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.453668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.463282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] The token cache is being invalidate because project a135eda580e94ddda8df08b6c1580ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:15.463571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.465345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:15.465947 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4169/8328] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:15 2022] DELETE /identity/v3/projects/3adba6f592254fff966ec56c2fab1208 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:15.469063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:15.469253 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4160/8329] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:15 2022] DELETE /identity/v3/projects/a135eda580e94ddda8df08b6c1580ac9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:15.470119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:15.471316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:15.475793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:15.532587 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:15.549007 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:15.658332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de2758-cd01-4e48-a180-db739e935dcc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:15.670311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ee516-9c31-4a7f-a1a9-4e3f108b0fc3 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:15.673591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:15.676166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:15.677231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:15.677901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:15.681042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:15.839838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:15.840389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:15.840662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:15.842455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:15.845358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:15.849933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:15.851554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:15.873497 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4161/8330] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:15.874417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:15.882152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:15.883853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:15.886029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:15.920203 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4170/8331] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:15.921190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:15.923632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:16.079836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7490a5-b3fd-4623-850b-67aa8f895e2c service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:16.093470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:16.094412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:16.094838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:16.095314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] PATH_INFO: `/v3/users/9651eeec08ac4eee83799d20dd515252` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:16.097737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9651eeec08ac4eee83799d20dd515252)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:16.099885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:16.128100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e1968-948d-45b4-96df-4758631fa51d service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:16.144455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:16.145693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:16.146154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:16.150010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] PATH_INFO: `/v3/users/721271ee014844eb966c52251a1675af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:16.152599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721271ee014844eb966c52251a1675af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:16.154942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:16.216405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9651eeec08ac4eee83799d20dd515252'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.233562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9651eeec08ac4eee83799d20dd515252'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.271169 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:16.277321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9651eeec08ac4eee83799d20dd515252'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.280731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9651eeec08ac4eee83799d20dd515252'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.292963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721271ee014844eb966c52251a1675af'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.298481 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:16.299168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9651eeec08ac4eee83799d20dd515252'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.312914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721271ee014844eb966c52251a1675af'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.313842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721271ee014844eb966c52251a1675af'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.317044 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4162/8332] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:15 2022] DELETE /identity/v3/users/9651eeec08ac4eee83799d20dd515252 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:16.346939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721271ee014844eb966c52251a1675af'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.347630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-6f2c6965-0132-49db-83d1-776c7c5ee4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721271ee014844eb966c52251a1675af'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:16.406033 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4171/8333] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:15 2022] DELETE /identity/v3/users/721271ee014844eb966c52251a1675af => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:16.981323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:16.985668 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:17.179040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a2eca-79dd-4a3d-868d-25e38ab9068f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:17.298384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:17.299275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.299522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.299971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] PATH_INFO: `/v3/projects/9c2142a0bce34b3c8e14e2e343471700` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:17.301465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2142a0bce34b3c8e14e2e343471700)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:17.304685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:17.385763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2142a0bce34b3c8e14e2e343471700', 'request_id': 'req-dd0aa81f-354a-49de-afac-100a8d403546'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.395086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2142a0bce34b3c8e14e2e343471700', 'request_id': 'req-dd0aa81f-354a-49de-afac-100a8d403546'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.402762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2142a0bce34b3c8e14e2e343471700', 'request_id': 'req-dd0aa81f-354a-49de-afac-100a8d403546'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.426521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] The token cache is being invalidate because project 9c2142a0bce34b3c8e14e2e343471700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:17.426849 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.428253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dd0aa81f-354a-49de-afac-100a8d403546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.430952 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4163/8334] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:16 2022] DELETE /identity/v3/projects/9c2142a0bce34b3c8e14e2e343471700 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:17.435846 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.436415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.436415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:17.461448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:17.462952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:17.534868 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4172/8335] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:17.541983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f81c-f199-4eec-8386-db60da2a8bf2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.542450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f81c-f199-4eec-8386-db60da2a8bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.542808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f81c-f199-4eec-8386-db60da2a8bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:17.554550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:17.556459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:17.577980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064ac7d-e6ea-486a-9c21-3e92c5b315ba None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:17.579596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b0c8f81c-f199-4eec-8386-db60da2a8bf2 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:17.582708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b0c8f81c-f199-4eec-8386-db60da2a8bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:17.586730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:17.588641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.590548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.591079 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] PATH_INFO: `/v3/projects/0586a15b339848748b4bdfdcfaf43b06` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:17.592938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0586a15b339848748b4bdfdcfaf43b06)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:17.595318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:17.597659 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4164/8336] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:45:17.603859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f81c-f199-4eec-8386-db60da2a8bf2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:17.618081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f81c-f199-4eec-8386-db60da2a8bf2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:17.627832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:17.628482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.628758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.629062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:17.629730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:45:17.630033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:17.631837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:17.654038 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4165/8337] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:45:17.656457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:17.670134 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:17.671530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0586a15b339848748b4bdfdcfaf43b06', 'request_id': 'req-4c1c3145-3c5c-438a-8eba-2051eb8a4199'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.681925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71b35-d493-4f54-9f00-52d8952d94a0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:17.687722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0586a15b339848748b4bdfdcfaf43b06', 'request_id': 'req-4c1c3145-3c5c-438a-8eba-2051eb8a4199'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.711020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0586a15b339848748b4bdfdcfaf43b06', 'request_id': 'req-4c1c3145-3c5c-438a-8eba-2051eb8a4199'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.732005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] The token cache is being invalidate because project 0586a15b339848748b4bdfdcfaf43b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:17.732500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.733330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4c1c3145-3c5c-438a-8eba-2051eb8a4199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:17.735598 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4173/8338] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:17 2022] DELETE /identity/v3/projects/0586a15b339848748b4bdfdcfaf43b06 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:17.740717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e2861-95fe-46e3-80bd-9e03e0cef7a6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.741182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e2861-95fe-46e3-80bd-9e03e0cef7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.741520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e2861-95fe-46e3-80bd-9e03e0cef7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:17.769199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b24e2861-95fe-46e3-80bd-9e03e0cef7a6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:17.771366 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b24e2861-95fe-46e3-80bd-9e03e0cef7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:17.820269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:17.821003 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.821287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.821563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:17.822210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:17.824237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:17.893391 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:17.927456 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4166/8339] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:17 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:17.934603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:17.943261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:17.953324 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4174/8340] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:17.960726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15da7e-7a93-40e9-81f9-93f7eede68e1 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:17.961302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15da7e-7a93-40e9-81f9-93f7eede68e1 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:17.961885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15da7e-7a93-40e9-81f9-93f7eede68e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.009353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7c15da7e-7a93-40e9-81f9-93f7eede68e1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:18.013610 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7c15da7e-7a93-40e9-81f9-93f7eede68e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:18.096980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca0967-ed54-4f24-89bf-a079ce4b9b72 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.119384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.120319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.120678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.121042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.121883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.124105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.162723 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4175/8341] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:18.167025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15da7e-7a93-40e9-81f9-93f7eede68e1 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.178597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15da7e-7a93-40e9-81f9-93f7eede68e1 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.185242 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4167/8342] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:17 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:18.186583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.192757 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.194067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.194353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.194697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.195433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:45:18.197935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.202430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.211756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d842-2511-4aab-b124-11b4a608afba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.226736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.228808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.229122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.229408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.230080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.232917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.240837 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4176/8343] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:45:18.241840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.260123 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4168/8344] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:18.265257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.266188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe524c-6983-4150-97df-e241c20fb332 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.280311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bdd02-5c18-4b71-943e-9e760215c896 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.282236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.283140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.284003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.284284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.284968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.286117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.286729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.287010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.287120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.287327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.287928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.289594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.309276 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4169/8345] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:18.312973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.337034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980837-f9fa-4860-b4eb-afe470fce971 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.343588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b2b3-4d51-4c6d-8f2c-de73c606eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.344404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b2b3-4d51-4c6d-8f2c-de73c606eb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.344689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b2b3-4d51-4c6d-8f2c-de73c606eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.345044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b2b3-4d51-4c6d-8f2c-de73c606eb42 admin admin] PATH_INFO: `/v3/projects/0d8bf2cc4ff640fe9c5cea711453df0d/users/386df073ed28407a8bfe1a77d2861c11/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.365927 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4177/8346] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:18 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:18.366146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b2b3-4d51-4c6d-8f2c-de73c606eb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8bf2cc4ff640fe9c5cea711453df0d, user_id=386df073ed28407a8bfe1a77d2861c11, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.367760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b2b3-4d51-4c6d-8f2c-de73c606eb42 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.368197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.410245 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4170/8347] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:18 2022] PUT /identity/v3/projects/0d8bf2cc4ff640fe9c5cea711453df0d/users/386df073ed28407a8bfe1a77d2861c11/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:45:18.413963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153b2d-637c-4071-8a37-3a24dfa60e77 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.414332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153b2d-637c-4071-8a37-3a24dfa60e77 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.414672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153b2d-637c-4071-8a37-3a24dfa60e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.479365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f6153b2d-637c-4071-8a37-3a24dfa60e77 None None] MFA Rules not processed for user `386df073ed28407a8bfe1a77d2861c11`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:18.480810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f6153b2d-637c-4071-8a37-3a24dfa60e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:18.510020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e2c36-1cde-4a70-a0c8-aa468ed0c9d0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.518835 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:18.593696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.594446 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.594825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.595230 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.596602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.598662 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.613782 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:18.619463 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4171/8348] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:18.626303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153b2d-637c-4071-8a37-3a24dfa60e77 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.643519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153b2d-637c-4071-8a37-3a24dfa60e77 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.649972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4178/8349] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:18 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:18.652551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.661815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.662261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.662476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.662753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.663392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.676805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d7669-d86d-41f6-93b3-b191139088f8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.677397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.685460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.686014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.686294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.686564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.687241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.689331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.711955 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4179/8350] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:18.712921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.733905 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4172/8351] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:18 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:45:18.734845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.741183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10e47-01ea-45fc-a4e3-e624b5a117b2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.846859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.847498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.847903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.848184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.848893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.850857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.863497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4180/8352] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:18.867364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:18.879058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed0c2-a572-4197-a781-d8777d51779f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.880553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a58817-557b-4959-b964-5420a1e78d2b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:18.887023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.887759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.888583 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.888717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] PATH_INFO: `/v3/projects/5f520c71edb04d26a71b4505e4ba6fc4/users/2e346be23a66470eac59e619522f4033/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.892431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f0a8d-af0c-4483-8b95-f2ae00859270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:18.893163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f0a8d-af0c-4483-8b95-f2ae00859270 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.894960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f0a8d-af0c-4483-8b95-f2ae00859270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.895258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f0a8d-af0c-4483-8b95-f2ae00859270 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.895907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f0a8d-af0c-4483-8b95-f2ae00859270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.904222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f0a8d-af0c-4483-8b95-f2ae00859270 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.909741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f520c71edb04d26a71b4505e4ba6fc4, user_id=2e346be23a66470eac59e619522f4033, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:18.912822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:18.949467 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4173/8354] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:18 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:18.949663 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4181/8354] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:18 2022] PUT /identity/v3/projects/5f520c71edb04d26a71b4505e4ba6fc4/users/2e346be23a66470eac59e619522f4033/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:18.951685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910fb3-9843-43c4-8015-ba8e283888ed None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:18.951685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910fb3-9843-43c4-8015-ba8e283888ed None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:18.951685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910fb3-9843-43c4-8015-ba8e283888ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:18.953016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.018850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3a910fb3-9843-43c4-8015-ba8e283888ed None None] MFA Rules not processed for user `2e346be23a66470eac59e619522f4033`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:19.020109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3a910fb3-9843-43c4-8015-ba8e283888ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:19.051092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36617d1a-bd34-4f06-a437-2efe261faffb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.062671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.065412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.065791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.066719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.068185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.072725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.087787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4182/8355] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:19.091854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.116208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5e4a3-ce90-4750-b3b3-532f3ac665a0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.122952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.123718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.124059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.124397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] PATH_INFO: `/v3/projects/480e12c7f7774d69a370ff841aef1d12/users/6e9d23ad2cd14cc79e21f7560a92d822/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.165956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4174/8356] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:19.169230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910fb3-9843-43c4-8015-ba8e283888ed None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.172297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480e12c7f7774d69a370ff841aef1d12, user_id=6e9d23ad2cd14cc79e21f7560a92d822, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.179088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.191837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910fb3-9843-43c4-8015-ba8e283888ed None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.207872 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4183/8357] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:19 2022] PUT /identity/v3/projects/480e12c7f7774d69a370ff841aef1d12/users/6e9d23ad2cd14cc79e21f7560a92d822/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:19.211644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.212967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.214588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.216239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.216908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.219332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.225647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.250641 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:19.273682 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4175/8358] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:19 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:19.277655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.288037 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:19.364018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e22ee-3940-4865-a522-5d88abda7972 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.427819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a55d-acaa-465d-8c81-05c8466d19a8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.435367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.436116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.436619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.437129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.437853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.440023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.460083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.460686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.461053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.461679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.474544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.480227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.501228 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4176/8359] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:19 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:19.502578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.506707 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4184/8360] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:19.512103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.515995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070b484-8451-4e37-8b76-f99625d2f198 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.526792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.529475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.529607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.531731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.533108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.538319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82906b4-9137-4181-85eb-3166f65da0cd admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.539071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.555168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9338a-cb0d-4ac8-b252-82ac0745bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.556683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9338a-cb0d-4ac8-b252-82ac0745bd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.560439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9338a-cb0d-4ac8-b252-82ac0745bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.560988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9338a-cb0d-4ac8-b252-82ac0745bd8c admin admin] PATH_INFO: `/v3/projects/480e12c7f7774d69a370ff841aef1d12/users/6e9d23ad2cd14cc79e21f7560a92d822/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.567203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9338a-cb0d-4ac8-b252-82ac0745bd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=480e12c7f7774d69a370ff841aef1d12, user_id=6e9d23ad2cd14cc79e21f7560a92d822, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.572666 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4177/8361] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:19.580109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9338a-cb0d-4ac8-b252-82ac0745bd8c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.582680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.608461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36378b34-5b40-41ae-ab7b-4e292972f22f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.613422 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4185/8362] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:19 2022] PUT /identity/v3/projects/480e12c7f7774d69a370ff841aef1d12/users/6e9d23ad2cd14cc79e21f7560a92d822/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:19.623735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae0198-ef9b-4ece-acdf-a2c8bb332ccb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.624027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae0198-ef9b-4ece-acdf-a2c8bb332ccb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.624451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae0198-ef9b-4ece-acdf-a2c8bb332ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.697532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fbae0198-ef9b-4ece-acdf-a2c8bb332ccb None None] MFA Rules not processed for user `6e9d23ad2cd14cc79e21f7560a92d822`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:19.699370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fbae0198-ef9b-4ece-acdf-a2c8bb332ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:19.741380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.742988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.743847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.743847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] PATH_INFO: `/v3/projects/795951a94fd44574a632372127059d6d/users/962d703c7eec4c49ba2710beac909249/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.769902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] RBAC: Authorizing `identity:create_grant(project_id=795951a94fd44574a632372127059d6d, user_id=962d703c7eec4c49ba2710beac909249, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.774084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.803867 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4186/8363] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:45:19.810251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4178/8364] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:19 2022] PUT /identity/v3/projects/795951a94fd44574a632372127059d6d/users/962d703c7eec4c49ba2710beac909249/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:19.819534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.822369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae0198-ef9b-4ece-acdf-a2c8bb332ccb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.822552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:19.838057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae0198-ef9b-4ece-acdf-a2c8bb332ccb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.919429 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:19.942030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.942577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.942863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.943131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.943535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277867af-58d9-4ccc-830f-8dd24a43668f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.944029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:19.945981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:19.955105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.955745 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.956025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.956300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.965214 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4187/8365] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:19.966418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:19.972667 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:19.985472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715984f1-98f8-46a8-8713-26cd59db8b80 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:19.994034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acaee3-bf00-4e40-bf01-62acf68127de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:19.994723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acaee3-bf00-4e40-bf01-62acf68127de admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:19.995052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acaee3-bf00-4e40-bf01-62acf68127de admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:19.995377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acaee3-bf00-4e40-bf01-62acf68127de admin admin] PATH_INFO: `/v3/projects/795951a94fd44574a632372127059d6d/users/962d703c7eec4c49ba2710beac909249/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:19.998281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acaee3-bf00-4e40-bf01-62acf68127de admin admin] RBAC: Authorizing `identity:create_grant(project_id=795951a94fd44574a632372127059d6d, user_id=962d703c7eec4c49ba2710beac909249, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:20.002911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acaee3-bf00-4e40-bf01-62acf68127de admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:20.024889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4188/8366] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:19 2022] PUT /identity/v3/projects/795951a94fd44574a632372127059d6d/users/962d703c7eec4c49ba2710beac909249/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:20.032958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:20.033313 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:20.033612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:20.068567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] MFA Rules not processed for user `962d703c7eec4c49ba2710beac909249`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:20.069853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:20.101260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:20.102817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:20.150684 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4179/8367] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:20.212000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4189/8368] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:45:20.227557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:20.248236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d9aba-838a-486d-9f95-2df36a361043 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:20.288444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:20.291045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:20.337344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:20.338000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:20.338356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:20.338694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:20.416209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:20.417832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:20.436800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80aab6-a65c-4285-9a76-ecf0e3b5f6ca None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:20.444592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbb2d7-af25-4847-9d84-8cf64586500c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:20.444733 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4180/8369] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:20.445954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb2d7-af25-4847-9d84-8cf64586500c service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:20.446615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb2d7-af25-4847-9d84-8cf64586500c service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:20.447088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb2d7-af25-4847-9d84-8cf64586500c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:20.562192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbb2d7-af25-4847-9d84-8cf64586500c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:20.564967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbb2d7-af25-4847-9d84-8cf64586500c service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:20.578214 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4190/8370] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:45:21.320969 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:21.440288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085eb7-786b-4ac9-a2ce-4e080adf9e36 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:21.445823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:21.447749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:21.448148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:21.449124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] PATH_INFO: `/v3/users/386df073ed28407a8bfe1a77d2861c11` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:21.453402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=386df073ed28407a8bfe1a77d2861c11)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:21.455491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:21.461144 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:21.542224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386df073ed28407a8bfe1a77d2861c11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:21.555269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386df073ed28407a8bfe1a77d2861c11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:21.578468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386df073ed28407a8bfe1a77d2861c11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:21.579286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386df073ed28407a8bfe1a77d2861c11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:21.601129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386df073ed28407a8bfe1a77d2861c11'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:21.609471 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4181/8371] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:21 2022] DELETE /identity/v3/users/386df073ed28407a8bfe1a77d2861c11 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:21.615397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34115-a952-4608-b29e-4e5b44aab50c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:21.615848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34115-a952-4608-b29e-4e5b44aab50c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:21.615926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34115-a952-4608-b29e-4e5b44aab50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:21.628036 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:21.647428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-16d34115-a952-4608-b29e-4e5b44aab50c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:21.648901 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-16d34115-a952-4608-b29e-4e5b44aab50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:21.788373 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4191/8372] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:21.801452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:21.802929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:21.898365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863612-0407-4d1a-a0ff-2104870aa8e0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:21.903141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:21.904046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:21.904530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:21.905048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:21.916459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:21.918649 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:21.943073 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4182/8373] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:22.048970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:22.049355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:22.049956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:22.111246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] MFA Rules not processed for user `c62d0152e89c461290120d94572ae7e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:22.112490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:22.234275 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4192/8374] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:22.260858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:22.263192 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:22.446202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:22.448040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:22.485786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbf0ad-5ed0-402c-bb85-af0292c212f2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:22.502858 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:22.503535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:22.503813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:22.504084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] PATH_INFO: `/v3/projects/0d8bf2cc4ff640fe9c5cea711453df0d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:22.506914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8bf2cc4ff640fe9c5cea711453df0d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:22.510789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:22.543419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92f657-5dd6-473a-862c-dd265ed2f091 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:22.567320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:22.569390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:22.569676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:22.569946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:22.581258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:22.638765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8bf2cc4ff640fe9c5cea711453df0d', 'request_id': 'req-67dd0c71-f700-425c-93bc-b1b7488144e9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:22.651388 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:22.663484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8bf2cc4ff640fe9c5cea711453df0d', 'request_id': 'req-67dd0c71-f700-425c-93bc-b1b7488144e9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:22.675132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8bf2cc4ff640fe9c5cea711453df0d', 'request_id': 'req-67dd0c71-f700-425c-93bc-b1b7488144e9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:22.723093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] The token cache is being invalidate because project 0d8bf2cc4ff640fe9c5cea711453df0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:22.723387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:22.729251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:22.731904 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4193/8375] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:22 2022] DELETE /identity/v3/projects/0d8bf2cc4ff640fe9c5cea711453df0d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:22.736559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:22.738926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:22.760322 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:22.783151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:22.785259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:22.830630 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4183/8376] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:22.884465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd0c71-f700-425c-93bc-b1b7488144e9 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:22.906485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:22.906485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:22.906485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:22.906485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] PATH_INFO: `/v3/users/6e9d23ad2cd14cc79e21f7560a92d822` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:22.912351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9d23ad2cd14cc79e21f7560a92d822)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:22.916508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:23.061334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9d23ad2cd14cc79e21f7560a92d822'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:23.074279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9d23ad2cd14cc79e21f7560a92d822'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:23.074989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9d23ad2cd14cc79e21f7560a92d822'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:23.093473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9d23ad2cd14cc79e21f7560a92d822'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:23.098229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9d23ad2cd14cc79e21f7560a92d822'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:23.174113 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4194/8377] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:22 2022] DELETE /identity/v3/users/6e9d23ad2cd14cc79e21f7560a92d822 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:24.530115 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:24.557520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665687-b92b-4adb-8de7-0635614f7829 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:24.807017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:24.811416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:24.811959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:24.812973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] PATH_INFO: `/v3/projects/480e12c7f7774d69a370ff841aef1d12` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:24.819443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] RBAC: Authorizing `identity:delete_project(project_id=480e12c7f7774d69a370ff841aef1d12)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:24.824845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:24.974621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:24.976251 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:25.032737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480e12c7f7774d69a370ff841aef1d12', 'request_id': 'req-e11da9d7-4d81-40fd-8f89-5d386414649b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:25.061764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480e12c7f7774d69a370ff841aef1d12', 'request_id': 'req-e11da9d7-4d81-40fd-8f89-5d386414649b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:25.087604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480e12c7f7774d69a370ff841aef1d12', 'request_id': 'req-e11da9d7-4d81-40fd-8f89-5d386414649b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:25.119133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] The token cache is being invalidate because project 480e12c7f7774d69a370ff841aef1d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:25.119496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:25.121464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-e11da9d7-4d81-40fd-8f89-5d386414649b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:25.140999 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4184/8378] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:24 2022] DELETE /identity/v3/projects/480e12c7f7774d69a370ff841aef1d12 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:25.143328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3270300-9a56-40aa-b5f2-6d191fec501b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:25.143617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3270300-9a56-40aa-b5f2-6d191fec501b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:25.153646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3270300-9a56-40aa-b5f2-6d191fec501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:25.198959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf1e25-732a-44ce-92ca-8986db3a813e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:25.233411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f3270300-9a56-40aa-b5f2-6d191fec501b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:25.269358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f3270300-9a56-40aa-b5f2-6d191fec501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:25.298922 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:25.436082 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:25.444338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:25.445866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:25.449033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:25.450953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:25.462718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:25.486079 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4185/8379] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:25.488462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630b21a-3add-4d5f-83d1-bcb8e32fe889 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:25.489712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630b21a-3add-4d5f-83d1-bcb8e32fe889 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:25.490194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630b21a-3add-4d5f-83d1-bcb8e32fe889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:25.528617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:25.534636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:25.541321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8630b21a-3add-4d5f-83d1-bcb8e32fe889 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:25.546063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8630b21a-3add-4d5f-83d1-bcb8e32fe889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:25.572166 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4186/8380] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:25.574480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630b21a-3add-4d5f-83d1-bcb8e32fe889 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:25.577224 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4195/8381] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:25.589680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630b21a-3add-4d5f-83d1-bcb8e32fe889 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:25.596480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:25.599081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:25.599520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:25.599944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:25.601081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:45:25.601543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:25.606087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:25.630755 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4187/8382] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:45:25.636044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:25.654475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2654cd-05ab-45a3-957f-9db817663c7f service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:25.667175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:25.667856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:25.668080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:25.668355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:25.669021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:25.693983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:25.816556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4196/8383] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:25 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:25.817852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:25.833846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e91c03-703f-4b10-a215-91f4276a275c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:25.988180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:25.989483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:25.990710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:25.991243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:26.005359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:26.012486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:26.087544 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4188/8384] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:25 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:26.091456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:26.109769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e636e1-0141-44ef-9dec-3d9f9db0ba61 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:26.124406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:26.139698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:26.141133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:26.149362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:26.150107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:26.177276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:26.225008 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4197/8385] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:26.229618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:26.247369 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f168ec-fc1a-4f27-88c9-d1c68ea5b7e9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:26.259431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c17c14-9795-41a1-b3c7-b8ca60bb2cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:26.260089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17c14-9795-41a1-b3c7-b8ca60bb2cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:26.260350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17c14-9795-41a1-b3c7-b8ca60bb2cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:26.260629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17c14-9795-41a1-b3c7-b8ca60bb2cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:26.264554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c17c14-9795-41a1-b3c7-b8ca60bb2cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:26.267884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c17c14-9795-41a1-b3c7-b8ca60bb2cf3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:26.298576 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4189/8386] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:26.301109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:26.334680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f234b-29f1-47ac-979f-4ea88cc1aec2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:26.353886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfc3f2-3d3d-4bb5-aeae-b6a1a2e1ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:26.354456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc3f2-3d3d-4bb5-aeae-b6a1a2e1ec49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:26.360552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc3f2-3d3d-4bb5-aeae-b6a1a2e1ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:26.361426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc3f2-3d3d-4bb5-aeae-b6a1a2e1ec49 admin admin] PATH_INFO: `/v3/projects/87b4d9eda9fe45a5bcd81122220d65dc/users/731ff168d2454522b4a5e051d77868ed/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:26.403168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfc3f2-3d3d-4bb5-aeae-b6a1a2e1ec49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b4d9eda9fe45a5bcd81122220d65dc, user_id=731ff168d2454522b4a5e051d77868ed, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:26.410461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfc3f2-3d3d-4bb5-aeae-b6a1a2e1ec49 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:26.433029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:26.433182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:26.433368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:26.446554 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4198/8387] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:26 2022] PUT /identity/v3/projects/87b4d9eda9fe45a5bcd81122220d65dc/users/731ff168d2454522b4a5e051d77868ed/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:45:26.461893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:26.462095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:26.462226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:26.503153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] MFA Rules not processed for user `c89ec4d04ba54e54a1d844a3566f3821`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:26.508349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:26.534603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] MFA Rules not processed for user `731ff168d2454522b4a5e051d77868ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:26.535941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:26.704470 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4199/8388] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:45:26.714610 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4190/8389] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:45:26.721074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:26.722919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:26.883458 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:26.898902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abe882-c607-4a4d-bfb6-dbebd9a25d44 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:26.911616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eadad0-3fc1-4e66-83ee-52f5764f8a69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:26.912679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eadad0-3fc1-4e66-83ee-52f5764f8a69 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:26.914174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eadad0-3fc1-4e66-83ee-52f5764f8a69 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:26.914555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eadad0-3fc1-4e66-83ee-52f5764f8a69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:26.941087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eadad0-3fc1-4e66-83ee-52f5764f8a69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:26.942721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eadad0-3fc1-4e66-83ee-52f5764f8a69 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:26.976561 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4200/8390] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:29.081732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:29.083447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:29.168386 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:29.191216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab5b9-5e05-42c5-b0db-27a5bd1ebed5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:29.197186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:29.198107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:29.198793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:29.199040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] PATH_INFO: `/v3/users/2e346be23a66470eac59e619522f4033` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:29.200385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e346be23a66470eac59e619522f4033)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:29.202715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:29.264376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e346be23a66470eac59e619522f4033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:29.276183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e346be23a66470eac59e619522f4033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:29.297450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e346be23a66470eac59e619522f4033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:29.299056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e346be23a66470eac59e619522f4033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:29.308993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e346be23a66470eac59e619522f4033'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:29.320855 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4191/8391] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:29 2022] DELETE /identity/v3/users/2e346be23a66470eac59e619522f4033 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:29.322658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:29.323093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:29.323210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:29.348875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:29.350445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:29.445337 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4201/8392] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:29.452166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:29.457165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:29.553320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f57ad6-138b-465b-995b-b9e96797cb8c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:29.558147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:29.559058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:29.559396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:29.559737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:29.574342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:29.576619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:29.612442 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4192/8393] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:30.042224 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:30.043674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:30.072817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2dd5-0d74-4460-9df2-d432172c7b35 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:30.079346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:30.080559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:30.081012 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:30.081442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] PATH_INFO: `/v3/projects/5f520c71edb04d26a71b4505e4ba6fc4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:30.090015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f520c71edb04d26a71b4505e4ba6fc4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:30.093273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:30.194395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f520c71edb04d26a71b4505e4ba6fc4', 'request_id': 'req-2c4abe4a-4e59-45f1-8088-b746c175e488'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.205971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f520c71edb04d26a71b4505e4ba6fc4', 'request_id': 'req-2c4abe4a-4e59-45f1-8088-b746c175e488'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.227073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f520c71edb04d26a71b4505e4ba6fc4', 'request_id': 'req-2c4abe4a-4e59-45f1-8088-b746c175e488'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.250700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] The token cache is being invalidate because project 5f520c71edb04d26a71b4505e4ba6fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:30.251040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.251756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.253668 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4202/8394] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:30 2022] DELETE /identity/v3/projects/5f520c71edb04d26a71b4505e4ba6fc4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:30.258161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:30.271835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc1a1-5614-4c7b-bee1-554c8046d656 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:30.382978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:30.384015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:30.384735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:30.385184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] PATH_INFO: `/v3/users/962d703c7eec4c49ba2710beac909249` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:30.386584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962d703c7eec4c49ba2710beac909249)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:30.389114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:30.408920 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:30.492740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962d703c7eec4c49ba2710beac909249'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.509110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962d703c7eec4c49ba2710beac909249'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.539640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962d703c7eec4c49ba2710beac909249'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.541171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962d703c7eec4c49ba2710beac909249'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.554204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-0f6d69e3-507b-42b2-97a5-2be733b53a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962d703c7eec4c49ba2710beac909249'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:30.562796 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4193/8395] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:30 2022] DELETE /identity/v3/users/962d703c7eec4c49ba2710beac909249 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:31.308155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:31.309623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:31.347467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4abe4a-4e59-45f1-8088-b746c175e488 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:31.506413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:31.507211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:31.507835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:31.508308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] PATH_INFO: `/v3/projects/795951a94fd44574a632372127059d6d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:31.509731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=795951a94fd44574a632372127059d6d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:31.512690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:31.553057 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:31.618023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795951a94fd44574a632372127059d6d', 'request_id': 'req-67ba1012-6693-407b-a728-48477a618c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:31.673686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795951a94fd44574a632372127059d6d', 'request_id': 'req-67ba1012-6693-407b-a728-48477a618c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:31.688416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795951a94fd44574a632372127059d6d', 'request_id': 'req-67ba1012-6693-407b-a728-48477a618c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:31.711513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] The token cache is being invalidate because project 795951a94fd44574a632372127059d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:31.711727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:31.712749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-67ba1012-6693-407b-a728-48477a618c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:31.719314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4203/8396] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:31 2022] DELETE /identity/v3/projects/795951a94fd44574a632372127059d6d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:31.724098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2adbd-50f5-41e8-a14d-be73dc2b7920 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:31.724618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2adbd-50f5-41e8-a14d-be73dc2b7920 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:31.724935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2adbd-50f5-41e8-a14d-be73dc2b7920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:31.771522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f3b2adbd-50f5-41e8-a14d-be73dc2b7920 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:31.772873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f3b2adbd-50f5-41e8-a14d-be73dc2b7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:31.924645 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4194/8397] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:31.930746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8859de-a434-4fc5-9e02-55e0df68a138 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:31.931034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8859de-a434-4fc5-9e02-55e0df68a138 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:31.931309 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8859de-a434-4fc5-9e02-55e0df68a138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:31.969598 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-db8859de-a434-4fc5-9e02-55e0df68a138 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:31.971429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-db8859de-a434-4fc5-9e02-55e0df68a138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:31.982450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4204/8398] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:31.987305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2adbd-50f5-41e8-a14d-be73dc2b7920 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:32.001170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2adbd-50f5-41e8-a14d-be73dc2b7920 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:32.010034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:32.010804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:32.011148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:32.011482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:32.012222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:45:32.012598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:32.014802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:32.034276 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4195/8399] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:45:32.038016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8859de-a434-4fc5-9e02-55e0df68a138 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:32.061163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8859de-a434-4fc5-9e02-55e0df68a138 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:32.075229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:32.076672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:32.077818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:32.078178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:32.081083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:32.083237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:32.152060 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4205/8400] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:32 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:45:32.156073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:32.171098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806dde-a2f5-46de-92f6-090caccbbb9e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:32.301734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:32.302528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:32.303160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:32.303761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:32.304634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:32.307670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:32.367432 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4196/8401] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:32 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:32.370587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:32.385038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f3d24-2ed5-4c7c-9d53-fb4fec00d4a6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:32.406626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:32.407640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:32.409043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:32.409993 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:32.410801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:32.414730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:32.466302 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4206/8402] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:32.470707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:32.498852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33736c3-e71d-4e0d-ae5d-974c4c1d2cc7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:32.505135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15a85a-3905-41fa-9aa2-add796e2a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:32.505772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a85a-3905-41fa-9aa2-add796e2a0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:32.506048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a85a-3905-41fa-9aa2-add796e2a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:32.506323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a85a-3905-41fa-9aa2-add796e2a0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:32.506978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15a85a-3905-41fa-9aa2-add796e2a0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:32.508847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15a85a-3905-41fa-9aa2-add796e2a0eb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:32.510572 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:32.538126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:32.538423 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4197/8403] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:32.553454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29becae-2c15-43f3-b654-2f3f5d9ccac4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:32.574055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:32.576311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:32.577358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:32.578354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] PATH_INFO: `/v3/projects/e2ea5734e4b54119aed4f6c872f640f3/users/5f652f8c83f24400bf9519de5816c259/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:32.639591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ea5734e4b54119aed4f6c872f640f3, user_id=5f652f8c83f24400bf9519de5816c259, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:32.643297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:32.668534 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4207/8404] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:32 2022] PUT /identity/v3/projects/e2ea5734e4b54119aed4f6c872f640f3/users/5f652f8c83f24400bf9519de5816c259/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:45:32.676230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:32.677185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:32.677489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:32.720701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:32.723047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:32.902457 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4198/8405] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:32.910870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:32.913570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:33.003333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c130298-c705-4512-a39f-6dd14578d533 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:33.007700 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:33.008316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:33.008596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:33.008897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:33.022957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:33.024820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:33.037190 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4208/8406] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:35.418267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:35.420534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:35.581065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1615e-746e-4bbf-8ab6-da8005b502f6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:35.590964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7074-2fa1-4d3a-97eb-bd48c4c3d024 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:35.591602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7074-2fa1-4d3a-97eb-bd48c4c3d024 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:35.591956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7074-2fa1-4d3a-97eb-bd48c4c3d024 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:35.592228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7074-2fa1-4d3a-97eb-bd48c4c3d024 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:35.597048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-220d7074-2fa1-4d3a-97eb-bd48c4c3d024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:35.615167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d7074-2fa1-4d3a-97eb-bd48c4c3d024 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:35.616820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d7074-2fa1-4d3a-97eb-bd48c4c3d024 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:35.654316 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4199/8407] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:39.767467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:39.769665 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:39.785406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08b3b-beb2-41a5-87dc-0ccee8d4db72 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:39.799918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:39.800379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:39.800503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:39.800503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:39.800676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:39.800917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:39.801190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] PATH_INFO: `/v3/users/1972cecb38fe443bbf248e71e6f01c12` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:39.808523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1972cecb38fe443bbf248e71e6f01c12)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:39.811086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:39.908973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] MFA Rules not processed for user `5f652f8c83f24400bf9519de5816c259`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:39.910371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:39.914776 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:39.954956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1972cecb38fe443bbf248e71e6f01c12'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:39.970911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1972cecb38fe443bbf248e71e6f01c12'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:39.971551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1972cecb38fe443bbf248e71e6f01c12'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:39.983106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1972cecb38fe443bbf248e71e6f01c12'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:39.983888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56078576-0a02-4859-88cb-39b73c2ad01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1972cecb38fe443bbf248e71e6f01c12'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:40.043977 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4209/8408] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:39 2022] DELETE /identity/v3/users/1972cecb38fe443bbf248e71e6f01c12 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:40.046559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.047281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.049027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.094732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:40.096378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:40.121945 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4200/8409] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:40.122935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:40.124376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:40.159266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47e44-a6be-41d8-9b83-1ec1c604331c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:40.205633 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:40.231101 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4210/8410] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:40.243869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:40.245641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:40.298756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:40.298756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.298756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.298756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.299282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:40.300482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:40.335255 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4201/8411] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:40 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:40.336425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:40.353389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e98a4-a4e2-436d-9ea5-ade206a0007f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:40.377823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:40.378050 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cffb7-f7aa-450c-923c-f25b39d4e36f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:40.379050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.379438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.379818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.380635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:40.382161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bed2b-c772-4486-b234-ceaeec96d30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:40.382653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:40.382830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bed2b-c772-4486-b234-ceaeec96d30e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.383111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bed2b-c772-4486-b234-ceaeec96d30e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.383378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bed2b-c772-4486-b234-ceaeec96d30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.400162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bed2b-c772-4486-b234-ceaeec96d30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:40.400801 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4202/8412] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:40.404983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bed2b-c772-4486-b234-ceaeec96d30e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:40.410804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:40.418675 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4211/8413] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:45:40.422767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10ffcc-9a81-437d-8b0f-c920c8b032e3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:40.429167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:40.430283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.430726 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.431164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] PATH_INFO: `/v3/system/users/af30f7cf3d5d4c2580899397ac1ea645/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.455802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af30f7cf3d5d4c2580899397ac1ea645, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:40.458842 n-d-master-1 devstack@keystone.service[81885]: WARNING py.warnings [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:45:40.458842 n-d-master-1 devstack@keystone.service[81885]: warnings.warn(msg) Aug 21 01:45:40.458842 n-d-master-1 devstack@keystone.service[81885]: Aug 21 01:45:40.459854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:40.474455 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4203/8414] 10.222.0.46 () {60 vars in 1378 bytes} [Sun Aug 21 01:45:40 2022] PUT /identity/v3/system/users/af30f7cf3d5d4c2580899397ac1ea645/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:40.486940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.487816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.487816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.521143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] MFA Rules not processed for user `af30f7cf3d5d4c2580899397ac1ea645`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:40.522467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:40.580678 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:40.677904 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4212/8415] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:40 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 01:45:40.682539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:40.748364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:40.750247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:40.776994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066730-53f2-477b-b7d8-68c235a21ff2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:40.783845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:40.785392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.786635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.787266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] PATH_INFO: `/v3/projects/b66b806e65424e56b49412c91d270e30` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.788938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66b806e65424e56b49412c91d270e30)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:40.792210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:40.866546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66b806e65424e56b49412c91d270e30', 'request_id': 'req-0da3a312-8040-4709-b4ed-90628f389b4a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:40.882646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66b806e65424e56b49412c91d270e30', 'request_id': 'req-0da3a312-8040-4709-b4ed-90628f389b4a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:40.893058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73e09d-7575-4419-81e7-ad55ee46f63d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:40.909916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66b806e65424e56b49412c91d270e30', 'request_id': 'req-0da3a312-8040-4709-b4ed-90628f389b4a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:40.941210 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:40.945606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] The token cache is being invalidate because project b66b806e65424e56b49412c91d270e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:40.946731 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:40.949180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0da3a312-8040-4709-b4ed-90628f389b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:40.953159 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4213/8416] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:40 2022] DELETE /identity/v3/projects/b66b806e65424e56b49412c91d270e30 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:45:40.960360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89af8d-59d0-4f10-b307-915cd6814ce6 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.960967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89af8d-59d0-4f10-b307-915cd6814ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.961262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89af8d-59d0-4f10-b307-915cd6814ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.976676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af30f7cf3d5d4c2580899397ac1ea645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:40.977647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:40.979111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:40.980181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] PATH_INFO: `/v3/services` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:40.980966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:40.982501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:40.993054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5b89af8d-59d0-4f10-b307-915cd6814ce6 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:40.994351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5b89af8d-59d0-4f10-b307-915cd6814ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:41.001192 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4204/8417] 10.222.0.46 () {58 vars in 1110 bytes} [Sun Aug 21 01:45:40 2022] GET /identity/v3/services => generated 2191 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:41.002643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.005143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:41.177514 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4214/8418] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:41.188211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc0ae-1557-45ad-9edb-e19f13de9bda None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.188487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc0ae-1557-45ad-9edb-e19f13de9bda None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.189979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc0ae-1557-45ad-9edb-e19f13de9bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.238638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-195dc0ae-1557-45ad-9edb-e19f13de9bda None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:41.240617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-195dc0ae-1557-45ad-9edb-e19f13de9bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:41.268440 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4215/8419] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:45:41.273045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dc0ae-1557-45ad-9edb-e19f13de9bda None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.288285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dc0ae-1557-45ad-9edb-e19f13de9bda None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.297905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.298563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.298838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.299111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.299772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:45:41.300069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.302478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.338522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4216/8420] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:45:41.343866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.347247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b381d8-e86b-41b7-b2b2-b618fe8a542a None tempest-ImageQuotaTest-1844397875-system-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.358507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b913d-b86d-4b71-bd53-12ac6bbbf1aa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.365779 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.366418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.366706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.367115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.368143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.370108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.396403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af30f7cf3d5d4c2580899397ac1ea645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.399925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.400377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.400786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] PATH_INFO: `/v3/limits` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.403341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.405033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.410139 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4217/8421] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:45:41 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:41.414067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.430149 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 21 01:45:41.461993 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 21 01:45:41.463154 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:45:41.468718 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4205/8422] 10.222.0.46 () {60 vars in 1126 bytes} [Sun Aug 21 01:45:41 2022] POST /identity/v3/limits => generated 124 bytes in 462 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 21 01:45:41.469784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.483653 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:41.493794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28dffd-ffb1-4c30-98e9-6876fc28e46a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.498688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.499377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.499722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.500076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.500836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.502937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.529160 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4218/8423] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:45:41 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:45:41.533369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.545913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4ca05-994b-414f-9ab7-492e15169c50 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.560131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.561452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.562048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.562396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.563216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.567038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.587018 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4219/8424] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:45:41.588792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.601773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01386-73c6-42d9-af58-dc6cf62698eb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.602009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4872-7116-48ba-b566-a8d688839f53 None tempest-ImageQuotaTest-1844397875-system-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.607885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.608367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.608825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.609078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.609725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.611703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.632216 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4220/8425] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:45:41.633359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.651247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67824498-6651-476e-b8ea-aaf6f6a59d51 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.664983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50eac6-27d9-40d7-88cf-cf641519287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.665677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50eac6-27d9-40d7-88cf-cf641519287e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.665957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50eac6-27d9-40d7-88cf-cf641519287e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.666232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50eac6-27d9-40d7-88cf-cf641519287e admin admin] PATH_INFO: `/v3/projects/225cd9662fd648cb85bfee65a6fe0660/users/6f075c3bf0954bff9e3b2cde9af3ae41/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.688383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af30f7cf3d5d4c2580899397ac1ea645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.689256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.689530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.689803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.693009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50eac6-27d9-40d7-88cf-cf641519287e admin admin] RBAC: Authorizing `identity:create_grant(project_id=225cd9662fd648cb85bfee65a6fe0660, user_id=6f075c3bf0954bff9e3b2cde9af3ae41, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.695871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50eac6-27d9-40d7-88cf-cf641519287e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.696506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:41.697670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:41.721229 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4206/8426] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:45:41 2022] GET /identity/v3/registered_limits => generated 129 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:45:41.722252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.730399 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4221/8427] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:45:41 2022] PUT /identity/v3/projects/225cd9662fd648cb85bfee65a6fe0660/users/6f075c3bf0954bff9e3b2cde9af3ae41/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:45:41.741742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.742029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.742304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.782196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] MFA Rules not processed for user `6f075c3bf0954bff9e3b2cde9af3ae41`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:45:41.784756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:41.866273 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:41.887220 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4222/8428] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:45:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:45:41.901854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:41.903404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:41.925505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386dd53-01cf-4161-9f48-e62ba7ce12e8 None tempest-ImageQuotaTest-1844397875-system-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:41.987217 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:41.995461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af30f7cf3d5d4c2580899397ac1ea645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:41.996093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:41.996367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:41.997372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:41.997520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:42.000068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:42.001871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ee54-f959-4607-a194-5b53e75c6f5c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:42.006203 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:42.006628 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4207/8429] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:45:41 2022] GET /identity/v3/registered_limits => generated 129 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:45:42.012714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:42.013131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:42.013484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:42.026194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:42.027663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:42.046005 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4223/8430] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:42.412734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:42.415257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:42.561488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774941af-4fbe-4bde-8aff-67fcee27ce65 None tempest-ImageQuotaTest-1844397875-system-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:42.569642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:42.570000 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:42.570246 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:42.570520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:42.575153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:42.693792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:42.696026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:42.710654 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4208/8431] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:45:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:45:47.564105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:47.566561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:47.664510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb67f0-de11-43ba-b4d1-58ae8e74e5fe service cinder] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:47.669873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:47.671269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:47.671752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:47.672400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] PATH_INFO: `/v3/users/5f652f8c83f24400bf9519de5816c259` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:47.676923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f652f8c83f24400bf9519de5816c259)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:47.679122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:47.753063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f652f8c83f24400bf9519de5816c259'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:47.766319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f652f8c83f24400bf9519de5816c259'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:47.769215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f652f8c83f24400bf9519de5816c259'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:47.778735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f652f8c83f24400bf9519de5816c259'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:47.779490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f652f8c83f24400bf9519de5816c259'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:47.802606 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4224/8432] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:47 2022] DELETE /identity/v3/users/5f652f8c83f24400bf9519de5816c259 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:48.007557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:48.026602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4757e6-5953-4cf9-99fc-4e85f143b688 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:48.084181 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:48.137382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:48.138051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:48.138344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:48.138679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] PATH_INFO: `/v3/projects/e2ea5734e4b54119aed4f6c872f640f3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:48.141647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ea5734e4b54119aed4f6c872f640f3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:48.143748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:48.203838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ea5734e4b54119aed4f6c872f640f3', 'request_id': 'req-804662e4-31e5-4afe-8d6a-7656e10c02bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.210764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ea5734e4b54119aed4f6c872f640f3', 'request_id': 'req-804662e4-31e5-4afe-8d6a-7656e10c02bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.216691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ea5734e4b54119aed4f6c872f640f3', 'request_id': 'req-804662e4-31e5-4afe-8d6a-7656e10c02bb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.246559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] The token cache is being invalidate because project e2ea5734e4b54119aed4f6c872f640f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:45:48.247145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.248014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.250058 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4209/8433] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:45:48 2022] DELETE /identity/v3/projects/e2ea5734e4b54119aed4f6c872f640f3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:48.255916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:48.257391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:48.271689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed3cd-e53c-45eb-bef7-ca600dfcd08b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:48.332593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:48.333263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:48.333539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:48.333804 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] PATH_INFO: `/v3/users/af30f7cf3d5d4c2580899397ac1ea645` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:48.334964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af30f7cf3d5d4c2580899397ac1ea645)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:48.336926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:48.348622 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:48.407551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af30f7cf3d5d4c2580899397ac1ea645'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.416392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af30f7cf3d5d4c2580899397ac1ea645'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.417051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af30f7cf3d5d4c2580899397ac1ea645'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.425266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af30f7cf3d5d4c2580899397ac1ea645'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.425999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af30f7cf3d5d4c2580899397ac1ea645'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:45:48.445775 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4225/8434] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:45:48 2022] DELETE /identity/v3/users/af30f7cf3d5d4c2580899397ac1ea645 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:45:48.773449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:45:48.774938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:45:48.821825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804662e4-31e5-4afe-8d6a-7656e10c02bb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:45:48.888950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14550412-a5a6-479b-b515-b64bfa3ccd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:45:48.889574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550412-a5a6-479b-b515-b64bfa3ccd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:45:48.889945 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550412-a5a6-479b-b515-b64bfa3ccd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:45:48.890220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550412-a5a6-479b-b515-b64bfa3ccd5e admin admin] PATH_INFO: `/v3/projects/None` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:45:48.899239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14550412-a5a6-479b-b515-b64bfa3ccd5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:45:48.901106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14550412-a5a6-479b-b515-b64bfa3ccd5e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application [None req-14550412-a5a6-479b-b515-b64bfa3ccd5e admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 01:45:48.912581 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 21 01:45:48.913732 n-d-master-1 devstack@keystone.service[81885]: ERROR keystone.server.flask.application Aug 21 01:45:48.914863 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4210/8435] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:45:48 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 01:45:58.442226 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=11,keystone:SELECT=26,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:58.904080 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:11.299767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:11.301349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:11.317198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716a09-faac-45e9-a654-adda3c2feb91 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:11.323002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:11.323941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:11.324369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:11.324864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] PATH_INFO: `/v3/users/731ff168d2454522b4a5e051d77868ed` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:11.326175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731ff168d2454522b4a5e051d77868ed)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:11.328646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:11.390051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731ff168d2454522b4a5e051d77868ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:11.403576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731ff168d2454522b4a5e051d77868ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:11.404571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731ff168d2454522b4a5e051d77868ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:11.417425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731ff168d2454522b4a5e051d77868ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:11.418492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731ff168d2454522b4a5e051d77868ed'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:11.448995 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4226/8436] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:46:11 2022] DELETE /identity/v3/users/731ff168d2454522b4a5e051d77868ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:11.457063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:11.457636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:11.457636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:11.497497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:11.498977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:11.563960 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4211/8437] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:11.573890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:11.575577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:11.692668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bce8-a7b7-473d-9a81-3f04ae014266 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:11.696736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47230a9c-43ab-473b-bdcd-99d871da94d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:11.697400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230a9c-43ab-473b-bdcd-99d871da94d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:11.697681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230a9c-43ab-473b-bdcd-99d871da94d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:11.698069 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230a9c-43ab-473b-bdcd-99d871da94d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:11.710318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47230a9c-43ab-473b-bdcd-99d871da94d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:11.712258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47230a9c-43ab-473b-bdcd-99d871da94d6 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:11.725934 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4227/8438] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:12.067277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.069099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:12.086993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b93cab-cf01-46a2-bc10-ae5049ec948e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.092309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.093152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.093436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.093715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] PATH_INFO: `/v3/projects/87b4d9eda9fe45a5bcd81122220d65dc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.095082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b4d9eda9fe45a5bcd81122220d65dc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.098478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:12.178461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b4d9eda9fe45a5bcd81122220d65dc', 'request_id': 'req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:12.185822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b4d9eda9fe45a5bcd81122220d65dc', 'request_id': 'req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:12.194363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b4d9eda9fe45a5bcd81122220d65dc', 'request_id': 'req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:12.211919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] The token cache is being invalidate because project 87b4d9eda9fe45a5bcd81122220d65dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:46:12.212220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:12.212906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d31f76e4-f9e2-4a15-9c79-4cf21e3ad520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:12.216621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4212/8439] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:46:12 2022] DELETE /identity/v3/projects/87b4d9eda9fe45a5bcd81122220d65dc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:12.221879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d49e6-4b56-48ef-ac03-e70df539b072 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.222771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d49e6-4b56-48ef-ac03-e70df539b072 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.223320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d49e6-4b56-48ef-ac03-e70df539b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.267793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-203d49e6-4b56-48ef-ac03-e70df539b072 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:12.269477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-203d49e6-4b56-48ef-ac03-e70df539b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:12.333354 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:12.356805 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4228/8440] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:12.364596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e3f6-baca-4ebc-b050-6a610917d82c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.364931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e3f6-baca-4ebc-b050-6a610917d82c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.365189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e3f6-baca-4ebc-b050-6a610917d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.387479 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0278e3f6-baca-4ebc-b050-6a610917d82c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:12.389158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0278e3f6-baca-4ebc-b050-6a610917d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:12.403570 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4213/8441] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:12.405395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d49e6-4b56-48ef-ac03-e70df539b072 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.416989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d49e6-4b56-48ef-ac03-e70df539b072 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.423944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.423944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.423944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.423944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.424373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:46:12.424373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.426045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:12.442959 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4229/8442] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:46:12.444052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278e3f6-baca-4ebc-b050-6a610917d82c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.454951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278e3f6-baca-4ebc-b050-6a610917d82c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.463710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.464478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.464760 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.465060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.465707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.467631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:12.501294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4214/8443] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:46:12 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:46:12.505587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.516719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39929ff-4ce5-4c40-9253-02f6ff87ca63 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.591713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.592425 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.592644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.592948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.593698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.595708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:12.623420 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4230/8444] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:46:12 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:46:12.625087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.636455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451e59c-bf16-497e-85de-52f98e49b17c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.641905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.642518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.642805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.643079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.643758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.645792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:12.660354 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4215/8445] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:46:12.661630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.672624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e585-039b-4f8f-af8c-59434f714532 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.678198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faf568-061e-4b9f-a0c2-5e1fe820d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.678942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf568-061e-4b9f-a0c2-5e1fe820d005 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.679249 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf568-061e-4b9f-a0c2-5e1fe820d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.679524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf568-061e-4b9f-a0c2-5e1fe820d005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.680208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faf568-061e-4b9f-a0c2-5e1fe820d005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.681860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faf568-061e-4b9f-a0c2-5e1fe820d005 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:12.699526 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4231/8446] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:46:12.700738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.713468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1aa3-7bc4-4c4b-a32f-647710cfae7f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.719712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.720402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.720685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.720997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] PATH_INFO: `/v3/projects/9d4ba3cc14844d08a6f85bbd32823067/users/f90ad477160c43d6afbdb868b89738fd/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.740229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4ba3cc14844d08a6f85bbd32823067, user_id=f90ad477160c43d6afbdb868b89738fd, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.743064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:12.759599 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4216/8447] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:46:12 2022] PUT /identity/v3/projects/9d4ba3cc14844d08a6f85bbd32823067/users/f90ad477160c43d6afbdb868b89738fd/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:12.772292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636efb65-3d9e-4e0e-b961-5491f8a7275b None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.772593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636efb65-3d9e-4e0e-b961-5491f8a7275b None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.772945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636efb65-3d9e-4e0e-b961-5491f8a7275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.802534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-636efb65-3d9e-4e0e-b961-5491f8a7275b None None] MFA Rules not processed for user `f90ad477160c43d6afbdb868b89738fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:12.804904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-636efb65-3d9e-4e0e-b961-5491f8a7275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:12.877873 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4232/8448] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:12.882575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:12.897323 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:12.963695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d80869-45da-4569-ac39-ebe1b17249a4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:12.968987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:12.969619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:12.969893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:12.970159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:12.970800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:12.972734 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:13.002630 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4217/8449] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:46:12 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:46:13.006799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636efb65-3d9e-4e0e-b961-5491f8a7275b None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:13.018163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636efb65-3d9e-4e0e-b961-5491f8a7275b None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:13.064123 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:13.082683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:13.085263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:13.085263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:13.085263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:13.085263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:13.086410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:13.111039 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4233/8450] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:46:13 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:46:13.113442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:13.124304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d9e9c-55c5-4490-8f6e-3670f3c8012e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:13.132373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:13.132968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:13.133235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:13.133512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:13.135522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:13.137203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:13.149731 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4218/8451] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:46:13.153970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:13.164781 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6223-2d81-4fba-894f-89b8561e04ea admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:13.170076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:13.170795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:13.171461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:13.171737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] PATH_INFO: `/v3/projects/905c257813494dcb9c715cf58f2930df/users/bfd5bef461e94a489f5ae70e8f8e5b20/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:13.188329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=905c257813494dcb9c715cf58f2930df, user_id=bfd5bef461e94a489f5ae70e8f8e5b20, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:13.191100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:13.205632 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4234/8452] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:46:13 2022] PUT /identity/v3/projects/905c257813494dcb9c715cf58f2930df/users/bfd5bef461e94a489f5ae70e8f8e5b20/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:13.209671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:13.220353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebbc1f-2e52-43ee-b250-a6d0862c254c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:13.283075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2b01-369d-47c8-af98-e585bad1ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:13.283714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2b01-369d-47c8-af98-e585bad1ca48 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:13.283987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2b01-369d-47c8-af98-e585bad1ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:13.284258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2b01-369d-47c8-af98-e585bad1ca48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:13.284958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2b01-369d-47c8-af98-e585bad1ca48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:13.286542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2b01-369d-47c8-af98-e585bad1ca48 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:13.297747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4219/8453] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:46:13.302095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:13.313674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937cea7-49ea-4882-80a8-f748a80a8a5e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:13.318539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:13.319303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:13.319580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:13.319914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] PATH_INFO: `/v3/projects/905c257813494dcb9c715cf58f2930df/users/bfd5bef461e94a489f5ae70e8f8e5b20/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:13.322234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905c257813494dcb9c715cf58f2930df, user_id=bfd5bef461e94a489f5ae70e8f8e5b20, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:13.324956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:13.336433 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4235/8454] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:46:13 2022] PUT /identity/v3/projects/905c257813494dcb9c715cf58f2930df/users/bfd5bef461e94a489f5ae70e8f8e5b20/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:46:13.347007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:13.347297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:13.347566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:13.377292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] MFA Rules not processed for user `bfd5bef461e94a489f5ae70e8f8e5b20`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:13.378598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:13.455472 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4220/8455] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:13.466137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:13.470897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:13.536461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814547ce-0f2d-4864-93ce-ba3d89db9081 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:13.540541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:13.543521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:13.543777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:13.544056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:13.607987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:13.609555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:13.618994 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4236/8456] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:15.457066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:15.458597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:15.475639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd7443-5471-4f76-a7f3-d01859bb559d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:15.481056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb526aa9-cc60-4136-a660-f65652ffe385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:15.482046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526aa9-cc60-4136-a660-f65652ffe385 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:15.482541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526aa9-cc60-4136-a660-f65652ffe385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:15.482980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526aa9-cc60-4136-a660-f65652ffe385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:15.486153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb526aa9-cc60-4136-a660-f65652ffe385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:15.496725 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:15.503940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb526aa9-cc60-4136-a660-f65652ffe385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:15.507662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb526aa9-cc60-4136-a660-f65652ffe385 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:15.520390 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4221/8457] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:15.751053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:15.764187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4bc0-13c2-452a-a421-550598120c6b service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:15.768639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:15.769384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:15.770085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:15.770516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:15.780712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:15.782682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:15.793430 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4237/8458] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:21.200674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:21.201255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:21.201379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:21.226741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] MFA Rules not processed for user `f90ad477160c43d6afbdb868b89738fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:21.228497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:21.239888 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4222/8459] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:21.662534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:21.685106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f6b0c-f438-4384-b6bc-74a044b8b158 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:21.695783 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:21.696458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:21.696735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:21.697061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:21.699365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:21.721861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:21.723342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:21.735872 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4238/8460] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:27.081586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:27.083318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:27.184613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bfebd-0789-4c6c-9c71-69837000986a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:27.190594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:27.191215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:27.191519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:27.191791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:27.193642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:27.261452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:27.263062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:27.274163 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4223/8461] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:31.729108 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:37.269660 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=68 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:37.673977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:37.675510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:37.786509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6faa7-2817-44c8-b6c3-53c4aa064b2d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:37.791654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404d06a-9e79-4c4b-8553-07f6a380f61c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:37.792327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d06a-9e79-4c4b-8553-07f6a380f61c service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:37.792792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d06a-9e79-4c4b-8553-07f6a380f61c service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:37.793231 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d06a-9e79-4c4b-8553-07f6a380f61c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:37.795469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7404d06a-9e79-4c4b-8553-07f6a380f61c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:37.819673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404d06a-9e79-4c4b-8553-07f6a380f61c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:37.821959 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404d06a-9e79-4c4b-8553-07f6a380f61c service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:37.838093 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4239/8462] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:40.194071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:40.195621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:40.270614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa30a2-a800-4dce-bab3-6320dc16b895 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:40.276089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:40.276899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:40.277467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:40.277982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] PATH_INFO: `/v3/users/6f075c3bf0954bff9e3b2cde9af3ae41` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:40.279224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f075c3bf0954bff9e3b2cde9af3ae41)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:40.281579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:40.333279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f075c3bf0954bff9e3b2cde9af3ae41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:40.343583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f075c3bf0954bff9e3b2cde9af3ae41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:40.356853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f075c3bf0954bff9e3b2cde9af3ae41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:40.357481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f075c3bf0954bff9e3b2cde9af3ae41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:40.366302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f075c3bf0954bff9e3b2cde9af3ae41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:40.373251 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4224/8463] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:46:40 2022] DELETE /identity/v3/users/6f075c3bf0954bff9e3b2cde9af3ae41 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:40.378491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:40.379437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:40.379920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:40.402430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:40.403773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:40.470976 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4240/8464] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:40.488221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:40.489927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:40.562570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122a10f-b8ab-4a2a-9f47-0256b0d0aacd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:40.566334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89538b6a-4a82-4a3d-9881-badd37467969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:40.566952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538b6a-4a82-4a3d-9881-badd37467969 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:40.567231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538b6a-4a82-4a3d-9881-badd37467969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:40.567508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538b6a-4a82-4a3d-9881-badd37467969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:40.577801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89538b6a-4a82-4a3d-9881-badd37467969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:40.578764 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89538b6a-4a82-4a3d-9881-badd37467969 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:40.589215 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4225/8465] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:41.058318 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.059988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:41.073461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf93b71-74ad-4ce0-9208-5835cbd70679 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:41.080044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:41.080707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.081019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.081292 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] PATH_INFO: `/v3/projects/225cd9662fd648cb85bfee65a6fe0660` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.082542 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=225cd9662fd648cb85bfee65a6fe0660)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:41.084464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:41.162592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225cd9662fd648cb85bfee65a6fe0660', 'request_id': 'req-2951d412-dd14-499b-8e9e-e2bc9e21b23b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:41.172703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225cd9662fd648cb85bfee65a6fe0660', 'request_id': 'req-2951d412-dd14-499b-8e9e-e2bc9e21b23b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:41.179480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225cd9662fd648cb85bfee65a6fe0660', 'request_id': 'req-2951d412-dd14-499b-8e9e-e2bc9e21b23b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:41.191661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] The token cache is being invalidate because project 225cd9662fd648cb85bfee65a6fe0660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:46:41.191910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:41.192711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2951d412-dd14-499b-8e9e-e2bc9e21b23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:41.194348 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4241/8466] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:46:41 2022] DELETE /identity/v3/projects/225cd9662fd648cb85bfee65a6fe0660 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:41.199840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f052-088e-4128-85a4-b75dc80ee912 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.200394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f052-088e-4128-85a4-b75dc80ee912 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.200513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f052-088e-4128-85a4-b75dc80ee912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.222291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9405f052-088e-4128-85a4-b75dc80ee912 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:41.223895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9405f052-088e-4128-85a4-b75dc80ee912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:41.242028 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:41.454065 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4226/8467] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:41.462756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5124c-f036-4412-bb64-8672405c10db None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.463245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5124c-f036-4412-bb64-8672405c10db None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.463340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5124c-f036-4412-bb64-8672405c10db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.483520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-10d5124c-f036-4412-bb64-8672405c10db None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:41.484746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-10d5124c-f036-4412-bb64-8672405c10db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:41.496166 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4242/8468] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:41.497518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405f052-088e-4128-85a4-b75dc80ee912 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.508823 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405f052-088e-4128-85a4-b75dc80ee912 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:41.514659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:41.515278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.515545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.515802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.516446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:46:41.516737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:41.518361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:41.536245 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4227/8469] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:46:41.540844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5124c-f036-4412-bb64-8672405c10db None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.551321 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5124c-f036-4412-bb64-8672405c10db None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:41.556790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:41.557512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.558179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.558179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.558941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:41.560971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:41.566231 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:41.595146 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4243/8470] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:46:41 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:46:41.599826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.612191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061840a-a192-4474-a64f-ec1e0339ff40 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:41.676229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:41.677190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.677611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.678020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.679084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:41.681363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:41.711966 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4228/8471] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:46:41 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:46:41.713512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.724530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a7b53-44e0-4250-b3b8-ede01f9bd535 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:41.729599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:41.730209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.730481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.730746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.731385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:41.733127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:41.747838 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4244/8472] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:46:41.749608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.760397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4c9f-6c37-4ba1-a212-070e763f5a48 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:41.765386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942dbd4-b1d4-4e88-90a5-b9388e4a211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:41.766002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942dbd4-b1d4-4e88-90a5-b9388e4a211c admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.766286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942dbd4-b1d4-4e88-90a5-b9388e4a211c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.767145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942dbd4-b1d4-4e88-90a5-b9388e4a211c admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.767912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942dbd4-b1d4-4e88-90a5-b9388e4a211c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:41.771123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942dbd4-b1d4-4e88-90a5-b9388e4a211c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:41.784074 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4229/8473] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:46:41.789353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.806601 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e8b1-2c65-45a7-9876-2bd8a075026a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:41.812823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:41.813551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.813826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.814093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] PATH_INFO: `/v3/projects/6dc448b84d714d849db9ca44a7757cd3/users/54c6df6966244dd8937bb33059885877/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.833860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc448b84d714d849db9ca44a7757cd3, user_id=54c6df6966244dd8937bb33059885877, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:41.836809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:41.855391 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4245/8474] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:46:41 2022] PUT /identity/v3/projects/6dc448b84d714d849db9ca44a7757cd3/users/54c6df6966244dd8937bb33059885877/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:41.866517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86bd50-0eb7-4cc0-b488-dee87a230c8c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:41.866801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86bd50-0eb7-4cc0-b488-dee87a230c8c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:41.867094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86bd50-0eb7-4cc0-b488-dee87a230c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:41.900290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ab86bd50-0eb7-4cc0-b488-dee87a230c8c None None] MFA Rules not processed for user `54c6df6966244dd8937bb33059885877`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:41.900733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab86bd50-0eb7-4cc0-b488-dee87a230c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:41.978213 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4230/8475] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:46:41.989493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:41.991269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:42.056559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05260d2d-1673-4059-a427-6e0216b54dff admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:42.060744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914f04a-c1cd-40a8-b425-a35fc13be33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:42.061738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f04a-c1cd-40a8-b425-a35fc13be33e service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:42.062110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f04a-c1cd-40a8-b425-a35fc13be33e service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:42.062463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f04a-c1cd-40a8-b425-a35fc13be33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:42.072835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914f04a-c1cd-40a8-b425-a35fc13be33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:42.074478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914f04a-c1cd-40a8-b425-a35fc13be33e service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:42.084453 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4246/8476] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:42.110714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86bd50-0eb7-4cc0-b488-dee87a230c8c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:42.147212 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:42.211956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86bd50-0eb7-4cc0-b488-dee87a230c8c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:42.222062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:42.222901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:42.223209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:42.223601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] PATH_INFO: `/v3/users/54c6df6966244dd8937bb33059885877` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:42.225014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c6df6966244dd8937bb33059885877)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:42.227158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:42.284261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c6df6966244dd8937bb33059885877'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:42.296407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c6df6966244dd8937bb33059885877'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:42.314852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c6df6966244dd8937bb33059885877'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:42.316149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c6df6966244dd8937bb33059885877'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:42.326400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c6df6966244dd8937bb33059885877'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:42.334162 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4231/8477] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:46:42 2022] DELETE /identity/v3/users/54c6df6966244dd8937bb33059885877 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:42.339419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:42.339788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:42.340248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:42.363615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:42.365089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:42.444015 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4247/8478] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:42.457212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:42.458739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:42.531512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bed8-8241-486d-b458-90594c8caddd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:42.535790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530322-3c22-472b-b453-485159319f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:42.536489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530322-3c22-472b-b453-485159319f42 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:42.536630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530322-3c22-472b-b453-485159319f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:42.536936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530322-3c22-472b-b453-485159319f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:42.551218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530322-3c22-472b-b453-485159319f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:42.552680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530322-3c22-472b-b453-485159319f42 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:42.563654 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4232/8479] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:43.010971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:43.012485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:43.027864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e05e4-b434-4f20-bfdf-c3e6d97300c7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:43.033800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:43.034710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.035172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.035442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] PATH_INFO: `/v3/projects/6dc448b84d714d849db9ca44a7757cd3` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.036646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc448b84d714d849db9ca44a7757cd3)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:43.038728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:43.169372 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:43.172025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc448b84d714d849db9ca44a7757cd3', 'request_id': 'req-78631176-b25d-45f9-a571-93df43fde0e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:43.187825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc448b84d714d849db9ca44a7757cd3', 'request_id': 'req-78631176-b25d-45f9-a571-93df43fde0e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:43.209123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc448b84d714d849db9ca44a7757cd3', 'request_id': 'req-78631176-b25d-45f9-a571-93df43fde0e2'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:43.223374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] The token cache is being invalidate because project 6dc448b84d714d849db9ca44a7757cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:46:43.223724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:43.224818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-78631176-b25d-45f9-a571-93df43fde0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:46:43.227358 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4248/8480] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:46:43 2022] DELETE /identity/v3/projects/6dc448b84d714d849db9ca44a7757cd3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:43.232862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cece-bc16-45d2-8771-244167d5d411 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.234321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cece-bc16-45d2-8771-244167d5d411 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.234681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cece-bc16-45d2-8771-244167d5d411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.257669 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-49f9cece-bc16-45d2-8771-244167d5d411 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:43.258903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-49f9cece-bc16-45d2-8771-244167d5d411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:43.309526 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:43.374468 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4233/8481] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:46:43.383725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6063a-2ff4-4c06-907e-14b9ff4fdc4e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.384017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6063a-2ff4-4c06-907e-14b9ff4fdc4e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.384296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6063a-2ff4-4c06-907e-14b9ff4fdc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.418267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-52b6063a-2ff4-4c06-907e-14b9ff4fdc4e None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:43.419515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-52b6063a-2ff4-4c06-907e-14b9ff4fdc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:43.451869 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4249/8482] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:43.456799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cece-bc16-45d2-8771-244167d5d411 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:43.469284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cece-bc16-45d2-8771-244167d5d411 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:43.474554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:43.475275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.475617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.475956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.476861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:46:43.477229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:43.478920 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:43.496901 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4234/8483] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:46:43.503108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6063a-2ff4-4c06-907e-14b9ff4fdc4e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:43.514312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6063a-2ff4-4c06-907e-14b9ff4fdc4e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:43.520424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:43.521150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.521427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.521693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.522704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:43.524651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:43.573673 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4250/8484] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:46:43 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:46:43.578072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:43.589043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361048b-bb7c-4a3e-8b9a-4d52c94797b7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:43.668100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:43.668911 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.669304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.669645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.670728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:43.673082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:43.703973 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4235/8485] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:46:43 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:46:43.707877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:43.729133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862f91-cccc-4487-b4b4-105214c9e2a0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:43.737305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:43.738644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.741040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.741594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.742588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:43.744941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:43.765854 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4251/8486] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:46:43.769328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:43.785224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb18a1-fc9d-4891-9c7c-26bc005c8faf admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:43.791457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8aee-3385-4afa-b734-35e4a420169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:43.792909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8aee-3385-4afa-b734-35e4a420169e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.793321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8aee-3385-4afa-b734-35e4a420169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.793686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8aee-3385-4afa-b734-35e4a420169e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.794495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8aee-3385-4afa-b734-35e4a420169e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:43.797843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8aee-3385-4afa-b734-35e4a420169e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:43.816549 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4236/8487] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:46:43.820951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:43.835628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eedd4-dff3-40b3-aae5-18bc256dc164 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:43.843015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:43.844405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.844832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.845178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] PATH_INFO: `/v3/projects/406733cfbadb4633a74f1680bcddb5da/users/781e46904b7243f29208992393cf4945/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.865111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406733cfbadb4633a74f1680bcddb5da, user_id=781e46904b7243f29208992393cf4945, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:43.867910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:43.889953 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4252/8488] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:46:43 2022] PUT /identity/v3/projects/406733cfbadb4633a74f1680bcddb5da/users/781e46904b7243f29208992393cf4945/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:46:43.899826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a0ed-cff3-4268-a730-bf51eefeeb1e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:43.900141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a0ed-cff3-4268-a730-bf51eefeeb1e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:43.900444 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a0ed-cff3-4268-a730-bf51eefeeb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:43.931925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6be5a0ed-cff3-4268-a730-bf51eefeeb1e None None] MFA Rules not processed for user `781e46904b7243f29208992393cf4945`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:43.933532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6be5a0ed-cff3-4268-a730-bf51eefeeb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:44.015985 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4237/8489] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:44.028519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:44.030807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:44.129816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6fa6-9fb3-4666-b0a0-3ca9ae6e32d5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:44.137431 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9a45f-fcf0-4dc8-8d67-7968211a0c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:44.138100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a45f-fcf0-4dc8-8d67-7968211a0c24 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:44.138339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a45f-fcf0-4dc8-8d67-7968211a0c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:44.138599 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a45f-fcf0-4dc8-8d67-7968211a0c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:44.156710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9a45f-fcf0-4dc8-8d67-7968211a0c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:44.158389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9a45f-fcf0-4dc8-8d67-7968211a0c24 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:44.168504 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4253/8490] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:44.287412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:44.287946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:44.288343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:44.308757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] MFA Rules not processed for user `6a5f1b1c768b43be80f4e2a89694a811`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:44.310284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:44.346821 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:44.383509 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4238/8491] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:46.740062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:46.741215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:46.741498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:46.761766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] MFA Rules not processed for user `781e46904b7243f29208992393cf4945`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:46:46.763128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:46.770641 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4254/8492] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:46:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:46:50.942610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:50.944190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:51.010740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00b273-1d01-45ef-bb36-d682bbcbfd6d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:51.014815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479e24a-675a-46d8-b755-70f2e1862ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:51.015438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e24a-675a-46d8-b755-70f2e1862ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:51.015705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e24a-675a-46d8-b755-70f2e1862ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:51.015987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e24a-675a-46d8-b755-70f2e1862ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:51.017795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d479e24a-675a-46d8-b755-70f2e1862ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:51.096417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479e24a-675a-46d8-b755-70f2e1862ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:51.098276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479e24a-675a-46d8-b755-70f2e1862ce7 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:51.113800 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4239/8493] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:46:51.328419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:46:51.330091 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:51.347331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89763d-7c18-43d3-920a-0c4e8ec92c82 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:46:51.351693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:46:51.352302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:46:51.352564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:46:51.352887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:46:51.355025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:46:51.372341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:46:51.374056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:46:51.387825 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4255/8494] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:46:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:47:01.107259 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=63 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:01.380339 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=69,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:01.854891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996060fe-990f-4e20-8546-a87944dbd65d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:01.855180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996060fe-990f-4e20-8546-a87944dbd65d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:01.855455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996060fe-990f-4e20-8546-a87944dbd65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:01.885034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-996060fe-990f-4e20-8546-a87944dbd65d None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:47:01.886260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-996060fe-990f-4e20-8546-a87944dbd65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:01.947387 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4240/8495] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:47:01.995675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:01.997503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:02.086233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d910c2-8dfb-4db4-af1b-85b81888d1fb service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:02.091636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:02.092257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:02.092528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:02.092824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:02.102509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:02.104260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:02.113097 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4256/8496] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:47:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:47:02.663519 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0410f3-f426-4526-ac59-0cddc59f6c26 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:02.664060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0410f3-f426-4526-ac59-0cddc59f6c26 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:02.664060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0410f3-f426-4526-ac59-0cddc59f6c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:02.684481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6b0410f3-f426-4526-ac59-0cddc59f6c26 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:47:02.685772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b0410f3-f426-4526-ac59-0cddc59f6c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:02.694807 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4241/8497] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:47:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:47:02.709278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:02.722838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da5393-901e-41bc-9617-fcdfe8c324d7 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:02.728622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:02.729242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:02.729516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:02.729787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:02.738283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:02.739863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:02.748659 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4257/8498] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:47:02.990504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2c3e-67f3-467e-8f00-8defce5071be None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:02.990782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2c3e-67f3-467e-8f00-8defce5071be None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:02.991052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2c3e-67f3-467e-8f00-8defce5071be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:03.011757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ae1c2c3e-67f3-467e-8f00-8defce5071be None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:47:03.013010 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ae1c2c3e-67f3-467e-8f00-8defce5071be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:03.022153 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4242/8499] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:47:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:47:03.034492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:03.048148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9486cbd-725a-427a-a9e0-d13ec6736972 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:03.054333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:03.054987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:03.055379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:03.055798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:03.065913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:03.067792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:03.077128 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4258/8500] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:47:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:47:03.426624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8bdec-c450-45b1-9d32-7b76f6bb0e1f None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:03.426896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8bdec-c450-45b1-9d32-7b76f6bb0e1f None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:03.427165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8bdec-c450-45b1-9d32-7b76f6bb0e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:03.447063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e1f8bdec-c450-45b1-9d32-7b76f6bb0e1f None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:47:03.448276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e1f8bdec-c450-45b1-9d32-7b76f6bb0e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:03.457177 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4243/8501] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:47:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:47:03.471626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:03.489480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26bfea-bc3b-4000-a7a9-aedeaf59471f service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:03.498417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361ffc-6ded-40b4-b539-a8838dc8d0c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:03.499019 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361ffc-6ded-40b4-b539-a8838dc8d0c0 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:03.499300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361ffc-6ded-40b4-b539-a8838dc8d0c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:03.499572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361ffc-6ded-40b4-b539-a8838dc8d0c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:03.508688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361ffc-6ded-40b4-b539-a8838dc8d0c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:03.510347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361ffc-6ded-40b4-b539-a8838dc8d0c0 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:03.519248 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4259/8502] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:47:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:47:06.722580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8bdec-c450-45b1-9d32-7b76f6bb0e1f None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:06.791031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8bdec-c450-45b1-9d32-7b76f6bb0e1f None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:06.796714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:06.797509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:06.797788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:06.798059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] PATH_INFO: `/v3/users/781e46904b7243f29208992393cf4945` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:06.799423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=781e46904b7243f29208992393cf4945)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:06.801447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:06.850065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781e46904b7243f29208992393cf4945'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:06.858256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781e46904b7243f29208992393cf4945'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:06.871495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781e46904b7243f29208992393cf4945'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:06.872545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781e46904b7243f29208992393cf4945'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:06.878079 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:06.880262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781e46904b7243f29208992393cf4945'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:06.887440 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4244/8503] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:47:06 2022] DELETE /identity/v3/users/781e46904b7243f29208992393cf4945 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:47:06.893791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:06.894342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:06.894585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:06.915410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:47:06.916694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:06.980025 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4260/8504] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:47:06.990450 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:06.992079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:07.059042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faf49c-af6c-4ce5-8141-07d8a3534758 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:07.063065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa5d0d-393c-462e-ba44-8fc81710f813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:07.063677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5d0d-393c-462e-ba44-8fc81710f813 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:07.063951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5d0d-393c-462e-ba44-8fc81710f813 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:07.064217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5d0d-393c-462e-ba44-8fc81710f813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:07.073988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa5d0d-393c-462e-ba44-8fc81710f813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:07.076061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa5d0d-393c-462e-ba44-8fc81710f813 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:07.086279 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4245/8505] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:47:07.263397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:07.265088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:07.279011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c23b-ec4e-4b96-ba24-ea146dba77cb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:07.284871 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:07.285620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:07.285967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:07.286306 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] PATH_INFO: `/v3/projects/406733cfbadb4633a74f1680bcddb5da` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:07.287746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406733cfbadb4633a74f1680bcddb5da)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:07.289820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:07.344352 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:07.347681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406733cfbadb4633a74f1680bcddb5da', 'request_id': 'req-26b935f5-c764-4c43-aee2-53acd261b1e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:07.357081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406733cfbadb4633a74f1680bcddb5da', 'request_id': 'req-26b935f5-c764-4c43-aee2-53acd261b1e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:07.363094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406733cfbadb4633a74f1680bcddb5da', 'request_id': 'req-26b935f5-c764-4c43-aee2-53acd261b1e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:07.374725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] The token cache is being invalidate because project 406733cfbadb4633a74f1680bcddb5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:47:07.375016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:07.375770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:47:07.377403 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4261/8506] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:47:07 2022] DELETE /identity/v3/projects/406733cfbadb4633a74f1680bcddb5da => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:47:17.081738 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=28 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:17.371526 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:53.703511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:53.704057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:53.704057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:53.723695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] MFA Rules not processed for user `f90ad477160c43d6afbdb868b89738fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:47:53.724959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:53.783083 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4246/8507] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:47:54.112732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:54.114344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:54.179143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b935f5-c764-4c43-aee2-53acd261b1e4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:54.182991 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:54.183592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:54.183870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:54.184144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:54.186115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:54.199652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:54.201198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:54.212393 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4262/8508] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:47:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:47:56.287398 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:56.289101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:56.305783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574b1ec-bacb-4575-b5d2-ae181477ef9e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:56.310196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:56.310872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:56.311211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:56.311689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:56.313707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:56.327580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:56.329040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:56.341529 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4247/8509] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:47:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:47:57.320029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:47:57.321667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:57.406284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82c747-bbed-4738-8db7-d26780982e60 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:47:57.411837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:47:57.412448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:47:57.412726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:47:57.413025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:47:57.414801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:47:57.430066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:47:57.431645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:47:57.445045 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4263/8510] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:47:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:48:06.334292 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=31 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:07.438168 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=60 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:14.181987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:48:14.183523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:14.265008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669d22-6dbb-480c-8e8a-9fede67cf01a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:48:14.271804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:48:14.272417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:14.272696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:14.272994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:14.275072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:14.289451 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:48:14.291504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:48:14.304382 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4248/8511] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:48:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:48:14.475195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:48:14.487550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead28975-8fcd-4418-b858-ef9c41b24af6 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:48:14.491337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:48:14.491928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:14.492204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:14.492473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:14.494223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:14.506404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:48:14.507811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:48:14.521823 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4264/8512] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:48:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:48:14.615642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:48:14.628250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb811e25-4cdf-4d61-a8a6-bf5846e58b7e service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:48:14.632421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073a17-77af-46df-baf6-71641a4cd02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:48:14.633080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073a17-77af-46df-baf6-71641a4cd02f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:14.633361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073a17-77af-46df-baf6-71641a4cd02f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:14.633630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073a17-77af-46df-baf6-71641a4cd02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:14.635578 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-eb073a17-77af-46df-baf6-71641a4cd02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:14.653870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073a17-77af-46df-baf6-71641a4cd02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:48:14.655270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073a17-77af-46df-baf6-71641a4cd02f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:48:14.670750 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4249/8513] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:48:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:48:24.512308 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:24.662265 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=38 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:37.610875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:48:37.625919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fda7f-ce8c-4642-bdea-86d0bb7bfc83 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:48:37.631379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:48:37.632355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:37.633519 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:37.633998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:37.640187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:37.707664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:48:37.712479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:48:37.732431 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4265/8514] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:48:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:48:41.117206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206eb8-52d5-4124-9c7d-1ea1c72f8d38 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:41.118077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206eb8-52d5-4124-9c7d-1ea1c72f8d38 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:41.118356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206eb8-52d5-4124-9c7d-1ea1c72f8d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:41.154646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b7206eb8-52d5-4124-9c7d-1ea1c72f8d38 None None] MFA Rules not processed for user `6a5f1b1c768b43be80f4e2a89694a811`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:48:41.156074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b7206eb8-52d5-4124-9c7d-1ea1c72f8d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:41.263948 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4250/8515] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:48:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:48:42.113723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:48:42.115502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:42.144346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167ed00-4b7a-4c63-9d0b-1ae7b245c218 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:48:42.149799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340b635-f0dd-48f4-94c3-e30b7186910d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:48:42.150436 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b635-f0dd-48f4-94c3-e30b7186910d service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:42.150709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b635-f0dd-48f4-94c3-e30b7186910d service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:42.150972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b635-f0dd-48f4-94c3-e30b7186910d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:42.152790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a340b635-f0dd-48f4-94c3-e30b7186910d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:42.168372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340b635-f0dd-48f4-94c3-e30b7186910d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:48:42.170287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340b635-f0dd-48f4-94c3-e30b7186910d service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:48:42.186358 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4266/8516] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:48:51.239353 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=25 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:51.895622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7206eb8-52d5-4124-9c7d-1ea1c72f8d38 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:48:51.927411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7206eb8-52d5-4124-9c7d-1ea1c72f8d38 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:48:51.940382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:48:51.941036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:51.941313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:51.941589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:51.943386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:51.999910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:48:52.001744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:48:52.026683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4251/8517] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:48:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:48:52.177142 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=12 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:53.121800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193152c8-b85e-461d-b517-80d47fe9b963 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:48:53.122146 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193152c8-b85e-461d-b517-80d47fe9b963 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:48:53.122479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193152c8-b85e-461d-b517-80d47fe9b963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:48:53.149414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-193152c8-b85e-461d-b517-80d47fe9b963 None None] MFA Rules not processed for user `f90ad477160c43d6afbdb868b89738fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:48:53.150608 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-193152c8-b85e-461d-b517-80d47fe9b963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:48:53.160187 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4267/8518] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:48:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:02.017469 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:03.142308 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:42.933127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:42.934581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:43.018779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7be259-e4ca-4fd0-bf10-b0b74be82704 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:43.025842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:43.026637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:43.026918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:43.027189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] PATH_INFO: `/v3/users/f90ad477160c43d6afbdb868b89738fd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:43.028357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90ad477160c43d6afbdb868b89738fd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:43.030310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:43.094089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90ad477160c43d6afbdb868b89738fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.102897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90ad477160c43d6afbdb868b89738fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.116939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90ad477160c43d6afbdb868b89738fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.117660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90ad477160c43d6afbdb868b89738fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.129566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90ad477160c43d6afbdb868b89738fd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.138987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4252/8519] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:49:42 2022] DELETE /identity/v3/users/f90ad477160c43d6afbdb868b89738fd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:49:43.140758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:43.141232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:43.141341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:43.161874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:49:43.163051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:43.235949 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4268/8520] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:43.246118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:43.247714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:43.339448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3315b-e986-46d5-a0eb-effd6329b3fa admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:43.343261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:43.343723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:43.343997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:43.344265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:43.354842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:43.356903 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:43.370987 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4253/8521] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:49:43.551186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:43.552836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:43.567273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79225da9-60ec-4657-bbb2-0d8bc906fdac None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:43.573419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:43.574110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:43.574580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:43.574865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] PATH_INFO: `/v3/projects/9d4ba3cc14844d08a6f85bbd32823067` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:43.576183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4ba3cc14844d08a6f85bbd32823067)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:43.578189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:43.629191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4ba3cc14844d08a6f85bbd32823067', 'request_id': 'req-9705390a-b395-4e71-842d-6834246e831e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.638572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4ba3cc14844d08a6f85bbd32823067', 'request_id': 'req-9705390a-b395-4e71-842d-6834246e831e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.645925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4ba3cc14844d08a6f85bbd32823067', 'request_id': 'req-9705390a-b395-4e71-842d-6834246e831e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.658514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] The token cache is being invalidate because project 9d4ba3cc14844d08a6f85bbd32823067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:49:43.658866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.659737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.661555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4269/8522] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:49:43 2022] DELETE /identity/v3/projects/9d4ba3cc14844d08a6f85bbd32823067 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:49:43.667420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:43.673815 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:43.680389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcbc86-48cb-41d8-9375-8515332985ab service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:43.751262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:43.751860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:43.752619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:43.752930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] PATH_INFO: `/v3/users/bfd5bef461e94a489f5ae70e8f8e5b20` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:43.754129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd5bef461e94a489f5ae70e8f8e5b20)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:43.755990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:43.808491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd5bef461e94a489f5ae70e8f8e5b20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.817718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd5bef461e94a489f5ae70e8f8e5b20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.830773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd5bef461e94a489f5ae70e8f8e5b20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.831556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd5bef461e94a489f5ae70e8f8e5b20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.839926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-dcf28aeb-b3f1-4871-a0b7-d55f993c7d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd5bef461e94a489f5ae70e8f8e5b20'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:43.846648 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4254/8523] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:49:43 2022] DELETE /identity/v3/users/bfd5bef461e94a489f5ae70e8f8e5b20 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:49:44.134973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.136807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:44.152836 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705390a-b395-4e71-842d-6834246e831e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:44.218118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:44.218672 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.218957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.219221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] PATH_INFO: `/v3/projects/905c257813494dcb9c715cf58f2930df` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.220370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=905c257813494dcb9c715cf58f2930df)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:44.222745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:44.255372 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:44.273154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905c257813494dcb9c715cf58f2930df', 'request_id': 'req-17d2ec75-844a-4234-8de4-bf6ee1e22943'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:44.281756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905c257813494dcb9c715cf58f2930df', 'request_id': 'req-17d2ec75-844a-4234-8de4-bf6ee1e22943'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:44.287885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905c257813494dcb9c715cf58f2930df', 'request_id': 'req-17d2ec75-844a-4234-8de4-bf6ee1e22943'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:44.299954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] The token cache is being invalidate because project 905c257813494dcb9c715cf58f2930df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:49:44.300236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:44.300970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-17d2ec75-844a-4234-8de4-bf6ee1e22943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:49:44.302577 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4270/8524] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:49:44 2022] DELETE /identity/v3/projects/905c257813494dcb9c715cf58f2930df => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:49:44.308081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff7aa9-7bc6-4fe5-98ab-19450b55c390 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.308634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff7aa9-7bc6-4fe5-98ab-19450b55c390 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.308634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff7aa9-7bc6-4fe5-98ab-19450b55c390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.341158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8aff7aa9-7bc6-4fe5-98ab-19450b55c390 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:49:44.342403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8aff7aa9-7bc6-4fe5-98ab-19450b55c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:44.414984 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4255/8525] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:44.427532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4a82-14ca-4547-9da6-2aa14530ec31 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.427903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4a82-14ca-4547-9da6-2aa14530ec31 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.428169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4a82-14ca-4547-9da6-2aa14530ec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.451469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4a5c4a82-14ca-4547-9da6-2aa14530ec31 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:49:44.453262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a5c4a82-14ca-4547-9da6-2aa14530ec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:44.465053 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4271/8526] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:44.469791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff7aa9-7bc6-4fe5-98ab-19450b55c390 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.480302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff7aa9-7bc6-4fe5-98ab-19450b55c390 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:44.486523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:44.487173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.487459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.487728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.488387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:49:44.488699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:44.490349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:44.502587 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4256/8527] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:49:44.507654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4a82-14ca-4547-9da6-2aa14530ec31 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.521340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4a82-14ca-4547-9da6-2aa14530ec31 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:44.527629 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:44.528232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.528509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.528798 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.529453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:44.531384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:44.572987 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4272/8528] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:49:44 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:49:44.577937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.589378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2f6d-5f69-48e2-ac4d-4bc555c8cef4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:44.599203 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:44.656436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:44.657078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.657365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.657632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.658278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:44.660294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:44.690185 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4257/8529] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:49:44 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:49:44.694332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.704964 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104ce89-44af-480c-aa15-b3c7bfab3b62 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:44.710017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:44.710626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.710904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.711175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.711853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:44.713496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:44.723972 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4273/8530] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:49:44.730118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.741435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5378ac-c180-4246-b95d-5c1ffc94ad80 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:44.746571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927fe6e-8a69-468f-b49a-3dc6bee4c400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:44.747168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927fe6e-8a69-468f-b49a-3dc6bee4c400 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.747468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927fe6e-8a69-468f-b49a-3dc6bee4c400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.747740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927fe6e-8a69-468f-b49a-3dc6bee4c400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.748377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927fe6e-8a69-468f-b49a-3dc6bee4c400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:44.750038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927fe6e-8a69-468f-b49a-3dc6bee4c400 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:44.761617 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4258/8531] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:49:44.766357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.783855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e91a3-4ff9-4b0b-b57f-78d0a8523898 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:44.790195 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:44.790824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.791142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.791414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] PATH_INFO: `/v3/projects/05989576d0d24f10836a22a6586c9f6f/users/4d6d757cd16a4ba494c903a3d17df919/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.807367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05989576d0d24f10836a22a6586c9f6f, user_id=4d6d757cd16a4ba494c903a3d17df919, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:44.810027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:44.825346 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4274/8532] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:49:44 2022] PUT /identity/v3/projects/05989576d0d24f10836a22a6586c9f6f/users/4d6d757cd16a4ba494c903a3d17df919/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:49:44.830543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feae418-a6b4-400f-bba9-b351f17209b0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:44.830827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feae418-a6b4-400f-bba9-b351f17209b0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:44.831132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feae418-a6b4-400f-bba9-b351f17209b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:44.851955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8feae418-a6b4-400f-bba9-b351f17209b0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:49:44.853503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8feae418-a6b4-400f-bba9-b351f17209b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:44.924149 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4259/8533] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:44.936799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:44.938622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:45.000817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240deb-6dbf-4090-841c-43f3a375e4a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:45.005392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:45.006007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:45.006310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:45.006581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:45.016730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:45.018697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:45.028473 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4275/8534] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:49:45.708759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1213168-0be0-443f-a12f-df40dd7dfe06 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:45.709347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1213168-0be0-443f-a12f-df40dd7dfe06 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:45.709347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1213168-0be0-443f-a12f-df40dd7dfe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:45.740027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-f1213168-0be0-443f-a12f-df40dd7dfe06 None None] MFA Rules not processed for user `4d6d757cd16a4ba494c903a3d17df919`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:49:45.741321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f1213168-0be0-443f-a12f-df40dd7dfe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:45.814573 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4260/8535] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:49:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:45.819373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:45.829325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2509-fb73-4fc5-99c7-a82a9d701686 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:45.834570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:45.835233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:45.835516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:45.835786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:45.836418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:45.838532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:45.868815 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4276/8536] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:49:45 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:49:45.871381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1213168-0be0-443f-a12f-df40dd7dfe06 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:45.882602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1213168-0be0-443f-a12f-df40dd7dfe06 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:45.901633 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:45.948721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:45.949405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:45.949683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:45.949972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:45.950594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:45.952527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:45.977054 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4261/8537] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:49:45 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:49:45.982848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:45.995379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661efe4-4e88-4ed6-8e9f-67aab5d2335c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:46.001609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:46.002286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:46.002921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:46.002921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:46.003523 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:46.005385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:46.016849 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4277/8538] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:49:46.021817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:46.032490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a3c34-04e0-4864-b2ff-95f1670bbeba admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:46.037870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:46.038534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:46.038800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:46.039067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] PATH_INFO: `/v3/projects/c3dfb244d8784013a72ccfebcb5f0fd6/users/0a5c9bfd67454690943c03efb8572f68/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:46.056145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dfb244d8784013a72ccfebcb5f0fd6, user_id=0a5c9bfd67454690943c03efb8572f68, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:46.059084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:46.076757 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4262/8539] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:49:46 2022] PUT /identity/v3/projects/c3dfb244d8784013a72ccfebcb5f0fd6/users/0a5c9bfd67454690943c03efb8572f68/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:49:46.081760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:46.092357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcaeb2-fdeb-484b-adba-60c43fd1e7f2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:46.101659 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:46.158478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1f797-ff47-4418-a1f9-8a1a7af4d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:46.159520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1f797-ff47-4418-a1f9-8a1a7af4d0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:46.159730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1f797-ff47-4418-a1f9-8a1a7af4d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:46.160026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1f797-ff47-4418-a1f9-8a1a7af4d0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:46.160719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1f797-ff47-4418-a1f9-8a1a7af4d0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:46.162341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1f797-ff47-4418-a1f9-8a1a7af4d0c6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:46.172401 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4278/8540] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:49:46.177088 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:46.188125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58696a4-a753-4b6f-81f3-a0c491b717f4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:46.194109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2819e22-66a0-4791-adf0-d0bb512eb090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:46.194775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2819e22-66a0-4791-adf0-d0bb512eb090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:46.195032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2819e22-66a0-4791-adf0-d0bb512eb090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:46.195299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2819e22-66a0-4791-adf0-d0bb512eb090 admin admin] PATH_INFO: `/v3/projects/c3dfb244d8784013a72ccfebcb5f0fd6/users/0a5c9bfd67454690943c03efb8572f68/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:46.197412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2819e22-66a0-4791-adf0-d0bb512eb090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dfb244d8784013a72ccfebcb5f0fd6, user_id=0a5c9bfd67454690943c03efb8572f68, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:46.200012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2819e22-66a0-4791-adf0-d0bb512eb090 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:46.211620 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4263/8541] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:49:46 2022] PUT /identity/v3/projects/c3dfb244d8784013a72ccfebcb5f0fd6/users/0a5c9bfd67454690943c03efb8572f68/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:49:46.874402 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:46.874974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:46.874974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:46.904906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] MFA Rules not processed for user `0a5c9bfd67454690943c03efb8572f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:49:46.906084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:46.978696 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4279/8542] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:49:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:46.990606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:46.991165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:46.991165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:47.010530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] MFA Rules not processed for user `4d6d757cd16a4ba494c903a3d17df919`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:49:47.011724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:47.071519 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4264/8543] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:49:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:49:47.084693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:49:47.086847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:49:47.179198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0b0b-96c1-4d8e-a714-0f04d23a5899 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:49:47.185263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:49:47.185878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:49:47.186147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:49:47.186414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:49:47.196754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:49:47.198382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:49:47.207942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4280/8544] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:49:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:49:57.064270 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=60,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:57.203192 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:11.372009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:11.373654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:11.480727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bcb9f-ef43-4846-a3a2-fdcb3e651231 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:11.486106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:11.486770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:11.487038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:11.487303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:11.489312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:11.504299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:11.505953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:11.519072 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4265/8545] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:11.973632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:12.042651 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd59a2-e056-46e2-98a9-f12960294a8f service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:12.050271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:12.051139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:12.051401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:12.051706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] PATH_INFO: `/v3/users/4d6d757cd16a4ba494c903a3d17df919` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:12.053671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6d757cd16a4ba494c903a3d17df919)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:12.056496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:12.110215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6d757cd16a4ba494c903a3d17df919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.119755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6d757cd16a4ba494c903a3d17df919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.120457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6d757cd16a4ba494c903a3d17df919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.127899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6d757cd16a4ba494c903a3d17df919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.128644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6d757cd16a4ba494c903a3d17df919'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.147836 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4281/8546] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:50:11 2022] DELETE /identity/v3/users/4d6d757cd16a4ba494c903a3d17df919 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:12.338415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:12.350184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f2a2-8e08-4864-91b9-b35eb82111a0 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:12.408386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:12.409099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:12.409238 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:12.409518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] PATH_INFO: `/v3/projects/05989576d0d24f10836a22a6586c9f6f` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:12.410664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05989576d0d24f10836a22a6586c9f6f)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:12.412592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:12.474329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05989576d0d24f10836a22a6586c9f6f', 'request_id': 'req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.482445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05989576d0d24f10836a22a6586c9f6f', 'request_id': 'req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.488583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05989576d0d24f10836a22a6586c9f6f', 'request_id': 'req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.505143 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] The token cache is being invalidate because project 05989576d0d24f10836a22a6586c9f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:50:12.505419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.506071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.507580 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4266/8547] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:50:12 2022] DELETE /identity/v3/projects/05989576d0d24f10836a22a6586c9f6f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:12.512083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:12.513582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:12.527705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2382cb0-134b-4275-aa1c-f1e387b1501f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:12.597706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:12.598356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:12.598630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:12.598893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] PATH_INFO: `/v3/users/0a5c9bfd67454690943c03efb8572f68` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:12.600105 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5c9bfd67454690943c03efb8572f68)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:12.602096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:12.630214 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:12.660835 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5c9bfd67454690943c03efb8572f68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.670499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5c9bfd67454690943c03efb8572f68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.671103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5c9bfd67454690943c03efb8572f68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.678044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5c9bfd67454690943c03efb8572f68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.678658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-772ae4bd-2c89-4631-ab0a-69b6185c2cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5c9bfd67454690943c03efb8572f68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:12.696031 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4282/8548] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:50:12 2022] DELETE /identity/v3/users/0a5c9bfd67454690943c03efb8572f68 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:12.874784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:12.876430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:12.891317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7bbf7-851e-417d-b2a0-fc5d58ad13a5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:12.901763 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:12.960497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:12.961182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:12.961459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:12.961731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] PATH_INFO: `/v3/projects/c3dfb244d8784013a72ccfebcb5f0fd6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:12.963046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3dfb244d8784013a72ccfebcb5f0fd6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:12.965001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.015829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3dfb244d8784013a72ccfebcb5f0fd6', 'request_id': 'req-91800424-44e3-49f1-bad2-6c11f9adc556'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:13.023286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3dfb244d8784013a72ccfebcb5f0fd6', 'request_id': 'req-91800424-44e3-49f1-bad2-6c11f9adc556'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:13.029929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3dfb244d8784013a72ccfebcb5f0fd6', 'request_id': 'req-91800424-44e3-49f1-bad2-6c11f9adc556'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:13.045548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] The token cache is being invalidate because project c3dfb244d8784013a72ccfebcb5f0fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:50:13.045896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:13.046695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-91800424-44e3-49f1-bad2-6c11f9adc556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:13.052037 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4267/8549] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:50:12 2022] DELETE /identity/v3/projects/c3dfb244d8784013a72ccfebcb5f0fd6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:13.053832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9fce3-dc83-42bc-a043-279a2ba20b30 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.054339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9fce3-dc83-42bc-a043-279a2ba20b30 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.054339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9fce3-dc83-42bc-a043-279a2ba20b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.074869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d4f9fce3-dc83-42bc-a043-279a2ba20b30 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:50:13.076087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d4f9fce3-dc83-42bc-a043-279a2ba20b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:13.136360 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4283/8550] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:50:13.145275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66269-9290-492e-be64-2c4fc7889cef None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.145562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66269-9290-492e-be64-2c4fc7889cef None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.145839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66269-9290-492e-be64-2c4fc7889cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.167386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c1c66269-9290-492e-be64-2c4fc7889cef None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:50:13.168616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c1c66269-9290-492e-be64-2c4fc7889cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:13.177185 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4268/8551] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:50:13.182126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9fce3-dc83-42bc-a043-279a2ba20b30 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:13.192395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9fce3-dc83-42bc-a043-279a2ba20b30 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:13.197898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:13.198505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.198775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.199036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.199674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:50:13.199971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:13.201604 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.213881 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4284/8552] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:50:13.219422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c66269-9290-492e-be64-2c4fc7889cef None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:13.232108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c66269-9290-492e-be64-2c4fc7889cef None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:13.238138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:13.238769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.239052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.239321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.239955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:13.241946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.273956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4269/8553] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:50:13 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:50:13.278482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:13.289023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8991f8-377f-449c-8f7a-e6683be7566b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:13.345502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:13.346109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.346384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.346652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.347271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:13.349217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.371895 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4285/8554] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:50:13 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:50:13.375831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:13.386517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24d79e-caad-472c-8ac5-f1de7dbf1e47 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:13.391457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:13.392069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.392343 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.392634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.393296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:13.395242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.408692 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4270/8555] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:50:13.413481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:13.425910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8d3c-f0f0-4d66-9f8f-9214c2cdb821 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:13.431337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d14591-96ee-4f2f-a75f-b65b856ac72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:13.432067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14591-96ee-4f2f-a75f-b65b856ac72b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.432472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14591-96ee-4f2f-a75f-b65b856ac72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.432939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14591-96ee-4f2f-a75f-b65b856ac72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.433833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d14591-96ee-4f2f-a75f-b65b856ac72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:13.435559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d14591-96ee-4f2f-a75f-b65b856ac72b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.447528 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4286/8556] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:50:13.452537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:13.463518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b7ab-3196-4f21-9d12-596d5959d08e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:13.470159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:13.470843 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.471134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.471419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] PATH_INFO: `/v3/projects/4bf69955f7c84c3885282ff6be8e68b6/users/b1f419f6abac4f8e960f065d6620c365/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.489397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf69955f7c84c3885282ff6be8e68b6, user_id=b1f419f6abac4f8e960f065d6620c365, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:13.492161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.508111 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4271/8557] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:50:13 2022] PUT /identity/v3/projects/4bf69955f7c84c3885282ff6be8e68b6/users/b1f419f6abac4f8e960f065d6620c365/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:13.514117 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.514525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.514859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.524210 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:13.537409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:50:13.539545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:13.615983 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4287/8558] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:50:13.626656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:13.628510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:13.677678 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:13.698908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5b7d-ada4-4386-96eb-368f6c246b62 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:13.703050 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3e38-c8d2-4919-a507-1ef70aedc76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:13.703696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3e38-c8d2-4919-a507-1ef70aedc76e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:13.703978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3e38-c8d2-4919-a507-1ef70aedc76e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:13.704277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3e38-c8d2-4919-a507-1ef70aedc76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:13.715412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f3e38-c8d2-4919-a507-1ef70aedc76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:13.716947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f3e38-c8d2-4919-a507-1ef70aedc76e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:13.730618 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4272/8559] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:16.545182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:16.546758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:16.637994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f0e3-8958-41e9-92dd-ba346afc4aca None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:16.643588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:16.644207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:16.644481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:16.645094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:16.646825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:16.758666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:16.761051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:16.785045 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4288/8560] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:50:18.030018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c504faf-c56b-4c61-8bc7-341add33c965 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:18.030586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c504faf-c56b-4c61-8bc7-341add33c965 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:18.030586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c504faf-c56b-4c61-8bc7-341add33c965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:18.063494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5c504faf-c56b-4c61-8bc7-341add33c965 None None] MFA Rules not processed for user `b1f419f6abac4f8e960f065d6620c365`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:50:18.064733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5c504faf-c56b-4c61-8bc7-341add33c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:18.156745 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4273/8561] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:50:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:50:18.161596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:18.173403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1fc42-a2af-4423-9f40-b8a4238afe97 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:18.178652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:18.179297 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:18.179575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:18.179847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:18.180474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:18.182439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:18.195467 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:18.214348 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4289/8562] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:50:18 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:50:18.218482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c504faf-c56b-4c61-8bc7-341add33c965 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:18.232418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c504faf-c56b-4c61-8bc7-341add33c965 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:18.296937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:18.297582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:18.297859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:18.298129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:18.298806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:18.300791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:18.324135 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4274/8563] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:50:18 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:50:18.330233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:18.342185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416c473-699b-4927-a068-7b7c1dc616a2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:18.347412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:18.348008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:18.348279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:18.348555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:18.349263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:18.350862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:18.362280 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4290/8564] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:50:18.366524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:18.377252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd97ab-d44a-4e02-9607-c63e73d0953f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:18.382319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:18.382964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:18.383237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:18.383506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] PATH_INFO: `/v3/projects/8dac24bfe0f9493a885a80bfa0bf0cf1/users/c0d2fa0c02f946f4b91109857abd7e22/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:18.399366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dac24bfe0f9493a885a80bfa0bf0cf1, user_id=c0d2fa0c02f946f4b91109857abd7e22, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:18.402126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:18.419528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4275/8565] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:50:18 2022] PUT /identity/v3/projects/8dac24bfe0f9493a885a80bfa0bf0cf1/users/c0d2fa0c02f946f4b91109857abd7e22/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:18.423889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:18.434884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bc622-7535-41ac-b196-ecd50333a5bf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:18.494562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:18.495081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:18.495361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:18.495799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:18.496875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:18.498477 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:18.509463 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4291/8566] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:50:18.514285 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:18.527345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bc883-072c-4309-9559-c531ded79ca3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:18.533237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:18.533973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:18.534251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:18.534521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] PATH_INFO: `/v3/projects/8dac24bfe0f9493a885a80bfa0bf0cf1/users/c0d2fa0c02f946f4b91109857abd7e22/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:18.536551 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dac24bfe0f9493a885a80bfa0bf0cf1, user_id=c0d2fa0c02f946f4b91109857abd7e22, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:18.539281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:18.551388 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4276/8567] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:50:18 2022] PUT /identity/v3/projects/8dac24bfe0f9493a885a80bfa0bf0cf1/users/c0d2fa0c02f946f4b91109857abd7e22/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:22.499482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:22.501960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:22.587847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:22.592020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:22.619918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c1538-ac0e-4ee4-b4ad-95a73d8b379d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:22.639076 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:22.755481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc1b2d-f0d0-44a9-94f6-c77123941624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:22.756222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc1b2d-f0d0-44a9-94f6-c77123941624 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:22.756421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc1b2d-f0d0-44a9-94f6-c77123941624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:22.756669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc1b2d-f0d0-44a9-94f6-c77123941624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:22.762059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8bcc1b2d-f0d0-44a9-94f6-c77123941624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:22.768495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6144b-400d-496f-85fa-545742565975 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:22.784817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:22.785190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:22.785468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:22.785757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:22.791029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:22.868394 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:22.898218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc1b2d-f0d0-44a9-94f6-c77123941624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:22.899703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc1b2d-f0d0-44a9-94f6-c77123941624 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:22.920802 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4292/8568] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:22.925395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:22.925395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:22.952816 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4277/8569] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:50:24.067465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8fd9-07d7-4d00-9582-ac0666f97df2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:24.068014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8fd9-07d7-4d00-9582-ac0666f97df2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:24.068014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8fd9-07d7-4d00-9582-ac0666f97df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:24.110257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-328b8fd9-07d7-4d00-9582-ac0666f97df2 None None] MFA Rules not processed for user `c0d2fa0c02f946f4b91109857abd7e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:50:24.111497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-328b8fd9-07d7-4d00-9582-ac0666f97df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:24.246818 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4293/8570] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:50:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:50:24.259856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:24.279737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d12b-3976-4d10-a796-102927335d11 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:24.297193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:24.298172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:24.298671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:24.299822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:24.314758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:24.318091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:24.332232 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4278/8571] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:24.408884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc8d9d-ac9b-428d-afa6-8ed32f576f50 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:24.409131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc8d9d-ac9b-428d-afa6-8ed32f576f50 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:24.409411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc8d9d-ac9b-428d-afa6-8ed32f576f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:24.431837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6afc8d9d-ac9b-428d-afa6-8ed32f576f50 None None] MFA Rules not processed for user `b1f419f6abac4f8e960f065d6620c365`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:50:24.433041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6afc8d9d-ac9b-428d-afa6-8ed32f576f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:24.539780 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4294/8572] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:50:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:50:25.058558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:25.060276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:25.165557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869fc87-08e6-4f13-b5ba-2d797ae946c2 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:25.171063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:25.171767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:25.172110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:25.172592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:25.174474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:25.191525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:25.193388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:25.223938 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4279/8573] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:27.714676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc8d9d-ac9b-428d-afa6-8ed32f576f50 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:27.742131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc8d9d-ac9b-428d-afa6-8ed32f576f50 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:27.747950 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:27.748667 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:27.749235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:27.749675 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:27.751720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:27.834056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:27.835500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:27.846886 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4295/8574] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:28.250484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:28.271709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f54379-4def-4c0c-bd57-087f57276016 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:28.285854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:28.289241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:28.289523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:28.289983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:28.292489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:28.313606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:28.315676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:28.332540 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4280/8575] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:35.104342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:35.106834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:35.120232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c62e4-9a7e-48c6-96c6-81131bf3a338 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:35.125661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:35.127011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:35.127383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:35.127850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] PATH_INFO: `/v3/users/c89ec4d04ba54e54a1d844a3566f3821` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:35.129254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89ec4d04ba54e54a1d844a3566f3821)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:35.131428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:35.142387 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=100 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:35.190814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89ec4d04ba54e54a1d844a3566f3821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.209356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89ec4d04ba54e54a1d844a3566f3821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.210147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89ec4d04ba54e54a1d844a3566f3821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.223956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89ec4d04ba54e54a1d844a3566f3821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.224816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89ec4d04ba54e54a1d844a3566f3821'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.243616 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4296/8576] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:50:35 2022] DELETE /identity/v3/users/c89ec4d04ba54e54a1d844a3566f3821 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:35.435854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:35.448864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44ba4-97a4-41ec-b4be-4414017b0bd2 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:35.469988 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:35.509860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:35.510483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:35.510763 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:35.511029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] PATH_INFO: `/v3/projects/a8b7791cd2474b4a8bbfc8f9a069024e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:35.512452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b7791cd2474b4a8bbfc8f9a069024e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:35.514277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:35.564351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'request_id': 'req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.570902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'request_id': 'req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.578122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'request_id': 'req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.593783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] The token cache is being invalidate because project a8b7791cd2474b4a8bbfc8f9a069024e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:50:35.594099 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.594746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.596259 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4281/8577] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:50:35 2022] DELETE /identity/v3/projects/a8b7791cd2474b4a8bbfc8f9a069024e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:35.600631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:35.602171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:35.617447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f342b1-585d-4e4f-9c2f-a32da60cf928 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:35.679163 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:35.679825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:35.680103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:35.680376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] PATH_INFO: `/v3/users/c62d0152e89c461290120d94572ae7e4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:35.681570 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62d0152e89c461290120d94572ae7e4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:35.683529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:35.737649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62d0152e89c461290120d94572ae7e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.748547 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62d0152e89c461290120d94572ae7e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.749187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62d0152e89c461290120d94572ae7e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.756712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62d0152e89c461290120d94572ae7e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.757392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c174d971-e9a4-4ee5-b926-2c62e53869bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62d0152e89c461290120d94572ae7e4'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:35.776943 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4297/8578] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:50:35 2022] DELETE /identity/v3/users/c62d0152e89c461290120d94572ae7e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:35.958628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:35.960125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:35.974293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbed64a-fc8b-4e9f-bcff-80b8a8b6fbf7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:36.033225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:36.033868 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:36.034144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:36.034411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] PATH_INFO: `/v3/projects/474e6a08031c46f58db6f0d21f941bfd` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:36.035523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474e6a08031c46f58db6f0d21f941bfd)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:36.037461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:36.090712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474e6a08031c46f58db6f0d21f941bfd', 'request_id': 'req-6625d151-bf28-4f92-974d-9fa6e9c229f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:36.097469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474e6a08031c46f58db6f0d21f941bfd', 'request_id': 'req-6625d151-bf28-4f92-974d-9fa6e9c229f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:36.098779 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:36.104220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474e6a08031c46f58db6f0d21f941bfd', 'request_id': 'req-6625d151-bf28-4f92-974d-9fa6e9c229f0'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:36.117937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] The token cache is being invalidate because project 474e6a08031c46f58db6f0d21f941bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:50:36.118204 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:36.118813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:36.120290 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4282/8579] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:50:35 2022] DELETE /identity/v3/projects/474e6a08031c46f58db6f0d21f941bfd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:36.907138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:36.907668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:36.907668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:36.915082 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:36.929096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] MFA Rules not processed for user `b1f419f6abac4f8e960f065d6620c365`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:50:36.930742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:36.989333 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4298/8580] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:50:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:50:43.345340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:43.346917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:43.431895 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d151-bf28-4f92-974d-9fa6e9c229f0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:43.438324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:43.438938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:43.439241 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:43.439510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:43.441412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:43.456432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:43.458070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:43.474501 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4283/8581] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:50:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:50:46.981906 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=24 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:53.464599 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=3,keystone:SELECT=36,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:59.255632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:59.257401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:59.339191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac29787-984b-42af-9aca-ad3e4f32cd17 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:59.344345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:59.345023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:59.345284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:59.345554 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] PATH_INFO: `/v3/users/b1f419f6abac4f8e960f065d6620c365` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:59.346705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f419f6abac4f8e960f065d6620c365)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:59.349002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:59.406480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f419f6abac4f8e960f065d6620c365'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.418727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f419f6abac4f8e960f065d6620c365'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.419482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f419f6abac4f8e960f065d6620c365'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.426941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f419f6abac4f8e960f065d6620c365'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.427568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f419f6abac4f8e960f065d6620c365'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.447488 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4299/8582] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:50:59 2022] DELETE /identity/v3/users/b1f419f6abac4f8e960f065d6620c365 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:59.634771 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:59.646158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614830fe-37b8-4d8b-ad16-afe5b663f83c service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:59.707951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:59.708988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:59.709266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:59.709539 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] PATH_INFO: `/v3/projects/4bf69955f7c84c3885282ff6be8e68b6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:59.710761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf69955f7c84c3885282ff6be8e68b6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:59.712677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:59.775609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf69955f7c84c3885282ff6be8e68b6', 'request_id': 'req-d566981d-03fe-4687-90c7-b112e2309564'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.782045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf69955f7c84c3885282ff6be8e68b6', 'request_id': 'req-d566981d-03fe-4687-90c7-b112e2309564'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.789660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf69955f7c84c3885282ff6be8e68b6', 'request_id': 'req-d566981d-03fe-4687-90c7-b112e2309564'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.805223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] The token cache is being invalidate because project 4bf69955f7c84c3885282ff6be8e68b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:50:59.805512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.806205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.807772 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4284/8583] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:50:59 2022] DELETE /identity/v3/projects/4bf69955f7c84c3885282ff6be8e68b6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:50:59.812150 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:50:59.813674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:50:59.827393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddc246-3e9c-4ba1-b29a-c6562a5afe14 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:50:59.888809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:50:59.889339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:50:59.889618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:50:59.889893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] PATH_INFO: `/v3/users/c0d2fa0c02f946f4b91109857abd7e22` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:50:59.891065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d2fa0c02f946f4b91109857abd7e22)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:50:59.893049 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:50:59.915417 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:59.944035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d2fa0c02f946f4b91109857abd7e22'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.953188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d2fa0c02f946f4b91109857abd7e22'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.953862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d2fa0c02f946f4b91109857abd7e22'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.961287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d2fa0c02f946f4b91109857abd7e22'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.961944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-f238fc86-87d3-4b81-b6b1-6e6f5c45bd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d2fa0c02f946f4b91109857abd7e22'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:50:59.980378 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4300/8584] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:50:59 2022] DELETE /identity/v3/users/c0d2fa0c02f946f4b91109857abd7e22 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:00.168080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.169650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:00.185908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566981d-03fe-4687-90c7-b112e2309564 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:00.250059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:00.250827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.251101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.251439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] PATH_INFO: `/v3/projects/8dac24bfe0f9493a885a80bfa0bf0cf1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.253372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dac24bfe0f9493a885a80bfa0bf0cf1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:00.256287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:00.296449 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:00.309624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dac24bfe0f9493a885a80bfa0bf0cf1', 'request_id': 'req-94f70177-f914-4056-8ff4-65f7166fbd35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:00.315800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dac24bfe0f9493a885a80bfa0bf0cf1', 'request_id': 'req-94f70177-f914-4056-8ff4-65f7166fbd35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:00.321468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dac24bfe0f9493a885a80bfa0bf0cf1', 'request_id': 'req-94f70177-f914-4056-8ff4-65f7166fbd35'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:00.335859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] The token cache is being invalidate because project 8dac24bfe0f9493a885a80bfa0bf0cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:51:00.336168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:00.336822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-94f70177-f914-4056-8ff4-65f7166fbd35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:00.338315 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4285/8585] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:51:00 2022] DELETE /identity/v3/projects/8dac24bfe0f9493a885a80bfa0bf0cf1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:00.343618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d496f8-8138-4224-9642-89d2fb20be5d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.344136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d496f8-8138-4224-9642-89d2fb20be5d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.344247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d496f8-8138-4224-9642-89d2fb20be5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.363911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-a0d496f8-8138-4224-9642-89d2fb20be5d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:00.365188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a0d496f8-8138-4224-9642-89d2fb20be5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:00.425798 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4301/8586] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:00.434820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba156b7-3f95-4f64-bf17-9ac5112f7f0b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.435281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba156b7-3f95-4f64-bf17-9ac5112f7f0b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.435686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba156b7-3f95-4f64-bf17-9ac5112f7f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.460277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fba156b7-3f95-4f64-bf17-9ac5112f7f0b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:00.461522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fba156b7-3f95-4f64-bf17-9ac5112f7f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:00.471557 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4286/8587] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:00.477755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d496f8-8138-4224-9642-89d2fb20be5d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.493256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d496f8-8138-4224-9642-89d2fb20be5d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:00.499258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:00.499854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.500129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.500391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.501082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:51:00.501381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:00.503014 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:00.516699 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4302/8588] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:51:00.523699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba156b7-3f95-4f64-bf17-9ac5112f7f0b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.534644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba156b7-3f95-4f64-bf17-9ac5112f7f0b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:00.540528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:00.541296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.541569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.541830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.542467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:00.544374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:00.574266 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4287/8589] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:51:00 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:00.580274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.592860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a890b-49d8-47e6-9a8b-1257fc564826 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:00.656272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:00.656976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.657213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.657521 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.658157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:00.660108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:00.684624 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4303/8590] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:51:00 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:00.689082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.700173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d5afc-e199-4845-9f24-22904465c1af admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:00.705085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:00.705685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.705962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.706229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.706865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:00.708513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:00.719457 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4288/8591] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:00.723726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.734322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9a0c-5034-4854-9a72-90a3b005ab62 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:00.739275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa6b0c-4c41-4386-85d1-eaa700a396b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:00.739873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6b0c-4c41-4386-85d1-eaa700a396b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.740149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6b0c-4c41-4386-85d1-eaa700a396b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.740420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6b0c-4c41-4386-85d1-eaa700a396b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.741395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa6b0c-4c41-4386-85d1-eaa700a396b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:00.742998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa6b0c-4c41-4386-85d1-eaa700a396b0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:00.754084 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4304/8592] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:00.758229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.768860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29c12-1704-4900-af44-557a025da018 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:00.774957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:00.775637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.775917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.776178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] PATH_INFO: `/v3/projects/1e3493d1d7ad47b2981af000f2168ed8/users/83c0183473044981a355938f51265763/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.792994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3493d1d7ad47b2981af000f2168ed8, user_id=83c0183473044981a355938f51265763, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:00.795659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:00.811514 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4289/8593] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:00 2022] PUT /identity/v3/projects/1e3493d1d7ad47b2981af000f2168ed8/users/83c0183473044981a355938f51265763/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:00.818183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d2098-f39f-4240-a21f-579b21834a12 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:00.818468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d2098-f39f-4240-a21f-579b21834a12 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:00.818737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d2098-f39f-4240-a21f-579b21834a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:00.828017 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:00.842914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-057d2098-f39f-4240-a21f-579b21834a12 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:00.844453 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-057d2098-f39f-4240-a21f-579b21834a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:00.925871 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4305/8594] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:51:00.936502 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:00.938442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:01.005494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5e4e-b18f-401d-acd7-dbe37c1d7fa4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:01.010031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:01.010641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:01.010921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:01.011193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:01.020454 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:01.021954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:01.032981 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4290/8595] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:05.552282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4fd92-9921-4bb5-8532-c7e7c070b880 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:05.552803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4fd92-9921-4bb5-8532-c7e7c070b880 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:05.552921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4fd92-9921-4bb5-8532-c7e7c070b880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:05.585633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c2c4fd92-9921-4bb5-8532-c7e7c070b880 None None] MFA Rules not processed for user `83c0183473044981a355938f51265763`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:05.586979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c2c4fd92-9921-4bb5-8532-c7e7c070b880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:05.666778 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4306/8596] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:05.671312 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:05.682973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb13fe6-9b1a-449a-9a24-9cbcc00d5b3e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:05.688057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:05.688707 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:05.689025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:05.689297 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:05.689926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:05.691878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:05.728528 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4291/8597] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:51:05 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:05.729711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4fd92-9921-4bb5-8532-c7e7c070b880 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:05.741118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4fd92-9921-4bb5-8532-c7e7c070b880 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:05.797723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:05.798354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:05.798615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:05.798881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:05.799494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:05.801457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:05.826086 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4307/8598] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:51:05 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:05.830758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:05.843239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ecd21-fd5d-443f-a143-37e9e517cce2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:05.849742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:05.850552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:05.850833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:05.851109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:05.852032 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:05.854615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:05.869883 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4292/8599] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:05.874414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:05.885096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741bf1f-0ee2-485c-9a79-340c9310bbbc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:05.890676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:05.891365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:05.891652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:05.891898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] PATH_INFO: `/v3/projects/8807f82c934a4189826137dffe435cf1/users/5b0c5b60f6e14c7c945c6d6104e07041/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:05.911040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8807f82c934a4189826137dffe435cf1, user_id=5b0c5b60f6e14c7c945c6d6104e07041, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:05.914634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:05.927367 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:05.933407 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4308/8600] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:05 2022] PUT /identity/v3/projects/8807f82c934a4189826137dffe435cf1/users/5b0c5b60f6e14c7c945c6d6104e07041/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:05.937698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:05.949229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099fa3-c7f6-4170-961e-d334127d2d04 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:05.974210 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:06.010179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420f061-5a9a-49bc-81c8-9a6f3979004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:06.010768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f061-5a9a-49bc-81c8-9a6f3979004f admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:06.011044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f061-5a9a-49bc-81c8-9a6f3979004f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:06.011319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f061-5a9a-49bc-81c8-9a6f3979004f admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:06.011966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420f061-5a9a-49bc-81c8-9a6f3979004f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:06.013609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420f061-5a9a-49bc-81c8-9a6f3979004f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:06.023964 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4293/8601] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:06.028527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:06.039664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf812cc-da66-43dc-88fc-7e9da1e13c00 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:06.045886 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:06.046549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:06.046820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:06.047084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] PATH_INFO: `/v3/projects/8807f82c934a4189826137dffe435cf1/users/5b0c5b60f6e14c7c945c6d6104e07041/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:06.049351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8807f82c934a4189826137dffe435cf1, user_id=5b0c5b60f6e14c7c945c6d6104e07041, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:06.051981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:06.063331 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4309/8602] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:06 2022] PUT /identity/v3/projects/8807f82c934a4189826137dffe435cf1/users/5b0c5b60f6e14c7c945c6d6104e07041/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:10.864467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:10.866153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:10.866438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:10.903824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] MFA Rules not processed for user `5b0c5b60f6e14c7c945c6d6104e07041`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:10.905237 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:10.988937 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4294/8603] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:11.001790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:11.003743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:11.096856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17abc74-a8c5-4d07-9d69-bd4d1572b15c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:11.100404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:11.101055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:11.101581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:11.101681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:11.166489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:11.167948 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:11.177514 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4310/8604] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:20.985543 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=51 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:21.174549 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:34.582491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:34.584091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:34.690303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d8e3d-3bc3-4dfb-a0b1-d198aebd88c0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:34.695422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f889cb-0ec4-4178-b479-1b2569e4efcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:34.696044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f889cb-0ec4-4178-b479-1b2569e4efcb service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:34.696316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f889cb-0ec4-4178-b479-1b2569e4efcb service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:34.696583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f889cb-0ec4-4178-b479-1b2569e4efcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:34.706436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f889cb-0ec4-4178-b479-1b2569e4efcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:34.708197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f889cb-0ec4-4178-b479-1b2569e4efcb service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:34.718294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4295/8605] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:51:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:51:35.270441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:35.272655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:35.349843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001aeb-7ee5-4048-8a57-0fa8ef2c3a7a service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:35.355268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:35.355927 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:35.356208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:35.356602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] PATH_INFO: `/v3/users/6a5f1b1c768b43be80f4e2a89694a811` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:35.357989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5f1b1c768b43be80f4e2a89694a811)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:35.359985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:35.424205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5f1b1c768b43be80f4e2a89694a811'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.435254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5f1b1c768b43be80f4e2a89694a811'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.435936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5f1b1c768b43be80f4e2a89694a811'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.443706 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5f1b1c768b43be80f4e2a89694a811'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.444348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5f1b1c768b43be80f4e2a89694a811'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.463714 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4311/8606] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:51:35 2022] DELETE /identity/v3/users/6a5f1b1c768b43be80f4e2a89694a811 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:35.468509 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:35.468811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:35.469403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:35.490247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:35.491489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:35.557103 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4296/8607] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:35.567872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:35.569462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:35.631777 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b3ce-446d-4b5c-ad09-d0fa2694e0b2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:35.635857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:35.636560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:35.636872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:35.637127 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:35.646474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:35.647955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:35.658275 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4312/8608] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:35.829987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:35.831614 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:35.845778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa865f2d-2bc1-4004-91d1-341558c056f9 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:35.857685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:35.858619 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:35.859053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:35.859469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] PATH_INFO: `/v3/projects/4d17d705402549dc94e6fdd36e917823` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:35.860959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d17d705402549dc94e6fdd36e917823)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:35.863124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:35.915914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d17d705402549dc94e6fdd36e917823', 'request_id': 'req-c5307b64-de48-4cb5-84ec-73ea645bfb21'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.922879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d17d705402549dc94e6fdd36e917823', 'request_id': 'req-c5307b64-de48-4cb5-84ec-73ea645bfb21'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.929066 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d17d705402549dc94e6fdd36e917823', 'request_id': 'req-c5307b64-de48-4cb5-84ec-73ea645bfb21'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.931739 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:35.945202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] The token cache is being invalidate because project 4d17d705402549dc94e6fdd36e917823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:51:35.945496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.946521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:35.948099 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4297/8609] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:51:35 2022] DELETE /identity/v3/projects/4d17d705402549dc94e6fdd36e917823 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:35.952505 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:35.963465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fde74-d631-4bbb-b006-aa6fff742fe1 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:35.982121 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:36.028866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.029576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.030048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.030484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] PATH_INFO: `/v3/users/1bff082a56ab4740aa1b0eafd0cf0c04` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.048814 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bff082a56ab4740aa1b0eafd0cf0c04)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.050799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.103680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bff082a56ab4740aa1b0eafd0cf0c04'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.113033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bff082a56ab4740aa1b0eafd0cf0c04'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.113704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bff082a56ab4740aa1b0eafd0cf0c04'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.122093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bff082a56ab4740aa1b0eafd0cf0c04'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.122861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c6f369ed-5856-4b03-8e7c-306ce79a7d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bff082a56ab4740aa1b0eafd0cf0c04'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.141484 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4313/8610] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:51:35 2022] DELETE /identity/v3/users/1bff082a56ab4740aa1b0eafd0cf0c04 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:36.334118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:36.335629 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:36.351831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5307b64-de48-4cb5-84ec-73ea645bfb21 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:36.412967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.413639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.414035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.414319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] PATH_INFO: `/v3/projects/98fd605c1535426d8c55a2aab5035335` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.425729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98fd605c1535426d8c55a2aab5035335)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.427700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.478748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98fd605c1535426d8c55a2aab5035335', 'request_id': 'req-a77e9722-cb6a-4708-9b86-99cd11ac26a3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.486201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98fd605c1535426d8c55a2aab5035335', 'request_id': 'req-a77e9722-cb6a-4708-9b86-99cd11ac26a3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.492180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98fd605c1535426d8c55a2aab5035335', 'request_id': 'req-a77e9722-cb6a-4708-9b86-99cd11ac26a3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.506491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] The token cache is being invalidate because project 98fd605c1535426d8c55a2aab5035335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:51:36.506779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.507399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a77e9722-cb6a-4708-9b86-99cd11ac26a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:36.508953 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4298/8611] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:51:36 2022] DELETE /identity/v3/projects/98fd605c1535426d8c55a2aab5035335 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:51:36.514831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae366-5f1d-4ff4-95b5-ae74f5332311 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.515322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae366-5f1d-4ff4-95b5-ae74f5332311 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.515503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae366-5f1d-4ff4-95b5-ae74f5332311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.535682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e9aae366-5f1d-4ff4-95b5-ae74f5332311 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:36.536933 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e9aae366-5f1d-4ff4-95b5-ae74f5332311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:36.601445 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4314/8612] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:36.610548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810239-c0ec-4d8e-b4b7-69dfd076ba30 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.611137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810239-c0ec-4d8e-b4b7-69dfd076ba30 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.611412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810239-c0ec-4d8e-b4b7-69dfd076ba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.631955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a6810239-c0ec-4d8e-b4b7-69dfd076ba30 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:36.633168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6810239-c0ec-4d8e-b4b7-69dfd076ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:36.642448 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4299/8613] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:36.647081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aae366-5f1d-4ff4-95b5-ae74f5332311 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:36.658478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aae366-5f1d-4ff4-95b5-ae74f5332311 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:36.663513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.664125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.664404 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.664678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.665362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:51:36.665674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.667884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.679695 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4315/8614] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:51:36.684300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6810239-c0ec-4d8e-b4b7-69dfd076ba30 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:36.694717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6810239-c0ec-4d8e-b4b7-69dfd076ba30 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:36.700653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.701371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.701728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.702065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.702781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.704794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.735263 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4300/8615] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:51:36 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:51:36.739811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:36.751097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b8f3b-7d6e-4d02-bcaf-c0f6fcf18899 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:36.765010 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:36.814343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.814958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.815237 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.815510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.816133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.818087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.841576 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4316/8616] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:51:36 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:36.846077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:36.857791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf140b-f13b-402e-8f53-276032c9f7fb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:36.863467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.864071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.864345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.864751 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.865305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.866921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.881418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4301/8617] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:36.882730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:36.893774 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0388e89-654d-4f88-9220-760979909f80 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:36.899184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb225ee4-811e-4b31-9d5d-7991bbacc7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.899792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb225ee4-811e-4b31-9d5d-7991bbacc7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.900066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb225ee4-811e-4b31-9d5d-7991bbacc7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.900325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb225ee4-811e-4b31-9d5d-7991bbacc7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.901126 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb225ee4-811e-4b31-9d5d-7991bbacc7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.902744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb225ee4-811e-4b31-9d5d-7991bbacc7b6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.913813 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4317/8618] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:36.918490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:36.929035 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2935d3-5074-48eb-9781-095462f49612 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:36.934242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:36.934892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.935168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.935437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] PATH_INFO: `/v3/projects/4833ff93f3024a70accc82ae402819dc/users/0c662e4ed8f3413b984b17391a93543b/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:36.950591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4833ff93f3024a70accc82ae402819dc, user_id=0c662e4ed8f3413b984b17391a93543b, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:36.953424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:36.969053 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4302/8619] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:36 2022] PUT /identity/v3/projects/4833ff93f3024a70accc82ae402819dc/users/0c662e4ed8f3413b984b17391a93543b/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:51:36.980955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ffa8-dd6e-45a4-9751-13276a75c233 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:36.981240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ffa8-dd6e-45a4-9751-13276a75c233 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:36.981503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ffa8-dd6e-45a4-9751-13276a75c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:37.009768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b083ffa8-dd6e-45a4-9751-13276a75c233 None None] MFA Rules not processed for user `0c662e4ed8f3413b984b17391a93543b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:37.011100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b083ffa8-dd6e-45a4-9751-13276a75c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:37.081787 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4318/8620] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:37.087335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:37.102681 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:37.157606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10681afb-6e9e-4399-9a01-f84e400fbbb1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:37.162355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:37.162972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:37.163250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:37.163520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:37.164170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:37.166122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:37.199048 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4303/8621] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:51:37 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:37.204304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ffa8-dd6e-45a4-9751-13276a75c233 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:37.216556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ffa8-dd6e-45a4-9751-13276a75c233 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:37.284093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:37.284713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:37.285021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:37.285299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:37.285922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:37.287888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:37.311144 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4319/8622] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:51:37 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:37.315218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:37.326292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d819a7-0579-495f-92a6-6fae383bb07e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:37.330958 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18561-aeda-4cbe-9217-15e0d261f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:37.331564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18561-aeda-4cbe-9217-15e0d261f64d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:37.331838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18561-aeda-4cbe-9217-15e0d261f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:37.332140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18561-aeda-4cbe-9217-15e0d261f64d admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:37.332875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18561-aeda-4cbe-9217-15e0d261f64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:37.334460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18561-aeda-4cbe-9217-15e0d261f64d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:37.347035 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4304/8623] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:37.351493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:37.362356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f79aa2-ca57-4262-bb1b-eafc381beffa admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:37.366982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:37.367639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:37.367918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:37.368193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] PATH_INFO: `/v3/projects/be4969f0676e406f9911531354cebc6e/users/3b309d19753c446384b590aa40ac7fa6/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:37.381035 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:37.384178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4969f0676e406f9911531354cebc6e, user_id=3b309d19753c446384b590aa40ac7fa6, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:37.387844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:37.403702 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4320/8624] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:37 2022] PUT /identity/v3/projects/be4969f0676e406f9911531354cebc6e/users/3b309d19753c446384b590aa40ac7fa6/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:51:37.414181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de4875-3b2c-4083-aaa9-0486ecdab834 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:37.414543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de4875-3b2c-4083-aaa9-0486ecdab834 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:37.414935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de4875-3b2c-4083-aaa9-0486ecdab834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:37.448354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-90de4875-3b2c-4083-aaa9-0486ecdab834 None None] MFA Rules not processed for user `3b309d19753c446384b590aa40ac7fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:37.449622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-90de4875-3b2c-4083-aaa9-0486ecdab834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:37.515627 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4305/8625] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:37 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:37.548040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:37.549863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:37.626194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad00e-1d08-4723-ab14-ace59e7e59d0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:37.631362 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301050ab-cad9-4cc6-978a-29394dc26ecb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:37.631990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301050ab-cad9-4cc6-978a-29394dc26ecb service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:37.632262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301050ab-cad9-4cc6-978a-29394dc26ecb service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:37.632524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301050ab-cad9-4cc6-978a-29394dc26ecb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:37.641218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301050ab-cad9-4cc6-978a-29394dc26ecb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:37.642737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301050ab-cad9-4cc6-978a-29394dc26ecb service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:37.651048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4321/8626] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:51:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:51:38.247468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de4875-3b2c-4083-aaa9-0486ecdab834 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:38.317248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de4875-3b2c-4083-aaa9-0486ecdab834 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:38.322452 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:38.323252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:38.323678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:38.324054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] PATH_INFO: `/v3/users/0c662e4ed8f3413b984b17391a93543b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:38.325391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c662e4ed8f3413b984b17391a93543b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:38.327808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:38.346855 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:38.380546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c662e4ed8f3413b984b17391a93543b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:38.388941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c662e4ed8f3413b984b17391a93543b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:38.403302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c662e4ed8f3413b984b17391a93543b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:38.403912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c662e4ed8f3413b984b17391a93543b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:38.411296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c662e4ed8f3413b984b17391a93543b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:38.417960 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4306/8627] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:51:38 2022] DELETE /identity/v3/users/0c662e4ed8f3413b984b17391a93543b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:38.422524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:38.422808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:38.423142 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:38.446009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:38.447256 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:38.510497 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4322/8628] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:38.520922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:38.522376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:38.584442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1c07-ebcf-4ce3-855a-fc947645f10c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:38.588279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:38.588939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:38.589387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:38.589675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:38.599428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:38.600889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:38.610766 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4307/8629] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:38.901236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:38.905196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:38.919881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df893b40-2708-44f1-83f8-ab926b4a9474 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:38.924934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:38.925605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:38.925881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:38.926315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] PATH_INFO: `/v3/projects/4833ff93f3024a70accc82ae402819dc` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:38.927458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4833ff93f3024a70accc82ae402819dc)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:38.929414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:38.988572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4833ff93f3024a70accc82ae402819dc', 'request_id': 'req-c8862542-95c3-4a0d-b82f-0a13324b557d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:38.998880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4833ff93f3024a70accc82ae402819dc', 'request_id': 'req-c8862542-95c3-4a0d-b82f-0a13324b557d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.005305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4833ff93f3024a70accc82ae402819dc', 'request_id': 'req-c8862542-95c3-4a0d-b82f-0a13324b557d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.017368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] The token cache is being invalidate because project 4833ff93f3024a70accc82ae402819dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:51:39.017650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.018341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.019884 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4323/8630] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:51:38 2022] DELETE /identity/v3/projects/4833ff93f3024a70accc82ae402819dc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:39.024615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:39.035887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b077c-4897-408b-9055-cf7c00b2678d service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:39.098313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:39.098963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:39.099355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:39.099765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] PATH_INFO: `/v3/users/3b309d19753c446384b590aa40ac7fa6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:39.101011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b309d19753c446384b590aa40ac7fa6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:39.102939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:39.167748 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:39.174933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b309d19753c446384b590aa40ac7fa6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.184783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b309d19753c446384b590aa40ac7fa6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.197295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b309d19753c446384b590aa40ac7fa6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.197935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b309d19753c446384b590aa40ac7fa6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.205116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-fedf21e9-c446-4454-8e4d-7360afd5781d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b309d19753c446384b590aa40ac7fa6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.210996 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4308/8631] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:51:39 2022] DELETE /identity/v3/users/3b309d19753c446384b590aa40ac7fa6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:39.506167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:39.507650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:39.517906 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:39.522411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8862542-95c3-4a0d-b82f-0a13324b557d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:39.585082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:39.585729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:39.586010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:39.586291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] PATH_INFO: `/v3/projects/be4969f0676e406f9911531354cebc6e` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:39.587451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4969f0676e406f9911531354cebc6e)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:39.590115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:39.644516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4969f0676e406f9911531354cebc6e', 'request_id': 'req-23d55162-0bba-46a1-ba3b-bf20b563bea9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.656193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4969f0676e406f9911531354cebc6e', 'request_id': 'req-23d55162-0bba-46a1-ba3b-bf20b563bea9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.662190 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4969f0676e406f9911531354cebc6e', 'request_id': 'req-23d55162-0bba-46a1-ba3b-bf20b563bea9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.674204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] The token cache is being invalidate because project be4969f0676e406f9911531354cebc6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:51:39.674491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.675137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-23d55162-0bba-46a1-ba3b-bf20b563bea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:51:39.676756 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4324/8632] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:51:39 2022] DELETE /identity/v3/projects/be4969f0676e406f9911531354cebc6e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:39.682282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20693092-cc5f-4234-959e-4c9e762476eb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:39.682803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20693092-cc5f-4234-959e-4c9e762476eb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:39.683131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20693092-cc5f-4234-959e-4c9e762476eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:39.704328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-20693092-cc5f-4234-959e-4c9e762476eb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:39.705752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-20693092-cc5f-4234-959e-4c9e762476eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:39.773269 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4309/8633] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:51:39.782173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f489-4521-4bdb-afcc-4074da22b22f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:39.782395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f489-4521-4bdb-afcc-4074da22b22f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:39.782631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f489-4521-4bdb-afcc-4074da22b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:39.805131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-77f6f489-4521-4bdb-afcc-4074da22b22f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:39.806375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-77f6f489-4521-4bdb-afcc-4074da22b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:39.814988 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4325/8634] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:39.819393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20693092-cc5f-4234-959e-4c9e762476eb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:39.829814 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20693092-cc5f-4234-959e-4c9e762476eb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:39.834309 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:39.834904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:39.835177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:39.835443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:39.836079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:51:39.836374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:39.838033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:39.849904 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4310/8635] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:51:39.854581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f489-4521-4bdb-afcc-4074da22b22f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:39.864935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f489-4521-4bdb-afcc-4074da22b22f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:39.870068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:39.871189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:39.871471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:39.871745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:39.872376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:39.874326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:39.907038 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4326/8636] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:51:39 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:39.911533 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:39.922392 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1d5d2-556e-4761-9e20-3592913c7ca2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:39.981298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:39.981909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:39.982185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:39.982458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:39.983097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:39.985042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.007975 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4311/8637] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:51:39 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:51:40.012658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.023666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3d596-52b8-4d52-8431-ac65685ac478 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.029802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.030417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.030695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.030973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.031609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.033332 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.045334 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4327/8638] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:51:40.050390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.061442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f938e4-a4de-4f85-9d26-a4e8e4c0c8ea admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.069302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0736a4-fedd-43db-8050-c727449fe353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.070006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0736a4-fedd-43db-8050-c727449fe353 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.070326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0736a4-fedd-43db-8050-c727449fe353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.070626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0736a4-fedd-43db-8050-c727449fe353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.071295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0736a4-fedd-43db-8050-c727449fe353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.073129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0736a4-fedd-43db-8050-c727449fe353 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.084862 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4312/8639] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:40.089673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.100348 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb0b8-92c9-4b30-aad6-f77bc7cb85ec admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.106022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.106759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.107151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.107316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] PATH_INFO: `/v3/projects/288daeed1607434ba873f29bfc0d6eee/users/137f0efed4004fab97a97c79a7ca01b0/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.125133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288daeed1607434ba873f29bfc0d6eee, user_id=137f0efed4004fab97a97c79a7ca01b0, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.127778 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.150948 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4328/8640] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:40 2022] PUT /identity/v3/projects/288daeed1607434ba873f29bfc0d6eee/users/137f0efed4004fab97a97c79a7ca01b0/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:40.162602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6773b3c-7dd8-4cf9-b2c7-28408d3ebe58 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.162907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6773b3c-7dd8-4cf9-b2c7-28408d3ebe58 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.163290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6773b3c-7dd8-4cf9-b2c7-28408d3ebe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.196338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a6773b3c-7dd8-4cf9-b2c7-28408d3ebe58 None None] MFA Rules not processed for user `137f0efed4004fab97a97c79a7ca01b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:40.197678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a6773b3c-7dd8-4cf9-b2c7-28408d3ebe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:40.209140 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:40.269013 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4313/8641] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:40.273635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.310956 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:40.345361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275356-848e-4c8f-a4e1-a2e632728717 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.350490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.351092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.351361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.351626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.352254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.354196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.385246 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4329/8642] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:51:40 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:51:40.386595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6773b3c-7dd8-4cf9-b2c7-28408d3ebe58 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.398495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6773b3c-7dd8-4cf9-b2c7-28408d3ebe58 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.461141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.461773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.462052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.462330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.462983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.465002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.488981 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4314/8643] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:51:40 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:40.492922 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.504822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43ef68-d742-4b14-ba67-2917c60de7f7 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.509790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.510503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.510999 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.511844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.512255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.513936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.529796 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4330/8644] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:40.533825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.545269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7632-6f2c-4556-8eaa-ef44aa8cf380 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.550140 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74819c84-d18e-4fa9-be8e-de55b0ab087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.550991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74819c84-d18e-4fa9-be8e-de55b0ab087b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.551274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74819c84-d18e-4fa9-be8e-de55b0ab087b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.551549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74819c84-d18e-4fa9-be8e-de55b0ab087b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.552225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74819c84-d18e-4fa9-be8e-de55b0ab087b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.554029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74819c84-d18e-4fa9-be8e-de55b0ab087b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.568561 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4315/8645] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:40.569741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.580813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ed1a-0f0b-4ea4-bc0b-324a3ed7ce1d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.585571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.586263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.586546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.586821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] PATH_INFO: `/v3/projects/f5ff7491842a45d4a3f174f27274a453/users/181129ec12df426eb9038179a78f7a68/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.602782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ff7491842a45d4a3f174f27274a453, user_id=181129ec12df426eb9038179a78f7a68, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.606867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.621736 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4331/8646] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:40 2022] PUT /identity/v3/projects/f5ff7491842a45d4a3f174f27274a453/users/181129ec12df426eb9038179a78f7a68/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:40.631988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadfa31-aaf7-460c-9e86-e7afe03df991 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.632378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadfa31-aaf7-460c-9e86-e7afe03df991 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.632711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadfa31-aaf7-460c-9e86-e7afe03df991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.663303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8dadfa31-aaf7-460c-9e86-e7afe03df991 None None] MFA Rules not processed for user `181129ec12df426eb9038179a78f7a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:40.664655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8dadfa31-aaf7-460c-9e86-e7afe03df991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:40.732920 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4316/8647] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:40.737827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.805376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61233-afe0-451c-b58c-db8efbe2af68 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.810285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.811020 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.811300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.811582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.812225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.814172 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.843900 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4332/8648] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:51:40 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:40.848244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadfa31-aaf7-460c-9e86-e7afe03df991 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.865644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadfa31-aaf7-460c-9e86-e7afe03df991 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.884268 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:40.930221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.930865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.931114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.931415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.932183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.934391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.961005 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4317/8649] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:51:40 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:51:40.962268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:40.973747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e21336-cf24-4146-92c9-fc9b8c060b34 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:40.979216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:40.979929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:40.980400 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:40.980677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:40.981371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:40.982995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:40.994326 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4333/8650] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:51:40.998696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:41.009370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ed47b-adb8-4ab9-a002-19ed6d7875e4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:41.014718 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:41.015417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:41.015671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:41.016009 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] PATH_INFO: `/v3/projects/f76f76a237ae41659fd38b3f425bcacb/users/189f7316a651475c933bd80f07396bca/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:41.032210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76f76a237ae41659fd38b3f425bcacb, user_id=189f7316a651475c933bd80f07396bca, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:41.035004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:41.050114 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4318/8651] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:40 2022] PUT /identity/v3/projects/f76f76a237ae41659fd38b3f425bcacb/users/189f7316a651475c933bd80f07396bca/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:51:41.054272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:41.069799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baa953-785f-492c-8bdd-323370b02d03 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:41.125002 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:41.132423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f19fb-9776-49e8-b9f7-37a548d1c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:41.133094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f19fb-9776-49e8-b9f7-37a548d1c89b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:41.133412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f19fb-9776-49e8-b9f7-37a548d1c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:41.133641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f19fb-9776-49e8-b9f7-37a548d1c89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:41.134291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f19fb-9776-49e8-b9f7-37a548d1c89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:41.136239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f19fb-9776-49e8-b9f7-37a548d1c89b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:41.149272 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4334/8652] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:51:41.152719 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:41.163628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7153f-8a18-45f5-b120-33e8a18f11c3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:41.169083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:41.169740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:41.170017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:41.170291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] PATH_INFO: `/v3/projects/f76f76a237ae41659fd38b3f425bcacb/users/189f7316a651475c933bd80f07396bca/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:41.172303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76f76a237ae41659fd38b3f425bcacb, user_id=189f7316a651475c933bd80f07396bca, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:41.175134 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:41.186586 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4319/8653] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:51:41 2022] PUT /identity/v3/projects/f76f76a237ae41659fd38b3f425bcacb/users/189f7316a651475c933bd80f07396bca/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:51:41.197687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:41.197971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:41.198241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:41.228044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] MFA Rules not processed for user `189f7316a651475c933bd80f07396bca`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:41.229169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:41.298145 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4335/8654] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:41.316516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:41.318890 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:41.406625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b53247-58bb-4cd9-859a-dd75dfcbc03d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:41.412648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb188f-1a30-4300-8be8-593de5d0c41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:41.413478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb188f-1a30-4300-8be8-593de5d0c41d service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:41.413756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb188f-1a30-4300-8be8-593de5d0c41d service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:41.414028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb188f-1a30-4300-8be8-593de5d0c41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:41.474345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb188f-1a30-4300-8be8-593de5d0c41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:41.477547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb188f-1a30-4300-8be8-593de5d0c41d service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:41.490588 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4320/8655] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:43.318412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:43.320017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:43.383786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc923742-51ce-40d9-a70b-7630780675eb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:43.387579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:43.388831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:43.388831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:43.388831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:43.399790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:43.401169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:43.411709 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4336/8656] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:47.458810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:47.459268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:47.459353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:47.507346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] MFA Rules not processed for user `137f0efed4004fab97a97c79a7ca01b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:51:47.508687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:47.518065 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4321/8657] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:51:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:51:48.052894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:48.065775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c822a9-48bc-4254-895b-a264ec3262f3 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:48.070847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:48.072110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:48.072587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:48.073046 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:48.075182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:48.091433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:48.093429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:48.113166 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4337/8658] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:52.106799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:52.108317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:52.115522 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:52.124333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e1928-45fb-4b37-af1f-66f10126e3a5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:52.128150 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad0e95-79bc-44b1-b0f5-3c3a5018f128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:52.128791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad0e95-79bc-44b1-b0f5-3c3a5018f128 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:52.129064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad0e95-79bc-44b1-b0f5-3c3a5018f128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:52.129342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad0e95-79bc-44b1-b0f5-3c3a5018f128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:52.131123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8bad0e95-79bc-44b1-b0f5-3c3a5018f128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:52.148419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad0e95-79bc-44b1-b0f5-3c3a5018f128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:52.150221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad0e95-79bc-44b1-b0f5-3c3a5018f128 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:52.164581 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4322/8659] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:51:53.371429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:51:53.383152 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7011f18-00d1-48d8-a471-595df6143d35 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:51:53.387502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:51:53.388139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:51:53.388390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:51:53.388655 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:51:53.390561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:51:53.409128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:51:53.410572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:51:53.425029 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4338/8660] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:51:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:52:02.156564 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:52:03.416975 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=76 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:06.437986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:06.438673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:06.438673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:06.458380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] MFA Rules not processed for user `83c0183473044981a355938f51265763`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:53:06.459586 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:06.518650 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4323/8661] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:53:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:53:09.330316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:09.347585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad39ae-e296-42dc-8b34-59046af8a46f service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:09.354189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a2b33-f31f-4ded-9cff-9ceb1ad73945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:09.355855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a2b33-f31f-4ded-9cff-9ceb1ad73945 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:09.356478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a2b33-f31f-4ded-9cff-9ceb1ad73945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:09.356936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a2b33-f31f-4ded-9cff-9ceb1ad73945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:09.360809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0e8a2b33-f31f-4ded-9cff-9ceb1ad73945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:09.379314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a2b33-f31f-4ded-9cff-9ceb1ad73945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:09.381466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a2b33-f31f-4ded-9cff-9ceb1ad73945 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:09.399489 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4339/8662] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:53:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:53:10.175635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:10.177543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:10.229852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f954-c0fe-4ef6-ad03-c393ecedb4e5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:10.239129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:10.239976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:10.240613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:10.241168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:10.243448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:10.272422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:10.274124 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:10.350106 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4324/8663] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:53:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:53:13.185546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629c586-7cf2-4811-b2f4-f473446b2b3c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:13.187153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629c586-7cf2-4811-b2f4-f473446b2b3c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:13.187819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629c586-7cf2-4811-b2f4-f473446b2b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:13.214076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-f629c586-7cf2-4811-b2f4-f473446b2b3c None None] MFA Rules not processed for user `137f0efed4004fab97a97c79a7ca01b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:53:13.215555 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f629c586-7cf2-4811-b2f4-f473446b2b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:13.226522 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4340/8664] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:53:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:53:13.677109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:13.694089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49819adb-e73a-48db-871a-cd7021656785 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:13.699415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:13.700265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:13.700727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:13.701205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:13.704101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:13.721180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:13.722967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:13.735699 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4325/8665] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:53:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:53:23.208045 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:23.729998 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=37 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:28.511115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629c586-7cf2-4811-b2f4-f473446b2b3c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:28.527571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629c586-7cf2-4811-b2f4-f473446b2b3c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:28.531671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:28.532850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:28.533115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:28.533588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:28.535938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:28.611197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:28.612632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:28.622903 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4341/8666] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:53:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:53:38.618579 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=30 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:42.917165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:42.920439 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:43.003105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd5c20-1ec3-4303-b3f4-94a66ff32aa3 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:43.010253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d028e-596b-41c8-a4cc-60417efd1de8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:43.011025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d028e-596b-41c8-a4cc-60417efd1de8 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:43.011527 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d028e-596b-41c8-a4cc-60417efd1de8 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:43.012105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d028e-596b-41c8-a4cc-60417efd1de8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:43.014894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9c3d028e-596b-41c8-a4cc-60417efd1de8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:43.037109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:43.043735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d028e-596b-41c8-a4cc-60417efd1de8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:43.045962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d028e-596b-41c8-a4cc-60417efd1de8 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:43.062433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4326/8667] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:53:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:53:43.120223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db3b0-ee10-4dab-a608-589ddedec776 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:43.125482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:43.126285 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:43.126663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:43.127033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] PATH_INFO: `/v3/users/137f0efed4004fab97a97c79a7ca01b0` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:43.128384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137f0efed4004fab97a97c79a7ca01b0)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:43.130565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:43.184234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137f0efed4004fab97a97c79a7ca01b0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.197786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137f0efed4004fab97a97c79a7ca01b0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.198494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137f0efed4004fab97a97c79a7ca01b0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.205853 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137f0efed4004fab97a97c79a7ca01b0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.206648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137f0efed4004fab97a97c79a7ca01b0'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.223846 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4342/8668] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:53:43 2022] DELETE /identity/v3/users/137f0efed4004fab97a97c79a7ca01b0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:53:43.228513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:43.228829 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:43.229102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:43.248647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:53:43.249946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:43.324205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4327/8669] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:53:43.335171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:43.336902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:43.397925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a257e33-d176-486e-a836-cdcb32a67419 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:43.403771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:43.404887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:43.405286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:43.405666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:43.416930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:43.418367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:43.428069 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4343/8670] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:53:43.622327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:43.623877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:43.640928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ebb62-f572-4b55-b57d-5dc2cc2dc359 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:43.646816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:43.647415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:43.647740 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:43.648207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] PATH_INFO: `/v3/projects/288daeed1607434ba873f29bfc0d6eee` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:43.649497 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] RBAC: Authorizing `identity:delete_project(project_id=288daeed1607434ba873f29bfc0d6eee)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:43.651900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:43.708957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288daeed1607434ba873f29bfc0d6eee', 'request_id': 'req-33e201ec-f71d-4d21-82e4-f7d28eca475a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.715692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288daeed1607434ba873f29bfc0d6eee', 'request_id': 'req-33e201ec-f71d-4d21-82e4-f7d28eca475a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.721495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288daeed1607434ba873f29bfc0d6eee', 'request_id': 'req-33e201ec-f71d-4d21-82e4-f7d28eca475a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.735710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] The token cache is being invalidate because project 288daeed1607434ba873f29bfc0d6eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:53:43.735996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.736617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.738513 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4328/8671] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:53:43 2022] DELETE /identity/v3/projects/288daeed1607434ba873f29bfc0d6eee => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:53:43.742658 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:43.752498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f3a3e-be0b-4f57-bb1f-625608c0897c service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:43.771449 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:43.814670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:43.815328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:43.815630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:43.815905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] PATH_INFO: `/v3/users/181129ec12df426eb9038179a78f7a68` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:43.817106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181129ec12df426eb9038179a78f7a68)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:43.819057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:43.872516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181129ec12df426eb9038179a78f7a68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.881515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181129ec12df426eb9038179a78f7a68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.882245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181129ec12df426eb9038179a78f7a68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.890551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181129ec12df426eb9038179a78f7a68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.891258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181129ec12df426eb9038179a78f7a68'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:43.911285 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4344/8672] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:53:43 2022] DELETE /identity/v3/users/181129ec12df426eb9038179a78f7a68 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:53:44.214757 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:44.216302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:44.233031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e201ec-f71d-4d21-82e4-f7d28eca475a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:44.244098 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:44.297138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:44.297778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:44.298133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:44.298412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] PATH_INFO: `/v3/projects/f5ff7491842a45d4a3f174f27274a453` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:44.299769 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ff7491842a45d4a3f174f27274a453)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:44.306243 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:44.361091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ff7491842a45d4a3f174f27274a453', 'request_id': 'req-262a55cc-35fe-4d00-970f-0d0ae380bddd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.368087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ff7491842a45d4a3f174f27274a453', 'request_id': 'req-262a55cc-35fe-4d00-970f-0d0ae380bddd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.375556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ff7491842a45d4a3f174f27274a453', 'request_id': 'req-262a55cc-35fe-4d00-970f-0d0ae380bddd'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.391865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] The token cache is being invalidate because project f5ff7491842a45d4a3f174f27274a453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:53:44.392086 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.392720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.394491 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4329/8673] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:53:44 2022] DELETE /identity/v3/projects/f5ff7491842a45d4a3f174f27274a453 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:53:44.398823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:44.400386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:44.414207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0599-d205-48c0-bbc0-f1e41ee7f842 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:44.477684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:44.478333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:44.478613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:44.478888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] PATH_INFO: `/v3/users/189f7316a651475c933bd80f07396bca` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:44.480073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=189f7316a651475c933bd80f07396bca)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:44.482037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:44.538679 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:44.543055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189f7316a651475c933bd80f07396bca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.556315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189f7316a651475c933bd80f07396bca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.557122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189f7316a651475c933bd80f07396bca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.566110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189f7316a651475c933bd80f07396bca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.566928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189f7316a651475c933bd80f07396bca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.585835 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4345/8674] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:53:44 2022] DELETE /identity/v3/users/189f7316a651475c933bd80f07396bca => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:53:44.781811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:53:44.783495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:53:44.798692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a55cc-35fe-4d00-970f-0d0ae380bddd admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:53:44.863532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:53:44.864187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:53:44.864530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:53:44.864883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] PATH_INFO: `/v3/projects/f76f76a237ae41659fd38b3f425bcacb` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:53:44.866187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76f76a237ae41659fd38b3f425bcacb)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:53:44.868494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:53:44.917076 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:44.920359 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76f76a237ae41659fd38b3f425bcacb', 'request_id': 'req-6d9aa639-5c83-4dec-9655-def818c08c7d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.928258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76f76a237ae41659fd38b3f425bcacb', 'request_id': 'req-6d9aa639-5c83-4dec-9655-def818c08c7d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.933971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76f76a237ae41659fd38b3f425bcacb', 'request_id': 'req-6d9aa639-5c83-4dec-9655-def818c08c7d'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.947959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] The token cache is being invalidate because project f76f76a237ae41659fd38b3f425bcacb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:53:44.948133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.948855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:53:44.950433 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4330/8675] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:53:44 2022] DELETE /identity/v3/projects/f76f76a237ae41659fd38b3f425bcacb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:53:54.581912 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:54.944788 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:23.675677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:23.678037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:23.693456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec42453-f84e-4376-84b8-754e3f4da0e6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:23.753851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:23.754510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:23.754807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:23.755167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] PATH_INFO: `/v3/users/83c0183473044981a355938f51265763` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:23.756741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c0183473044981a355938f51265763)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:23.758713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:23.807373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c0183473044981a355938f51265763'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:23.815749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c0183473044981a355938f51265763'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:23.816365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c0183473044981a355938f51265763'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:23.823397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c0183473044981a355938f51265763'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:23.824081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c0183473044981a355938f51265763'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:23.843013 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4346/8676] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:54:23 2022] DELETE /identity/v3/users/83c0183473044981a355938f51265763 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:54:24.028981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:24.031075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:24.044896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aa639-5c83-4dec-9655-def818c08c7d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:24.107195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:24.107732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:24.108007 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:24.108281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] PATH_INFO: `/v3/projects/1e3493d1d7ad47b2981af000f2168ed8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:24.109492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3493d1d7ad47b2981af000f2168ed8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:24.111423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:24.160045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3493d1d7ad47b2981af000f2168ed8', 'request_id': 'req-c7f59d03-5cd7-4e96-bc83-6771305da7ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.166758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3493d1d7ad47b2981af000f2168ed8', 'request_id': 'req-c7f59d03-5cd7-4e96-bc83-6771305da7ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.172856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3493d1d7ad47b2981af000f2168ed8', 'request_id': 'req-c7f59d03-5cd7-4e96-bc83-6771305da7ed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.187909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] The token cache is being invalidate because project 1e3493d1d7ad47b2981af000f2168ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:54:24.188196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.188858 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.190441 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4331/8677] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:54:24 2022] DELETE /identity/v3/projects/1e3493d1d7ad47b2981af000f2168ed8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:54:24.195221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:24.196736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:24.210141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8598-a332-411e-94de-4ad1b70e9bab admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:24.268241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:24.268903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:24.269178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:24.269434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] PATH_INFO: `/v3/users/5b0c5b60f6e14c7c945c6d6104e07041` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:24.270646 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0c5b60f6e14c7c945c6d6104e07041)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:24.272738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:24.294355 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:24.327315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0c5b60f6e14c7c945c6d6104e07041'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.336428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0c5b60f6e14c7c945c6d6104e07041'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.337059 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0c5b60f6e14c7c945c6d6104e07041'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.344327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0c5b60f6e14c7c945c6d6104e07041'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.344998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-35696a3f-c2a1-40ed-bda9-cd55b9a1c3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0c5b60f6e14c7c945c6d6104e07041'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.362060 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4347/8678] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:54:24 2022] DELETE /identity/v3/users/5b0c5b60f6e14c7c945c6d6104e07041 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:54:24.539662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:24.541281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:24.557075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59d03-5cd7-4e96-bc83-6771305da7ed admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:24.616756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:24.617342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:24.617620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:24.617894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] PATH_INFO: `/v3/projects/8807f82c934a4189826137dffe435cf1` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:24.619043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8807f82c934a4189826137dffe435cf1)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:24.620990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:24.664710 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:24.683044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8807f82c934a4189826137dffe435cf1', 'request_id': 'req-8aca1e6a-f840-4a8e-8b34-425113e89bf2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.689396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8807f82c934a4189826137dffe435cf1', 'request_id': 'req-8aca1e6a-f840-4a8e-8b34-425113e89bf2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.695687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8807f82c934a4189826137dffe435cf1', 'request_id': 'req-8aca1e6a-f840-4a8e-8b34-425113e89bf2'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.710356 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] The token cache is being invalidate because project 8807f82c934a4189826137dffe435cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:54:24.710727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.711500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8aca1e6a-f840-4a8e-8b34-425113e89bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:54:24.713158 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4332/8679] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:54:24 2022] DELETE /identity/v3/projects/8807f82c934a4189826137dffe435cf1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:54:24.718592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e5677-5a05-409b-9e53-431ea8388bf0 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:24.719067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e5677-5a05-409b-9e53-431ea8388bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:24.719167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e5677-5a05-409b-9e53-431ea8388bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:24.740817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-257e5677-5a05-409b-9e53-431ea8388bf0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:54:24.742035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-257e5677-5a05-409b-9e53-431ea8388bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:24.817821 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4348/8680] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:54:24.826512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88152-a9fb-4e30-8be1-411ec44a4a4c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:24.826788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88152-a9fb-4e30-8be1-411ec44a4a4c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:24.827113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88152-a9fb-4e30-8be1-411ec44a4a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:24.848589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fdf88152-a9fb-4e30-8be1-411ec44a4a4c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:54:24.850403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fdf88152-a9fb-4e30-8be1-411ec44a4a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:24.858827 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4333/8681] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:54:24.863385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e5677-5a05-409b-9e53-431ea8388bf0 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:24.873625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e5677-5a05-409b-9e53-431ea8388bf0 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:24.879193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:24.879787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:24.880098 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:24.880365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:24.881206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:54:24.881501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:24.883092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:24.896023 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4349/8682] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 01:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:54:24.900980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf88152-a9fb-4e30-8be1-411ec44a4a4c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:24.911399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf88152-a9fb-4e30-8be1-411ec44a4a4c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:24.918643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:24.919249 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:24.919528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:24.919798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:24.920418 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:24.922372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:24.956381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4334/8683] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:54:24 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:54:24.960530 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:24.976356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f555-ec24-44aa-a952-446d9ce4bab2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:25.045497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:25.046107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:25.046386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:25.046656 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:25.047281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:25.049236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:25.074674 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4350/8684] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:54:24 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:54:25.079265 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:25.091706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd777b4-3ccc-411e-b609-5aa8560ea7fc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:25.099812 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:25.100395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:25.100670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:25.100967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:25.101605 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:25.103207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:25.113727 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4335/8685] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:54:25.117919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:25.128830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d0d8-3b0a-4076-8571-e0b03bf8512f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:25.134497 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647e6b9-9088-45a9-b7e5-17ead11bfcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:25.135106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e6b9-9088-45a9-b7e5-17ead11bfcde admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:25.135383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e6b9-9088-45a9-b7e5-17ead11bfcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:25.135650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e6b9-9088-45a9-b7e5-17ead11bfcde admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:25.136274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647e6b9-9088-45a9-b7e5-17ead11bfcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:25.137893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647e6b9-9088-45a9-b7e5-17ead11bfcde admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:25.149448 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4351/8686] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:54:25.153851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:25.166257 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca003-6927-46b4-b3d9-33429d929984 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:25.172758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:25.173651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:25.174022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:25.174282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] PATH_INFO: `/v3/projects/4c38de005ef44a40a8eae4bee4f27a33/users/d45ded05250841d08b1bcc7b637515c3/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:25.191060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c38de005ef44a40a8eae4bee4f27a33, user_id=d45ded05250841d08b1bcc7b637515c3, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:25.193795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:25.209756 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4336/8687] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:54:25 2022] PUT /identity/v3/projects/4c38de005ef44a40a8eae4bee4f27a33/users/d45ded05250841d08b1bcc7b637515c3/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:54:25.215140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb84bd-c93d-49ae-b329-2e6b30cfb23c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:25.215417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb84bd-c93d-49ae-b329-2e6b30cfb23c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:25.215682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb84bd-c93d-49ae-b329-2e6b30cfb23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:25.223880 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:25.236023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b0bb84bd-c93d-49ae-b329-2e6b30cfb23c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:54:25.237502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b0bb84bd-c93d-49ae-b329-2e6b30cfb23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:25.311177 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4352/8688] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:54:25.321272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:25.323200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:25.386394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334805-69e6-4f8a-8ba3-ca56eae806d0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:25.390399 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:25.391247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:25.391524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:25.391794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:25.401405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:25.402841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:25.412610 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4337/8689] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:54:29.486364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843128-9050-46b1-9c24-5f9c9c7c3533 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:29.486894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843128-9050-46b1-9c24-5f9c9c7c3533 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:29.487015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843128-9050-46b1-9c24-5f9c9c7c3533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:29.533682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bb843128-9050-46b1-9c24-5f9c9c7c3533 None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:54:29.535008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb843128-9050-46b1-9c24-5f9c9c7c3533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:29.616227 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4353/8690] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:54:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:54:29.619513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:29.636496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059e143-bc49-4c0e-9738-c38c02a74891 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:29.642768 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:29.643601 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:29.643772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:29.644069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:29.644706 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:29.646914 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:29.682359 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4338/8691] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 01:54:29 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:54:29.686685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb843128-9050-46b1-9c24-5f9c9c7c3533 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:29.702159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb843128-9050-46b1-9c24-5f9c9c7c3533 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:29.791075 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:29.791704 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:29.791986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:29.792265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:29.792945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:29.795394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:29.815132 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:29.825088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4354/8692] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 01:54:29 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:54:29.827341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:29.855063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568683b-6dd5-4df1-ab17-6e6d84189aec admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:29.860258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:29.861165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:29.862080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:29.862080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:29.862759 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:29.865320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:29.876852 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4339/8693] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:54:29.881182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:29.891650 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6e489-8f63-497c-8eb4-0d1f5acb8d17 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:29.896713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:29.898099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:29.898381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:29.898736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] PATH_INFO: `/v3/projects/128dc71896e9497eb2a3b27fff7480af/users/1fc59ffdf5b242b98bb849199cd60872/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:29.915823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=128dc71896e9497eb2a3b27fff7480af, user_id=1fc59ffdf5b242b98bb849199cd60872, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:29.918493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:29.932694 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4355/8694] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:54:29 2022] PUT /identity/v3/projects/128dc71896e9497eb2a3b27fff7480af/users/1fc59ffdf5b242b98bb849199cd60872/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:54:29.937043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:29.947899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bf5d-b913-4ebb-8350-8052363329dc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:29.956058 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:30.017442 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905507ae-e06f-4ebc-bd55-3f83ffb5a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:30.018048 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905507ae-e06f-4ebc-bd55-3f83ffb5a218 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:30.018322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905507ae-e06f-4ebc-bd55-3f83ffb5a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:30.018603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905507ae-e06f-4ebc-bd55-3f83ffb5a218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:30.019218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905507ae-e06f-4ebc-bd55-3f83ffb5a218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:30.021090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905507ae-e06f-4ebc-bd55-3f83ffb5a218 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:30.032068 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4340/8695] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:54:30.038033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:30.049062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e376343-d129-44e3-ab3f-17de3ed07c1e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:30.055045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:30.055718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:30.056004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:30.056274 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] PATH_INFO: `/v3/projects/128dc71896e9497eb2a3b27fff7480af/users/1fc59ffdf5b242b98bb849199cd60872/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:30.058490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=128dc71896e9497eb2a3b27fff7480af, user_id=1fc59ffdf5b242b98bb849199cd60872, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:30.061173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:30.073187 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4356/8696] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 01:54:30 2022] PUT /identity/v3/projects/128dc71896e9497eb2a3b27fff7480af/users/1fc59ffdf5b242b98bb849199cd60872/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:54:34.508040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae91eb-b31a-4c40-b1ec-69678df51923 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:34.508579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae91eb-b31a-4c40-b1ec-69678df51923 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:34.508579 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae91eb-b31a-4c40-b1ec-69678df51923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:34.547637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-78ae91eb-b31a-4c40-b1ec-69678df51923 None None] MFA Rules not processed for user `1fc59ffdf5b242b98bb849199cd60872`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:54:34.549273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-78ae91eb-b31a-4c40-b1ec-69678df51923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:34.658243 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4341/8697] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:54:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:54:34.671262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:34.673171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:34.769793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384944c8-c107-4c26-9272-1f38be39f22e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:34.773301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb3f44-3e25-46cd-a095-5c0bc57cc1dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:34.774138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3f44-3e25-46cd-a095-5c0bc57cc1dd service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:34.774484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3f44-3e25-46cd-a095-5c0bc57cc1dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:34.774821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3f44-3e25-46cd-a095-5c0bc57cc1dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:34.786720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb3f44-3e25-46cd-a095-5c0bc57cc1dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:34.789066 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb3f44-3e25-46cd-a095-5c0bc57cc1dd service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:34.802752 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4357/8698] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:54:34.894473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae91eb-b31a-4c40-b1ec-69678df51923 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:34.907550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae91eb-b31a-4c40-b1ec-69678df51923 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:34.911318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:34.911973 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:34.912531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:34.912833 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:34.981401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:34.982853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:34.992439 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4342/8699] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:54:36.478920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:36.479513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:36.479513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:36.498809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:54:36.500037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:36.507525 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4358/8700] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:54:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:54:37.267564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:37.269613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:37.300450 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:37.357020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2ee1-b966-4f8a-9657-c222d99ebb1c service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:37.362639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:37.363618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:37.363918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:37.372821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:37.372821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:37.382925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:37.384797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:37.402621 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4343/8701] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:54:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:54:39.220514 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:39.222233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:39.300189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5792227-8f80-486b-a310-ada7a236f6f9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:39.304027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6698a6-67ba-4610-959b-614a3ac0bbda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:39.304663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6698a6-67ba-4610-959b-614a3ac0bbda service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:39.304971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6698a6-67ba-4610-959b-614a3ac0bbda service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:39.305240 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6698a6-67ba-4610-959b-614a3ac0bbda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:39.307025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df6698a6-67ba-4610-959b-614a3ac0bbda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:39.319864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6698a6-67ba-4610-959b-614a3ac0bbda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:39.321374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6698a6-67ba-4610-959b-614a3ac0bbda service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:39.344110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4359/8702] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:54:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:54:47.394956 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=22 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:49.327155 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:55.102234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:54:55.104728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:55.212606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffaee2-ca37-49df-a1a5-008784ff975f service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:54:55.218256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:54:55.218871 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:54:55.219145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:54:55.219416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:54:55.221191 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:54:55.237787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:54:55.239811 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:54:55.255376 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4344/8703] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:54:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:55:05.247610 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=41 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:11.179248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0845-da9c-42e7-be97-b9cf5884e361 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:55:11.180045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0845-da9c-42e7-be97-b9cf5884e361 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:55:11.180045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0845-da9c-42e7-be97-b9cf5884e361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:55:11.205342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-da8a0845-da9c-42e7-be97-b9cf5884e361 None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:55:11.207405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-da8a0845-da9c-42e7-be97-b9cf5884e361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:55:11.216059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4360/8704] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:55:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:55:21.198393 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:52.350549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:55:52.366109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183ae79-06b7-48a5-82eb-30f80d9a80f0 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:55:52.372131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce54db9-95a7-4ca5-9adc-6c144045349c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:55:52.372788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54db9-95a7-4ca5-9adc-6c144045349c service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:55:52.373068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54db9-95a7-4ca5-9adc-6c144045349c service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:55:52.373335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54db9-95a7-4ca5-9adc-6c144045349c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:55:52.375183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cce54db9-95a7-4ca5-9adc-6c144045349c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:55:52.408270 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce54db9-95a7-4ca5-9adc-6c144045349c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:55:52.409917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce54db9-95a7-4ca5-9adc-6c144045349c service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:55:52.423657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4345/8705] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:55:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:56:01.896831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:56:01.897375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:56:01.897375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:56:01.918250 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:56:01.919451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:56:01.927318 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4361/8706] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:56:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:56:02.416918 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=11 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:02.602968 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8ad95-7bc1-4838-8744-5209c2f32412 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:56:02.603248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8ad95-7bc1-4838-8744-5209c2f32412 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:56:02.603822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8ad95-7bc1-4838-8744-5209c2f32412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:56:02.655301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bcd8ad95-7bc1-4838-8744-5209c2f32412 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:56:02.657036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bcd8ad95-7bc1-4838-8744-5209c2f32412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:56:02.666234 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4346/8707] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:56:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:56:02.678470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:56:02.679975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:56:02.698324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6603f9-fd8f-45e0-be17-0cdd83eb02a9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:56:02.704026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0fb8a-7e0e-4149-bd38-29b20b2303b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:56:02.704639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0fb8a-7e0e-4149-bd38-29b20b2303b2 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:56:02.704951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0fb8a-7e0e-4149-bd38-29b20b2303b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:56:02.705223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0fb8a-7e0e-4149-bd38-29b20b2303b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:56:02.713759 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0fb8a-7e0e-4149-bd38-29b20b2303b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:56:02.715388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0fb8a-7e0e-4149-bd38-29b20b2303b2 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:56:02.725634 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4362/8708] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:56:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:56:06.620850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8ad95-7bc1-4838-8744-5209c2f32412 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:56:06.634487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8ad95-7bc1-4838-8744-5209c2f32412 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:56:06.640043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:56:06.640672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:56:06.641055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:56:06.641329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:56:06.643600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:56:06.659520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:56:06.661189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:56:06.675417 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4347/8709] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:56:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:56:12.721491 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:16.670181 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=19 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:02.701065 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af2ca-516a-4aa1-b9ab-7da31ff09e3e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:02.701527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af2ca-516a-4aa1-b9ab-7da31ff09e3e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:02.701527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af2ca-516a-4aa1-b9ab-7da31ff09e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:02.722405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d07af2ca-516a-4aa1-b9ab-7da31ff09e3e None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:57:02.724064 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d07af2ca-516a-4aa1-b9ab-7da31ff09e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:02.732134 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4363/8710] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:57:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:57:02.773635 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:57:02.791591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b571a-8d57-498f-a4d2-32be09166a4e service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:57:02.797600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:57:02.798303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:02.798630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:02.798919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:02.801543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:02.838437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:57:02.839781 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:57:02.853557 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4348/8711] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:57:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:57:03.096680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b0b1-2295-4af2-b777-42b027c9b60e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:03.096900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b0b1-2295-4af2-b777-42b027c9b60e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:03.097222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b0b1-2295-4af2-b777-42b027c9b60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:03.162435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b981b0b1-2295-4af2-b777-42b027c9b60e None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:57:03.163647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b981b0b1-2295-4af2-b777-42b027c9b60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:03.171026 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4364/8712] 10.222.0.46 () {58 vars in 1062 bytes} [Sun Aug 21 01:57:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:57:03.180425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:57:03.194525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bfa4-c39e-4a4b-a111-ba56ab75e2f9 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:57:03.199327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be1fb9-1b1c-4232-a509-0dc6644abb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:57:03.199934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be1fb9-1b1c-4232-a509-0dc6644abb29 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:03.200214 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be1fb9-1b1c-4232-a509-0dc6644abb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:03.200485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be1fb9-1b1c-4232-a509-0dc6644abb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:03.202595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-99be1fb9-1b1c-4232-a509-0dc6644abb29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:03.216733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be1fb9-1b1c-4232-a509-0dc6644abb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:57:03.218198 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be1fb9-1b1c-4232-a509-0dc6644abb29 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:57:03.229463 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4349/8713] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:57:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:57:03.715349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6f14b-552a-4b07-9d01-1a09950380ab None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:03.715873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6f14b-552a-4b07-9d01-1a09950380ab None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:03.716028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6f14b-552a-4b07-9d01-1a09950380ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:03.729362 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9860-9458-48a6-abbd-bd8310060697 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:03.729651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9860-9458-48a6-abbd-bd8310060697 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:03.729931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9860-9458-48a6-abbd-bd8310060697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:03.736823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ace6f14b-552a-4b07-9d01-1a09950380ab None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:57:03.738171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ace6f14b-552a-4b07-9d01-1a09950380ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:03.747651 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4365/8714] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 01:57:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:57:03.750855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0d4c9860-9458-48a6-abbd-bd8310060697 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:57:03.752043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0d4c9860-9458-48a6-abbd-bd8310060697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:03.759370 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6f14b-552a-4b07-9d01-1a09950380ab None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:57:03.759721 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4350/8715] 10.222.0.46 () {58 vars in 1062 bytes} [Sun Aug 21 01:57:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:57:03.765606 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c9860-9458-48a6-abbd-bd8310060697 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:57:03.775139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6f14b-552a-4b07-9d01-1a09950380ab None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:57:03.782167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe21f6-46da-41dc-824d-5892b01c373b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:57:03.783144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe21f6-46da-41dc-824d-5892b01c373b service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:03.783426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe21f6-46da-41dc-824d-5892b01c373b service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:03.783701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe21f6-46da-41dc-824d-5892b01c373b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:03.784090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c9860-9458-48a6-abbd-bd8310060697 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:57:03.788643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f255c57-afb0-4e43-a99c-1e397196fb1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:57:03.789311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255c57-afb0-4e43-a99c-1e397196fb1b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:03.789585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255c57-afb0-4e43-a99c-1e397196fb1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:03.790046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255c57-afb0-4e43-a99c-1e397196fb1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:03.791822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2f255c57-afb0-4e43-a99c-1e397196fb1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:03.793831 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe21f6-46da-41dc-824d-5892b01c373b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:57:03.795510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe21f6-46da-41dc-824d-5892b01c373b service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:57:03.808683 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4366/8716] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:57:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:57:03.810784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f255c57-afb0-4e43-a99c-1e397196fb1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:57:03.812242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f255c57-afb0-4e43-a99c-1e397196fb1b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:57:03.827366 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4351/8717] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:57:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:57:13.801663 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=30 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:13.819354 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=29 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:25.435255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9daa6-cd7f-45e2-8163-e5e5a5ed2cce None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:25.435711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9daa6-cd7f-45e2-8163-e5e5a5ed2cce None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:25.435818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9daa6-cd7f-45e2-8163-e5e5a5ed2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:25.489129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3df9daa6-cd7f-45e2-8163-e5e5a5ed2cce None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:57:25.490411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3df9daa6-cd7f-45e2-8163-e5e5a5ed2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:25.558975 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4367/8718] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 01:57:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:57:25.610193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275ffc-eb31-467b-83b5-e8f4e7034284 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:25.610688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275ffc-eb31-467b-83b5-e8f4e7034284 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:25.610801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275ffc-eb31-467b-83b5-e8f4e7034284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:25.650820 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-70275ffc-eb31-467b-83b5-e8f4e7034284 None None] MFA Rules not processed for user `1eadc3e155df4f5a9f40ae75ee27733f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:57:25.652122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-70275ffc-eb31-467b-83b5-e8f4e7034284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:25.716418 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4352/8719] 10.222.0.46 () {58 vars in 1040 bytes} [Sun Aug 21 01:57:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:57:25.723129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9daa6-cd7f-45e2-8163-e5e5a5ed2cce None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:57:25.735494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9daa6-cd7f-45e2-8163-e5e5a5ed2cce None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:57:25.740926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:57:25.743135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:25.743422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:25.743694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:25.752620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:57:25.754475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:57:25.763357 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4368/8720] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:57:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:57:27.050637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9af61-115f-4df8-9050-8107992e7d53 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:57:27.051239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9af61-115f-4df8-9050-8107992e7d53 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:57:27.051239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9af61-115f-4df8-9050-8107992e7d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:57:27.072411 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5ee9af61-115f-4df8-9050-8107992e7d53 None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:57:27.073643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5ee9af61-115f-4df8-9050-8107992e7d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:57:27.081674 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4353/8721] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:57:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:57:35.759898 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=46 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:37.066347 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=38 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:11.814055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:58:11.835000 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b618ad4-d63b-487e-aa54-e37aaa3abc54 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:58:11.841214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:58:11.841839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:58:11.842116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:58:11.842419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:58:11.844217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:58:11.860531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:58:11.862165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:58:11.877059 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4369/8722] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:58:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:58:19.866293 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30f85-0ff2-4a70-85ca-b3aac2435ace None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:58:19.866835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30f85-0ff2-4a70-85ca-b3aac2435ace None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:58:19.866835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30f85-0ff2-4a70-85ca-b3aac2435ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:58:19.886280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5cc30f85-0ff2-4a70-85ca-b3aac2435ace None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:58:19.887471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5cc30f85-0ff2-4a70-85ca-b3aac2435ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:58:19.895561 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4354/8723] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 01:58:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:58:19.909458 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:58:19.922038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a5234-21ef-424b-9456-686ba433d27a service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:58:19.928287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:58:19.929189 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:58:19.929472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:58:19.929749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:58:19.938540 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:58:19.940196 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:58:19.949350 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4370/8724] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 01:58:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:58:29.880797 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:29.945860 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=12 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:37.754070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fad6a5-1219-4243-8853-bbb32db74b44 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:58:37.754698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fad6a5-1219-4243-8853-bbb32db74b44 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:58:37.754698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fad6a5-1219-4243-8853-bbb32db74b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:58:37.776279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-91fad6a5-1219-4243-8853-bbb32db74b44 None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:58:37.777532 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-91fad6a5-1219-4243-8853-bbb32db74b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:58:37.785729 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4355/8725] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 01:58:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:58:47.770640 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:59:41.029229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:59:41.039539 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0394b97-359c-43e7-be09-ee28751aa748 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:59:41.043428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:59:41.044025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:59:41.044307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:59:41.044578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:59:41.054716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:59:41.056143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:59:41.068367 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4371/8726] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 01:59:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:59:51.060692 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:00:56.021008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fad6a5-1219-4243-8853-bbb32db74b44 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:00:56.054912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fad6a5-1219-4243-8853-bbb32db74b44 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:00:56.062005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40092fe-a193-4350-b63a-dad25f8ccace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:00:56.062630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40092fe-a193-4350-b63a-dad25f8ccace service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:00:56.062909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40092fe-a193-4350-b63a-dad25f8ccace service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:00:56.063200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40092fe-a193-4350-b63a-dad25f8ccace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:00:56.071473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40092fe-a193-4350-b63a-dad25f8ccace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:00:56.073090 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40092fe-a193-4350-b63a-dad25f8ccace service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:00:56.082458 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4356/8727] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:00:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:00:56.374383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:00:56.401114 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7695223-a2c8-487b-bb48-50673c1801f6 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:00:56.406410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:00:56.407023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:00:56.407299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:00:56.407565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:00:56.419220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:00:56.420802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:00:56.433999 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4372/8728] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:00:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:01:04.299195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f3d87-beec-4dab-92e6-3927b9964eda None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:01:04.299762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f3d87-beec-4dab-92e6-3927b9964eda None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:01:04.299762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f3d87-beec-4dab-92e6-3927b9964eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:01:04.323523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-444f3d87-beec-4dab-92e6-3927b9964eda None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:01:04.324752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-444f3d87-beec-4dab-92e6-3927b9964eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:01:04.334346 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4357/8729] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:01:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:01:06.426405 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:06.462221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:01:06.477729 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efbb7f-eb22-4f97-bb8d-df3cb82cd436 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:01:06.483830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:01:06.484708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:01:06.485451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:01:06.485724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:01:06.495211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:01:06.496808 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:01:06.508186 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4373/8730] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:01:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:01:14.318173 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=13 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:14.658344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f3d87-beec-4dab-92e6-3927b9964eda None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:01:14.674363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f3d87-beec-4dab-92e6-3927b9964eda None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:01:14.680279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:01:14.681004 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:01:14.681350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:01:14.681682 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:01:14.693793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:01:14.695407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:01:14.708890 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4358/8731] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:01:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:01:16.503958 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:23.142981 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:01:23.144936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:01:23.167156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014341-e35b-40fe-a838-c4e836b4374a service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:01:23.173772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc29d2d-aaaa-435b-b63b-f03d6bc09b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:01:23.174890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc29d2d-aaaa-435b-b63b-f03d6bc09b57 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:01:23.174890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc29d2d-aaaa-435b-b63b-f03d6bc09b57 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:01:23.175141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc29d2d-aaaa-435b-b63b-f03d6bc09b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:01:23.188216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc29d2d-aaaa-435b-b63b-f03d6bc09b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:01:23.190677 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc29d2d-aaaa-435b-b63b-f03d6bc09b57 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:01:23.204851 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4374/8732] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:01:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:01:24.703566 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:25.779607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:01:25.800206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bec71-6ab3-4776-856b-5e1028d79e89 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:01:25.804688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:01:25.805319 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:01:25.805600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:01:25.805874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:01:25.815926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:01:25.817405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:01:25.827494 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4359/8733] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:01:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:01:33.199613 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:35.822903 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:02:56.279984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99406f9-71f8-42a1-bf3c-d568cec91e47 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:02:56.280625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99406f9-71f8-42a1-bf3c-d568cec91e47 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:02:56.280625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99406f9-71f8-42a1-bf3c-d568cec91e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:02:56.310606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b99406f9-71f8-42a1-bf3c-d568cec91e47 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:02:56.312336 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b99406f9-71f8-42a1-bf3c-d568cec91e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:02:56.323541 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4375/8734] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Aug 21 02:02:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:02:56.337607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:02:56.353537 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7af84f-3cc6-45a1-9e63-99f64ea2dc2a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:02:56.360146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a6633-fe67-4d58-a0de-92db9432f233 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:02:56.360898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a6633-fe67-4d58-a0de-92db9432f233 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:02:56.361202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a6633-fe67-4d58-a0de-92db9432f233 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:02:56.361464 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a6633-fe67-4d58-a0de-92db9432f233 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:02:56.370424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a6633-fe67-4d58-a0de-92db9432f233 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:02:56.372012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a6633-fe67-4d58-a0de-92db9432f233 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:02:56.382093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4360/8735] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:02:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:06.303104 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:06.378029 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:09.997390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652ba99-a8ed-4ab3-9bab-f4647883b629 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:09.997958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652ba99-a8ed-4ab3-9bab-f4647883b629 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:09.997958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652ba99-a8ed-4ab3-9bab-f4647883b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:10.017459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c652ba99-a8ed-4ab3-9bab-f4647883b629 None None] MFA Rules not processed for user `d45ded05250841d08b1bcc7b637515c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:03:10.018673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c652ba99-a8ed-4ab3-9bab-f4647883b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:03:10.026643 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4376/8736] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:03:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:03:10.067055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0fed-2b43-43da-a99a-2c25471ac7b5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:10.067573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0fed-2b43-43da-a99a-2c25471ac7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:10.067573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0fed-2b43-43da-a99a-2c25471ac7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:10.113094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cf8d0fed-2b43-43da-a99a-2c25471ac7b5 None None] MFA Rules not processed for user `1c9c0901260e44a789d750c2032bfbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:03:10.114353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf8d0fed-2b43-43da-a99a-2c25471ac7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:03:10.121745 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4361/8737] 10.222.0.46 () {58 vars in 1061 bytes} [Sun Aug 21 02:03:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:03:10.128055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652ba99-a8ed-4ab3-9bab-f4647883b629 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:10.140943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652ba99-a8ed-4ab3-9bab-f4647883b629 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:10.146165 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08056d-8720-4f2c-87e8-9dbc077bbe0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:10.147315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08056d-8720-4f2c-87e8-9dbc077bbe0b service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:10.147596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08056d-8720-4f2c-87e8-9dbc077bbe0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:10.147869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08056d-8720-4f2c-87e8-9dbc077bbe0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:10.162549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08056d-8720-4f2c-87e8-9dbc077bbe0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:10.164033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08056d-8720-4f2c-87e8-9dbc077bbe0b service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:10.177856 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4377/8738] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:10.483453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0fed-2b43-43da-a99a-2c25471ac7b5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:10.496424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0fed-2b43-43da-a99a-2c25471ac7b5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:10.500612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:10.501232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:10.501505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:10.501774 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:10.512391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:10.513886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:10.525526 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4362/8739] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:11.016162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425007-45a3-4839-8a19-5268c965bd30 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:11.016641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425007-45a3-4839-8a19-5268c965bd30 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:11.016951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425007-45a3-4839-8a19-5268c965bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:11.031880 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:11.042661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1b425007-45a3-4839-8a19-5268c965bd30 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:03:11.043420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdb764-39ce-4929-872f-f14105b9ad8d service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:11.043893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1b425007-45a3-4839-8a19-5268c965bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:03:11.047400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cee659-78e7-4735-b72a-677177cc2f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:11.048006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cee659-78e7-4735-b72a-677177cc2f76 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:11.048301 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cee659-78e7-4735-b72a-677177cc2f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:11.048569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cee659-78e7-4735-b72a-677177cc2f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:11.053871 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4378/8740] 10.222.0.46 () {58 vars in 1058 bytes} [Sun Aug 21 02:03:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:03:11.060207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425007-45a3-4839-8a19-5268c965bd30 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:11.062902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cee659-78e7-4735-b72a-677177cc2f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:11.064323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cee659-78e7-4735-b72a-677177cc2f76 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:11.070693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425007-45a3-4839-8a19-5268c965bd30 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:11.076333 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:11.076954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:11.077227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:11.077492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:11.078662 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4363/8741] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:11.087393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:11.089007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:11.098936 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4379/8742] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:03:11.616031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d35560-1efe-46ae-ad84-453efa366fc2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:11.616303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d35560-1efe-46ae-ad84-453efa366fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:11.616589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d35560-1efe-46ae-ad84-453efa366fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:11.637852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-91d35560-1efe-46ae-ad84-453efa366fc2 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:03:11.639065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-91d35560-1efe-46ae-ad84-453efa366fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:03:11.648688 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4364/8743] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Aug 21 02:03:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:03:11.698972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:11.712903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d9839-c1f9-42f9-9b72-1e53e3fb9f6c service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:11.719470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:11.720182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:11.720455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:11.720725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:11.730147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:11.731763 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:11.741889 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4380/8744] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:12.994796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d35560-1efe-46ae-ad84-453efa366fc2 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:13.005679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d35560-1efe-46ae-ad84-453efa366fc2 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:13.010162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:13.011449 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:13.011822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:13.012182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:13.014935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:03:13.032482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:13.034633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:13.052589 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4365/8745] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:13.672465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:13.710239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eabb0f-924a-44d3-8401-15d1a7c94fe6 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:13.715956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:13.717217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:13.717499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:13.717938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:13.744556 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:13.746325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:13.760942 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4381/8746] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:23.040724 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=30 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:23.753197 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=30 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:32.131405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:03:32.149427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c3be2-d6ed-4923-9201-aae479f98c64 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:03:32.155607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed457-8051-4d38-8fd3-1ed9b0ae5f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:03:32.156354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed457-8051-4d38-8fd3-1ed9b0ae5f05 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:03:32.156639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed457-8051-4d38-8fd3-1ed9b0ae5f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:03:32.156942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed457-8051-4d38-8fd3-1ed9b0ae5f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:03:32.159108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d15ed457-8051-4d38-8fd3-1ed9b0ae5f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:03:32.175461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed457-8051-4d38-8fd3-1ed9b0ae5f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:03:32.177146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed457-8051-4d38-8fd3-1ed9b0ae5f05 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:03:32.191027 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4366/8747] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:03:42.183901 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:04:45.073390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:04:45.134300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea583fc-36c1-47f5-acaf-226e0359f2db service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:04:45.138491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:04:45.139101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:04:45.139346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:04:45.139644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:04:45.141631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:04:45.164900 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:04:45.166560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:04:45.177781 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4382/8748] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:04:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:04:55.171744 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=32 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:12.126480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d8e39-4d67-4c4e-8ece-e4f1cd713feb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:12.127529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d8e39-4d67-4c4e-8ece-e4f1cd713feb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:12.128530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d8e39-4d67-4c4e-8ece-e4f1cd713feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:12.153690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bf8d8e39-4d67-4c4e-8ece-e4f1cd713feb None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:12.154954 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bf8d8e39-4d67-4c4e-8ece-e4f1cd713feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:12.185592 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4367/8749] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Aug 21 02:05:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:12.199479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:12.216917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115821f-167e-4938-a8eb-027222751e25 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:12.220822 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad6abe-bec6-4c7f-a946-16fd5b438534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:12.221463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6abe-bec6-4c7f-a946-16fd5b438534 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:12.221736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6abe-bec6-4c7f-a946-16fd5b438534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:12.222006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6abe-bec6-4c7f-a946-16fd5b438534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:12.230276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad6abe-bec6-4c7f-a946-16fd5b438534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:12.231892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad6abe-bec6-4c7f-a946-16fd5b438534 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:12.241362 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4383/8750] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:12.262317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd06d-5615-4017-b8f5-11e11cbdba72 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:12.262547 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd06d-5615-4017-b8f5-11e11cbdba72 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:12.262921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd06d-5615-4017-b8f5-11e11cbdba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:12.305709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-a90cd06d-5615-4017-b8f5-11e11cbdba72 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:12.306938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a90cd06d-5615-4017-b8f5-11e11cbdba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:12.398857 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4368/8751] 10.222.0.46 () {58 vars in 1059 bytes} [Sun Aug 21 02:05:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:12.405426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cd404-cdc5-4ac0-ae08-847c2f5e0421 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:12.405841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cd404-cdc5-4ac0-ae08-847c2f5e0421 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:12.406211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cd404-cdc5-4ac0-ae08-847c2f5e0421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:12.427129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-039cd404-cdc5-4ac0-ae08-847c2f5e0421 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:12.428460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-039cd404-cdc5-4ac0-ae08-847c2f5e0421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:12.439290 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4384/8752] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:05:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:12.450710 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd06d-5615-4017-b8f5-11e11cbdba72 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:12.460663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd06d-5615-4017-b8f5-11e11cbdba72 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:12.465162 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6b4f8-3a5c-4fbc-8169-384bcad99239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:12.465891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b4f8-3a5c-4fbc-8169-384bcad99239 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:12.466171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b4f8-3a5c-4fbc-8169-384bcad99239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:12.466438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b4f8-3a5c-4fbc-8169-384bcad99239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:12.478095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6b4f8-3a5c-4fbc-8169-384bcad99239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:12.479531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6b4f8-3a5c-4fbc-8169-384bcad99239 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:12.491579 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4369/8753] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:13.672216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7a03-09ff-4fe7-a56b-b4ac94180595 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:13.672841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7a03-09ff-4fe7-a56b-b4ac94180595 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:13.672841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7a03-09ff-4fe7-a56b-b4ac94180595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:13.693208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-01ed7a03-09ff-4fe7-a56b-b4ac94180595 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:13.694415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-01ed7a03-09ff-4fe7-a56b-b4ac94180595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:13.704151 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4385/8754] 10.222.0.46 () {58 vars in 1059 bytes} [Sun Aug 21 02:05:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:13.710121 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701a066-eb5e-408b-9fd5-365daf8a823c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:13.710672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701a066-eb5e-408b-9fd5-365daf8a823c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:13.710672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701a066-eb5e-408b-9fd5-365daf8a823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:13.730874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2701a066-eb5e-408b-9fd5-365daf8a823c None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:13.731933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2701a066-eb5e-408b-9fd5-365daf8a823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:13.741437 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4370/8755] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:05:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:13.755217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed7a03-09ff-4fe7-a56b-b4ac94180595 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:13.766342 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed7a03-09ff-4fe7-a56b-b4ac94180595 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:13.770139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:13.770752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:13.771022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:13.771430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:13.784558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:13.786039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:13.797300 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4386/8756] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:14.393320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aec57-bacc-4b83-960b-88f0b8e8bfa2 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:14.393604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aec57-bacc-4b83-960b-88f0b8e8bfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:14.393878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aec57-bacc-4b83-960b-88f0b8e8bfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:14.415689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-720aec57-bacc-4b83-960b-88f0b8e8bfa2 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:14.416964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-720aec57-bacc-4b83-960b-88f0b8e8bfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:14.430493 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4371/8757] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:14.446640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:14.457830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfecfb8-3f46-4c3c-a96a-77069cd55d3a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:14.467387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:14.468010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:14.468329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:14.468605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:14.478109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:14.479727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:14.490980 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4387/8758] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:24.409843 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=68 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:24.486295 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=27 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:25.885269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96481b2-a01e-4f15-994f-3de31f8beccd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:25.885799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96481b2-a01e-4f15-994f-3de31f8beccd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:25.885799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96481b2-a01e-4f15-994f-3de31f8beccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:25.906517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e96481b2-a01e-4f15-994f-3de31f8beccd None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:25.908120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e96481b2-a01e-4f15-994f-3de31f8beccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:25.918342 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4372/8759] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:05:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:25.932125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:25.944140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41851ea-4d00-4a99-8577-7c06794ef18e service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:25.950299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:25.951631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:25.952071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:25.952412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:25.961787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:25.963448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:25.977305 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4388/8760] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:27.085607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffabc5-6ade-4c27-a119-97a6b1b37cdf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:27.086483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffabc5-6ade-4c27-a119-97a6b1b37cdf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:27.086483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffabc5-6ade-4c27-a119-97a6b1b37cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:27.111962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-87ffabc5-6ade-4c27-a119-97a6b1b37cdf None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:27.113240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-87ffabc5-6ade-4c27-a119-97a6b1b37cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:27.124413 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4373/8761] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Aug 21 02:05:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:27.141987 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:27.151884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930a74-0779-421e-a1cd-1c919b270278 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:27.156048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafb7ea-60fc-4407-be93-fe40c73426b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:27.156660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb7ea-60fc-4407-be93-fe40c73426b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:27.156970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb7ea-60fc-4407-be93-fe40c73426b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:27.157239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb7ea-60fc-4407-be93-fe40c73426b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:27.164915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafb7ea-60fc-4407-be93-fe40c73426b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:27.166367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafb7ea-60fc-4407-be93-fe40c73426b6 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:27.174652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4389/8762] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:37.104992 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:37.170810 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=12 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:38.048978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffabc5-6ade-4c27-a119-97a6b1b37cdf None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:38.057966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffabc5-6ade-4c27-a119-97a6b1b37cdf None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:38.062361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:38.063051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:38.063327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:38.063595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:38.065531 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:38.162752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:38.164222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:38.184516 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4374/8763] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:41.509467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b940-dbc3-4d32-957c-a9a18f683102 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:41.509985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b940-dbc3-4d32-957c-a9a18f683102 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:41.509985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b940-dbc3-4d32-957c-a9a18f683102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:41.531100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7141b940-dbc3-4d32-957c-a9a18f683102 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:41.532430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7141b940-dbc3-4d32-957c-a9a18f683102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:41.611200 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4390/8764] 10.222.0.46 () {58 vars in 1058 bytes} [Sun Aug 21 02:05:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:41.617401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:41.629400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b24474-8a65-4734-8ab4-c6d9d04c596f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:41.634940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:41.635568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:41.635836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:41.636109 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:41.637957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:41.653383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:41.654910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:41.668650 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4375/8765] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:44.512988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141b940-dbc3-4d32-957c-a9a18f683102 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:44.524015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141b940-dbc3-4d32-957c-a9a18f683102 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:44.530670 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:44.531437 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:44.531720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:44.531994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:44.534809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:44.550834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:44.552469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:44.583633 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4391/8766] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:05:44.590070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:44.591786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:44.607881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d87755-2370-4dc9-8680-4f5cf5b221c8 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:44.612869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:44.613667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:44.614058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:44.614428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] PATH_INFO: `/v3/users/d45ded05250841d08b1bcc7b637515c3` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:44.629354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45ded05250841d08b1bcc7b637515c3)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:44.631296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:44.682406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45ded05250841d08b1bcc7b637515c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:44.691011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45ded05250841d08b1bcc7b637515c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:44.704469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45ded05250841d08b1bcc7b637515c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:44.705203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45ded05250841d08b1bcc7b637515c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:44.712428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45ded05250841d08b1bcc7b637515c3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:44.718776 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4376/8767] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:05:44 2022] DELETE /identity/v3/users/d45ded05250841d08b1bcc7b637515c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:05:44.912258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:44.926153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafda47-13bc-4cbc-ae11-822952a10e77 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:44.986564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:44.987205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:44.987484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:44.987787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] PATH_INFO: `/v3/projects/4c38de005ef44a40a8eae4bee4f27a33` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:44.998661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c38de005ef44a40a8eae4bee4f27a33)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:45.000727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:45.049023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c38de005ef44a40a8eae4bee4f27a33', 'request_id': 'req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.059527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c38de005ef44a40a8eae4bee4f27a33', 'request_id': 'req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.065761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c38de005ef44a40a8eae4bee4f27a33', 'request_id': 'req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.077334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] The token cache is being invalidate because project 4c38de005ef44a40a8eae4bee4f27a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:05:45.077613 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.078303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.079803 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4392/8768] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:05:44 2022] DELETE /identity/v3/projects/4c38de005ef44a40a8eae4bee4f27a33 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:05:45.084125 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:45.085650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:45.099569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f622e9-f917-4777-a289-87b1cde09f7d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:45.109598 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:45.163999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:45.164640 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:45.164951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:45.165230 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] PATH_INFO: `/v3/users/1fc59ffdf5b242b98bb849199cd60872` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:45.181836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc59ffdf5b242b98bb849199cd60872)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:45.183787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:45.231232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc59ffdf5b242b98bb849199cd60872'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.240012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc59ffdf5b242b98bb849199cd60872'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.251886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc59ffdf5b242b98bb849199cd60872'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.252506 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc59ffdf5b242b98bb849199cd60872'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.259657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-12127227-6fa0-47c1-aa91-c79e166bf998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc59ffdf5b242b98bb849199cd60872'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.266470 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4377/8769] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:05:45 2022] DELETE /identity/v3/users/1fc59ffdf5b242b98bb849199cd60872 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:05:45.458744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:45.460381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:45.474458 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:45.478970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2a50-a0c5-4aaa-a82b-1bf02c58d563 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:45.542247 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:45.542941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:45.543148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:45.543418 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] PATH_INFO: `/v3/projects/128dc71896e9497eb2a3b27fff7480af` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:45.555259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] RBAC: Authorizing `identity:delete_project(project_id=128dc71896e9497eb2a3b27fff7480af)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:45.559038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:45.619998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128dc71896e9497eb2a3b27fff7480af', 'request_id': 'req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.630134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128dc71896e9497eb2a3b27fff7480af', 'request_id': 'req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.635792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128dc71896e9497eb2a3b27fff7480af', 'request_id': 'req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.648265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] The token cache is being invalidate because project 128dc71896e9497eb2a3b27fff7480af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:05:45.648552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.649315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a5f5ae28-8393-4400-8a45-0cfdfcdf890a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:05:45.650952 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4393/8770] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:05:45 2022] DELETE /identity/v3/projects/128dc71896e9497eb2a3b27fff7480af => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:05:55.262089 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:55.380018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f155cb-84d7-4e30-bb11-e9a1fa80527d None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.380263 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f155cb-84d7-4e30-bb11-e9a1fa80527d None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.380489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f155cb-84d7-4e30-bb11-e9a1fa80527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.439163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-51f155cb-84d7-4e30-bb11-e9a1fa80527d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:55.440697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-51f155cb-84d7-4e30-bb11-e9a1fa80527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:55.512370 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4378/8771] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:55.522174 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba78a1-07f3-443c-9d31-4c317b020e0f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.522711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba78a1-07f3-443c-9d31-4c317b020e0f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.522711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba78a1-07f3-443c-9d31-4c317b020e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.543302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1bba78a1-07f3-443c-9d31-4c317b020e0f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:55.544508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1bba78a1-07f3-443c-9d31-4c317b020e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:55.553200 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4394/8772] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:05:55.560692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f155cb-84d7-4e30-bb11-e9a1fa80527d None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:55.572885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f155cb-84d7-4e30-bb11-e9a1fa80527d None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:55.578266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:55.578862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.579136 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.579403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.580070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:05:55.580340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:55.582173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:55.593728 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4379/8773] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:05:55.605732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba78a1-07f3-443c-9d31-4c317b020e0f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:55.618106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba78a1-07f3-443c-9d31-4c317b020e0f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:55.623531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:55.624139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.624412 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.624678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.625330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:55.627244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:55.677744 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4395/8774] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:05:55 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:05:55.683690 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:55.694908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc8f76-883e-4d49-8484-c8736fceec9b admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:55.757431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:55.758036 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.758313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.758581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.759209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:55.761160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:55.792640 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4380/8775] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:05:55 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:05:55.799298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:55.810283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2485c2-63cc-41b4-bae6-e6a9c52e860d admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:55.815353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:55.815958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.816233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.816512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.817183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:55.818791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:55.828902 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4396/8776] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:05:55.833101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:55.843512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444822a5-1e6f-4175-87d3-fd44e17b2f6d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:55.848705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d272f95-d229-47f7-827d-84f76a656011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:55.849334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272f95-d229-47f7-827d-84f76a656011 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.849612 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272f95-d229-47f7-827d-84f76a656011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.849917 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272f95-d229-47f7-827d-84f76a656011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.850565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d272f95-d229-47f7-827d-84f76a656011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:55.852168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d272f95-d229-47f7-827d-84f76a656011 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:55.863464 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4381/8777] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:05:55.870214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:55.886943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5d538-42b7-47a7-b931-e1b6c62167da admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:55.895509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:55.896162 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.896439 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.896708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] PATH_INFO: `/v3/projects/cd999ed44fc04ba3a8aa7d78f1ea52e5/users/7b7aba122ecd4007b6eccb20cca5801d/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.912125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd999ed44fc04ba3a8aa7d78f1ea52e5, user_id=7b7aba122ecd4007b6eccb20cca5801d, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:55.914773 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:55.930629 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4397/8778] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:05:55 2022] PUT /identity/v3/projects/cd999ed44fc04ba3a8aa7d78f1ea52e5/users/7b7aba122ecd4007b6eccb20cca5801d/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:05:55.948093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c6fd-e3ab-4656-b295-d7e91bdf48f6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:55.948333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c6fd-e3ab-4656-b295-d7e91bdf48f6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:55.948639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c6fd-e3ab-4656-b295-d7e91bdf48f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:55.979215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-dc23c6fd-e3ab-4656-b295-d7e91bdf48f6 None None] MFA Rules not processed for user `7b7aba122ecd4007b6eccb20cca5801d`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:55.980507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-dc23c6fd-e3ab-4656-b295-d7e91bdf48f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:56.017515 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:56.065381 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4382/8779] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:05:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:56.072848 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:56.092629 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:56.145648 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350ee7b-a7a0-4be6-b5b0-0f3891ab066e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:56.151122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:56.151743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.152022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.152295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.152957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:56.154885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:56.190580 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4398/8780] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:05:56 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:05:56.192962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c6fd-e3ab-4656-b295-d7e91bdf48f6 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:56.204443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c6fd-e3ab-4656-b295-d7e91bdf48f6 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:56.262068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:56.262683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.263254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.263254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.263813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:56.265859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:56.293019 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4383/8781] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:05:56 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:05:56.294228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:56.306493 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0f2ce-6975-4b3c-80a2-7f4dc1e3d1f1 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:56.311532 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:56.312168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.312447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.312716 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.313391 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:56.314989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:56.326712 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4399/8782] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:05:56.330999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:56.341997 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc682-122a-4c45-8bb7-64ac37c9e0a5 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:56.346671 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:56.347428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.347703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.347976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] PATH_INFO: `/v3/projects/b206fc51dc894b059cbf38b4e977cccf/users/30345084b33c4b40bb0af7e7f117f777/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.363180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b206fc51dc894b059cbf38b4e977cccf, user_id=30345084b33c4b40bb0af7e7f117f777, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:56.365923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:56.380676 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4384/8783] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:05:56 2022] PUT /identity/v3/projects/b206fc51dc894b059cbf38b4e977cccf/users/30345084b33c4b40bb0af7e7f117f777/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:05:56.384787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:56.395784 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db91dfc-8303-495d-a69b-ce1ce07ab30e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:56.454041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08438a-4bd9-4d0b-a0a1-63d2a164b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:56.454569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08438a-4bd9-4d0b-a0a1-63d2a164b326 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.454844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08438a-4bd9-4d0b-a0a1-63d2a164b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.455116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08438a-4bd9-4d0b-a0a1-63d2a164b326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.455758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08438a-4bd9-4d0b-a0a1-63d2a164b326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:56.457755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08438a-4bd9-4d0b-a0a1-63d2a164b326 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:56.468030 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4400/8784] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:05:56.472807 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:56.484495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c3c5-7f8b-4df3-8a9a-23fd7da6f862 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:56.490042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b083d3-d583-4750-99a0-cc6fee0afc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:56.490722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b083d3-d583-4750-99a0-cc6fee0afc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.490998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b083d3-d583-4750-99a0-cc6fee0afc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.491245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b083d3-d583-4750-99a0-cc6fee0afc21 admin admin] PATH_INFO: `/v3/projects/b206fc51dc894b059cbf38b4e977cccf/users/30345084b33c4b40bb0af7e7f117f777/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.493335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b083d3-d583-4750-99a0-cc6fee0afc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b206fc51dc894b059cbf38b4e977cccf, user_id=30345084b33c4b40bb0af7e7f117f777, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:56.496002 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b083d3-d583-4750-99a0-cc6fee0afc21 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:56.507692 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4385/8785] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:05:56 2022] PUT /identity/v3/projects/b206fc51dc894b059cbf38b4e977cccf/users/30345084b33c4b40bb0af7e7f117f777/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:05:56.518212 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.518508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.518837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.548580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] MFA Rules not processed for user `30345084b33c4b40bb0af7e7f117f777`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:56.549826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:56.631276 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4401/8786] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:56.643994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbdf38-2ee5-491e-a2ea-4618f6a8b9cf None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.644344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbdf38-2ee5-491e-a2ea-4618f6a8b9cf None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.644673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbdf38-2ee5-491e-a2ea-4618f6a8b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.666029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2dcbdf38-2ee5-491e-a2ea-4618f6a8b9cf None None] MFA Rules not processed for user `7b7aba122ecd4007b6eccb20cca5801d`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:05:56.667260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2dcbdf38-2ee5-491e-a2ea-4618f6a8b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:56.729887 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4386/8787] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:05:56.749546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:05:56.751490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:05:56.763872 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:56.829845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a960f79-28fb-4860-9b56-91cf8ac8a1f7 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:05:56.836262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:05:56.836917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:05:56.837194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:05:56.837456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:05:56.845221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:05:56.846963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:05:56.859574 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4402/8788] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:05:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:06.507374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:06.507937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:06.507937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:06.544117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:06.545409 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:06.555100 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4387/8789] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:06:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:06.569869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:06.581307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d857-671e-40fc-b91d-55b13b43aaec service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:06.587816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78248f7-c596-4826-a3c8-35506405a148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:06.588434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78248f7-c596-4826-a3c8-35506405a148 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:06.588707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78248f7-c596-4826-a3c8-35506405a148 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:06.589021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78248f7-c596-4826-a3c8-35506405a148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:06.598743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78248f7-c596-4826-a3c8-35506405a148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:06.600273 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78248f7-c596-4826-a3c8-35506405a148 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:06.611092 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4403/8790] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:08.487582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:08.489146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:08.504296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051aa92-280c-4524-a57d-a01b2d5d7749 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:08.511190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:08.511794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:08.512070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:08.512335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:08.521146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:08.522731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:08.532806 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4388/8791] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:08.549385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634765-d642-4446-9b18-2fed2d025f9d None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:08.550092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634765-d642-4446-9b18-2fed2d025f9d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:08.550259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634765-d642-4446-9b18-2fed2d025f9d None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:08.552693 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4404/8792] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 02:06:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 02:06:08.557344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 02:06:08.563253 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:08.570173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:08.579340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e89205-85ed-45e3-9c40-e9f2f3443abf service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:08.584998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30345084b33c4b40bb0af7e7f117f777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b206fc51dc894b059cbf38b4e977cccf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:08.585646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:08.585925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:08.586197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] PATH_INFO: `/v3/projects/b206fc51dc894b059cbf38b4e977cccf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:08.587365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] RBAC: Authorizing `identity:get_project(project_id=b206fc51dc894b059cbf38b4e977cccf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:08.589310 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:08.591004 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4389/8793] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 02:06:08 2022] GET /identity/v3/projects/b206fc51dc894b059cbf38b4e977cccf => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:06:08.752312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a569-cfd5-4503-9831-088682c4d993 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:08.752663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a569-cfd5-4503-9831-088682c4d993 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:08.753040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a569-cfd5-4503-9831-088682c4d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:08.774500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-22d2a569-cfd5-4503-9831-088682c4d993 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:08.775708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-22d2a569-cfd5-4503-9831-088682c4d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:08.832834 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4405/8794] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:06:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:08.844835 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:08.846766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:08.860592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666c2fd-a1a6-491b-accf-aa89a636eae0 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:08.865215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:08.865818 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:08.866093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:08.866364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:08.873876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:08.875302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:08.883320 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4390/8795] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:09.070269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559084-f0ff-4ee6-8f3a-b49a476538db None None] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:09.070562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559084-f0ff-4ee6-8f3a-b49a476538db None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:09.070825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559084-f0ff-4ee6-8f3a-b49a476538db None None] PATH_INFO: `/` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:09.072179 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4406/8796] 10.222.0.46 () {54 vars in 912 bytes} [Sun Aug 21 02:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 02:06:09.077093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] Authenticating service token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 21 02:06:09.091788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:09.102286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde648b8-c568-48d8-9def-6e0db1367dad service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:09.107673 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30345084b33c4b40bb0af7e7f117f777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b206fc51dc894b059cbf38b4e977cccf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:09.108299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:09.108604 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:09.108910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] PATH_INFO: `/v3/projects/b206fc51dc894b059cbf38b4e977cccf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:09.110102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] RBAC: Authorizing `identity:get_project(project_id=b206fc51dc894b059cbf38b4e977cccf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:09.111900 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:09.113586 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4391/8797] 10.222.0.46 () {58 vars in 1443 bytes} [Sun Aug 21 02:06:09 2022] GET /identity/v3/projects/b206fc51dc894b059cbf38b4e977cccf => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:06:09.275006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024645-23b2-41d3-8a3b-4b63b74c2919 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:09.275315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024645-23b2-41d3-8a3b-4b63b74c2919 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:09.275549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024645-23b2-41d3-8a3b-4b63b74c2919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:09.297454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-58024645-23b2-41d3-8a3b-4b63b74c2919 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:09.298682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-58024645-23b2-41d3-8a3b-4b63b74c2919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:09.305941 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4407/8798] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:06:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:09.318233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:09.321216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:09.341643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21dc8c-73f6-40b7-af72-c6cb5701ca0c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:09.346496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76922949-c80f-44c9-9439-185b8b242841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:09.347097 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922949-c80f-44c9-9439-185b8b242841 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:09.347375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922949-c80f-44c9-9439-185b8b242841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:09.347645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922949-c80f-44c9-9439-185b8b242841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:09.356897 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76922949-c80f-44c9-9439-185b8b242841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:09.359068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76922949-c80f-44c9-9439-185b8b242841 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:09.369930 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4392/8799] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:13.227411 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58024645-23b2-41d3-8a3b-4b63b74c2919 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:13.295257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58024645-23b2-41d3-8a3b-4b63b74c2919 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:13.300253 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:13.300851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:13.301136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:13.301409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] PATH_INFO: `/v3/users/7b7aba122ecd4007b6eccb20cca5801d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:13.302609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7aba122ecd4007b6eccb20cca5801d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:13.305122 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:13.336489 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:13.356862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7aba122ecd4007b6eccb20cca5801d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.365206 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7aba122ecd4007b6eccb20cca5801d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.365827 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7aba122ecd4007b6eccb20cca5801d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.372865 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7aba122ecd4007b6eccb20cca5801d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.373503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7aba122ecd4007b6eccb20cca5801d'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.392201 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4408/8800] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:06:13 2022] DELETE /identity/v3/users/7b7aba122ecd4007b6eccb20cca5801d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:06:13.398043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:13.398589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:13.398589 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:13.423350 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:13.424576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:13.499911 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4393/8801] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:13.515510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:13.518067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:13.585978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535893bc-eb1b-4a43-88b6-b4a7a9efa6c5 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:13.590361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:13.590979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:13.591254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:13.591520 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:13.601267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:13.602738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:13.612703 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4409/8802] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:13.801732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:13.803473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:13.823882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd13d-5ce2-46e2-80ff-6f425dab06b5 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:13.830830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:13.831477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:13.831738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:13.832011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] PATH_INFO: `/v3/projects/cd999ed44fc04ba3a8aa7d78f1ea52e5` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:13.833207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd999ed44fc04ba3a8aa7d78f1ea52e5)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:13.835466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:13.886848 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'request_id': 'req-a313c20b-6685-4586-8a14-6ea4f965eecb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.893351 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'request_id': 'req-a313c20b-6685-4586-8a14-6ea4f965eecb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.899647 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'request_id': 'req-a313c20b-6685-4586-8a14-6ea4f965eecb'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.914752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] The token cache is being invalidate because project cd999ed44fc04ba3a8aa7d78f1ea52e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:06:13.915034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.915882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:13.917440 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4394/8803] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:06:13 2022] DELETE /identity/v3/projects/cd999ed44fc04ba3a8aa7d78f1ea52e5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:06:13.921568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:13.931577 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d120-b565-4a62-9324-4775aa864f1a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:13.990440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:13.991112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:13.991350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:13.991623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] PATH_INFO: `/v3/users/30345084b33c4b40bb0af7e7f117f777` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:13.992812 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30345084b33c4b40bb0af7e7f117f777)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:13.994732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:14.043823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30345084b33c4b40bb0af7e7f117f777'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.045484 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:14.052726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30345084b33c4b40bb0af7e7f117f777'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.103461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30345084b33c4b40bb0af7e7f117f777'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.103461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30345084b33c4b40bb0af7e7f117f777'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.103461 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-d52aa9d2-77c0-4ad2-b7f8-1656fff9879d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30345084b33c4b40bb0af7e7f117f777'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.103461 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4410/8804] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:06:13 2022] DELETE /identity/v3/users/30345084b33c4b40bb0af7e7f117f777 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:06:14.391566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:14.393242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:14.411281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c20b-6685-4586-8a14-6ea4f965eecb admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:14.454706 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:14.472616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:14.473268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.473544 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.473841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] PATH_INFO: `/v3/projects/b206fc51dc894b059cbf38b4e977cccf` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.474979 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b206fc51dc894b059cbf38b4e977cccf)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:14.477083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:14.526950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b206fc51dc894b059cbf38b4e977cccf', 'request_id': 'req-cbc7e6a6-e069-4988-a488-76da21fc2556'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.533838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b206fc51dc894b059cbf38b4e977cccf', 'request_id': 'req-cbc7e6a6-e069-4988-a488-76da21fc2556'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.540322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b206fc51dc894b059cbf38b4e977cccf', 'request_id': 'req-cbc7e6a6-e069-4988-a488-76da21fc2556'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.556713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] The token cache is being invalidate because project b206fc51dc894b059cbf38b4e977cccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:06:14.557038 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.557655 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-cbc7e6a6-e069-4988-a488-76da21fc2556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:06:14.559156 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4395/8805] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:06:14 2022] DELETE /identity/v3/projects/b206fc51dc894b059cbf38b4e977cccf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:06:14.565500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70c418-b45d-499c-9252-02803fbd062c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.565976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70c418-b45d-499c-9252-02803fbd062c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.566057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70c418-b45d-499c-9252-02803fbd062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.586573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ab70c418-b45d-499c-9252-02803fbd062c None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:14.587710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab70c418-b45d-499c-9252-02803fbd062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:14.653088 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4411/8806] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:14.662274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218705-c539-4b88-ad40-8be9b64c061b None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.662566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218705-c539-4b88-ad40-8be9b64c061b None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.662845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218705-c539-4b88-ad40-8be9b64c061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.683313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2d218705-c539-4b88-ad40-8be9b64c061b None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:14.684546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2d218705-c539-4b88-ad40-8be9b64c061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:14.693214 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4396/8807] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:14.697910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70c418-b45d-499c-9252-02803fbd062c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:14.707826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70c418-b45d-499c-9252-02803fbd062c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:14.712980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:14.713585 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.713861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.714130 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.714785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:06:14.715088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:14.716678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:14.729556 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4412/8808] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:06:14.734232 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218705-c539-4b88-ad40-8be9b64c061b None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:14.744353 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218705-c539-4b88-ad40-8be9b64c061b None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:14.749641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:14.750239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.750516 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.750789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.751406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:14.753357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:14.784625 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4397/8809] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:06:14 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:06:14.790723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:14.804449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546eeed-4ea2-46e0-a508-561dfbf5206b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:14.867975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:14.868498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.868747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.869074 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.869713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:14.871687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:14.895000 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4413/8810] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:06:14 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:06:14.900177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:14.915429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04bc2c-5e4c-47d0-9aea-abcea58b0f76 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:14.920433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:14.921075 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.921352 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.921621 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.922295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:14.923891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:14.934145 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4398/8811] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:06:14.938207 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:14.948741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3089ca-04c4-4be1-8856-9c8be1030adc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:14.953705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746697-80b2-446d-90b1-e2ffaee74aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:14.954307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746697-80b2-446d-90b1-e2ffaee74aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.954578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746697-80b2-446d-90b1-e2ffaee74aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.954849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746697-80b2-446d-90b1-e2ffaee74aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:14.955487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59746697-80b2-446d-90b1-e2ffaee74aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:14.957110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59746697-80b2-446d-90b1-e2ffaee74aa0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:14.967957 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4414/8812] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:06:14.972122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:14.983746 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30d91-d65a-4621-8423-d315ef4abc91 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:14.989089 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:14.989739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:14.990020 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:14.990322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] PATH_INFO: `/v3/projects/c126d8141af543d0829cd995c44069cc/users/c74a6df542e043c09471cf8725bd9ff7/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:15.015307 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c126d8141af543d0829cd995c44069cc, user_id=c74a6df542e043c09471cf8725bd9ff7, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:15.019603 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:15.037566 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4399/8813] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:06:14 2022] PUT /identity/v3/projects/c126d8141af543d0829cd995c44069cc/users/c74a6df542e043c09471cf8725bd9ff7/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:06:15.043039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d0a75-3bed-491a-bdce-f89e0a2a734d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:15.043327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d0a75-3bed-491a-bdce-f89e0a2a734d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:15.043636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d0a75-3bed-491a-bdce-f89e0a2a734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:15.064015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4d9d0a75-3bed-491a-bdce-f89e0a2a734d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:15.065295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4d9d0a75-3bed-491a-bdce-f89e0a2a734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:15.092599 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:15.128396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4415/8814] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:15.138741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:15.140790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:15.205267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1d05a-ef80-46ad-86a0-8c56916a1ca1 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:15.209366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fb9dd-1316-43a1-bb2a-613b41d3811a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:15.210225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb9dd-1316-43a1-bb2a-613b41d3811a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:15.210651 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb9dd-1316-43a1-bb2a-613b41d3811a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:15.211030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb9dd-1316-43a1-bb2a-613b41d3811a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:15.226262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fb9dd-1316-43a1-bb2a-613b41d3811a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:15.227869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fb9dd-1316-43a1-bb2a-613b41d3811a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:15.241230 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4400/8815] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:19.352235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:19.352732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:19.352837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:19.384753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] MFA Rules not processed for user `c74a6df542e043c09471cf8725bd9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:19.386057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:19.456264 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4416/8816] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:06:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:19.475766 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553ec69-aea7-4257-a386-b09a019014b8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:19.476272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553ec69-aea7-4257-a386-b09a019014b8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:19.476401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553ec69-aea7-4257-a386-b09a019014b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:19.497825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b553ec69-aea7-4257-a386-b09a019014b8 None None] MFA Rules not processed for user `c74a6df542e043c09471cf8725bd9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:19.499468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b553ec69-aea7-4257-a386-b09a019014b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:19.507428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4401/8817] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:06:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:19.521800 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:19.523826 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:19.608659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544b11-aa16-48a5-90a8-cf8292988e94 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:19.615120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a258-17a9-46b8-ad3d-6aa1016a9dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:19.615744 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a258-17a9-46b8-ad3d-6aa1016a9dde service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:19.616100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a258-17a9-46b8-ad3d-6aa1016a9dde service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:19.616943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a258-17a9-46b8-ad3d-6aa1016a9dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:19.625705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964a258-17a9-46b8-ad3d-6aa1016a9dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:19.627299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964a258-17a9-46b8-ad3d-6aa1016a9dde service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:19.636489 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4417/8818] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:29.491378 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:29.632200 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=79 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:31.174960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553ec69-aea7-4257-a386-b09a019014b8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:31.186013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553ec69-aea7-4257-a386-b09a019014b8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:31.190457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:31.191070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:31.191344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:31.191611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:31.193414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:31.207577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:31.209322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:31.220998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4402/8819] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:06:31.330620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:31.331100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:31.331200 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:31.387108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:06:31.388282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:31.455893 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4418/8820] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:06:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:06:31.468585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:31.470239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:31.486195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5041f-71ba-404d-a1b8-f57b85f0ea07 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:31.491791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:31.492388 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:31.492689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:31.492985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:31.502064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:31.503767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:31.514077 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4403/8821] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:31.713921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:31.715612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:31.727631 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e6f3-1994-47fc-a908-14e18c09b53a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:31.731893 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d6feb-b434-4717-91ab-f1ea9297f6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:31.732516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6feb-b434-4717-91ab-f1ea9297f6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:31.732837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6feb-b434-4717-91ab-f1ea9297f6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:31.733108 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6feb-b434-4717-91ab-f1ea9297f6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:31.734897 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-328d6feb-b434-4717-91ab-f1ea9297f6e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:31.753689 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d6feb-b434-4717-91ab-f1ea9297f6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:31.755788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d6feb-b434-4717-91ab-f1ea9297f6e3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:31.771458 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4419/8822] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:31.843049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:06:31.857626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40e8bc-2d35-4532-abf0-577dfb77cf11 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:06:31.863946 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:06:31.864555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:06:31.864831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:06:31.865102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:06:31.866901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:06:31.879553 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:06:31.881142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:06:31.891521 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4404/8823] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:06:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:06:41.763819 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=46 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:41.887184 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=18 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:11.493109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956e5ba-31a3-45a9-b10f-0c6863dc7ebd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:11.493611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956e5ba-31a3-45a9-b10f-0c6863dc7ebd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:11.493816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956e5ba-31a3-45a9-b10f-0c6863dc7ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:11.527170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d956e5ba-31a3-45a9-b10f-0c6863dc7ebd None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:07:11.528406 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d956e5ba-31a3-45a9-b10f-0c6863dc7ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:11.538943 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4420/8824] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:07:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:07:11.551386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:11.553126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:11.564354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956e5ba-31a3-45a9-b10f-0c6863dc7ebd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:11.568328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed240e-c7c1-4938-bee5-33fe14e6afcc service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:11.575215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:11.575832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956e5ba-31a3-45a9-b10f-0c6863dc7ebd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:11.576039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:11.576528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:11.576987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:11.583245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:11.584004 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:11.584330 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:11.584714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] PATH_INFO: `/v3/users/c74a6df542e043c09471cf8725bd9ff7` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:11.586026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74a6df542e043c09471cf8725bd9ff7)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:11.588350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:11.588457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:11.590081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:11.600691 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4405/8825] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:07:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:07:11.648099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74a6df542e043c09471cf8725bd9ff7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:11.660512 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74a6df542e043c09471cf8725bd9ff7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:11.661422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74a6df542e043c09471cf8725bd9ff7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:11.668722 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74a6df542e043c09471cf8725bd9ff7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:11.669416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-3943ff80-ba2d-4531-ba22-0ad99e7c9109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74a6df542e043c09471cf8725bd9ff7'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:11.687512 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4421/8826] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:07:11 2022] DELETE /identity/v3/users/c74a6df542e043c09471cf8725bd9ff7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:07:11.867383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:11.878253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46f03c-945c-4179-9d15-c2c9070ee513 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:11.941943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:11.942625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:11.942803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:11.943076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] PATH_INFO: `/v3/projects/c126d8141af543d0829cd995c44069cc` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:11.944254 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c126d8141af543d0829cd995c44069cc)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:11.946231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:11.996279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c126d8141af543d0829cd995c44069cc', 'request_id': 'req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:12.003287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c126d8141af543d0829cd995c44069cc', 'request_id': 'req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:12.010782 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c126d8141af543d0829cd995c44069cc', 'request_id': 'req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:12.028489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] The token cache is being invalidate because project c126d8141af543d0829cd995c44069cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:07:12.028797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:12.029504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c2640d7c-9f8a-4c5e-97b5-a648d1e14df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:07:12.031102 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4406/8827] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:07:11 2022] DELETE /identity/v3/projects/c126d8141af543d0829cd995c44069cc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:07:12.036916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aad42-5f65-4ef3-8dda-bf67110044bb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.037301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aad42-5f65-4ef3-8dda-bf67110044bb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.037635 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aad42-5f65-4ef3-8dda-bf67110044bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.058888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-be7aad42-5f65-4ef3-8dda-bf67110044bb None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:07:12.060096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-be7aad42-5f65-4ef3-8dda-bf67110044bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:12.126072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4422/8828] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:07:12.134260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27683-75fb-4041-82eb-22884df11a25 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.134546 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27683-75fb-4041-82eb-22884df11a25 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.134828 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27683-75fb-4041-82eb-22884df11a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.156407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1cb27683-75fb-4041-82eb-22884df11a25 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:07:12.157995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1cb27683-75fb-4041-82eb-22884df11a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:12.167065 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4407/8829] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:07:12.171696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aad42-5f65-4ef3-8dda-bf67110044bb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:12.182244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aad42-5f65-4ef3-8dda-bf67110044bb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:12.187882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:12.188593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.188995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.189261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.189890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:07:12.190192 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:12.191851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:12.204396 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4423/8830] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:07:12.209419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27683-75fb-4041-82eb-22884df11a25 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:12.219481 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27683-75fb-4041-82eb-22884df11a25 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:12.224817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:12.225445 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.225739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.225989 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.226613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:12.228602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:12.260596 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4408/8831] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:07:12.263600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:12.274573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11b065-b6da-446a-9e79-f0aceb65ce2a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:12.317814 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:12.338084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:12.338728 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.339002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.339270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.339891 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:12.341892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:12.368042 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4424/8832] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:07:12 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:07:12.371057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:12.382393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cb03c-60b3-489f-b681-b7bce774b708 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:12.388841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:12.389443 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.389717 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.389982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.390622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:12.392231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:12.404385 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4409/8833] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:07:12.409179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:12.419946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb10e8-0f09-404b-8485-cd80116e639e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:12.425415 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378f16d-2592-42c5-883a-1432fdfde01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:12.426010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378f16d-2592-42c5-883a-1432fdfde01d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.426301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378f16d-2592-42c5-883a-1432fdfde01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.426776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378f16d-2592-42c5-883a-1432fdfde01d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.427401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378f16d-2592-42c5-883a-1432fdfde01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:12.429076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378f16d-2592-42c5-883a-1432fdfde01d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:12.443652 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4425/8834] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:07:12.448425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:12.460096 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c384-4eb2-47eb-8dde-f07f840c5370 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:12.466120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:12.466778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.467054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.467326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] PATH_INFO: `/v3/projects/a04100f9970f4ed2a2d21bc1a84cf74d/users/7f0d463954f54cc6b266fc4920697515/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.482808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04100f9970f4ed2a2d21bc1a84cf74d, user_id=7f0d463954f54cc6b266fc4920697515, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:12.485540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:12.500294 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4410/8835] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:07:12 2022] PUT /identity/v3/projects/a04100f9970f4ed2a2d21bc1a84cf74d/users/7f0d463954f54cc6b266fc4920697515/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:07:12.505649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16333b-a50b-4832-85cd-9e44adf492f8 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.506145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16333b-a50b-4832-85cd-9e44adf492f8 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.506246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16333b-a50b-4832-85cd-9e44adf492f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.526329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-df16333b-a50b-4832-85cd-9e44adf492f8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:07:12.527550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-df16333b-a50b-4832-85cd-9e44adf492f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:12.598866 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4426/8836] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:07:12.609063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:12.610998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:12.631216 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:12.689014 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ea02-e30c-417e-906f-7433a6975aa3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:12.693313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa2af8-8abe-4cbf-92bf-d4c47a6bb088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:12.693941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2af8-8abe-4cbf-92bf-d4c47a6bb088 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:12.694215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2af8-8abe-4cbf-92bf-d4c47a6bb088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:12.694482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2af8-8abe-4cbf-92bf-d4c47a6bb088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:12.705154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa2af8-8abe-4cbf-92bf-d4c47a6bb088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:12.706659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa2af8-8abe-4cbf-92bf-d4c47a6bb088 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:12.717653 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4411/8837] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:07:16.470526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:16.471008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:16.471139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:16.502360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] MFA Rules not processed for user `7f0d463954f54cc6b266fc4920697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:07:16.503498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:16.575075 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4427/8838] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:07:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:07:16.586291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186d97-c80e-47e7-bb60-cefd736ac7cd None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:16.586827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186d97-c80e-47e7-bb60-cefd736ac7cd None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:16.586827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186d97-c80e-47e7-bb60-cefd736ac7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:16.605992 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-84186d97-c80e-47e7-bb60-cefd736ac7cd None None] MFA Rules not processed for user `7f0d463954f54cc6b266fc4920697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:07:16.607203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84186d97-c80e-47e7-bb60-cefd736ac7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:16.614512 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4412/8839] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:07:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:07:16.626537 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:16.628191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:16.688576 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:16.728740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7d194-cfc4-4c27-9a5b-23d962d4605e None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:16.737353 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:16.738382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:16.738947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:16.739403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:16.759085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:16.761687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:16.776504 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4428/8840] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:07:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:07:26.601418 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=28 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:26.769473 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=18 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:28.230976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:28.231493 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:28.231597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:28.271819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:07:28.273258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:28.280689 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4413/8841] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:07:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:07:28.297331 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:28.299053 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:28.312028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a36b-c80e-4378-8708-867a9d032c4e service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:28.316750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6acb7-86cc-43e4-97fa-fcfa4c78079e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:28.317403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6acb7-86cc-43e4-97fa-fcfa4c78079e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:28.317680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6acb7-86cc-43e4-97fa-fcfa4c78079e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:28.317939 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6acb7-86cc-43e4-97fa-fcfa4c78079e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:28.326422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6acb7-86cc-43e4-97fa-fcfa4c78079e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:28.327878 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6acb7-86cc-43e4-97fa-fcfa4c78079e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:28.337307 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4429/8842] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:07:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:07:38.268951 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:38.333733 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:56.316918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:07:56.318738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:56.397908 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a738e-5086-4e04-a775-897358767d87 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:07:56.403284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:07:56.403898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:07:56.404173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:07:56.404448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:07:56.409938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:07:56.429727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:07:56.431373 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:07:56.442408 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4414/8843] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:07:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:08:06.438355 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=32 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:11.653375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:08:11.653904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:08:11.654024 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:08:11.673905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] MFA Rules not processed for user `7f0d463954f54cc6b266fc4920697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:08:11.675153 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:08:11.683565 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4430/8844] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:08:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:08:12.287334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:08:12.298758 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee41cf-b0d2-46c2-8316-051931a80f15 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:08:12.304244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:08:12.304901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:08:12.305186 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:08:12.305455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:08:12.307327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:08:12.319703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:08:12.321330 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:08:12.338337 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4415/8845] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:08:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:08:21.668808 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:22.327621 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:23.607120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:08:23.608709 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:08:23.624725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ba0e-c30e-4819-b124-5a81eb5a00cb None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:08:23.632314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:08:23.633371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:08:23.633761 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:08:23.634140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:08:23.636684 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:08:23.656582 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:08:23.659356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:08:23.675072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4431/8846] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:08:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:08:33.669508 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:06.068151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.083123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c40cf-8493-41fb-9907-6b3ecbc4049c service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.088383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.089283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.089749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.090207 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] PATH_INFO: `/v3/users/7f0d463954f54cc6b266fc4920697515` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.091526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0d463954f54cc6b266fc4920697515)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:06.093504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:06.144680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0d463954f54cc6b266fc4920697515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.154618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0d463954f54cc6b266fc4920697515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.167940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0d463954f54cc6b266fc4920697515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.168664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0d463954f54cc6b266fc4920697515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.176113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-a12e9076-14fa-4706-90d6-2fefc46ab71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0d463954f54cc6b266fc4920697515'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.182277 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4416/8847] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:09:06 2022] DELETE /identity/v3/users/7f0d463954f54cc6b266fc4920697515 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:09:06.364106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.378086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce353-529f-4389-9cbd-2ea634f23f1f service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.439857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.440533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.440852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.441133 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] PATH_INFO: `/v3/projects/a04100f9970f4ed2a2d21bc1a84cf74d` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.442491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04100f9970f4ed2a2d21bc1a84cf74d)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:06.445214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:06.496992 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'request_id': 'req-2f85a899-132d-43a1-a4fe-6048c204420e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.506245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'request_id': 'req-2f85a899-132d-43a1-a4fe-6048c204420e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.512464 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'request_id': 'req-2f85a899-132d-43a1-a4fe-6048c204420e'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.524041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] The token cache is being invalidate because project a04100f9970f4ed2a2d21bc1a84cf74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:09:06.524261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.525018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-2f85a899-132d-43a1-a4fe-6048c204420e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:09:06.526637 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4432/8848] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:09:06 2022] DELETE /identity/v3/projects/a04100f9970f4ed2a2d21bc1a84cf74d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:09:06.532278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc921f-081e-4451-993f-f1ca79b159c8 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.532566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc921f-081e-4451-993f-f1ca79b159c8 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.532876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc921f-081e-4451-993f-f1ca79b159c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.557052 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2bfc921f-081e-4451-993f-f1ca79b159c8 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:09:06.558933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2bfc921f-081e-4451-993f-f1ca79b159c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:09:06.627979 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4417/8849] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:09:06.639329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e227e4d-e4ad-4b8e-98f1-f511b9d8a12f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.639617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e227e4d-e4ad-4b8e-98f1-f511b9d8a12f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.639890 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e227e4d-e4ad-4b8e-98f1-f511b9d8a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.668747 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7e227e4d-e4ad-4b8e-98f1-f511b9d8a12f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:09:06.670565 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7e227e4d-e4ad-4b8e-98f1-f511b9d8a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:09:06.683551 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4433/8850] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:09:06.688675 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc921f-081e-4451-993f-f1ca79b159c8 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.704884 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc921f-081e-4451-993f-f1ca79b159c8 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.711937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.712543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.712864 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.713152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.713805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:09:06.714107 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:06.715709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:06.728314 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4418/8851] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:09:06.732902 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e227e4d-e4ad-4b8e-98f1-f511b9d8a12f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.742854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e227e4d-e4ad-4b8e-98f1-f511b9d8a12f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.747753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.748382 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.748663 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.748971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.749723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:06.751622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:06.784812 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4434/8852] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:09:06 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:09:06.790382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.801595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43988-7a3d-4e73-980f-022f9b1a49c8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.865873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.866402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.866701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.866965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.867597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:06.869583 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:06.877453 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:06.895345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4419/8853] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:09:06 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:09:06.899980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.911270 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a07273-7dc7-48cb-a930-15935adf2c48 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.916393 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.917027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.917311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.917578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.918226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:06.919830 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:06.930048 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4435/8854] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:09:06.934094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.945425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faff26d-eede-45b3-b245-a771c412a806 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.950993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2ec08-e399-4e31-add4-6d9014a2b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.951592 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2ec08-e399-4e31-add4-6d9014a2b245 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.951872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2ec08-e399-4e31-add4-6d9014a2b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.952142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2ec08-e399-4e31-add4-6d9014a2b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:06.952822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2ec08-e399-4e31-add4-6d9014a2b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:06.954466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2ec08-e399-4e31-add4-6d9014a2b245 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:06.965967 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4420/8855] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:09:06.970186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:06.980919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478890a1-6de9-4b37-93fe-33587fc3a909 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:06.986387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:06.987343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:06.987624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:06.987896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] PATH_INFO: `/v3/projects/79bcc7627b8b42349425ac3245102d4d/users/a97638d5939f4c10a9326e705db5843c/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:07.003409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bcc7627b8b42349425ac3245102d4d, user_id=a97638d5939f4c10a9326e705db5843c, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:07.006204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:07.021037 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4436/8856] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:09:06 2022] PUT /identity/v3/projects/79bcc7627b8b42349425ac3245102d4d/users/a97638d5939f4c10a9326e705db5843c/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:09:07.026384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a75f7-8a4b-423f-8f31-56688b830141 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:07.026699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a75f7-8a4b-423f-8f31-56688b830141 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:07.026980 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a75f7-8a4b-423f-8f31-56688b830141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:07.049461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-018a75f7-8a4b-423f-8f31-56688b830141 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:09:07.050744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-018a75f7-8a4b-423f-8f31-56688b830141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:09:07.122998 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4421/8857] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:09:07.134612 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:07.136518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:09:07.172569 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:07.205129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4508-b58f-4d4c-a510-6665d043266a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:07.209183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:07.209945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:07.210222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:07.210560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:07.221043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:07.222888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:07.232688 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4437/8858] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:09:11.110287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e7a55-021e-49c7-a286-80106bbf5251 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:11.110770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e7a55-021e-49c7-a286-80106bbf5251 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:11.111384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e7a55-021e-49c7-a286-80106bbf5251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:11.151617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d04e7a55-021e-49c7-a286-80106bbf5251 None None] MFA Rules not processed for user `a97638d5939f4c10a9326e705db5843c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:09:11.153251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d04e7a55-021e-49c7-a286-80106bbf5251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:09:11.233571 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4422/8859] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:09:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:09:11.249121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:09:11.250622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:09:11.329806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabcef-915d-49c6-afb3-78c61c257426 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:09:11.335775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:09:11.336399 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:11.336673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:11.336972 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:11.345683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:09:11.347298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:09:11.357337 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4438/8860] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:09:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:09:13.033260 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c390-df23-4eda-a281-46d4d777bf58 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:09:13.033794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c390-df23-4eda-a281-46d4d777bf58 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:09:13.033883 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c390-df23-4eda-a281-46d4d777bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:09:13.054355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d1e4c390-df23-4eda-a281-46d4d777bf58 None None] MFA Rules not processed for user `a97638d5939f4c10a9326e705db5843c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:09:13.055620 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d1e4c390-df23-4eda-a281-46d4d777bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:09:13.066320 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4423/8861] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:09:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:09:21.353528 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=48 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:23.048635 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:31.146054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:10:31.147737 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:31.161805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ffdf0-a2f9-4494-904d-58aa7a0e66a3 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:10:31.165553 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf77bcc-6bbf-4524-a8c5-f3e895f8be1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:10:31.166355 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf77bcc-6bbf-4524-a8c5-f3e895f8be1d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:31.166636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf77bcc-6bbf-4524-a8c5-f3e895f8be1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:31.166904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf77bcc-6bbf-4524-a8c5-f3e895f8be1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:31.168619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ddf77bcc-6bbf-4524-a8c5-f3e895f8be1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:31.182376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf77bcc-6bbf-4524-a8c5-f3e895f8be1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:10:31.183801 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf77bcc-6bbf-4524-a8c5-f3e895f8be1d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:10:31.195131 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4439/8862] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:10:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:10:31.404642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c390-df23-4eda-a281-46d4d777bf58 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:10:31.415076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c390-df23-4eda-a281-46d4d777bf58 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:10:31.419229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:10:31.424201 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:31.426103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:31.427495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:31.429380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:31.444735 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:10:31.447045 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:10:31.460735 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4424/8863] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:10:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:10:32.228710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747b94-58d0-4b54-8291-b6be893e493a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:32.229173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747b94-58d0-4b54-8291-b6be893e493a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:32.229320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747b94-58d0-4b54-8291-b6be893e493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:32.251988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-48747b94-58d0-4b54-8291-b6be893e493a None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:10:32.253276 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-48747b94-58d0-4b54-8291-b6be893e493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:32.264734 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4440/8864] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:10:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:10:32.278320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:10:32.293049 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71f4c9-1e5a-4f09-9994-b3d6966b16a1 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:10:32.299275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:10:32.300069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:32.300376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:32.300646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:32.313637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:10:32.315118 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:10:32.326785 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4425/8865] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:10:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:10:33.233527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48747b94-58d0-4b54-8291-b6be893e493a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:10:33.244680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48747b94-58d0-4b54-8291-b6be893e493a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:10:33.248317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:10:33.248957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:33.249236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:33.249506 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:33.251239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:33.261575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:10:33.263008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:10:33.271587 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4441/8866] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:10:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:10:42.321738 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=12 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:43.267678 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=15 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:45.974711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:10:45.984328 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c230507-2faf-4295-a726-d54840abcba0 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:10:45.989708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfb14d-0f0d-44fb-91dc-4d365125e4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:10:45.991001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb14d-0f0d-44fb-91dc-4d365125e4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:45.991278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb14d-0f0d-44fb-91dc-4d365125e4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:45.991548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb14d-0f0d-44fb-91dc-4d365125e4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:45.993866 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2ccfb14d-0f0d-44fb-91dc-4d365125e4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:46.006017 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb14d-0f0d-44fb-91dc-4d365125e4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:10:46.007456 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb14d-0f0d-44fb-91dc-4d365125e4f2 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:10:46.015954 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4426/8867] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:10:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:10:46.508113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:10:46.523086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3fc8a-f2c7-4fdc-a5b0-8142d5695388 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:10:46.529423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:10:46.530042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:46.530323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:46.530591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:46.532383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:46.545745 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:10:46.547352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:10:46.558608 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4442/8868] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:10:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:10:55.848819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:10:55.849349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:10:55.849349 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:10:55.868847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] MFA Rules not processed for user `a97638d5939f4c10a9326e705db5843c`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:10:55.870132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:10:55.878160 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4427/8869] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:10:56.554079 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:11:05.863347 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:11:09.844703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:11:09.846863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:11:09.870479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205eec-c757-4362-82c0-b4e916a7b66b service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:11:09.876438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:11:09.877073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:11:09.877350 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:11:09.877620 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:11:09.879395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:11:09.892855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:11:09.894753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:11:09.906203 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4443/8870] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:11:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:11:19.901513 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:23.180128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:12:23.181681 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:12:23.263796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87d92b-32cc-47fb-82f9-b8182d5c4f59 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:12:23.269142 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:12:23.269755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:12:23.270029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:12:23.270300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:12:23.272151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:12:23.285660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:12:23.287594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:12:23.298641 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4428/8871] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:12:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:12:23.556042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:12:23.568262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c980-d312-4774-9664-d9b2b0811a80 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:12:23.574051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fc516-9c78-447a-a58d-58438299dd48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:12:23.574657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc516-9c78-447a-a58d-58438299dd48 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:12:23.574935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc516-9c78-447a-a58d-58438299dd48 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:12:23.575209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc516-9c78-447a-a58d-58438299dd48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:12:23.577099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-975fc516-9c78-447a-a58d-58438299dd48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:12:23.589194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fc516-9c78-447a-a58d-58438299dd48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:12:23.590775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fc516-9c78-447a-a58d-58438299dd48 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:12:23.600693 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4444/8872] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:12:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:12:32.372916 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:12:32.386577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6308795-4d54-41b9-b69c-9ea665a5177a service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:12:32.393236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:12:32.394027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:12:32.394494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:12:32.394724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:12:32.396795 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:12:32.412486 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:12:32.414298 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:12:32.426812 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4429/8873] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:12:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:12:33.596493 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:38.653390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:12:38.653970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:12:38.653970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:12:38.674262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] MFA Rules not processed for user `a97638d5939f4c10a9326e705db5843c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:12:38.675491 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:12:38.683488 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4445/8874] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:12:39.004205 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:12:39.034127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0c32-e65e-4707-a721-6a5c33f92737 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:12:39.040448 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:12:39.041098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:12:39.041379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:12:39.041650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:12:39.044130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:12:39.056023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:12:39.057507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:12:39.066324 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4430/8875] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:12:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:12:48.669075 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:49.062386 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=52 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:13:03.329496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:13:03.331726 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:13:03.353825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c07be-7fd8-4c82-854d-195cac18dc30 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:13:03.360861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:13:03.361507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:13:03.361786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:13:03.362060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:13:03.363998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:13:03.376341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:13:03.378088 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:13:03.392275 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4446/8876] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:13:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:13:13.385590 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:13:26.633987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:13:26.647385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c0a79-04cb-40b4-9c12-bfeb126c950a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:13:26.653387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:13:26.653986 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:13:26.654262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:13:26.654525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:13:26.656401 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:13:26.668229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:13:26.669923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:13:26.680111 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4431/8877] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:13:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:13:36.676059 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:13:54.524914 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:13:54.545055 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b5985-897a-4257-870d-0e3e55d55f2c service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:13:54.552534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b64c2d-ef84-4263-a23e-5c88dd21cea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:13:54.553976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64c2d-ef84-4263-a23e-5c88dd21cea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:13:54.554275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64c2d-ef84-4263-a23e-5c88dd21cea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:13:54.554524 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64c2d-ef84-4263-a23e-5c88dd21cea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:13:54.556686 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-47b64c2d-ef84-4263-a23e-5c88dd21cea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:13:54.573268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b64c2d-ef84-4263-a23e-5c88dd21cea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:13:54.574854 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b64c2d-ef84-4263-a23e-5c88dd21cea6 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:13:54.584807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4447/8878] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:13:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:14:04.580283 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:11.544660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:14:11.554987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86db0-b1ae-47f3-9eee-d87c76f5b826 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:14:11.559467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:14:11.560085 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:14:11.560347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:14:11.560611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:14:11.570618 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:14:11.572033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:14:11.581609 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4432/8879] 10.222.0.46 () {60 vars in 1396 bytes} [Sun Aug 21 02:14:11 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:14:21.577153 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:24.996481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5ccc-5563-4f86-ab87-333082275227 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:14:24.997033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5ccc-5563-4f86-ab87-333082275227 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:14:24.997129 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5ccc-5563-4f86-ab87-333082275227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:14:25.016568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2bba5ccc-5563-4f86-ab87-333082275227 None None] MFA Rules not processed for user `a97638d5939f4c10a9326e705db5843c`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:14:25.017863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2bba5ccc-5563-4f86-ab87-333082275227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:14:25.025254 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4448/8880] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:14:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:14:25.379060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:14:25.392459 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed614947-0c2a-4405-b010-967710e5892c service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:14:25.398271 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:14:25.399132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:14:25.399503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:14:25.399855 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:14:25.402727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:14:25.413267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:14:25.414696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:14:25.423317 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4433/8881] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:14:25.768498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5ccc-5563-4f86-ab87-333082275227 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:14:25.782218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5ccc-5563-4f86-ab87-333082275227 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:14:25.788740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83efe-7716-4958-b6a9-465a02f54faf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:14:25.789484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83efe-7716-4958-b6a9-465a02f54faf service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:14:25.789821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83efe-7716-4958-b6a9-465a02f54faf service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:14:25.790157 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83efe-7716-4958-b6a9-465a02f54faf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:14:25.792495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4fb83efe-7716-4958-b6a9-465a02f54faf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:14:25.805002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb83efe-7716-4958-b6a9-465a02f54faf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:14:25.806862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb83efe-7716-4958-b6a9-465a02f54faf service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:14:25.823700 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4449/8882] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:14:35.419520 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:35.819266 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:42.326851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:15:42.347512 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fcccd-21c1-48d6-a8b5-ed8c040be3dc service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:15:42.352941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:15:42.353505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:15:42.353784 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:15:42.354061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:15:42.387670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:15:42.389137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:15:42.401891 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4434/8883] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:15:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:15:42.595609 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28fcc7-5834-4ced-8d35-6d0b539088af None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:15:42.596041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28fcc7-5834-4ced-8d35-6d0b539088af None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:15:42.596139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28fcc7-5834-4ced-8d35-6d0b539088af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:15:42.659842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-9f28fcc7-5834-4ced-8d35-6d0b539088af None None] MFA Rules not processed for user `1c9c0901260e44a789d750c2032bfbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:15:42.660996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-9f28fcc7-5834-4ced-8d35-6d0b539088af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:15:42.743704 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4450/8884] 10.222.0.46 () {58 vars in 1061 bytes} [Sun Aug 21 02:15:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:15:42.750042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:15:42.760188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4fb3-9219-499f-93b3-a9917067089f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:15:42.765999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:15:42.766813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:15:42.767098 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:15:42.767471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:15:42.782367 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:15:42.783775 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:15:42.796428 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4435/8885] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:15:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:15:52.740483 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=46 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:52.791012 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=26 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:54.311494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28fcc7-5834-4ced-8d35-6d0b539088af None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:15:54.327394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28fcc7-5834-4ced-8d35-6d0b539088af None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:15:54.331680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:15:54.332320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:15:54.332593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:15:54.332894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:15:54.343971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:15:54.345383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:15:54.356639 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4451/8886] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:15:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:15:55.260517 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:15:55.271154 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b570bf8-eba1-4a2e-80df-e0fea874d537 service cinder] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:15:55.275483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:15:55.276366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:15:55.277027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:15:55.277366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:15:55.285505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:15:55.287016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:15:55.295477 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4436/8887] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:15:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:16:04.351568 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:05.292508 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:15.593288 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:16:15.601995 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ee90d-18e2-4255-b2c7-a1a1c6608497 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:16:15.605793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:16:15.607171 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:16:15.607456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:16:15.607732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:16:15.615496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:16:15.617241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:16:15.625900 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4452/8888] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:16:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:16:16.077600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:16:16.092371 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d734be2-3d13-44e2-a09c-1f665e855316 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:16:16.099347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:16:16.099967 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:16:16.100244 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:16:16.100523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:16:16.110732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:16:16.112303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:16:16.124620 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4437/8889] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:16:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:16:25.622940 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:26.120193 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:04.041752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:04.051125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bdb10-0a55-4c23-b576-04240f1cdbbb service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:04.055186 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:04.055785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:04.056063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:04.056335 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:04.065715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:04.067175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:04.099679 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4453/8890] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:17:07.337023 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:07.348393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b85a-bd98-437d-b179-264933026a7c service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:07.353715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:07.354334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:07.354626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:07.354891 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:07.356585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:07.382458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:07.383972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:07.395049 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4438/8891] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:17:07.406926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:07.417479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd341e2-d637-48be-8272-21383e3cc500 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:07.422817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:07.423359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:07.423794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:07.424214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] PATH_INFO: `/v3/users/a97638d5939f4c10a9326e705db5843c` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:07.425597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97638d5939f4c10a9326e705db5843c)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:07.427860 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:07.479589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97638d5939f4c10a9326e705db5843c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.487557 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97638d5939f4c10a9326e705db5843c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.488193 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97638d5939f4c10a9326e705db5843c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.495430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97638d5939f4c10a9326e705db5843c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.496061 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ccb2315b-bfb6-44a7-9a23-9a98f01ccdd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97638d5939f4c10a9326e705db5843c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.513314 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4454/8892] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:17:07 2022] DELETE /identity/v3/users/a97638d5939f4c10a9326e705db5843c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:17:07.698335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:07.709809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f99580-df23-4f68-b698-9fa66c3cef5a service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:07.770934 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:07.771573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:07.771964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:07.772416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] PATH_INFO: `/v3/projects/79bcc7627b8b42349425ac3245102d4d` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:07.774510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bcc7627b8b42349425ac3245102d4d)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:07.776436 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:07.830800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bcc7627b8b42349425ac3245102d4d', 'request_id': 'req-ae3446da-db00-4167-919a-6df4ac75b779'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.836981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bcc7627b8b42349425ac3245102d4d', 'request_id': 'req-ae3446da-db00-4167-919a-6df4ac75b779'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.842857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bcc7627b8b42349425ac3245102d4d', 'request_id': 'req-ae3446da-db00-4167-919a-6df4ac75b779'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.871113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] The token cache is being invalidate because project 79bcc7627b8b42349425ac3245102d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:17:07.871393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.872061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-ae3446da-db00-4167-919a-6df4ac75b779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:07.873639 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4439/8893] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:17:07 2022] DELETE /identity/v3/projects/79bcc7627b8b42349425ac3245102d4d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:17:07.878702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b19ba-bb41-4ce0-83b2-479a97f1b355 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:07.878982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b19ba-bb41-4ce0-83b2-479a97f1b355 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:07.879257 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b19ba-bb41-4ce0-83b2-479a97f1b355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:07.950113 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-744b19ba-bb41-4ce0-83b2-479a97f1b355 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:07.951267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-744b19ba-bb41-4ce0-83b2-479a97f1b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:08.015668 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4455/8894] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:08.025403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6e3c-add2-40c6-9acd-126680adeb87 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.025689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6e3c-add2-40c6-9acd-126680adeb87 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.025959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6e3c-add2-40c6-9acd-126680adeb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.047133 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-271a6e3c-add2-40c6-9acd-126680adeb87 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:08.048363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-271a6e3c-add2-40c6-9acd-126680adeb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:08.058281 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4440/8895] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:08.062896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b19ba-bb41-4ce0-83b2-479a97f1b355 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:08.074056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b19ba-bb41-4ce0-83b2-479a97f1b355 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:08.083494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:08.084107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.084383 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.084921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.085768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:17:08.086071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:08.087719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:08.097708 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:08.101992 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4456/8896] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:17:08.106657 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6e3c-add2-40c6-9acd-126680adeb87 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:08.117053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6e3c-add2-40c6-9acd-126680adeb87 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:08.125030 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:08.125678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.125953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.126220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.126854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:08.128799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:08.173854 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4441/8897] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:17:08 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:17:08.178168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:08.189010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e8b2-4898-4c7b-9970-6c8b1366a45a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:08.249840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:08.250470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.250752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.251028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.251678 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:08.253653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:08.281119 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4457/8898] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:17:08 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:17:08.282447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:08.293524 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a6e3-130a-4a82-a747-5cb2cfef0eac admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:08.298314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:08.298948 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.299228 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.299501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.300145 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:08.301787 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:08.312450 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4442/8899] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:17:08.316616 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:08.327978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701155-6645-447f-abe1-3a80a861314c admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:08.332958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df25718-6261-4631-a7a6-b00536c6113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:08.333563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df25718-6261-4631-a7a6-b00536c6113c admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.333833 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df25718-6261-4631-a7a6-b00536c6113c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.334125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df25718-6261-4631-a7a6-b00536c6113c admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.334802 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df25718-6261-4631-a7a6-b00536c6113c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:08.336574 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df25718-6261-4631-a7a6-b00536c6113c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:08.347405 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4458/8900] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:17:08.351772 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:08.362029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f002-93f3-4aec-8cc6-6b98bd07dce2 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:08.367697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:08.368387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.368652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.368966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] PATH_INFO: `/v3/projects/c2ee3a950b274e36b952100c954522f2/users/9dd42bfac29d4e39a6af2779d6e00c9a/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.371384 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:08.387111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ee3a950b274e36b952100c954522f2, user_id=9dd42bfac29d4e39a6af2779d6e00c9a, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:08.389798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:08.405033 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4443/8901] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:17:08 2022] PUT /identity/v3/projects/c2ee3a950b274e36b952100c954522f2/users/9dd42bfac29d4e39a6af2779d6e00c9a/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:17:08.410039 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71342a04-9bc8-41c2-a256-c395db339673 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.410508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71342a04-9bc8-41c2-a256-c395db339673 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.410605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71342a04-9bc8-41c2-a256-c395db339673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.430580 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-71342a04-9bc8-41c2-a256-c395db339673 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:08.431794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-71342a04-9bc8-41c2-a256-c395db339673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:08.493416 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4459/8902] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:08.503311 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:08.505296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:08.567695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718e9bb-2952-4663-951a-c35fa00566ec admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:08.571736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0af7a8-d830-4ac7-840c-0dd5c0875e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:08.572345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af7a8-d830-4ac7-840c-0dd5c0875e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:08.572622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af7a8-d830-4ac7-840c-0dd5c0875e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:08.572919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af7a8-d830-4ac7-840c-0dd5c0875e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:08.582927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0af7a8-d830-4ac7-840c-0dd5c0875e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:08.584431 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0af7a8-d830-4ac7-840c-0dd5c0875e0e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:08.594420 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4444/8903] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:17:12.441994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:12.442482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:12.442589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:12.472740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] MFA Rules not processed for user `9dd42bfac29d4e39a6af2779d6e00c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:12.473943 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:12.550625 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4460/8904] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:12.561101 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906faa6-f172-4cfd-9cdd-419a9bde7f82 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:12.562212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906faa6-f172-4cfd-9cdd-419a9bde7f82 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:12.562684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906faa6-f172-4cfd-9cdd-419a9bde7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:12.583972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9906faa6-f172-4cfd-9cdd-419a9bde7f82 None None] MFA Rules not processed for user `9dd42bfac29d4e39a6af2779d6e00c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:12.585417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9906faa6-f172-4cfd-9cdd-419a9bde7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:12.597538 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4445/8905] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:12.609442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:12.610990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:12.622193 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:12.691702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64562b-7798-43b3-bd78-2497e0ff4448 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:12.699102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:12.699906 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:12.700198 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:12.700471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:12.710889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:12.712504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:12.730606 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4461/8906] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:17:22.578331 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:22.719493 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=30 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:26.565585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:26.566103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:26.566103 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:26.586381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] MFA Rules not processed for user `9dd42bfac29d4e39a6af2779d6e00c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:26.587610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:26.595342 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4446/8907] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:27.193354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:27.194942 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:27.268659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eb214-275c-4da8-bf8e-364f8f1c444b service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:27.274246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd22ced-0f56-4aed-9a98-f3b89e687c8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:27.274862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd22ced-0f56-4aed-9a98-f3b89e687c8e service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:27.275134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd22ced-0f56-4aed-9a98-f3b89e687c8e service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:27.275397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd22ced-0f56-4aed-9a98-f3b89e687c8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:27.277271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bfd22ced-0f56-4aed-9a98-f3b89e687c8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:27.289202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd22ced-0f56-4aed-9a98-f3b89e687c8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:27.290820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd22ced-0f56-4aed-9a98-f3b89e687c8e service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:27.301394 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4462/8908] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:17:33.818783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:33.820292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:33.857316 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149fe41-72d7-47e2-a762-ee74d9d2c52a None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:33.863872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:33.864494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:33.864788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:33.865068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:33.867033 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:33.879733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:33.881357 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:33.893386 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4447/8909] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:17:37.296972 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=32 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:43.887815 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=17 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:46.460238 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:46.463141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:46.465479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:46.528015 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:46.538236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:46.539645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:46.541374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c848ff-5e5d-49a0-a2c1-a3765f5a46e5 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:46.546590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:46.547233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:46.547507 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:46.547778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] PATH_INFO: `/v3/users/9dd42bfac29d4e39a6af2779d6e00c9a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:46.549251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd42bfac29d4e39a6af2779d6e00c9a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:46.551223 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:46.553062 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4463/8910] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:17:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:46.563965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:46.565642 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:46.586178 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af91c4-ba9a-434e-8f3b-f6ef0ed9397f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:46.591845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:46.592468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:46.592889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:46.593073 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:46.603047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:46.604792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:46.615801 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4464/8911] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:17:46.620069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd42bfac29d4e39a6af2779d6e00c9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:46.633722 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd42bfac29d4e39a6af2779d6e00c9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:46.649333 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd42bfac29d4e39a6af2779d6e00c9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:46.650046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd42bfac29d4e39a6af2779d6e00c9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:46.656996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-8c514e9b-3cb7-4ff1-b57f-a8e7a43ff656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd42bfac29d4e39a6af2779d6e00c9a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:46.663194 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4448/8912] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:17:46 2022] DELETE /identity/v3/users/9dd42bfac29d4e39a6af2779d6e00c9a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:17:46.848102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:46.862320 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593943dc-7dca-443d-8101-68f63e7c2e00 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:46.923515 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:46.924267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:46.924544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:46.924843 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] PATH_INFO: `/v3/projects/c2ee3a950b274e36b952100c954522f2` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:46.925974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ee3a950b274e36b952100c954522f2)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:46.927945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:46.978474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ee3a950b274e36b952100c954522f2', 'request_id': 'req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:46.987293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ee3a950b274e36b952100c954522f2', 'request_id': 'req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:46.993011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ee3a950b274e36b952100c954522f2', 'request_id': 'req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:47.005025 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] The token cache is being invalidate because project c2ee3a950b274e36b952100c954522f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:17:47.005307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:47.006070 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-4f3e8740-d3b1-4c1e-9c5b-69cb5030852f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:47.008014 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4465/8913] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:17:46 2022] DELETE /identity/v3/projects/c2ee3a950b274e36b952100c954522f2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:17:47.013153 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b75a-80d9-4e82-9cee-8dc48e209aba None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.013434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b75a-80d9-4e82-9cee-8dc48e209aba None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.013703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b75a-80d9-4e82-9cee-8dc48e209aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.035680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-fdd8b75a-80d9-4e82-9cee-8dc48e209aba None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:47.036938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fdd8b75a-80d9-4e82-9cee-8dc48e209aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:47.100122 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4449/8914] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:47.108141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65bf7-abcc-49b3-a927-33b01e07db6a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.108470 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65bf7-abcc-49b3-a927-33b01e07db6a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.108719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65bf7-abcc-49b3-a927-33b01e07db6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.129687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-90c65bf7-abcc-49b3-a927-33b01e07db6a None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:47.130918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-90c65bf7-abcc-49b3-a927-33b01e07db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:47.140033 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4466/8915] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:47.144693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b75a-80d9-4e82-9cee-8dc48e209aba None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:47.155377 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b75a-80d9-4e82-9cee-8dc48e209aba None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:47.160511 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:47.161163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.161441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.161741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.162397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:17:47.162704 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:47.164320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:47.176610 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4450/8916] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:17:47.180861 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c65bf7-abcc-49b3-a927-33b01e07db6a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:47.191041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c65bf7-abcc-49b3-a927-33b01e07db6a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:47.196586 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:47.197226 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.197528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.197795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.198417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:47.200319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:47.233959 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4467/8917] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:17:47 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:17:47.238834 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:47.249686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b31cf8-76ef-48a0-9a6d-393b837c3605 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:47.310199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:47.310830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.311110 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.311383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.312082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:47.314161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:47.322282 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:47.341205 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4451/8918] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:17:47 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:17:47.344385 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:47.356488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f2482-7e7f-4885-add1-d7d4d5639f01 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:47.362567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:47.363199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.363481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.363739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.364380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:47.366041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:47.377281 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4468/8919] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:17:47.382059 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:47.392963 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce95ac-252c-4681-90fb-0cd292087c0f admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:47.398128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff748194-3b2b-4db6-ba08-645671f4bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:47.398754 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748194-3b2b-4db6-ba08-645671f4bf55 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.399025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748194-3b2b-4db6-ba08-645671f4bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.399290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748194-3b2b-4db6-ba08-645671f4bf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.399910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff748194-3b2b-4db6-ba08-645671f4bf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:47.401562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff748194-3b2b-4db6-ba08-645671f4bf55 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:47.413956 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4452/8920] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:17:47.418310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:47.430365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8372-6d9f-4049-b780-de959710e1e6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:47.435258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:47.435929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.436225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.436500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] PATH_INFO: `/v3/projects/94e86c0698394b87be4db609bee242b4/users/332df5938622443c84236b9e2230cc58/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.439952 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:47.456522 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e86c0698394b87be4db609bee242b4, user_id=332df5938622443c84236b9e2230cc58, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:47.459791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:47.475203 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4469/8921] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:17:47 2022] PUT /identity/v3/projects/94e86c0698394b87be4db609bee242b4/users/332df5938622443c84236b9e2230cc58/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:17:47.486798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d057-98ca-4097-b1e5-25c5ad164299 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.487080 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d057-98ca-4097-b1e5-25c5ad164299 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.487354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d057-98ca-4097-b1e5-25c5ad164299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.524375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3fb9d057-98ca-4097-b1e5-25c5ad164299 None None] MFA Rules not processed for user `332df5938622443c84236b9e2230cc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:47.526290 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3fb9d057-98ca-4097-b1e5-25c5ad164299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:47.596880 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4453/8922] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:47.607548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:47.609343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:47.680045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e324c9-61b6-472e-bf57-98e6a3a449ef admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:47.684594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8f3a5-99ea-4595-90fc-9872fb6cb6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:47.685245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f3a5-99ea-4595-90fc-9872fb6cb6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:47.685525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f3a5-99ea-4595-90fc-9872fb6cb6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:47.685795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f3a5-99ea-4595-90fc-9872fb6cb6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:47.695261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8f3a5-99ea-4595-90fc-9872fb6cb6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:47.696710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8f3a5-99ea-4595-90fc-9872fb6cb6e9 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:47.706119 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4470/8923] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:17:57.593651 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:57.701797 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:59.352797 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9d057-98ca-4097-b1e5-25c5ad164299 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:59.423224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9d057-98ca-4097-b1e5-25c5ad164299 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:59.428078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:59.428716 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:59.429026 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:59.429300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] PATH_INFO: `/v3/users/332df5938622443c84236b9e2230cc58` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:59.430433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332df5938622443c84236b9e2230cc58)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:59.432389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:59.482824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332df5938622443c84236b9e2230cc58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:59.492803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332df5938622443c84236b9e2230cc58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:59.507164 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332df5938622443c84236b9e2230cc58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:59.507899 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332df5938622443c84236b9e2230cc58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:59.515587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332df5938622443c84236b9e2230cc58'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:59.522244 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4454/8924] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:17:59 2022] DELETE /identity/v3/users/332df5938622443c84236b9e2230cc58 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:17:59.526968 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:59.527443 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:59.527535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:59.548164 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:17:59.549416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:59.621545 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4471/8925] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:17:59.632573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:59.634332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:59.694632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63cb70-27d2-452f-8de1-c46c28df9c65 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:59.698976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e27731-6166-4d3c-8ae4-18ea4eaa3830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:59.699590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e27731-6166-4d3c-8ae4-18ea4eaa3830 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:59.699867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e27731-6166-4d3c-8ae4-18ea4eaa3830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:59.700138 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e27731-6166-4d3c-8ae4-18ea4eaa3830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:59.710275 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e27731-6166-4d3c-8ae4-18ea4eaa3830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:59.711708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e27731-6166-4d3c-8ae4-18ea4eaa3830 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:59.721555 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4455/8926] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:17:59.911217 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:17:59.912921 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:17:59.927803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6858d-9ac5-4f4a-ada6-86c9b1dfea2f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:17:59.933216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:17:59.933866 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:17:59.934148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:17:59.934421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] PATH_INFO: `/v3/projects/94e86c0698394b87be4db609bee242b4` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:17:59.935696 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e86c0698394b87be4db609bee242b4)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:17:59.937657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:17:59.987509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e86c0698394b87be4db609bee242b4', 'request_id': 'req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:17:59.995563 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e86c0698394b87be4db609bee242b4', 'request_id': 'req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:00.001340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e86c0698394b87be4db609bee242b4', 'request_id': 'req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:00.012509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] The token cache is being invalidate because project 94e86c0698394b87be4db609bee242b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:18:00.012845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:00.013533 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-9035e3e9-df97-44f2-ad59-bf4b5d0568cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:00.015152 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4472/8927] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:17:59 2022] DELETE /identity/v3/projects/94e86c0698394b87be4db609bee242b4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:18:00.020841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326258-b24d-4d12-a38c-7b13f4e42e33 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.021123 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326258-b24d-4d12-a38c-7b13f4e42e33 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.021393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326258-b24d-4d12-a38c-7b13f4e42e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.048927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-71326258-b24d-4d12-a38c-7b13f4e42e33 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:00.050200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-71326258-b24d-4d12-a38c-7b13f4e42e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:00.068821 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:00.123151 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4456/8928] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:00.131482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5fd9-3f53-4acc-804d-932e998ce131 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.131753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5fd9-3f53-4acc-804d-932e998ce131 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.132032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5fd9-3f53-4acc-804d-932e998ce131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.154219 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-975f5fd9-3f53-4acc-804d-932e998ce131 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:00.155450 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-975f5fd9-3f53-4acc-804d-932e998ce131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:00.163619 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4473/8929] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:00.167982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326258-b24d-4d12-a38c-7b13f4e42e33 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:00.178339 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326258-b24d-4d12-a38c-7b13f4e42e33 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:00.183034 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:00.183628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.183904 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.184172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.184796 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:18:00.185247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:00.186840 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:00.198974 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4457/8930] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:18:00.205179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f5fd9-3f53-4acc-804d-932e998ce131 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:00.215481 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f5fd9-3f53-4acc-804d-932e998ce131 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:00.221768 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:00.222596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.222875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.223149 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.223785 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:00.225733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:00.256406 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4474/8931] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:18:00 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:18:00.260631 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:00.272200 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92fc04-dd5c-422e-908b-d417d2939a00 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:00.338773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:00.339386 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.339664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.339937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.340570 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:00.342574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:00.369825 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4458/8932] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:18:00 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:18:00.374057 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:00.385509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0955-809f-4e18-9408-a73aae911f3e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:00.391416 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:00.392255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.392588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.392908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.393558 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:00.395201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:00.406313 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4475/8933] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 02:18:00.410624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:00.420977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cf799-94aa-41dc-898f-4181caa197ae admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:00.426334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa0520-9eaa-4699-9aed-fc5269e1ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:00.426944 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0520-9eaa-4699-9aed-fc5269e1ce48 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.427225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0520-9eaa-4699-9aed-fc5269e1ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.427496 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0520-9eaa-4699-9aed-fc5269e1ce48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.428131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa0520-9eaa-4699-9aed-fc5269e1ce48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:00.429850 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa0520-9eaa-4699-9aed-fc5269e1ce48 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:00.440882 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4459/8934] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:18:00.445138 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:00.455421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba67dff-2ccb-469c-b623-b7fc86dfcb53 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:00.460357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:00.461051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.461326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.461594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] PATH_INFO: `/v3/projects/1cac89e318194129beea18aa00c98cab/users/ba4489b8284545b8a27026b8aeb0cd41/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.476435 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cac89e318194129beea18aa00c98cab, user_id=ba4489b8284545b8a27026b8aeb0cd41, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:00.479111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:00.494056 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4476/8935] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:18:00 2022] PUT /identity/v3/projects/1cac89e318194129beea18aa00c98cab/users/ba4489b8284545b8a27026b8aeb0cd41/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:18:00.504630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e668fb-19f7-412e-9f9f-68ab4fe34160 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.504942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e668fb-19f7-412e-9f9f-68ab4fe34160 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.505212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e668fb-19f7-412e-9f9f-68ab4fe34160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.535563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-76e668fb-19f7-412e-9f9f-68ab4fe34160 None None] MFA Rules not processed for user `ba4489b8284545b8a27026b8aeb0cd41`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:00.536810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-76e668fb-19f7-412e-9f9f-68ab4fe34160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:00.612672 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4460/8936] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:00.625184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:00.627279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:00.660816 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:00.702682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992c70-0c61-45fd-92ac-5e89e24cb9e6 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:00.707760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd0737-96c3-4188-8087-3d75ba9203e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:00.708373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd0737-96c3-4188-8087-3d75ba9203e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:00.708661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd0737-96c3-4188-8087-3d75ba9203e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:00.708998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd0737-96c3-4188-8087-3d75ba9203e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:00.717967 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd0737-96c3-4188-8087-3d75ba9203e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:00.719405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd0737-96c3-4188-8087-3d75ba9203e6 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:00.728807 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4477/8937] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:18:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:18:05.188832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e668fb-19f7-412e-9f9f-68ab4fe34160 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:05.213131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:05.259102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e668fb-19f7-412e-9f9f-68ab4fe34160 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:05.264952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:05.265613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:05.265930 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:05.266222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] PATH_INFO: `/v3/users/ba4489b8284545b8a27026b8aeb0cd41` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:05.267699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4489b8284545b8a27026b8aeb0cd41)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:05.269699 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:05.323172 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4489b8284545b8a27026b8aeb0cd41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.331932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4489b8284545b8a27026b8aeb0cd41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.345528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4489b8284545b8a27026b8aeb0cd41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.346221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4489b8284545b8a27026b8aeb0cd41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.353326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4489b8284545b8a27026b8aeb0cd41'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.359740 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4461/8938] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:18:05 2022] DELETE /identity/v3/users/ba4489b8284545b8a27026b8aeb0cd41 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:18:05.364568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:05.365115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:05.365210 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:05.385429 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:05.386621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:05.447980 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4478/8939] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:05.460157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:05.462482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:05.529550 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358bf77-a22b-4838-a295-0f05162b3d2e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:05.533813 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c151-150f-4097-97b7-8045cfa172ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:05.534421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c151-150f-4097-97b7-8045cfa172ee service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:05.534694 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c151-150f-4097-97b7-8045cfa172ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:05.534961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c151-150f-4097-97b7-8045cfa172ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:05.544236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c151-150f-4097-97b7-8045cfa172ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:05.545693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c151-150f-4097-97b7-8045cfa172ee service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:05.555683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4462/8940] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:18:05.732733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:05.734637 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:05.747975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2259-80a4-403d-b865-7cdffa5a2a12 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:05.753949 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:05.754659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:05.755422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:05.755422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] PATH_INFO: `/v3/projects/1cac89e318194129beea18aa00c98cab` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:05.756397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cac89e318194129beea18aa00c98cab)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:05.758365 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:05.809839 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cac89e318194129beea18aa00c98cab', 'request_id': 'req-ade9c121-656f-4d14-a796-aa010571288c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.818903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cac89e318194129beea18aa00c98cab', 'request_id': 'req-ade9c121-656f-4d14-a796-aa010571288c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.824459 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cac89e318194129beea18aa00c98cab', 'request_id': 'req-ade9c121-656f-4d14-a796-aa010571288c'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.835510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] The token cache is being invalidate because project 1cac89e318194129beea18aa00c98cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:18:05.835789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.836419 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-ade9c121-656f-4d14-a796-aa010571288c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:18:05.837951 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4479/8941] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:18:05 2022] DELETE /identity/v3/projects/1cac89e318194129beea18aa00c98cab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:18:05.843216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6aa66-f3cb-448a-b15b-ad4b3a6ffa33 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:05.843504 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6aa66-f3cb-448a-b15b-ad4b3a6ffa33 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:05.843780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6aa66-f3cb-448a-b15b-ad4b3a6ffa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:05.864582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-12a6aa66-f3cb-448a-b15b-ad4b3a6ffa33 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:05.865846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-12a6aa66-f3cb-448a-b15b-ad4b3a6ffa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:05.907154 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:05.939143 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4463/8942] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:18:05.947413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69fe1-db2f-47e8-a372-8c751f81ff5d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:05.947697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69fe1-db2f-47e8-a372-8c751f81ff5d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:05.947975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69fe1-db2f-47e8-a372-8c751f81ff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:05.969343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-70c69fe1-db2f-47e8-a372-8c751f81ff5d None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:05.970682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-70c69fe1-db2f-47e8-a372-8c751f81ff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:05.979831 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4480/8943] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:05.984175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6aa66-f3cb-448a-b15b-ad4b3a6ffa33 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:05.994773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6aa66-f3cb-448a-b15b-ad4b3a6ffa33 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:06.000334 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:06.000994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.001360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.001767 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.002259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:18:06.002558 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:06.004171 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:06.016229 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4464/8944] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:18:06.020896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c69fe1-db2f-47e8-a372-8c751f81ff5d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:06.030688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c69fe1-db2f-47e8-a372-8c751f81ff5d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:06.035720 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:06.036324 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.036600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.036966 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.037531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:06.039432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:06.072668 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4481/8945] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:18:06 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:18:06.079236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:06.091738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990366a-84b1-43dc-a725-2c51b1e4bf2a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:06.155252 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:06.155821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.156094 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.156361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.157040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:06.159247 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:06.182769 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4465/8946] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:18:06 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:18:06.187083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:06.197978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04c96-e9bb-4132-9536-e2205fe7edb8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:06.202771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:06.203377 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.203654 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.203923 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.204633 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:06.206275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:06.216791 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4482/8947] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:18:06.221012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:06.235178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb415bd0-8548-4fa8-af56-33d6b18306c3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:06.240120 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71962-e412-4f6e-b51e-d1a5d2e9808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:06.240724 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71962-e412-4f6e-b51e-d1a5d2e9808b admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.241025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71962-e412-4f6e-b51e-d1a5d2e9808b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.241278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71962-e412-4f6e-b51e-d1a5d2e9808b admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.241919 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71962-e412-4f6e-b51e-d1a5d2e9808b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:06.243514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71962-e412-4f6e-b51e-d1a5d2e9808b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:06.255196 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4466/8948] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:18:06.259591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:06.273029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4522b1-17d8-4cdb-8bec-880caa97003b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:06.277767 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:06.278433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.278714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.278986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] PATH_INFO: `/v3/projects/a41e2267dc9c45c6b6c24f3c9102662e/users/25a1b2f053d9484990f839272109fdca/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.281384 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:06.297980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41e2267dc9c45c6b6c24f3c9102662e, user_id=25a1b2f053d9484990f839272109fdca, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:06.300864 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:06.319950 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4483/8949] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:18:06 2022] PUT /identity/v3/projects/a41e2267dc9c45c6b6c24f3c9102662e/users/25a1b2f053d9484990f839272109fdca/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:18:06.325376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.325658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.325931 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.345324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:06.346555 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:06.410059 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4467/8950] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:06.420139 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:06.422084 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:06.482339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7f2a2-e089-439b-b719-6d1ac267eaeb admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:06.487287 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd686f4-a5a9-4fb2-9b87-a71266459ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:06.487905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd686f4-a5a9-4fb2-9b87-a71266459ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:06.488188 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd686f4-a5a9-4fb2-9b87-a71266459ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:06.488460 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd686f4-a5a9-4fb2-9b87-a71266459ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:06.499096 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd686f4-a5a9-4fb2-9b87-a71266459ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:06.500541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd686f4-a5a9-4fb2-9b87-a71266459ec4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:06.511247 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4484/8951] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:18:07.259526 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:07.262181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:07.322612 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:07.351730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c519fc-8585-421e-8b1e-b9835c9b5ab3 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:07.359695 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:07.360729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:07.360729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:07.361360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:07.363892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:07.378168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:07.379817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:07.397021 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4468/8952] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:18:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:18:10.721840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1973c-e97b-4d1b-ace7-5b140f02c073 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:10.723092 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1973c-e97b-4d1b-ace7-5b140f02c073 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:10.723469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1973c-e97b-4d1b-ace7-5b140f02c073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:10.756844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e4b1973c-e97b-4d1b-ace7-5b140f02c073 None None] MFA Rules not processed for user `25a1b2f053d9484990f839272109fdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:10.758880 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e4b1973c-e97b-4d1b-ace7-5b140f02c073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:10.835793 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4485/8953] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:10.840672 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:10.852022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e441-491f-4524-a999-e6a2d5b7f1f0 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:10.856610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:10.857245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:10.857523 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:10.857805 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:10.858430 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:10.860424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:10.893222 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4469/8954] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:18:10 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:18:10.897441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1973c-e97b-4d1b-ace7-5b140f02c073 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:10.910755 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1973c-e97b-4d1b-ace7-5b140f02c073 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:10.969373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:10.970218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:10.970544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:10.970811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:10.971440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:10.973473 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:10.996315 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4486/8955] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:18:10 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:18:11.000485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:11.011536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a149b3-ac8f-45d9-93ac-0db8f35bb3dc admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:11.016715 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:11.017419 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:11.017761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:11.018127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:11.018838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:11.020588 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:11.032014 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4470/8956] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:18:11.036735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:11.043818 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:11.048680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a80bab-ef3f-4b14-afdc-245e981d3a91 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:11.055713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:11.056387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:11.056666 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:11.056970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] PATH_INFO: `/v3/projects/21e1eba5a69541faab6b2a79fad5391b/users/ff36835fc0fa4c0288d8e31ed767f051/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:11.073647 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e1eba5a69541faab6b2a79fad5391b, user_id=ff36835fc0fa4c0288d8e31ed767f051, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:11.076356 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:11.091716 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4487/8957] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:18:11 2022] PUT /identity/v3/projects/21e1eba5a69541faab6b2a79fad5391b/users/ff36835fc0fa4c0288d8e31ed767f051/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:18:11.096070 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:11.106857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38dc688-5809-4051-ae95-739241aca80e admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:11.171663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6750b8-0d27-4e34-8410-5bf3dcc84d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:11.172280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6750b8-0d27-4e34-8410-5bf3dcc84d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:11.172557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6750b8-0d27-4e34-8410-5bf3dcc84d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:11.172927 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6750b8-0d27-4e34-8410-5bf3dcc84d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:11.173729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6750b8-0d27-4e34-8410-5bf3dcc84d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:11.175341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6750b8-0d27-4e34-8410-5bf3dcc84d4e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:11.185718 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4471/8958] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:18:11.190007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:11.200856 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2118c-b5c4-4b1f-aa65-236227689ccf admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:11.205926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:11.206626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:11.206934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:11.207351 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] PATH_INFO: `/v3/projects/21e1eba5a69541faab6b2a79fad5391b/users/ff36835fc0fa4c0288d8e31ed767f051/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:11.209312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e1eba5a69541faab6b2a79fad5391b, user_id=ff36835fc0fa4c0288d8e31ed767f051, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:11.211916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:11.222976 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4488/8959] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:18:11 2022] PUT /identity/v3/projects/21e1eba5a69541faab6b2a79fad5391b/users/ff36835fc0fa4c0288d8e31ed767f051/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:18:15.876736 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405dfb3-56b2-4a78-9b7a-41a34a3ece38 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:15.877284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405dfb3-56b2-4a78-9b7a-41a34a3ece38 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:15.877284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405dfb3-56b2-4a78-9b7a-41a34a3ece38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:15.912475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-9405dfb3-56b2-4a78-9b7a-41a34a3ece38 None None] MFA Rules not processed for user `ff36835fc0fa4c0288d8e31ed767f051`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:15.913867 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9405dfb3-56b2-4a78-9b7a-41a34a3ece38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:15.996940 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4472/8960] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:16.011372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:16.014135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:16.095794 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd152-fbfb-4ca8-91bd-b4e9ceea6201 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:16.101816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:16.102456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:16.102736 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:16.103007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:16.167211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:16.168857 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:16.180963 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4489/8961] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:18:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:18:17.268711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:17.269405 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:17.269561 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:17.290785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] MFA Rules not processed for user `25a1b2f053d9484990f839272109fdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:17.292012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:17.300093 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4473/8962] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:18:26.173989 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:27.285424 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:30.114669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:30.116628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:30.185389 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361c4b-042e-4b56-88da-1fcdda1e5b24 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:30.189301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db453ae-8d28-4320-9271-c253348a37d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9c0901260e44a789d750c2032bfbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:30.189961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db453ae-8d28-4320-9271-c253348a37d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:30.190236 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db453ae-8d28-4320-9271-c253348a37d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:30.190507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db453ae-8d28-4320-9271-c253348a37d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:30.200545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db453ae-8d28-4320-9271-c253348a37d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:30.202029 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db453ae-8d28-4320-9271-c253348a37d0 service cinder] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:30.214110 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4490/8963] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:18:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:18:32.608441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:18:32.610572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:32.691637 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02d4d1-28f9-4759-a3dc-30fe4d542859 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:18:32.697294 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee67946-a9ac-45f4-ad2d-a022ec8ba57c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:18:32.697961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee67946-a9ac-45f4-ad2d-a022ec8ba57c service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:32.698240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee67946-a9ac-45f4-ad2d-a022ec8ba57c service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:32.698513 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee67946-a9ac-45f4-ad2d-a022ec8ba57c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:32.700292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-aee67946-a9ac-45f4-ad2d-a022ec8ba57c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:32.712281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee67946-a9ac-45f4-ad2d-a022ec8ba57c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:18:32.713896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee67946-a9ac-45f4-ad2d-a022ec8ba57c service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:18:32.724088 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4474/8964] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:18:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:18:40.207480 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=26 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:42.719800 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=32 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:56.999478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168c5f-389d-446a-93d5-ed2260c9f268 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:18:57.000005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168c5f-389d-446a-93d5-ed2260c9f268 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:18:57.000005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168c5f-389d-446a-93d5-ed2260c9f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:18:57.021269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1b168c5f-389d-446a-93d5-ed2260c9f268 None None] MFA Rules not processed for user `25a1b2f053d9484990f839272109fdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:18:57.022597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1b168c5f-389d-446a-93d5-ed2260c9f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:18:57.030564 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4491/8965] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:18:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:19:07.014831 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:36.407284 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9b9a-365f-4578-9581-c6e6dda4789c None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:19:36.407893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9b9a-365f-4578-9581-c6e6dda4789c None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:19:36.407893 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9b9a-365f-4578-9581-c6e6dda4789c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:19:36.427492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-8c2a9b9a-365f-4578-9581-c6e6dda4789c None None] MFA Rules not processed for user `25a1b2f053d9484990f839272109fdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:19:36.428692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8c2a9b9a-365f-4578-9581-c6e6dda4789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:19:36.436120 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4475/8966] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:19:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:19:36.712659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168c5f-389d-446a-93d5-ed2260c9f268 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:19:36.769494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168c5f-389d-446a-93d5-ed2260c9f268 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:19:36.773735 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:19:36.774343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:19:36.774619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:19:36.774879 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:19:36.776911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:19:36.792003 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:19:36.794119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:19:36.803542 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4492/8967] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:19:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:19:37.168678 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a9b9a-365f-4578-9581-c6e6dda4789c None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:19:37.181245 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a9b9a-365f-4578-9581-c6e6dda4789c None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:19:37.186184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:19:37.186792 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:19:37.187061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:19:37.187324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:19:37.189019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:19:37.201400 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:19:37.203022 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:19:37.213338 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4476/8968] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:19:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:19:46.800128 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=26 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:47.209385 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:20.987592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:21.064928 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08776-272d-4251-9caf-cd9f8e95cb34 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:21.070472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:21.071118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:21.071392 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:21.071661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] PATH_INFO: `/v3/users/25a1b2f053d9484990f839272109fdca` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:21.073140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a1b2f053d9484990f839272109fdca)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:21.075503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:21.143669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a1b2f053d9484990f839272109fdca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.159467 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a1b2f053d9484990f839272109fdca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.160810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a1b2f053d9484990f839272109fdca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.175562 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a1b2f053d9484990f839272109fdca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.177123 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a1b2f053d9484990f839272109fdca'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.207450 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4493/8969] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:20:20 2022] DELETE /identity/v3/users/25a1b2f053d9484990f839272109fdca => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:20:21.414659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:21.426397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c474-6dcd-4c5f-ad9c-c187dca9742f service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:21.487520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:21.488194 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:21.488474 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:21.488748 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] PATH_INFO: `/v3/projects/a41e2267dc9c45c6b6c24f3c9102662e` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:21.489952 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41e2267dc9c45c6b6c24f3c9102662e)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:21.491906 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:21.539429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41e2267dc9c45c6b6c24f3c9102662e', 'request_id': 'req-c1161edf-e556-425d-a54a-8790ff34bee9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.545854 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41e2267dc9c45c6b6c24f3c9102662e', 'request_id': 'req-c1161edf-e556-425d-a54a-8790ff34bee9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.552529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41e2267dc9c45c6b6c24f3c9102662e', 'request_id': 'req-c1161edf-e556-425d-a54a-8790ff34bee9'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.567689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] The token cache is being invalidate because project a41e2267dc9c45c6b6c24f3c9102662e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:20:21.567976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.568653 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.570246 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4477/8970] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:20:21 2022] DELETE /identity/v3/projects/a41e2267dc9c45c6b6c24f3c9102662e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:20:21.574550 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:21.575917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:21.589989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aba1e9-58f1-4d00-99e9-35041e5d4ca4 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:21.651703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:21.652344 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:21.652618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:21.652918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] PATH_INFO: `/v3/users/ff36835fc0fa4c0288d8e31ed767f051` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:21.654068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff36835fc0fa4c0288d8e31ed767f051)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:21.655986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:21.682280 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:21.720592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff36835fc0fa4c0288d8e31ed767f051'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.730693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff36835fc0fa4c0288d8e31ed767f051'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.731328 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff36835fc0fa4c0288d8e31ed767f051'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.739545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff36835fc0fa4c0288d8e31ed767f051'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.740258 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-e11f19d3-de26-4761-b127-11f468d106e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff36835fc0fa4c0288d8e31ed767f051'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:21.760205 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4494/8971] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:20:21 2022] DELETE /identity/v3/users/ff36835fc0fa4c0288d8e31ed767f051 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:20:21.960065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:21.961744 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:21.990383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161edf-e556-425d-a54a-8790ff34bee9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.051975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.052636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.052943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.053216 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] PATH_INFO: `/v3/projects/21e1eba5a69541faab6b2a79fad5391b` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.054480 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e1eba5a69541faab6b2a79fad5391b)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.056478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.096839 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:22.117700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e1eba5a69541faab6b2a79fad5391b', 'request_id': 'req-695be402-3605-4f0c-9ad4-e47260ebdc5b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:22.127728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e1eba5a69541faab6b2a79fad5391b', 'request_id': 'req-695be402-3605-4f0c-9ad4-e47260ebdc5b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:22.135224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e1eba5a69541faab6b2a79fad5391b', 'request_id': 'req-695be402-3605-4f0c-9ad4-e47260ebdc5b'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:22.151557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] The token cache is being invalidate because project 21e1eba5a69541faab6b2a79fad5391b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:20:22.151847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:22.152528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-695be402-3605-4f0c-9ad4-e47260ebdc5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:20:22.154092 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4478/8972] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:20:21 2022] DELETE /identity/v3/projects/21e1eba5a69541faab6b2a79fad5391b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:20:22.159743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7665-5f92-4060-bab6-5f0de65b1c24 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.160216 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7665-5f92-4060-bab6-5f0de65b1c24 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.160305 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7665-5f92-4060-bab6-5f0de65b1c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.183568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-180d7665-5f92-4060-bab6-5f0de65b1c24 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:22.185792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-180d7665-5f92-4060-bab6-5f0de65b1c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:22.254912 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4495/8973] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:22.262905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afbeb1-0b9e-4eb5-a677-f8b7a5705c91 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.263212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afbeb1-0b9e-4eb5-a677-f8b7a5705c91 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.263489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afbeb1-0b9e-4eb5-a677-f8b7a5705c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.284255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-14afbeb1-0b9e-4eb5-a677-f8b7a5705c91 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:22.285832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-14afbeb1-0b9e-4eb5-a677-f8b7a5705c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:22.295295 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4479/8974] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:22.299712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7665-5f92-4060-bab6-5f0de65b1c24 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:22.310600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7665-5f92-4060-bab6-5f0de65b1c24 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.315511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.316136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.316409 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.316681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.317395 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:20:22.317695 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.319314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.331744 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4496/8975] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:20:22.336268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afbeb1-0b9e-4eb5-a677-f8b7a5705c91 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:22.347236 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afbeb1-0b9e-4eb5-a677-f8b7a5705c91 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.352215 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.352851 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.353127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.353391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.354016 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.356005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.388605 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4480/8976] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:20:22 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:20:22.392911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:22.404919 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca821e9-5699-4c88-ba17-dff7b282ee8f admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.463479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.464104 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.464381 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.464653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.465327 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.467248 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.491319 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4497/8977] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:20:22 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:20:22.495630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:22.506990 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5e68f-3f2f-475b-8dfb-816dc2243d72 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.512666 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.513305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.513581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.513846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.514482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.516095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.527060 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4481/8978] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 02:20:22.531239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:22.541908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7524-fb36-4860-821f-4be195122342 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.546863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c75ec-13f0-43e8-be9d-7d0f968b50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.547451 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c75ec-13f0-43e8-be9d-7d0f968b50df admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.547771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c75ec-13f0-43e8-be9d-7d0f968b50df admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.548037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c75ec-13f0-43e8-be9d-7d0f968b50df admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.548796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c75ec-13f0-43e8-be9d-7d0f968b50df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.550507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c75ec-13f0-43e8-be9d-7d0f968b50df admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.561466 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4498/8979] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:20:22.565728 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:22.576801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769119b7-f7f6-4547-96c6-cca628830713 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.583259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.583939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.584213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.584485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] PATH_INFO: `/v3/projects/32f5be9d42ac40b1a916f2c09324d761/users/9a95ca48487c4d469371ce0755e04aed/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.600166 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f5be9d42ac40b1a916f2c09324d761, user_id=9a95ca48487c4d469371ce0755e04aed, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.602881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.618044 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4482/8980] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:20:22 2022] PUT /identity/v3/projects/32f5be9d42ac40b1a916f2c09324d761/users/9a95ca48487c4d469371ce0755e04aed/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:20:22.623379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcf6d-c5da-4f12-8ea8-4edb79117718 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.623732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcf6d-c5da-4f12-8ea8-4edb79117718 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.623926 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcf6d-c5da-4f12-8ea8-4edb79117718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.632422 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:22.646326 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-afadcf6d-c5da-4f12-8ea8-4edb79117718 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:22.648373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-afadcf6d-c5da-4f12-8ea8-4edb79117718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:22.717355 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4499/8981] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:22.730875 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:22.733084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:22.797490 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62a515-214b-4f52-ad97-a7e0bf051c06 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:22.802498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:22.803104 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:22.803375 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:22.803639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:22.813863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:22.815476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:22.826295 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4483/8982] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:20:27.316738 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a27a-5318-41db-93a4-d557a5ad1b3c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:27.317304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a27a-5318-41db-93a4-d557a5ad1b3c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:27.317951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a27a-5318-41db-93a4-d557a5ad1b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:27.349888 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-b096a27a-5318-41db-93a4-d557a5ad1b3c None None] MFA Rules not processed for user `9a95ca48487c4d469371ce0755e04aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:27.351081 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b096a27a-5318-41db-93a4-d557a5ad1b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:27.420970 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4500/8983] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:20:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:27.425646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:27.438473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276e705-0dd5-4fcb-b1e9-e2a37c76e27b service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:27.443778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:27.444396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:27.444674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:27.444985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:27.445615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:27.447596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:27.479262 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4484/8984] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:20:27 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:20:27.484396 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a27a-5318-41db-93a4-d557a5ad1b3c None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:27.496072 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a27a-5318-41db-93a4-d557a5ad1b3c None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:27.561832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:27.562358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:27.562659 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:27.562930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:27.563624 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:27.565581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:27.591308 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4501/8985] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:20:27 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:20:27.595770 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:27.606761 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc7e0e-608c-49fe-b504-f057f02b9181 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:27.612594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:27.613229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:27.613508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:27.613777 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:27.614421 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:27.616119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:27.627363 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4485/8986] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:20:27.632805 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:27.645820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6e00c-ac5b-47bf-a733-a127fafd6110 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:27.650809 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:27.651551 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:27.651895 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:27.652166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] PATH_INFO: `/v3/projects/51bd1d1980bb4df69e00d29da9552465/users/d5dd19846a4b471884e105bf8a66684a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:27.673796 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bd1d1980bb4df69e00d29da9552465, user_id=d5dd19846a4b471884e105bf8a66684a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:27.676600 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:27.690237 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:27.696043 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4502/8987] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:20:27 2022] PUT /identity/v3/projects/51bd1d1980bb4df69e00d29da9552465/users/d5dd19846a4b471884e105bf8a66684a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:20:27.700965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:27.712658 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763334c-e40f-455b-a51b-f314bfb466e7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:27.742520 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:27.786127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f651d2b-a043-41bf-b1da-199b2bafea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:27.786750 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651d2b-a043-41bf-b1da-199b2bafea5e admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:27.787028 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651d2b-a043-41bf-b1da-199b2bafea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:27.787300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651d2b-a043-41bf-b1da-199b2bafea5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:27.787978 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f651d2b-a043-41bf-b1da-199b2bafea5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:27.789697 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f651d2b-a043-41bf-b1da-199b2bafea5e admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:27.801126 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4486/8988] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 02:20:27.805713 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:27.817227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ac348-22ac-4618-a5e1-24fe3bcc8083 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:27.822954 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b5f23-4f94-495e-aba1-4b930a3f4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:27.823788 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5f23-4f94-495e-aba1-4b930a3f4daf admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:27.824068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5f23-4f94-495e-aba1-4b930a3f4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:27.824339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5f23-4f94-495e-aba1-4b930a3f4daf admin admin] PATH_INFO: `/v3/projects/51bd1d1980bb4df69e00d29da9552465/users/d5dd19846a4b471884e105bf8a66684a/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:27.826611 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b5f23-4f94-495e-aba1-4b930a3f4daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bd1d1980bb4df69e00d29da9552465, user_id=d5dd19846a4b471884e105bf8a66684a, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:27.829615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b5f23-4f94-495e-aba1-4b930a3f4daf admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:27.842669 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4503/8989] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:20:27 2022] PUT /identity/v3/projects/51bd1d1980bb4df69e00d29da9552465/users/d5dd19846a4b471884e105bf8a66684a/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:20:32.085610 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56f71f-8e3c-430f-a08b-d2d1fa3879bc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:32.086091 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56f71f-8e3c-430f-a08b-d2d1fa3879bc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:32.086206 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56f71f-8e3c-430f-a08b-d2d1fa3879bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:32.171376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-2d56f71f-8e3c-430f-a08b-d2d1fa3879bc None None] MFA Rules not processed for user `d5dd19846a4b471884e105bf8a66684a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:32.172709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2d56f71f-8e3c-430f-a08b-d2d1fa3879bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:32.252667 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4487/8990] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:20:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:32.287627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f89f0-2209-4c8f-a762-3887ba4028c9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:32.288187 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f89f0-2209-4c8f-a762-3887ba4028c9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:32.288284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f89f0-2209-4c8f-a762-3887ba4028c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:32.382683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ec4f89f0-2209-4c8f-a762-3887ba4028c9 None None] MFA Rules not processed for user `9fff798abd7e4970977c2465aaed01b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:32.384002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ec4f89f0-2209-4c8f-a762-3887ba4028c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:32.451642 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4504/8991] 10.222.0.46 () {58 vars in 1064 bytes} [Sun Aug 21 02:20:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:32.458314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56f71f-8e3c-430f-a08b-d2d1fa3879bc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:32.468955 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56f71f-8e3c-430f-a08b-d2d1fa3879bc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:32.473119 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:32.473806 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:32.474146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:32.474482 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:32.541282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:32.543027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:32.554535 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4488/8992] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:20:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:20:32.724850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2873-ee6e-41ba-b314-2b5b0bac5f50 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:32.725227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2873-ee6e-41ba-b314-2b5b0bac5f50 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:32.725568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2873-ee6e-41ba-b314-2b5b0bac5f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:32.793569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-76cb2873-ee6e-41ba-b314-2b5b0bac5f50 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:32.794817 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-76cb2873-ee6e-41ba-b314-2b5b0bac5f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:32.880929 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4505/8993] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:20:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:32.937011 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:32.938922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:32.996032 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=100 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:33.040500 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291e10c-a649-4b11-874d-ff7b874c870e service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:33.045988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:33.046608 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:33.046886 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:33.047158 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:33.056161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:33.057779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:33.066583 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4489/8994] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:20:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:20:41.792753 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:41.793359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:41.793359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:41.814544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] MFA Rules not processed for user `9a95ca48487c4d469371ce0755e04aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:41.815821 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:41.824178 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4506/8995] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:20:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:41.871602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:41.885541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33904ae-f562-4458-b3a6-9f5d1ed7a9ce service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:41.890573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a927-0afa-4d83-9e70-96fe8df46085 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:41.891315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a927-0afa-4d83-9e70-96fe8df46085 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:41.891596 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a927-0afa-4d83-9e70-96fe8df46085 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:41.891941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a927-0afa-4d83-9e70-96fe8df46085 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:41.894429 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c953a927-0afa-4d83-9e70-96fe8df46085 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:41.970231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953a927-0afa-4d83-9e70-96fe8df46085 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:41.971615 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953a927-0afa-4d83-9e70-96fe8df46085 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:41.983770 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4490/8996] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:20:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:20:42.580990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:42.582956 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:42.617841 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:42.648671 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e298c7c-dcff-4a14-90af-afc20a079bd5 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:42.652452 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:42.653102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:42.653378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:42.653649 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:42.655433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:42.669931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:42.671407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:42.682837 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4507/8997] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:20:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:20:43.905345 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cbdc-9e7d-4e6d-828a-e3ca8b3bc895 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:43.905857 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cbdc-9e7d-4e6d-828a-e3ca8b3bc895 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:43.905943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cbdc-9e7d-4e6d-828a-e3ca8b3bc895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:43.925494 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1ba7cbdc-9e7d-4e6d-828a-e3ca8b3bc895 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:20:43.926701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1ba7cbdc-9e7d-4e6d-828a-e3ca8b3bc895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:43.934585 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4491/8998] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:20:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:20:43.947420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:43.959160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d7ede-a669-4aa1-8d49-8877a2aa9585 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:43.964548 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:43.965208 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:43.965484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:43.965751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:43.974263 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:43.975852 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:43.984536 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4508/8999] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:20:53.919909 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=57 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:53.981466 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=19 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:55.536227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cbdc-9e7d-4e6d-828a-e3ca8b3bc895 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:20:55.546106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cbdc-9e7d-4e6d-828a-e3ca8b3bc895 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:20:55.550549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:20:55.551167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:20:55.551477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:20:55.551731 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:20:55.553885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:20:55.564732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:20:55.566199 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:20:55.574306 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4492/9000] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:20:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:21:05.570779 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:21:20.928592 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:21:20.939482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023071d1-9385-4ffc-9d5c-9d9138c5014d service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:21:20.944340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:21:20.944989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:21:20.945268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:21:20.945535 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:21:20.960733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:21:20.963135 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:21:20.974323 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4509/9001] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:21:22.967383 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:21:22.969892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:21:23.002525 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3365-4499-4d78-a66f-795d089425f7 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:21:23.008622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:21:23.009341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:21:23.009685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:21:23.010046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:21:23.012069 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:21:23.028581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:21:23.030376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:21:23.043124 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4493/9002] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:21:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:21:30.969839 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:21:33.038555 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:23:10.324983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:23:10.326605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:23:10.417930 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afa32-bfbf-4fca-b95c-64e1b8f39c33 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:23:10.423916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:23:10.424820 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:23:10.425111 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:23:10.425386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:23:10.427214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:23:10.446007 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:23:10.448158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:23:10.464666 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4510/9003] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:23:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:23:20.459260 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=36 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:23:39.616836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:23:39.618876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:23:39.637111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ac581-5782-4d0b-96ac-ae1ef5637915 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:23:39.643962 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77d586-3a15-4040-a8e1-fa8f4c68b5c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:23:39.644563 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77d586-3a15-4040-a8e1-fa8f4c68b5c6 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:23:39.644874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77d586-3a15-4040-a8e1-fa8f4c68b5c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:23:39.645147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77d586-3a15-4040-a8e1-fa8f4c68b5c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:23:39.647068 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0c77d586-3a15-4040-a8e1-fa8f4c68b5c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:23:39.658773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77d586-3a15-4040-a8e1-fa8f4c68b5c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:23:39.660573 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77d586-3a15-4040-a8e1-fa8f4c68b5c6 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:23:39.671118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4494/9004] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:23:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:23:49.666942 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:11.152340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:11.155159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:11.178197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5701f74-f2ab-4bdf-8aa0-e235b5798d25 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:11.185124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:11.186182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:11.186725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:11.187239 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:11.189643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:11.208569 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:11.210022 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:11.221635 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4511/9005] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:25:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:25:21.216638 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:24.964742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede59ce-1f00-48c9-b214-9c16add15cf9 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:24.965240 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede59ce-1f00-48c9-b214-9c16add15cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:24.965331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede59ce-1f00-48c9-b214-9c16add15cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:24.985932 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-1ede59ce-1f00-48c9-b214-9c16add15cf9 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:25:24.987146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1ede59ce-1f00-48c9-b214-9c16add15cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:24.996406 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4495/9006] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 02:25:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:25:25.042017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:25.058476 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965b03-2878-42c6-8d78-d2184d48c43b service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:25.067374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:25.067983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:25.068259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:25.068529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:25.078776 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:25.080462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:25.089747 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4512/9007] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:25:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:25:25.605976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c1322-07dc-4594-a456-491c4c88c295 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:25.606261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c1322-07dc-4594-a456-491c4c88c295 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:25.606541 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c1322-07dc-4594-a456-491c4c88c295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:25.627332 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7a7c1322-07dc-4594-a456-491c4c88c295 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:25:25.628591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7a7c1322-07dc-4594-a456-491c4c88c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:25.637408 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4496/9008] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:25:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:25:25.650892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:25.662379 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6911a-b941-441f-b1cc-493c9c8fe37c service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:25.668009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d301d8-96aa-47d9-94fb-e628cfbb37cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:25.668632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d301d8-96aa-47d9-94fb-e628cfbb37cc service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:25.668932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d301d8-96aa-47d9-94fb-e628cfbb37cc service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:25.669201 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d301d8-96aa-47d9-94fb-e628cfbb37cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:25.678479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d301d8-96aa-47d9-94fb-e628cfbb37cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:25.680102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d301d8-96aa-47d9-94fb-e628cfbb37cc service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:25.688680 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4513/9009] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:25:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 02:25:34.030845 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c1322-07dc-4594-a456-491c4c88c295 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:34.045591 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c1322-07dc-4594-a456-491c4c88c295 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:34.052564 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:34.053211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:34.053492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:34.053831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:34.061909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:34.063495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:34.073469 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4497/9010] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:25:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:25:34.147375 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab687e4-22fb-4a61-8b5c-8ed2d0ffe8a2 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:34.147882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab687e4-22fb-4a61-8b5c-8ed2d0ffe8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:34.148102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab687e4-22fb-4a61-8b5c-8ed2d0ffe8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:34.167739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-1ab687e4-22fb-4a61-8b5c-8ed2d0ffe8a2 None None] MFA Rules not processed for user `9a95ca48487c4d469371ce0755e04aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:25:34.168978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1ab687e4-22fb-4a61-8b5c-8ed2d0ffe8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:34.177240 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4514/9011] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:25:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:25:34.469106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:34.496202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450c89-71b0-4b7a-b645-a0f27892113c service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:34.500981 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89164ced-466c-4bc2-acde-e5469793d931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:34.501584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89164ced-466c-4bc2-acde-e5469793d931 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:34.502039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89164ced-466c-4bc2-acde-e5469793d931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:34.502188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89164ced-466c-4bc2-acde-e5469793d931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:34.504478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-89164ced-466c-4bc2-acde-e5469793d931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:34.515684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89164ced-466c-4bc2-acde-e5469793d931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:34.518185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89164ced-466c-4bc2-acde-e5469793d931 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:34.526683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4498/9012] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:25:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:25:34.868969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab687e4-22fb-4a61-8b5c-8ed2d0ffe8a2 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:34.883023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab687e4-22fb-4a61-8b5c-8ed2d0ffe8a2 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:34.889724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:34.890449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:34.890799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:34.891136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:34.893638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:34.907889 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:34.909751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:34.922010 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4515/9013] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:25:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:25:36.240793 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1a6c-2164-4066-980a-12f57e37903e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:36.241315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1a6c-2164-4066-980a-12f57e37903e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:36.241508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1a6c-2164-4066-980a-12f57e37903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:36.261838 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-21fb1a6c-2164-4066-980a-12f57e37903e None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:25:36.263071 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-21fb1a6c-2164-4066-980a-12f57e37903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:36.272095 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4499/9014] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:25:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:25:36.285277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:36.297587 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783cdf-2ccc-458c-a86e-3f3a0eda8ba5 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:36.303100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:36.304100 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:36.304424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:36.304719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:36.313913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:36.315990 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:36.325330 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4516/9015] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:25:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:25:41.950196 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb1a6c-2164-4066-980a-12f57e37903e None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:41.960902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb1a6c-2164-4066-980a-12f57e37903e None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:41.964994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:41.965688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:41.965964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:41.966346 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:41.978798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:41.980248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:41.993840 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4500/9016] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:25:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:25:43.133241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:43.176023 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb58eed-a482-430e-b760-6445b8f27c61 service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:43.180303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:43.181034 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:43.181401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:43.181896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:43.235315 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:43.236916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:43.251234 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4517/9017] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:25:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:25:51.988021 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=31 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:53.244570 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=47 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:54.057783 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:25:54.110693 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2df2-12f9-4943-8b26-cbc3b6a9c30c service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:25:54.117659 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:25:54.118286 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:25:54.118622 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:25:54.118898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:25:54.121645 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:25:54.162476 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:25:54.164076 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:25:54.175012 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4501/9018] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:25:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:26:04.170388 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=28 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:26:09.992005 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:26:10.000915 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985056c-47e4-4f4c-b598-f42f3810f433 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:26:10.005573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:26:10.006199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:26:10.006478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:26:10.006877 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:26:10.015223 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:26:10.017097 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:26:10.025819 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4518/9019] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:26:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:26:20.021974 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:03.508975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:03.541595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413ac74-2363-469a-b0fa-08d544e79135 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:03.550326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66de7b5-2353-459c-874a-17416551a3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:03.551510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de7b5-2353-459c-874a-17416551a3a4 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:03.552047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de7b5-2353-459c-874a-17416551a3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:03.553060 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de7b5-2353-459c-874a-17416551a3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:03.571809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66de7b5-2353-459c-874a-17416551a3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:03.574135 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66de7b5-2353-459c-874a-17416551a3a4 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:03.587233 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4502/9020] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:28:13.581865 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=9 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:15.847799 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:15.862690 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496ba4-5b58-4cc8-8fe4-21b1fc3fd067 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:15.869605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:15.870211 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:15.870488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:15.870758 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:15.880107 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:15.881733 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:15.892549 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4519/9021] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:28:17.636548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9029864-62ae-4d65-8177-6d578dec76cc None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:17.637067 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9029864-62ae-4d65-8177-6d578dec76cc None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:17.637542 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9029864-62ae-4d65-8177-6d578dec76cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:17.685340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d9029864-62ae-4d65-8177-6d578dec76cc None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:28:17.687055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d9029864-62ae-4d65-8177-6d578dec76cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:17.699980 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4503/9022] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:28:17.742674 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:17.755471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acb70-cd97-491f-9195-dd32a25de610 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:17.761989 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:17.762591 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:17.762855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:17.763148 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:17.773423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:17.775002 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:17.783373 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4520/9023] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:28:18.177358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9029864-62ae-4d65-8177-6d578dec76cc None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:18.187478 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9029864-62ae-4d65-8177-6d578dec76cc None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:18.191213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:18.191819 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:18.192092 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:18.192365 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:18.275742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:18.277778 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:18.301227 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4504/9024] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:28:21.563983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:21.576279 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beddb5-4dea-4095-8fbd-e9aad2d522ac service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:21.582272 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:21.582904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:21.583175 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:21.583456 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:21.585304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:21.613970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:21.618576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:21.628328 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4521/9025] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:28:24.994522 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:25.008569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c465-521b-4f31-afd8-edf50c33e29a service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:25.013909 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:25.014565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:25.014842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:25.015116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] PATH_INFO: `/v3/users/9a95ca48487c4d469371ce0755e04aed` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:25.016623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a95ca48487c4d469371ce0755e04aed)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:25.018611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:25.068283 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a95ca48487c4d469371ce0755e04aed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.077354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a95ca48487c4d469371ce0755e04aed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.089977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a95ca48487c4d469371ce0755e04aed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.090636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a95ca48487c4d469371ce0755e04aed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.097703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a95ca48487c4d469371ce0755e04aed'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.105695 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4505/9026] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:28:24 2022] DELETE /identity/v3/users/9a95ca48487c4d469371ce0755e04aed => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:28:25.295339 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:25.306717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace450b5-fb29-4108-b2c6-9707b9b93498 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:25.381266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:25.381965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:25.382260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:25.382509 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] PATH_INFO: `/v3/projects/32f5be9d42ac40b1a916f2c09324d761` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:25.383693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f5be9d42ac40b1a916f2c09324d761)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:25.385754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:25.441847 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f5be9d42ac40b1a916f2c09324d761', 'request_id': 'req-a40f2e42-622a-46c7-a235-32fe64bb86ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.452721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f5be9d42ac40b1a916f2c09324d761', 'request_id': 'req-a40f2e42-622a-46c7-a235-32fe64bb86ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.459225 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f5be9d42ac40b1a916f2c09324d761', 'request_id': 'req-a40f2e42-622a-46c7-a235-32fe64bb86ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.485294 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] The token cache is being invalidate because project 32f5be9d42ac40b1a916f2c09324d761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:28:25.485572 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.486280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.487883 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4522/9027] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:28:25 2022] DELETE /identity/v3/projects/32f5be9d42ac40b1a916f2c09324d761 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:28:25.492008 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:25.493534 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:25.508181 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919ae7d-6eca-401e-8b34-3494f7e40a30 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:25.540462 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:25.569073 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:25.569723 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:25.569999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:25.570268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] PATH_INFO: `/v3/users/d5dd19846a4b471884e105bf8a66684a` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:25.571415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dd19846a4b471884e105bf8a66684a)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:25.573469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:25.626079 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dd19846a4b471884e105bf8a66684a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.634961 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dd19846a4b471884e105bf8a66684a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.648056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dd19846a4b471884e105bf8a66684a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.648705 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dd19846a4b471884e105bf8a66684a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.656738 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-bf04cbe5-a051-434b-a25b-05ed5fbc4b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dd19846a4b471884e105bf8a66684a'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:25.663331 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4506/9028] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:28:25 2022] DELETE /identity/v3/users/d5dd19846a4b471884e105bf8a66684a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:28:25.857769 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:25.859541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:25.877544 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f2e42-622a-46c7-a235-32fe64bb86ea admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:25.905276 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:25.938529 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:25.939170 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:25.939449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:25.939723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] PATH_INFO: `/v3/projects/51bd1d1980bb4df69e00d29da9552465` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:25.940841 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bd1d1980bb4df69e00d29da9552465)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:25.942748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:25.998691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bd1d1980bb4df69e00d29da9552465', 'request_id': 'req-65f7b300-98c7-47ce-9307-13cfa99a17ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:26.011254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bd1d1980bb4df69e00d29da9552465', 'request_id': 'req-65f7b300-98c7-47ce-9307-13cfa99a17ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:26.017793 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bd1d1980bb4df69e00d29da9552465', 'request_id': 'req-65f7b300-98c7-47ce-9307-13cfa99a17ea'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:26.029408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] The token cache is being invalidate because project 51bd1d1980bb4df69e00d29da9552465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:28:26.029694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:26.030413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-65f7b300-98c7-47ce-9307-13cfa99a17ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:28:26.031970 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4523/9029] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:28:25 2022] DELETE /identity/v3/projects/51bd1d1980bb4df69e00d29da9552465 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:28:26.037428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a075bed-adba-43ad-817e-25b48b8ca0c0 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.037959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a075bed-adba-43ad-817e-25b48b8ca0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.037959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a075bed-adba-43ad-817e-25b48b8ca0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.099574 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-7a075bed-adba-43ad-817e-25b48b8ca0c0 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:28:26.100817 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-7a075bed-adba-43ad-817e-25b48b8ca0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:26.165660 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4507/9030] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:28:26.176525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44e78-36f5-414c-8cf0-ffe794829cf9 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.176832 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44e78-36f5-414c-8cf0-ffe794829cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.177106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44e78-36f5-414c-8cf0-ffe794829cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.199433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-c0c44e78-36f5-414c-8cf0-ffe794829cf9 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:28:26.200664 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c0c44e78-36f5-414c-8cf0-ffe794829cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:26.209517 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4524/9031] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:28:26.214222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a075bed-adba-43ad-817e-25b48b8ca0c0 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.225790 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a075bed-adba-43ad-817e-25b48b8ca0c0 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.232804 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.233467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.233743 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.234018 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.234713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:28:26.235025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.236670 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.250313 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4508/9032] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:28:26.256694 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44e78-36f5-414c-8cf0-ffe794829cf9 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.271899 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44e78-36f5-414c-8cf0-ffe794829cf9 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.279508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.280106 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.280386 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.280653 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.281310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.283197 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.325729 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4525/9033] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:28:26 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:28:26.330188 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.341372 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085821b-7187-4310-a8cf-2e142e0f161d admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.346266 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:26.404470 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.405279 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.405520 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.405789 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.406406 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.408321 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.434544 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4509/9034] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:28:26 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:28:26.441468 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.455703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ea0f-eb4b-4fbc-b48c-31d7a76db88a admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.461304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.461938 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.462214 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.462483 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.463128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.464739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.475489 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4526/9035] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:28:26.480108 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.494584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e1617-cd4d-4297-a2d6-f69c61b455b0 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.500495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1ff30-14bf-4571-805c-b9df60a05c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.501337 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1ff30-14bf-4571-805c-b9df60a05c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.501665 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1ff30-14bf-4571-805c-b9df60a05c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.502013 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1ff30-14bf-4571-805c-b9df60a05c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.502970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1ff30-14bf-4571-805c-b9df60a05c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.505414 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1ff30-14bf-4571-805c-b9df60a05c70 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.519200 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4510/9036] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:28:26.523508 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.534345 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a6d7-7d09-44f4-9c8b-c67bc55a238b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.539979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.540630 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.540955 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.541218 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] PATH_INFO: `/v3/projects/83cf02fdc1394f2db3f7628a4d28ec47/users/e49e5ba10abf48a9954f8b6725bb84a6/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.557465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cf02fdc1394f2db3f7628a4d28ec47, user_id=e49e5ba10abf48a9954f8b6725bb84a6, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.560103 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.577739 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4527/9037] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:28:26 2022] PUT /identity/v3/projects/83cf02fdc1394f2db3f7628a4d28ec47/users/e49e5ba10abf48a9954f8b6725bb84a6/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:28:26.588933 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470e88-d578-487d-8ff7-eb058793b503 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.589217 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470e88-d578-487d-8ff7-eb058793b503 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.589484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470e88-d578-487d-8ff7-eb058793b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.620935 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3d470e88-d578-487d-8ff7-eb058793b503 None None] MFA Rules not processed for user `e49e5ba10abf48a9954f8b6725bb84a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:28:26.622178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3d470e88-d578-487d-8ff7-eb058793b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:26.697173 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4511/9038] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:28:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:28:26.702040 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.752639 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:26.769115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc3ae5-dc96-4d66-aebb-5360bcfcc210 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.774144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.774750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.775030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.775301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.775953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.777934 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.806849 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4528/9039] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:28:26 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:28:26.811132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d470e88-d578-487d-8ff7-eb058793b503 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.822195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d470e88-d578-487d-8ff7-eb058793b503 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.880892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.881530 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.881844 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.882114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.882785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.884816 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.908166 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4512/9040] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:28:26 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:28:26.912323 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.923037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d97b8-a8dc-4e8c-a417-e135abfa7d85 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.927970 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.928594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.928912 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.929184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.929825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.931440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.943145 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4529/9041] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:28:26.947696 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:26.958184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87edf-5cdf-435f-a6ab-fcb693e68d3a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:26.962976 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:26.963624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:26.964046 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:26.964322 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] PATH_INFO: `/v3/projects/d5d8fa13075b4f6481d75a25daabe966/users/2dffe34085c845ae9e2a57bb76085914/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:26.966628 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:26.981557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d8fa13075b4f6481d75a25daabe966, user_id=2dffe34085c845ae9e2a57bb76085914, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:26.984202 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:26.998928 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4513/9042] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:28:26 2022] PUT /identity/v3/projects/d5d8fa13075b4f6481d75a25daabe966/users/2dffe34085c845ae9e2a57bb76085914/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:28:27.005261 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:27.020541 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02653af-deb3-4dee-b737-88a79ac8c1bc admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:27.084244 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e96f3-34b6-4c8e-a284-d2cbab26bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:27.084875 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e96f3-34b6-4c8e-a284-d2cbab26bde9 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:27.085154 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e96f3-34b6-4c8e-a284-d2cbab26bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:27.085414 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e96f3-34b6-4c8e-a284-d2cbab26bde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:27.086045 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e96f3-34b6-4c8e-a284-d2cbab26bde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:27.087636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e96f3-34b6-4c8e-a284-d2cbab26bde9 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:27.097489 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4530/9043] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:28:27.101913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:27.113053 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe6a8-f129-4ae6-ac43-94135b84d120 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:27.118457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:27.119106 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:27.119381 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:27.119652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] PATH_INFO: `/v3/projects/d5d8fa13075b4f6481d75a25daabe966/users/2dffe34085c845ae9e2a57bb76085914/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:27.121938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d8fa13075b4f6481d75a25daabe966, user_id=2dffe34085c845ae9e2a57bb76085914, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:27.124587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:27.136430 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4514/9044] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:28:27 2022] PUT /identity/v3/projects/d5d8fa13075b4f6481d75a25daabe966/users/2dffe34085c845ae9e2a57bb76085914/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:28:27.147151 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:27.147438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:27.147743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:27.176685 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] MFA Rules not processed for user `2dffe34085c845ae9e2a57bb76085914`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:28:27.177951 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:27.258297 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4531/9045] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:28:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:28:27.276280 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:27.278762 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:27.381861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368537d-7991-406f-ad00-0fe778b1e80a admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:27.388424 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c59c2c-ea7f-4476-bf54-7c9d5acdb29f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:27.389063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c59c2c-ea7f-4476-bf54-7c9d5acdb29f service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:27.389347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c59c2c-ea7f-4476-bf54-7c9d5acdb29f service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:27.389616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c59c2c-ea7f-4476-bf54-7c9d5acdb29f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:27.454218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c59c2c-ea7f-4476-bf54-7c9d5acdb29f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:27.455865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c59c2c-ea7f-4476-bf54-7c9d5acdb29f service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:27.466662 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4515/9046] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:28:30.362724 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:30.364314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:30.417026 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:30.443479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7b37-c996-44a4-b44a-d50ff2e6930f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:30.447177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:30.447803 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:30.448317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:30.449009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:30.458471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:30.459908 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:30.471938 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4532/9047] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:28:33.454160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35499-c588-4ecb-b729-c99e14642290 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:33.454646 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35499-c588-4ecb-b729-c99e14642290 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:33.454810 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35499-c588-4ecb-b729-c99e14642290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:33.474393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-74f35499-c588-4ecb-b729-c99e14642290 None None] MFA Rules not processed for user `e49e5ba10abf48a9954f8b6725bb84a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:28:33.475628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-74f35499-c588-4ecb-b729-c99e14642290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:33.484064 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4516/9048] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:28:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:28:34.186281 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:34.189765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:34.277913 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae04fc-ad9e-488a-b654-ccabe777f86d service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:34.282859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:34.283469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:34.283742 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:34.284010 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:34.285885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:34.298026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:34.299621 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:34.310366 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4533/9049] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:28:43.469031 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:44.305831 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=44 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:44.562432 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f35499-c588-4ecb-b729-c99e14642290 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:28:44.575306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f35499-c588-4ecb-b729-c99e14642290 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:28:44.581281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3a1f6-9cf0-411f-996e-38831b101135 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:28:44.581888 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3a1f6-9cf0-411f-996e-38831b101135 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:28:44.582161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3a1f6-9cf0-411f-996e-38831b101135 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:28:44.582425 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3a1f6-9cf0-411f-996e-38831b101135 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:28:44.584179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3af3a1f6-9cf0-411f-996e-38831b101135 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:28:44.597853 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3a1f6-9cf0-411f-996e-38831b101135 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:28:44.599498 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3a1f6-9cf0-411f-996e-38831b101135 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:28:44.615752 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4517/9050] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:28:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:28:54.608190 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:03.365905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:30:03.376925 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7168f29-0691-44a2-91ea-3573a3280463 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:30:03.382946 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:30:03.383560 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:30:03.383837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:30:03.384110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:30:03.385945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:30:03.398973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:30:03.400606 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:30:03.411072 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4534/9051] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:30:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:30:09.433501 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df67fe-339e-4c65-a310-6c8f2a590d94 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:30:09.434111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df67fe-339e-4c65-a310-6c8f2a590d94 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:30:09.434111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df67fe-339e-4c65-a310-6c8f2a590d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:30:09.455027 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-44df67fe-339e-4c65-a310-6c8f2a590d94 None None] MFA Rules not processed for user `e49e5ba10abf48a9954f8b6725bb84a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:30:09.456465 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-44df67fe-339e-4c65-a310-6c8f2a590d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:30:09.464380 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4518/9052] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:30:13.253960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:30:13.258011 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:30:13.274825 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e859a0-1e35-452a-b79e-cf3277edb823 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:30:13.280417 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:30:13.281094 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:30:13.281372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:30:13.281644 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:30:13.283367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:30:13.297526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:30:13.298896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:30:13.310435 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4535/9053] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:30:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:30:19.449647 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:23.305788 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=12 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:31:11.996221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df67fe-339e-4c65-a310-6c8f2a590d94 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:31:12.008625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df67fe-339e-4c65-a310-6c8f2a590d94 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:31:12.013861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:31:12.015012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:31:12.015273 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:31:12.015378 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:31:12.017572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:31:12.027994 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:31:12.029483 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:31:12.038339 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4519/9054] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:31:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:31:22.034644 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:31:26.273499 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:31:26.283712 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af06da-a1f1-4d63-9f7e-b12e172af876 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:31:26.288156 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d51158-ff3f-4e68-999d-0d6845af3986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:31:26.288882 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51158-ff3f-4e68-999d-0d6845af3986 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:31:26.289166 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51158-ff3f-4e68-999d-0d6845af3986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:31:26.289438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51158-ff3f-4e68-999d-0d6845af3986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:31:26.291293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-f6d51158-ff3f-4e68-999d-0d6845af3986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:31:26.305973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d51158-ff3f-4e68-999d-0d6845af3986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:31:26.307427 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d51158-ff3f-4e68-999d-0d6845af3986 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:31:26.331025 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4536/9055] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:31:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:31:27.937587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:31:27.939437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:31:27.950225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a26da-4089-4992-af0e-4cae8e2d47cf service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:31:27.955131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:31:27.955711 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:31:27.955975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:31:27.956255 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:31:27.958361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:31:27.973248 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:31:27.974703 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:31:27.986539 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4520/9056] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:31:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:31:36.327795 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:31:37.981581 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:43.356669 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5af7-515d-430c-b800-c4e2729f7589 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:32:43.359697 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5af7-515d-430c-b800-c4e2729f7589 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:32:43.360047 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5af7-515d-430c-b800-c4e2729f7589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:32:43.393806 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-daed5af7-515d-430c-b800-c4e2729f7589 None None] MFA Rules not processed for user `e49e5ba10abf48a9954f8b6725bb84a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:32:43.395259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-daed5af7-515d-430c-b800-c4e2729f7589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:32:43.405810 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4537/9057] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:32:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:32:43.776212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:32:43.787397 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f537e7-df18-44a9-ba4b-b5e82ed9dd88 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:32:43.791636 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:32:43.792408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:32:43.792822 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:32:43.793235 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:32:43.795340 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:32:43.807272 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:32:43.809055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:32:43.818867 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4521/9058] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:32:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:32:53.387627 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:53.814481 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:54.146973 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5af7-515d-430c-b800-c4e2729f7589 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:32:54.164343 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5af7-515d-430c-b800-c4e2729f7589 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:32:54.170421 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:32:54.171051 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:32:54.171340 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:32:54.171602 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:32:54.173488 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:32:54.186740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:32:54.188337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:32:54.199921 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4538/9059] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:32:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:33:04.195560 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:33:21.305575 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:33:21.307261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:33:21.334708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b6858-7e62-4f5f-b48a-302483a0a72e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:33:21.340700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:33:21.341335 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:33:21.341662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:33:21.341929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:33:21.343910 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:33:21.356173 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:33:21.357832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:33:21.368241 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4522/9060] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:33:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:33:31.363811 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:33:31.374160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:33:31.385978 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349656d-1d3c-4bf1-b57b-19702029c742 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:33:31.392756 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a809a-7496-4000-b2ac-e1ecdf1416a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:33:31.393349 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a809a-7496-4000-b2ac-e1ecdf1416a9 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:33:31.393627 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a809a-7496-4000-b2ac-e1ecdf1416a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:33:31.393903 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a809a-7496-4000-b2ac-e1ecdf1416a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:33:31.402652 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a809a-7496-4000-b2ac-e1ecdf1416a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:33:31.404691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a809a-7496-4000-b2ac-e1ecdf1416a9 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:33:31.415925 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4539/9061] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:33:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:33:41.410619 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:33:50.596144 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:33:50.607435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1708b-1bce-4557-94d6-345b0aa07db4 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:33:50.614274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:33:50.614874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:33:50.615149 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:33:50.615417 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:33:50.624613 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:33:50.626395 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:33:50.637229 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4523/9062] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:33:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:34:00.632679 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:02.157167 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d610dd8-6a36-4652-a971-ea777206ea7d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:02.157739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d610dd8-6a36-4652-a971-ea777206ea7d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:02.157739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d610dd8-6a36-4652-a971-ea777206ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:02.200904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-7d610dd8-6a36-4652-a971-ea777206ea7d None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:34:02.202319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7d610dd8-6a36-4652-a971-ea777206ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:34:02.209325 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4540/9063] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:34:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:34:02.221229 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:34:02.231358 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d318d72-7f83-4f1d-8c03-b07e6f299117 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:34:02.235127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:34:02.235749 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:02.235999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:02.236268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:02.246061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:34:02.247495 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:34:02.256497 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4524/9064] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:34:02.344622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6d09a-e578-416f-9ade-c4d222adb0af None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:02.344940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6d09a-e578-416f-9ade-c4d222adb0af None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:02.345215 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6d09a-e578-416f-9ade-c4d222adb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:02.386275 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d5a6d09a-e578-416f-9ade-c4d222adb0af None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:34:02.387876 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d5a6d09a-e578-416f-9ade-c4d222adb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:34:02.398389 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4541/9065] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:34:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:34:02.409938 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:34:02.423521 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3f14f-6ea2-4999-b512-f5021a80301f service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:34:02.429708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:34:02.430314 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:02.430593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:02.430863 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:02.439315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:34:02.440942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:34:02.451118 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4525/9066] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:34:02.724994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529485-a739-49e4-a58a-0c2145afa284 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:02.725299 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529485-a739-49e4-a58a-0c2145afa284 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:02.725573 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529485-a739-49e4-a58a-0c2145afa284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:02.774095 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-43529485-a739-49e4-a58a-0c2145afa284 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:34:02.775322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-43529485-a739-49e4-a58a-0c2145afa284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:34:02.786944 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4542/9067] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:34:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:34:02.800278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:34:02.811281 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ba34-aff2-4930-8ede-ba35bc1d7751 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:34:02.815836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:34:02.816446 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:02.816720 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:02.817025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:02.828256 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:34:02.829721 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:34:02.840813 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4526/9068] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:34:02.918101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529485-a739-49e4-a58a-0c2145afa284 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:34:02.930482 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529485-a739-49e4-a58a-0c2145afa284 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:34:02.936009 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:34:02.936632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:02.936905 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:02.937169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:02.939177 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:34:02.950874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:34:02.952448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:34:02.963218 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4543/9069] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:34:12.836367 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=18 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:12.958335 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=33 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:16.843602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:34:16.855616 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6466-8deb-46fb-8387-0069a6cfe3af service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:34:16.861460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:34:16.862083 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:16.862382 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:16.862633 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:16.864957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:34:16.876741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:34:16.879163 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:34:16.890683 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4527/9070] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:34:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:34:26.886026 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:52.941071 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:34:52.954337 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d261a-2dd1-4040-bedd-69e5ef080006 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:34:52.960115 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:34:52.960725 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:52.961026 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:52.961303 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:52.963110 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:34:52.976280 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:34:52.977904 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:34:52.989628 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4544/9071] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:34:58.732326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:34:58.745730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2731fa-4d0c-425e-8361-f207c0829715 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:34:58.751929 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5180-a4ce-4cf8-b46b-47bc61f34bd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:34:58.752639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5180-a4ce-4cf8-b46b-47bc61f34bd6 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:34:58.752951 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5180-a4ce-4cf8-b46b-47bc61f34bd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:34:58.753227 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5180-a4ce-4cf8-b46b-47bc61f34bd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:34:58.755058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-1a6c5180-a4ce-4cf8-b46b-47bc61f34bd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:34:58.772827 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5180-a4ce-4cf8-b46b-47bc61f34bd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:34:58.774821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5180-a4ce-4cf8-b46b-47bc61f34bd6 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:34:58.799893 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4528/9072] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:34:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:35:02.044940 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:35:02.055234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f8179-de3d-4c5f-9b6e-8b73023aaa18 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:35:02.059622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:35:02.060301 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:35:02.060790 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:35:02.061144 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:35:02.072334 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:35:02.073840 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:35:02.085836 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4545/9073] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:35:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:35:04.749458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42d8a-4813-455b-b00f-913ed2acee09 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:35:04.750039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42d8a-4813-455b-b00f-913ed2acee09 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:35:04.750039 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42d8a-4813-455b-b00f-913ed2acee09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:35:04.773514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-60e42d8a-4813-455b-b00f-913ed2acee09 None None] MFA Rules not processed for user `e49e5ba10abf48a9954f8b6725bb84a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:35:04.774756 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-60e42d8a-4813-455b-b00f-913ed2acee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:35:04.785546 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4529/9074] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:35:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:35:05.201052 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:35:05.211829 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393827c-d7cc-4f94-b72d-586168e01fa3 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:35:05.220369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:35:05.221255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:35:05.221636 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:35:05.221983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:35:05.224183 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:35:05.237371 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:35:05.254182 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:35:05.272049 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4546/9075] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:35:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:35:06.733892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42d8a-4813-455b-b00f-913ed2acee09 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:35:06.747250 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42d8a-4813-455b-b00f-913ed2acee09 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:35:06.752943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:35:06.753595 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:35:06.753865 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:35:06.754130 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:35:06.764652 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:35:06.766355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:35:06.778913 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4530/9076] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:35:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:35:15.267396 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=18 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:16.773610 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=15 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:22.971374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:35:22.985874 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c40d1-5902-4c07-8597-7a82803d1558 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:35:22.992338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:35:22.993268 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:35:22.993996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:35:22.994300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:35:23.004378 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:35:23.006101 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:35:23.018840 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4547/9077] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:35:33.013375 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:36:16.956141 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:36:16.998416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd461-5a9a-414d-9ab4-cfc7dd69a5de service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:36:17.003299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:36:17.003907 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:36:17.004182 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:36:17.004427 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:36:17.013005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:36:17.014471 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:36:17.023210 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4531/9078] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:36:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:36:27.019280 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=18 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:36:28.345752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:36:28.367639 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd57a98-4153-48df-892a-bbf9ec789ca5 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:36:28.371475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26617eb-0c8f-410e-83dc-3e7e9d6c29db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:36:28.372080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26617eb-0c8f-410e-83dc-3e7e9d6c29db service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:36:28.372360 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26617eb-0c8f-410e-83dc-3e7e9d6c29db service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:36:28.372632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26617eb-0c8f-410e-83dc-3e7e9d6c29db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:36:28.406584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26617eb-0c8f-410e-83dc-3e7e9d6c29db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:36:28.408027 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26617eb-0c8f-410e-83dc-3e7e9d6c29db service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:36:28.422001 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4548/9079] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:36:29.618638 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:36:29.628341 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde06e5-b5b0-409d-ad3b-82301096ae33 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:36:29.633029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:36:29.633634 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:36:29.633878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:36:29.634165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:36:29.646874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:36:29.648299 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:36:29.659747 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4532/9080] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:36:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:36:38.414876 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=20 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:36:39.654617 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:44.356387 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ce6b-6b2f-4d05-918c-81297a1d197d None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:37:44.356969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ce6b-6b2f-4d05-918c-81297a1d197d None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:37:44.356969 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ce6b-6b2f-4d05-918c-81297a1d197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:37:44.389291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4543ce6b-6b2f-4d05-918c-81297a1d197d None None] MFA Rules not processed for user `e49e5ba10abf48a9954f8b6725bb84a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:37:44.390907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4543ce6b-6b2f-4d05-918c-81297a1d197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:37:44.398789 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4549/9081] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:37:54.383576 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:38:27.298503 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:38:27.310985 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e493a-296c-427f-a77c-d4cca7e21c54 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:38:27.317113 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:38:27.317712 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:38:27.318051 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:38:27.318327 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:38:27.327355 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:38:27.328966 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:38:27.339366 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4533/9082] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:38:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:38:37.335234 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:38:56.579986 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543ce6b-6b2f-4d05-918c-81297a1d197d None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:38:56.652310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543ce6b-6b2f-4d05-918c-81297a1d197d None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:38:56.658976 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:38:56.659596 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:38:56.659872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:38:56.660140 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:38:56.662312 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:38:56.687617 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:38:56.689269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:38:56.699610 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4550/9083] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:38:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:38:59.770643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:38:59.773074 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:38:59.882317 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f24e-7911-4648-bc4d-286da29cf585 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:38:59.889394 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:38:59.889995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:38:59.890274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:38:59.890518 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:38:59.892468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:38:59.978100 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:38:59.979685 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:38:59.998345 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4534/9084] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:38:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:39:06.695183 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=37 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:09.995680 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=77 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:14.682740 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:14.694559 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e05e33-e2e2-4c2c-a9b5-cd1891170816 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:14.700204 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24f8a5-14df-4207-8d5c-640fefc80996 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:14.700816 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24f8a5-14df-4207-8d5c-640fefc80996 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:14.701116 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24f8a5-14df-4207-8d5c-640fefc80996 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:14.701372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24f8a5-14df-4207-8d5c-640fefc80996 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:14.710872 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24f8a5-14df-4207-8d5c-640fefc80996 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:14.712463 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24f8a5-14df-4207-8d5c-640fefc80996 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:14.723223 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4551/9085] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:39:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:39:14.993839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:14.995607 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:15.106363 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c68b9b-ba95-44ea-a1fb-2fbb32280ebd service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:15.111830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:15.112815 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:15.113318 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:15.113799 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] PATH_INFO: `/v3/users/e49e5ba10abf48a9954f8b6725bb84a6` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:15.115654 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49e5ba10abf48a9954f8b6725bb84a6)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:15.118195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:15.181988 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49e5ba10abf48a9954f8b6725bb84a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.204302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49e5ba10abf48a9954f8b6725bb84a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.220063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49e5ba10abf48a9954f8b6725bb84a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.221291 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49e5ba10abf48a9954f8b6725bb84a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.230780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49e5ba10abf48a9954f8b6725bb84a6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.238177 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4535/9086] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:39:14 2022] DELETE /identity/v3/users/e49e5ba10abf48a9954f8b6725bb84a6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:39:15.242702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:15.243503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:15.244691 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:15.282376 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:39:15.283603 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:15.354693 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4552/9087] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 02:39:15.364928 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:15.366940 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:15.428392 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:15.443057 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6d94-2441-4e78-b6b1-80f6a31d6c06 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:15.446972 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:15.447572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:15.447846 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:15.448111 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:15.457877 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:15.459468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:15.470508 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4536/9088] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:39:15.650401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:15.652038 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:15.665373 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bbc84-d00a-4cd8-9c39-1a8ae22ed2bf None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:15.671185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:15.671838 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:15.672118 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:15.672384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] PATH_INFO: `/v3/projects/83cf02fdc1394f2db3f7628a4d28ec47` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:15.674518 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cf02fdc1394f2db3f7628a4d28ec47)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:15.676527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:15.725086 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cf02fdc1394f2db3f7628a4d28ec47', 'request_id': 'req-a3d0d35a-a730-4650-bb96-3ca334275e70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.734924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cf02fdc1394f2db3f7628a4d28ec47', 'request_id': 'req-a3d0d35a-a730-4650-bb96-3ca334275e70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.741687 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cf02fdc1394f2db3f7628a4d28ec47', 'request_id': 'req-a3d0d35a-a730-4650-bb96-3ca334275e70'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.753136 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] The token cache is being invalidate because project 83cf02fdc1394f2db3f7628a4d28ec47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:39:15.753420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.754145 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.755877 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4553/9089] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:39:15 2022] DELETE /identity/v3/projects/83cf02fdc1394f2db3f7628a4d28ec47 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:39:15.760821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:15.771552 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bdcdd-a140-44ec-9d30-223cda1c4e35 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:15.833821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:15.834587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:15.834894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:15.835342 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] PATH_INFO: `/v3/users/2dffe34085c845ae9e2a57bb76085914` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:15.851221 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dffe34085c845ae9e2a57bb76085914)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:15.853209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:15.901264 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dffe34085c845ae9e2a57bb76085914'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.911625 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dffe34085c845ae9e2a57bb76085914'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.927441 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dffe34085c845ae9e2a57bb76085914'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.928218 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dffe34085c845ae9e2a57bb76085914'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.935664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-c214ce7c-6672-422a-b058-00b610010f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dffe34085c845ae9e2a57bb76085914'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:15.941758 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4537/9090] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:39:15 2022] DELETE /identity/v3/users/2dffe34085c845ae9e2a57bb76085914 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:39:16.241295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:16.242884 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:16.256444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0d35a-a730-4650-bb96-3ca334275e70 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:16.320054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:16.320702 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.321037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.321311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] PATH_INFO: `/v3/projects/d5d8fa13075b4f6481d75a25daabe966` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.328304 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:16.333413 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d8fa13075b4f6481d75a25daabe966)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:16.335466 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:16.386575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d8fa13075b4f6481d75a25daabe966', 'request_id': 'req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:16.395168 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d8fa13075b4f6481d75a25daabe966', 'request_id': 'req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:16.401102 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d8fa13075b4f6481d75a25daabe966', 'request_id': 'req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:16.412962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] The token cache is being invalidate because project d5d8fa13075b4f6481d75a25daabe966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81886) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:39:16.413311 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:16.413957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-8bbe8feb-fb4b-4aa9-aba2-5a107a909f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:39:16.415461 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4554/9091] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:39:16 2022] DELETE /identity/v3/projects/d5d8fa13075b4f6481d75a25daabe966 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:39:16.421885 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f12fa-8cbd-4b69-8301-c8d5be2d3dd1 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.422384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f12fa-8cbd-4b69-8301-c8d5be2d3dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.422489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f12fa-8cbd-4b69-8301-c8d5be2d3dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.489755 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-856f12fa-8cbd-4b69-8301-c8d5be2d3dd1 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:39:16.491047 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-856f12fa-8cbd-4b69-8301-c8d5be2d3dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:16.512373 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:16.555439 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4538/9092] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:39:16.568254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbcaf-7fae-4846-a5f0-a00b0bb2581f None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.568531 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbcaf-7fae-4846-a5f0-a00b0bb2581f None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.569054 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbcaf-7fae-4846-a5f0-a00b0bb2581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.594837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-facbbcaf-7fae-4846-a5f0-a00b0bb2581f None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:39:16.596044 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-facbbcaf-7fae-4846-a5f0-a00b0bb2581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:16.604711 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4555/9093] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:39:16.609656 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f12fa-8cbd-4b69-8301-c8d5be2d3dd1 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:16.620937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f12fa-8cbd-4b69-8301-c8d5be2d3dd1 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:16.627565 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:16.628492 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.628739 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.629175 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.630168 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:39:16.630624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:16.633176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:16.650618 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4539/9094] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:39:16.655209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbcaf-7fae-4846-a5f0-a00b0bb2581f None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:16.665771 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbcaf-7fae-4846-a5f0-a00b0bb2581f None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:16.670837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:16.671430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.671705 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.671957 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.672584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:16.674494 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:16.716414 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4556/9095] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:39:16 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:39:16.722660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:16.739354 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7883bc-c51d-42e7-a8b2-c7b4d101e4e7 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:16.807234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:16.807870 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.808147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.808415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.809072 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:16.811005 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:16.832608 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4540/9096] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:39:16 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:39:16.837546 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:16.848282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389ccbf-59cf-472e-b46a-99de65ffb8c8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:16.853325 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:16.853953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.854234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.854615 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.855269 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:16.856892 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:16.867211 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4557/9097] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:39:16.871598 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:16.887360 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4574-9aec-4a70-a7e8-d3660e616b47 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:16.894791 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021fa9c-edc0-4d62-8558-c0291531c1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:16.895410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021fa9c-edc0-4d62-8558-c0291531c1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.895687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021fa9c-edc0-4d62-8558-c0291531c1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.895941 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021fa9c-edc0-4d62-8558-c0291531c1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.896577 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021fa9c-edc0-4d62-8558-c0291531c1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:16.898315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021fa9c-edc0-4d62-8558-c0291531c1bc admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:16.908527 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4541/9098] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:39:16.914945 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:16.929997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f799-232c-4037-b766-5e2debcf9780 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:16.935896 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:16.936552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.936850 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.937124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] PATH_INFO: `/v3/projects/5e5295ac46034f46b4781ed5d0374912/users/89156176073c4a8b960c14e55528d7a9/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:16.953048 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5295ac46034f46b4781ed5d0374912, user_id=89156176073c4a8b960c14e55528d7a9, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:16.955681 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:16.971687 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4558/9099] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:39:16 2022] PUT /identity/v3/projects/5e5295ac46034f46b4781ed5d0374912/users/89156176073c4a8b960c14e55528d7a9/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:39:16.977233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bc7d-0dfa-49cc-a674-3b353eeda542 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:16.977514 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bc7d-0dfa-49cc-a674-3b353eeda542 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:16.977779 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bc7d-0dfa-49cc-a674-3b353eeda542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:17.001368 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-b7e2bc7d-0dfa-49cc-a674-3b353eeda542 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:39:17.002600 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b7e2bc7d-0dfa-49cc-a674-3b353eeda542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:17.067850 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4542/9100] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:39:17.078593 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:17.080384 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:17.140264 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b54f-299b-457e-b65a-4150ef380628 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:17.144316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:17.144953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:17.145234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:17.145503 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:17.155001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:17.156428 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:17.166034 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4559/9101] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:39:21.249824 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e00d2-9c6b-4727-b3b8-c7199fbc53aa None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:21.250338 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e00d2-9c6b-4727-b3b8-c7199fbc53aa None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:21.250434 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e00d2-9c6b-4727-b3b8-c7199fbc53aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:21.281663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-006e00d2-9c6b-4727-b3b8-c7199fbc53aa None None] MFA Rules not processed for user `89156176073c4a8b960c14e55528d7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:39:21.282913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-006e00d2-9c6b-4727-b3b8-c7199fbc53aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:21.317887 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:21.392682 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4543/9102] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:39:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:39:21.397971 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:21.408359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b5320-e0dc-4d32-8508-346ace9a0c71 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:21.413347 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:21.413962 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:21.414234 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:21.414501 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:21.415314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:21.417259 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:21.433678 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:21.453315 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e00d2-9c6b-4727-b3b8-c7199fbc53aa None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:21.453990 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4560/9103] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:39:21 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:39:21.465639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e00d2-9c6b-4727-b3b8-c7199fbc53aa None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:21.531460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:21.532139 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:21.532364 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:21.532632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:21.533300 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:21.535251 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:21.563167 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4544/9104] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:39:21 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:39:21.564668 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:21.576469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458d567-f35e-4674-a8cd-165e5c960e1e admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:21.581575 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:21.582209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:21.582490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:21.582765 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:21.583424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:21.585316 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:21.597230 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4561/9105] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:39:21.601839 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:21.612510 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100467c6-8815-45c7-991b-bb4ffbb89ff9 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:21.617732 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:21.618407 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:21.618686 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:21.618982 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] PATH_INFO: `/v3/projects/e7c9974c1ddb4f6fb6cfd658d94ec351/users/78bbec87054e41b48b2ae5233df9583b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:21.636447 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9974c1ddb4f6fb6cfd658d94ec351, user_id=78bbec87054e41b48b2ae5233df9583b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:21.640031 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:21.655254 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4545/9106] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:39:21 2022] PUT /identity/v3/projects/e7c9974c1ddb4f6fb6cfd658d94ec351/users/78bbec87054e41b48b2ae5233df9583b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:39:21.659492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:21.671063 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205401d9-e71d-45cf-b8f4-d63b38bd7f7b admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:21.733819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1be221-8b84-449d-bfbf-75e8f6bb61a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:21.734438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be221-8b84-449d-bfbf-75e8f6bb61a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:21.734710 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be221-8b84-449d-bfbf-75e8f6bb61a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:21.734980 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be221-8b84-449d-bfbf-75e8f6bb61a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:21.735851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1be221-8b84-449d-bfbf-75e8f6bb61a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:21.737526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1be221-8b84-449d-bfbf-75e8f6bb61a6 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:21.749508 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4562/9107] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:39:21.753765 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:21.766872 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e060-3642-4d5e-98a5-182d04909e92 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:21.772006 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:21.772925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:21.773195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:21.773460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] PATH_INFO: `/v3/projects/e7c9974c1ddb4f6fb6cfd658d94ec351/users/78bbec87054e41b48b2ae5233df9583b/roles/fd13fde432a246499375976d02e43d56` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:21.775469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9974c1ddb4f6fb6cfd658d94ec351, user_id=78bbec87054e41b48b2ae5233df9583b, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:21.778211 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:21.789903 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4546/9108] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:39:21 2022] PUT /identity/v3/projects/e7c9974c1ddb4f6fb6cfd658d94ec351/users/78bbec87054e41b48b2ae5233df9583b/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:39:25.924746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b695c3-b3c6-4344-a8af-94d853a88365 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:25.925282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b695c3-b3c6-4344-a8af-94d853a88365 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:25.925380 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b695c3-b3c6-4344-a8af-94d853a88365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:25.954898 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-12b695c3-b3c6-4344-a8af-94d853a88365 None None] MFA Rules not processed for user `78bbec87054e41b48b2ae5233df9583b`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:39:25.956035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12b695c3-b3c6-4344-a8af-94d853a88365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:26.029182 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4563/9109] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:39:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:39:26.046289 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:26.049224 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:26.125609 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588e033-4f3f-4ec9-9cef-98d8af244a3c admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:26.132380 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:26.133040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:26.133663 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:26.133947 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:26.144261 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:26.208925 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:26.212269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:26.222675 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4547/9110] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:39:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:39:27.389513 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447b61-f463-4f99-be7b-77a089c5d1bd None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:27.390364 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447b61-f463-4f99-be7b-77a089c5d1bd None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:27.390643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447b61-f463-4f99-be7b-77a089c5d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:27.418795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-d2447b61-f463-4f99-be7b-77a089c5d1bd None None] MFA Rules not processed for user `89156176073c4a8b960c14e55528d7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:39:27.420037 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-d2447b61-f463-4f99-be7b-77a089c5d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:27.433418 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4564/9111] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:39:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:39:36.218327 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=22 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:37.412496 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=1,keystone:SELECT=73 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:42.171268 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:42.173410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:42.189416 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c70a9b-a2fa-41af-bb92-7eec6f00a975 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:42.195055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:42.195674 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:42.195995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:42.196261 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:42.201233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:39:42.216114 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:42.217841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:42.229412 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4548/9112] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:39:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:39:45.140947 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2447b61-f463-4f99-be7b-77a089c5d1bd None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:39:45.206388 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2447b61-f463-4f99-be7b-77a089c5d1bd None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:39:45.210594 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:39:45.211209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:39:45.211484 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:39:45.211752 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:39:45.221300 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:39:45.222718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:39:45.232389 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4565/9113] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:39:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:39:52.224725 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:55.228291 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=26 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:41:21.946971 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:41:21.949242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:41:21.962788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef0fd8-d33b-4d41-9771-8934678a380e service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:41:21.968084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:41:21.968729 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:41:21.969161 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:41:21.969435 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:41:21.971809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:41:21.983259 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:41:21.984701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:41:21.993343 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4549/9114] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:41:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:41:31.989581 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:11.274083 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:11.275605 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:11.360227 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be3483-3d6c-4a3b-bc82-e7c102237e66 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:11.364033 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e454c69-a5dd-444f-b494-c88998f51107 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:11.364638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e454c69-a5dd-444f-b494-c88998f51107 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:11.364953 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e454c69-a5dd-444f-b494-c88998f51107 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:11.365222 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e454c69-a5dd-444f-b494-c88998f51107 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:11.367199 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5e454c69-a5dd-444f-b494-c88998f51107 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:11.382772 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e454c69-a5dd-444f-b494-c88998f51107 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:11.384394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e454c69-a5dd-444f-b494-c88998f51107 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:11.406361 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4566/9115] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:42:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:42:11.605366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:11.614956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10fa75-24bf-4ef1-b6ae-46fe1f37b799 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:11.619320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:11.619913 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:11.620195 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:11.620466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:11.622374 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:11.636860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:11.638296 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:11.649510 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4550/9116] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:42:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:42:21.403721 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=39 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:21.644708 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:28.626787 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2d345-710e-4ce0-9b93-abf3db56e0bc None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:28.627293 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2d345-710e-4ce0-9b93-abf3db56e0bc None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:28.627410 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2d345-710e-4ce0-9b93-abf3db56e0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:28.692442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-bec2d345-710e-4ce0-9b93-abf3db56e0bc None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:42:28.693619 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bec2d345-710e-4ce0-9b93-abf3db56e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:28.761610 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4567/9117] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:42:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:42:28.814348 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:28.816582 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:28.919127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491d1f-2d41-4239-8ae8-6e343c9ae039 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:28.924987 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca2c40-ec9c-4180-9406-435f09ed7ead service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:28.925611 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2c40-ec9c-4180-9406-435f09ed7ead service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:28.925887 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2c40-ec9c-4180-9406-435f09ed7ead service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:28.926157 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2c40-ec9c-4180-9406-435f09ed7ead service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:28.934692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca2c40-ec9c-4180-9406-435f09ed7ead service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:28.936292 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca2c40-ec9c-4180-9406-435f09ed7ead service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:28.944506 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4551/9118] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:42:38.758756 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=44 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:38.941231 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=41 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:41.772714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2d345-710e-4ce0-9b93-abf3db56e0bc None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:41.783082 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2d345-710e-4ce0-9b93-abf3db56e0bc None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:41.787205 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:41.787819 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:41.788080 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:41.788341 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:41.790408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:41.800369 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:41.801824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:41.811626 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4568/9119] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:42:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:42:41.945943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a673ff-7dea-453e-a3eb-60be13b0d357 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:41.946549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a673ff-7dea-453e-a3eb-60be13b0d357 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:41.946549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a673ff-7dea-453e-a3eb-60be13b0d357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:41.968809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-89a673ff-7dea-453e-a3eb-60be13b0d357 None None] MFA Rules not processed for user `0ffef7873ae44899a84aa7376be7b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:42:41.970304 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-89a673ff-7dea-453e-a3eb-60be13b0d357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:41.980436 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4552/9120] 10.222.0.46 () {58 vars in 1018 bytes} [Sun Aug 21 02:42:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:42:41.991894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:42.001965 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a64565-a1de-4232-b1a4-a2971a06513e service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:42.006030 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:42.006723 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:42.007060 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:42.007390 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:42.018408 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:42.019932 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:42.031749 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4569/9121] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:42:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:42:42.101183 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a673ff-7dea-453e-a3eb-60be13b0d357 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:42.110876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a673ff-7dea-453e-a3eb-60be13b0d357 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:42.114455 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:42.115055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:42.115329 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:42.115594 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:42.117366 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:42.128691 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:42.130484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:42.141351 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4553/9122] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:42:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:42:42.221760 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:42.231909 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63580f-7d64-4c1b-abf5-9d58dfbbb755 service glance] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:42.236284 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385314be-8ba6-4902-b59f-17f0b3221d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:42.236920 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385314be-8ba6-4902-b59f-17f0b3221d31 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:42.237194 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385314be-8ba6-4902-b59f-17f0b3221d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:42.237462 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385314be-8ba6-4902-b59f-17f0b3221d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:42.239485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-385314be-8ba6-4902-b59f-17f0b3221d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:42.254367 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385314be-8ba6-4902-b59f-17f0b3221d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:42.256128 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385314be-8ba6-4902-b59f-17f0b3221d31 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:42.271871 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4570/9123] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:42:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:42:42.344581 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:42.346288 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:42.419423 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35f5c-2ba1-4a23-a490-a31d5330c620 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:42.424676 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:42.425323 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:42.425602 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:42.425873 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:42.427687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:42.439861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:42.441433 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:42.451789 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4554/9124] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:42:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:42:44.429209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbe4a-082e-4f53-82b5-c7869cce726c None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:44.429730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbe4a-082e-4f53-82b5-c7869cce726c None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:44.429730 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbe4a-082e-4f53-82b5-c7869cce726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:44.449538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-575fbe4a-082e-4f53-82b5-c7869cce726c None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:42:44.451099 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-575fbe4a-082e-4f53-82b5-c7869cce726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:42:44.459441 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4571/9125] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:42:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:42:44.471626 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:42:44.483170 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08029ba-78f4-47cc-b8f0-6b74c8f3b07f service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:42:44.488126 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:42:44.488737 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:42:44.489042 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:42:44.489313 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:42:44.497587 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:42:44.499160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:42:44.507794 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4555/9126] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:42:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:42:54.444761 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=21 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:54.504175 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=47 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:43:04.984907 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:43:04.985434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:43:04.985434 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:43:05.008209 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:43:05.009472 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:43:05.021814 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4572/9127] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 02:43:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:43:05.034700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:43:05.047093 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeed36-c8dc-44c7-96d7-08e326b98b41 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:43:05.052794 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:43:05.053403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:43:05.053679 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:43:05.053950 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:43:05.063266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:43:05.065597 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:43:05.077492 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4556/9128] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:43:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:43:15.001774 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=3 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:43:15.073368 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:43:29.226161 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:43:29.228228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:43:29.259507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a79e-0afd-4002-8660-f880ea128008 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:43:29.266304 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:43:29.266952 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:43:29.267232 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:43:29.267511 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:43:29.269490 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:43:29.281985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:43:29.283682 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:43:29.293911 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4573/9129] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:43:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:43:39.289800 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=10 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:43:59.598689 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:43:59.611146 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492957-e1ae-422d-9076-e4b5e0b659f9 service swift] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:43:59.617576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:43:59.618185 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:43:59.618468 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:43:59.618725 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:43:59.620627 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:43:59.632878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:43:59.634632 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:43:59.645604 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4557/9130] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:43:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:44:09.641025 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:44:41.820289 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:44:41.831032 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572daa3-7e27-4827-848d-75c566c07990 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:44:41.835549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1225-932a-4d07-826b-282406fc1c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:44:41.836159 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1225-932a-4d07-826b-282406fc1c67 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:44:41.836430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1225-932a-4d07-826b-282406fc1c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:44:41.836688 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1225-932a-4d07-826b-282406fc1c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:44:41.846597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae1225-932a-4d07-826b-282406fc1c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:44:41.848028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae1225-932a-4d07-826b-282406fc1c67 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:44:41.857555 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4574/9131] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:44:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:44:42.736213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:44:42.749847 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba21ac-57db-472f-bc68-be0bffdf6b57 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:44:42.758384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:44:42.759148 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:44:42.759295 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:44:42.759536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:44:42.761384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:44:42.776825 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:44:42.778643 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:44:42.791734 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4558/9132] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:44:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:44:49.742329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70170-5158-41aa-9362-77ef7761d25a None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:44:49.742887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70170-5158-41aa-9362-77ef7761d25a None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:44:49.742887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70170-5158-41aa-9362-77ef7761d25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:44:49.765067 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-16d70170-5158-41aa-9362-77ef7761d25a None None] MFA Rules not processed for user `89156176073c4a8b960c14e55528d7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:44:49.766407 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-16d70170-5158-41aa-9362-77ef7761d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:44:49.774455 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4575/9133] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:44:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:44:52.786968 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:44:59.760065 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=9 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:06.535842 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:45:06.549624 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a4b8-3ea5-4083-841b-5954879a1867 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:45:06.556160 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:45:06.557077 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:45:06.557408 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:45:06.557742 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:45:06.560453 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:45:06.572213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:45:06.573683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:45:06.582031 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4559/9134] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:45:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:45:08.095699 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70170-5158-41aa-9362-77ef7761d25a None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:45:08.109438 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70170-5158-41aa-9362-77ef7761d25a None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:45:08.116307 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:45:08.117228 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:45:08.117507 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:45:08.117807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:45:08.121076 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:45:08.135623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:45:08.137245 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:45:08.148924 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4576/9135] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:45:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:45:12.945420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:45:12.955566 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4291-0bdb-467c-8e88-8cd332442057 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:45:12.960063 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:45:12.960936 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:45:12.961212 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:45:12.961660 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:45:12.963747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:45:12.975977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:45:12.977708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:45:12.987658 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4560/9136] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:45:13.590035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:45:13.605235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441d098-fabe-4b78-8419-9a6f6346f244 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:45:13.612184 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:45:13.613160 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:45:13.613444 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:45:13.613749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:45:13.615770 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:45:13.629479 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:45:13.631471 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:45:13.645400 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4577/9137] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:45:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:45:22.983831 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=12 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:23.638872 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=12 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:28.440889 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:45:28.458993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f207c-067a-4cee-8e96-793959fa70a4 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:45:28.465041 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:45:28.465650 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:45:28.465923 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:45:28.466190 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:45:28.476147 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:45:28.477881 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:45:28.489073 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4561/9138] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:45:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:45:30.701743 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:45:30.713267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311d53-57dd-4872-9e71-e435d83306f5 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:45:30.718179 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:45:30.718842 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:45:30.719124 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:45:30.719422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:45:30.730338 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:45:30.731782 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:45:30.741762 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4578/9139] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:45:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:45:38.484516 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:40.737413 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:30.328178 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:47:30.370485 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b75e88-539c-44cb-9f5f-4b5bf6b3f106 service nova] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:47:30.375078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:47:30.376087 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:47:30.376344 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:47:30.376801 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:47:30.409780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:47:30.411184 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:47:30.423019 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4562/9140] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:47:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:47:31.631403 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:47:31.663711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5619-e841-4dc7-8317-6f8fc6df40e7 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:47:31.667657 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:47:31.668302 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:47:31.668911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:47:31.668911 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:47:31.679358 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:47:31.680811 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:47:31.691731 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4579/9141] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:47:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:47:40.418104 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=27 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:41.687280 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=15 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:46.186593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:47:46.195996 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0463adc-9831-47c8-b9cd-4fe132173a9e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:47:46.200213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:47:46.200915 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:47:46.201179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:47:46.201458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:47:46.209896 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:47:46.211391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:47:46.221638 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4563/9142] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:47:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:47:46.310131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:47:46.319068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1888aa-4dc0-4a43-8712-2b11cd5f46b4 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:47:46.322766 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:47:46.323368 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:47:46.323645 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:47:46.323916 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:47:46.334715 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:47:46.336132 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:47:46.347898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4580/9143] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:47:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:47:46.429788 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:47:46.443585 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1633-8685-41d6-bb03-51190578a487 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:47:46.450278 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:47:46.450876 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:47:46.451151 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:47:46.451415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:47:46.460584 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:47:46.462208 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:47:46.472951 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4564/9144] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:47:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:47:53.310792 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:47:53.320996 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2f93e-650a-48aa-8f94-1412af73a68a service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:47:53.326527 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:47:53.327143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:47:53.327495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:47:53.327786 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:47:53.336711 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:47:53.338191 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:47:53.346656 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4581/9145] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:47:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:47:56.468248 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=12 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:48:03.343256 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=12 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:48:32.240536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:48:32.252370 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004c0f7-c9fe-45cb-9526-b517428c2431 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:48:32.258129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:48:32.258773 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:48:32.259210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:48:32.259488 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:48:32.268630 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:48:32.270239 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:48:32.280744 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4565/9146] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:48:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:48:42.276465 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:02.576750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:02.596815 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea73f0b-7ad8-4ab2-87e5-404100c27f35 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:02.604089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:02.604698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:02.604985 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:02.605266 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:02.614267 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:02.615824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:02.626531 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4582/9147] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:49:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:49:12.621993 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:34.938462 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:34.940376 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:34.983253 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbc45d-362e-4cc9-86d7-f1ffc1cbda78 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:34.988167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:34.989044 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:34.989412 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:34.989861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:34.991993 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:35.086347 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:35.087802 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:35.107696 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4566/9148] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:49:38.049641 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:38.064623 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd36e6-80df-4248-bef2-8d43e9136a07 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:38.070277 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:38.070997 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:38.071454 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:38.071887 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:38.074202 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:38.111213 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:38.116588 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:38.130416 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4583/9149] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:49:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:49:41.416709 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:41.431780 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a465c7a-1b4c-452d-b001-6d264b745faa service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:41.441390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:41.441664 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:41.442128 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:41.442568 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:41.444538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:41.457943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:41.459639 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:41.479869 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4567/9150] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:49:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:49:41.499397 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:41.501944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:41.524944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab068f5d-03b3-469e-b021-1a2b58243c00 service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:41.531043 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:41.531834 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:41.532717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:41.532717 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] PATH_INFO: `/v3/users/89156176073c4a8b960c14e55528d7a9` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:41.552741 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89156176073c4a8b960c14e55528d7a9)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:41.555089 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:41.603679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89156176073c4a8b960c14e55528d7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:41.620465 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89156176073c4a8b960c14e55528d7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:41.621308 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89156176073c4a8b960c14e55528d7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:41.643791 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89156176073c4a8b960c14e55528d7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:41.644528 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89156176073c4a8b960c14e55528d7a9'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:41.662285 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4584/9151] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:49:41 2022] DELETE /identity/v3/users/89156176073c4a8b960c14e55528d7a9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:49:41.842167 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:41.858043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45301a8b-2e02-427b-9b4d-b7495756ac66 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:41.926628 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:41.927266 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:41.927562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:41.927831 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] PATH_INFO: `/v3/projects/5e5295ac46034f46b4781ed5d0374912` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:41.938458 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5295ac46034f46b4781ed5d0374912)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:41.940379 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:41.983407 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:42.002287 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5295ac46034f46b4781ed5d0374912', 'request_id': 'req-b49c636d-ee59-4cef-8a25-d2225a96fbde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.009733 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5295ac46034f46b4781ed5d0374912', 'request_id': 'req-b49c636d-ee59-4cef-8a25-d2225a96fbde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.016078 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5295ac46034f46b4781ed5d0374912', 'request_id': 'req-b49c636d-ee59-4cef-8a25-d2225a96fbde'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.031487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] The token cache is being invalidate because project 5e5295ac46034f46b4781ed5d0374912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:49:42.031752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.032384 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.033963 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4568/9152] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:49:41 2022] DELETE /identity/v3/projects/5e5295ac46034f46b4781ed5d0374912 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:49:42.038278 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:42.039708 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:42.053813 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ead6-9bd7-4cdb-ab80-64a1a8036324 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:42.114068 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:42.115173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:42.115173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:42.115173 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] PATH_INFO: `/v3/users/78bbec87054e41b48b2ae5233df9583b` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:42.130584 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78bbec87054e41b48b2ae5233df9583b)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:42.132504 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:42.163586 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:42.184062 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bbec87054e41b48b2ae5233df9583b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.194673 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bbec87054e41b48b2ae5233df9583b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.195433 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bbec87054e41b48b2ae5233df9583b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.203120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bbec87054e41b48b2ae5233df9583b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.203789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-10515c17-fa45-4355-b744-6495d040a13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bbec87054e41b48b2ae5233df9583b'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.222155 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4585/9153] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:49:42 2022] DELETE /identity/v3/users/78bbec87054e41b48b2ae5233df9583b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:49:42.410306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:42.411832 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:42.425861 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c636d-ee59-4cef-8a25-d2225a96fbde admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:42.486152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:42.486786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:42.487065 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:42.487331 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] PATH_INFO: `/v3/projects/e7c9974c1ddb4f6fb6cfd658d94ec351` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:42.498559 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c9974c1ddb4f6fb6cfd658d94ec351)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:42.500477 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:42.549024 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c9974c1ddb4f6fb6cfd658d94ec351', 'request_id': 'req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.556019 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c9974c1ddb4f6fb6cfd658d94ec351', 'request_id': 'req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.562785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c9974c1ddb4f6fb6cfd658d94ec351', 'request_id': 'req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.576473 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] The token cache is being invalidate because project e7c9974c1ddb4f6fb6cfd658d94ec351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:49:42.576808 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.577487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-6c2890ec-2a4d-4aae-b044-ce816ebbaf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:49:42.579032 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4569/9154] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:49:42 2022] DELETE /identity/v3/projects/e7c9974c1ddb4f6fb6cfd658d94ec351 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:49:42.584357 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c185ec-0de5-465f-9e24-d423f7e45fb4 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:42.584863 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c185ec-0de5-465f-9e24-d423f7e45fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:42.584961 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c185ec-0de5-465f-9e24-d423f7e45fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:42.659622 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-36c185ec-0de5-465f-9e24-d423f7e45fb4 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:49:42.660867 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-36c185ec-0de5-465f-9e24-d423f7e45fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:42.724246 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4586/9155] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:49:42.732700 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d304b-3249-4feb-9cbd-dc3b713abc89 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:42.733132 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d304b-3249-4feb-9cbd-dc3b713abc89 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:42.733403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d304b-3249-4feb-9cbd-dc3b713abc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:42.756957 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-297d304b-3249-4feb-9cbd-dc3b713abc89 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:49:42.758187 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-297d304b-3249-4feb-9cbd-dc3b713abc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:42.767164 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4570/9156] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:49:42.773561 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c185ec-0de5-465f-9e24-d423f7e45fb4 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:42.788420 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c185ec-0de5-465f-9e24-d423f7e45fb4 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:42.795750 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:42.796354 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:42.796628 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:42.796924 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:42.797564 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81886) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 02:49:42.797859 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:42.799534 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:42.817782 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4587/9157] 10.222.0.46 () {58 vars in 1153 bytes} [Sun Aug 21 02:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 02:49:42.822420 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d304b-3249-4feb-9cbd-dc3b713abc89 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:42.832538 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d304b-3249-4feb-9cbd-dc3b713abc89 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:42.839055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:42.839692 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:42.839964 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:42.840233 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:42.840894 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:42.842882 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:42.879409 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:42.890749 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4571/9158] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:49:42 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:49:42.896141 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:42.906944 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eb210-6733-411a-b0d6-65795e4292b2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:42.966510 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:42.967121 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:42.967394 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:42.967661 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:42.968282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:42.970221 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:42.978975 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:42.993388 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4588/9159] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:49:42 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:49:42.997837 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:43.010029 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abfaf1-72ce-4b72-84c8-f1fb052b18a3 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:43.015856 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:43.016475 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:43.016752 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:43.017062 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:43.017874 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:43.019508 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:43.030828 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4572/9160] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:49:43.034958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:43.046361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31b80d-cb38-4c88-95e7-3f42f35a8d44 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:43.052155 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230962f-f478-4de5-a589-c7e5f47d831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:43.053085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230962f-f478-4de5-a589-c7e5f47d831d admin admin] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:43.053372 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230962f-f478-4de5-a589-c7e5f47d831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:43.053643 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230962f-f478-4de5-a589-c7e5f47d831d admin admin] PATH_INFO: `/v3/roles` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:43.054296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230962f-f478-4de5-a589-c7e5f47d831d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:43.055918 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230962f-f478-4de5-a589-c7e5f47d831d admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:43.067683 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4589/9161] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:49:43.072012 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:43.082826 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342fdb-79f0-413e-a6d6-a30dca428319 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:43.087959 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:43.088641 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:43.089021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:43.089269 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] PATH_INFO: `/v3/projects/ada6671b46a84260bf51e80a6043e882/users/b7733529dcc341e293d8af606a664c6f/roles/a11e5ddd599243b983e4f4e44fe1bd85` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:43.106129 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada6671b46a84260bf51e80a6043e882, user_id=b7733529dcc341e293d8af606a664c6f, role_id=a11e5ddd599243b983e4f4e44fe1bd85)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:43.109803 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:43.127589 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4573/9162] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:49:43 2022] PUT /identity/v3/projects/ada6671b46a84260bf51e80a6043e882/users/b7733529dcc341e293d8af606a664c6f/roles/a11e5ddd599243b983e4f4e44fe1bd85 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:49:43.132974 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0c25-97c2-4090-ae57-2338b3a2c021 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:43.133260 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0c25-97c2-4090-ae57-2338b3a2c021 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:43.133538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0c25-97c2-4090-ae57-2338b3a2c021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:43.153751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-079c0c25-97c2-4090-ae57-2338b3a2c021 None None] MFA Rules not processed for user `d3c40350199043a89e4162ff1c7c88f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:49:43.154963 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-079c0c25-97c2-4090-ae57-2338b3a2c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:43.218101 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4590/9163] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:49:43.228800 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:43.231549 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:43.306403 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f5fab-8874-4092-bc96-f31c08e3bba4 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:43.311025 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:43.311642 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:43.311939 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:43.312203 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:43.322320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:43.323753 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:43.334265 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4574/9164] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:49:47.439870 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0001ad-6b4f-4b54-bc0b-2e3d7aaea597 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:47.440359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0001ad-6b4f-4b54-bc0b-2e3d7aaea597 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:47.440449 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0001ad-6b4f-4b54-bc0b-2e3d7aaea597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:47.484500 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-4c0001ad-6b4f-4b54-bc0b-2e3d7aaea597 None None] MFA Rules not processed for user `b7733529dcc341e293d8af606a664c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:49:47.486028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-4c0001ad-6b4f-4b54-bc0b-2e3d7aaea597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:47.586166 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4591/9165] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:49:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:49:47.587131 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:47.598785 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295542d-8ff4-4907-8c7f-81d37ddbf3e5 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:47.604061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:47.604683 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:47.604995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:47.605267 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:47.606055 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:47.608180 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:47.644108 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4575/9166] 10.222.0.46 () {60 vars in 1153 bytes} [Sun Aug 21 02:49:47 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 02:49:47.645131 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0001ad-6b4f-4b54-bc0b-2e3d7aaea597 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:47.657474 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0001ad-6b4f-4b54-bc0b-2e3d7aaea597 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:47.719660 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:47.720298 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:47.720579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:47.720873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:47.721516 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:47.723432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:47.743492 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:47.751882 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4592/9167] 10.222.0.46 () {60 vars in 1144 bytes} [Sun Aug 21 02:49:47 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 02:49:47.755786 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:47.767571 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8014-3851-4c9f-977a-105ae6c0f892 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:47.772389 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:47.773043 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:47.773320 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:47.773590 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:47.774231 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:47.775841 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:47.788119 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4576/9168] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:49:47.791718 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:47.802525 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6d7f2-9148-42be-be48-544a008a37a8 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:47.807352 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:47.808042 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:47.808317 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:47.808693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] PATH_INFO: `/v3/projects/4db83ce470814c44ba94d801754f65f8/users/c2ea324770ca4de9b4adf872808b5086/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:47.827683 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db83ce470814c44ba94d801754f65f8, user_id=c2ea324770ca4de9b4adf872808b5086, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:47.830405 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:47.845794 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4593/9169] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:49:47 2022] PUT /identity/v3/projects/4db83ce470814c44ba94d801754f65f8/users/c2ea324770ca4de9b4adf872808b5086/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 02:49:47.849937 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:47.870540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab716cc4-c114-4a78-848e-e7e1dee65aa8 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:47.948995 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1f8a-c28f-4e3d-bc2c-678e25e39e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:47.949714 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1f8a-c28f-4e3d-bc2c-678e25e39e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:47.949991 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1f8a-c28f-4e3d-bc2c-678e25e39e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:47.950262 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1f8a-c28f-4e3d-bc2c-678e25e39e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:47.950921 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d1f8a-c28f-4e3d-bc2c-678e25e39e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:47.952543 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d1f8a-c28f-4e3d-bc2c-678e25e39e6a admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:47.963334 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4577/9170] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 02:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 02:49:47.967749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:47.979749 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc278d5d-d3af-4cea-b2ed-1763a4a8fe70 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:47.985028 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:47.985727 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:47.986008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:47.986283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] PATH_INFO: `/v3/projects/4db83ce470814c44ba94d801754f65f8/users/c2ea324770ca4de9b4adf872808b5086/roles/fd13fde432a246499375976d02e43d56` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:47.988254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db83ce470814c44ba94d801754f65f8, user_id=c2ea324770ca4de9b4adf872808b5086, role_id=fd13fde432a246499375976d02e43d56)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:47.990958 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:48.008285 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4594/9171] 10.222.0.46 () {60 vars in 1483 bytes} [Sun Aug 21 02:49:47 2022] PUT /identity/v3/projects/4db83ce470814c44ba94d801754f65f8/users/c2ea324770ca4de9b4adf872808b5086/roles/fd13fde432a246499375976d02e43d56 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:49:52.397902 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6675cb-ff04-4d7a-933a-ed4ee6b1ac7e None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:52.398422 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6675cb-ff04-4d7a-933a-ed4ee6b1ac7e None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:52.398535 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6675cb-ff04-4d7a-933a-ed4ee6b1ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:52.431189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-6e6675cb-ff04-4d7a-933a-ed4ee6b1ac7e None None] MFA Rules not processed for user `c2ea324770ca4de9b4adf872808b5086`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:49:52.432324 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-6e6675cb-ff04-4d7a-933a-ed4ee6b1ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:52.453609 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:52.515426 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4578/9172] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:49:52.531885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:52.534475 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:52.645881 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ff96-1a44-4f49-93f0-6f4740ed79c2 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:52.654581 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:52.655233 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:52.655487 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:52.655754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:52.722296 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:52.723851 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:52.736960 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4595/9173] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:49:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:49:54.823970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825575-06cc-4dd4-9e84-de941ec37929 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:54.824469 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825575-06cc-4dd4-9e84-de941ec37929 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:54.824567 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825575-06cc-4dd4-9e84-de941ec37929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:54.844155 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-12825575-06cc-4dd4-9e84-de941ec37929 None None] MFA Rules not processed for user `b7733529dcc341e293d8af606a664c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:49:54.845391 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-12825575-06cc-4dd4-9e84-de941ec37929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:54.852926 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4579/9174] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:49:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:49:55.193478 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:49:55.195426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:55.249159 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:55.266169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f2516-e13b-45be-bac8-289e829a9fd5 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:49:55.270693 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:49:55.271235 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:49:55.271495 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:49:55.271869 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:49:55.274017 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:49:55.284824 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:49:55.286265 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:49:55.294861 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4596/9175] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:49:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:50:04.838489 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=24 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:50:05.290853 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=7 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:50:12.358159 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825575-06cc-4dd4-9e84-de941ec37929 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:50:12.369540 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825575-06cc-4dd4-9e84-de941ec37929 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:50:12.374393 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:50:12.375058 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:50:12.375410 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:50:12.375687 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:50:12.387116 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:50:12.388623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:50:12.400720 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4580/9176] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:50:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:50:14.395576 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:50:14.414078 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f50c-c5a6-491e-8ab2-5256f84981d0 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:50:14.420844 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:50:14.421448 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:50:14.421721 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:50:14.421988 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:50:14.424714 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:50:14.438597 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:50:14.440441 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:50:14.451837 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4597/9177] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:50:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:50:22.395792 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=6 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:50:24.447712 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:52:40.400117 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:52:40.402177 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:52:40.494176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd93cd-a721-4f3b-8f50-e4582bd1e88e service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:52:40.499056 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e191a-80cd-4175-989d-38cc709256d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:52:40.499698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e191a-80cd-4175-989d-38cc709256d4 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:52:40.499975 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e191a-80cd-4175-989d-38cc709256d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:52:40.500305 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e191a-80cd-4175-989d-38cc709256d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:52:40.502193 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf0e191a-80cd-4175-989d-38cc709256d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:52:40.518021 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e191a-80cd-4175-989d-38cc709256d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:52:40.520303 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e191a-80cd-4175-989d-38cc709256d4 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:52:40.545960 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4581/9178] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:52:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:52:47.869374 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:52:47.896322 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afa827-79b2-40be-8769-d8e6c72970a6 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:52:47.903112 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:52:47.903732 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:52:47.903998 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:52:47.904283 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:52:47.906469 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:52:47.920286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:52:47.921929 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:52:47.935204 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4598/9179] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:52:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:52:49.629905 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a536b-94d4-45f8-b104-687c6ce80801 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:52:49.630390 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a536b-94d4-45f8-b104-687c6ce80801 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:52:49.630569 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a536b-94d4-45f8-b104-687c6ce80801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:52:49.694860 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-296a536b-94d4-45f8-b104-687c6ce80801 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:52:49.696082 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-296a536b-94d4-45f8-b104-687c6ce80801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:52:49.777105 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4582/9180] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:52:49.830119 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:52:49.831640 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:52:49.943093 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b30f-504b-4157-9c3d-e7f136ef85f3 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:52:49.949807 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:52:49.950424 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:52:49.950703 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:52:49.950977 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:52:49.961707 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:52:49.963579 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:52:49.972755 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4599/9181] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:52:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:52:59.397437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4ba4-b47d-45b7-9273-2c9192b5afeb None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:52:59.397953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4ba4-b47d-45b7-9273-2c9192b5afeb None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:52:59.397953 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4ba4-b47d-45b7-9273-2c9192b5afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:52:59.416983 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-3f1f4ba4-b47d-45b7-9273-2c9192b5afeb None None] MFA Rules not processed for user `b7733529dcc341e293d8af606a664c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:52:59.418282 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-3f1f4ba4-b47d-45b7-9273-2c9192b5afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:52:59.426278 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4583/9182] 10.222.0.46 () {58 vars in 958 bytes} [Sun Aug 21 02:52:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:52:59.968445 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=51 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:00.110680 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:53:00.112447 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:00.137081 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4ba4-b47d-45b7-9273-2c9192b5afeb None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:53:00.147277 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4ba4-b47d-45b7-9273-2c9192b5afeb None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:53:00.150918 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9090-7668-48ef-a96c-4696b9ac9f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:53:00.151528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9090-7668-48ef-a96c-4696b9ac9f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:53:00.151809 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9090-7668-48ef-a96c-4696b9ac9f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:53:00.152197 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9090-7668-48ef-a96c-4696b9ac9f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:53:00.153956 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-538f9090-7668-48ef-a96c-4696b9ac9f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:00.169701 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9090-7668-48ef-a96c-4696b9ac9f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:53:00.171152 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9090-7668-48ef-a96c-4696b9ac9f52 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:53:00.182835 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4584/9183] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:53:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 02:53:00.191229 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03863c-196c-48aa-9c93-499a78a8871e service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:53:00.196936 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:53:00.197566 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:53:00.197845 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:53:00.198120 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:53:00.199982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:00.212457 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:53:00.214085 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:53:00.225196 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4600/9184] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:53:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:53:02.471242 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec040e-0a71-4d88-9bbe-0a8f35d4b323 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:53:02.471741 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec040e-0a71-4d88-9bbe-0a8f35d4b323 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:53:02.471836 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec040e-0a71-4d88-9bbe-0a8f35d4b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:53:02.480131 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=93 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:02.492556 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-62ec040e-0a71-4d88-9bbe-0a8f35d4b323 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:53:02.493821 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-62ec040e-0a71-4d88-9bbe-0a8f35d4b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:02.501540 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4585/9185] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:53:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:53:02.513502 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:53:02.526818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a710f9f-ab67-41aa-98a3-068bd26396fc service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:53:02.532035 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:53:02.532676 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:53:02.532982 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:53:02.533291 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:53:02.542894 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:53:02.544480 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:53:02.553290 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4601/9186] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:53:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:53:10.456667 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec040e-0a71-4d88-9bbe-0a8f35d4b323 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:53:10.471562 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec040e-0a71-4d88-9bbe-0a8f35d4b323 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:53:10.477064 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:53:10.477878 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:53:10.478302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:53:10.478428 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:53:10.480580 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:10.496385 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:53:10.498137 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:53:10.509065 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4586/9187] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:53:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:53:12.549564 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=38 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:20.503990 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=8 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:33.931008 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:53:33.945983 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f5318-2321-4e9e-b7c9-e63d1cd4357f service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:53:33.953994 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:53:33.955001 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:53:33.955255 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:53:33.955549 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:53:33.958751 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:33.971873 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:53:33.973346 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:53:33.981913 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4602/9188] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:53:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:53:37.218593 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:53:37.220276 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:37.249122 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672500-6176-4034-81f2-5b99869909b9 service neutron] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:53:37.258467 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21746feb-7d0a-45f3-b4fa-b4c721b7d11e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:53:37.259404 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746feb-7d0a-45f3-b4fa-b4c721b7d11e service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:53:37.259688 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746feb-7d0a-45f3-b4fa-b4c721b7d11e service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:53:37.259965 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746feb-7d0a-45f3-b4fa-b4c721b7d11e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:53:37.262336 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-21746feb-7d0a-45f3-b4fa-b4c721b7d11e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:53:37.274306 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21746feb-7d0a-45f3-b4fa-b4c721b7d11e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:53:37.275892 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21746feb-7d0a-45f3-b4fa-b4c721b7d11e service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:53:37.287290 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4587/9189] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:53:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:53:43.978173 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:47.282519 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=10 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:12.593941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:54:12.607979 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03829b9-254c-40a2-b96b-3e4a06e3abb3 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:54:12.614426 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:54:12.615169 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:54:12.615775 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:54:12.616056 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:54:12.618041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:54:12.630143 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:54:12.632185 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:54:12.642333 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4603/9190] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:54:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:54:22.638364 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:45.143234 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ae43-158c-4912-8baf-5c4ba257b4c4 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:54:45.143862 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ae43-158c-4912-8baf-5c4ba257b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:54:45.144225 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ae43-158c-4912-8baf-5c4ba257b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:54:45.164713 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-c831ae43-158c-4912-8baf-5c4ba257b4c4 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:54:45.165960 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c831ae43-158c-4912-8baf-5c4ba257b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:54:45.174368 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4588/9191] 10.222.0.46 () {58 vars in 1009 bytes} [Sun Aug 21 02:54:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:54:45.215837 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:54:45.228538 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11564-43a2-422c-adc9-4053e53cbc3d service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:54:45.233632 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3afdcc-72d3-4a27-8daa-0fda5bd1e23d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:54:45.234271 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3afdcc-72d3-4a27-8daa-0fda5bd1e23d service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:54:45.234638 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3afdcc-72d3-4a27-8daa-0fda5bd1e23d service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:54:45.234931 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3afdcc-72d3-4a27-8daa-0fda5bd1e23d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:54:45.244041 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3afdcc-72d3-4a27-8daa-0fda5bd1e23d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:54:45.245818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3afdcc-72d3-4a27-8daa-0fda5bd1e23d service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:54:45.254428 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4604/9192] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:54:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:54:52.833677 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831ae43-158c-4912-8baf-5c4ba257b4c4 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:54:52.845105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831ae43-158c-4912-8baf-5c4ba257b4c4 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:54:52.849922 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff798abd7e4970977c2465aaed01b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:54:52.850970 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:54:52.851830 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:54:52.852326 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:54:52.864054 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:54:52.865554 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:54:52.876801 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4589/9193] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:54:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:54:55.019634 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473f2d-727a-4601-af48-54368697d326 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:54:55.020180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473f2d-727a-4601-af48-54368697d326 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:54:55.020180 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473f2d-727a-4601-af48-54368697d326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:54:55.040578 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-2f473f2d-727a-4601-af48-54368697d326 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:54:55.041855 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-2f473f2d-727a-4601-af48-54368697d326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:54:55.049605 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4605/9194] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 02:54:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:54:55.065105 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:54:55.081617 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042065-376b-4422-9f28-dae43ced4670 service glance] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:54:55.086708 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57719177-6197-4e27-8158-10973c86a436 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:54:55.087302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57719177-6197-4e27-8158-10973c86a436 service swift] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:54:55.087576 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57719177-6197-4e27-8158-10973c86a436 service swift] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:54:55.087859 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57719177-6197-4e27-8158-10973c86a436 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:54:55.096258 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57719177-6197-4e27-8158-10973c86a436 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:54:55.098061 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57719177-6197-4e27-8158-10973c86a436 service swift] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:54:55.106686 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4590/9195] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:54:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:54:56.334937 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473f2d-727a-4601-af48-54368697d326 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:54:56.350492 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473f2d-727a-4601-af48-54368697d326 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:54:56.356862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ffef7873ae44899a84aa7376be7b8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:54:56.357489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:54:56.357746 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:54:56.358220 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:54:56.360015 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:54:56.375445 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:54:56.377935 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:54:56.395384 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4606/9196] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:54:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:55:00.068415 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337a543-dd9e-4e68-be7b-607ce12ff2e6 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:00.068901 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337a543-dd9e-4e68-be7b-607ce12ff2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:00.068998 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337a543-dd9e-4e68-be7b-607ce12ff2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:00.088572 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-5337a543-dd9e-4e68-be7b-607ce12ff2e6 None None] MFA Rules not processed for user `ececa74a5c554c85b42f85ed93be05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:55:00.089798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-5337a543-dd9e-4e68-be7b-607ce12ff2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:55:00.097463 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4591/9197] 10.222.0.46 () {58 vars in 967 bytes} [Sun Aug 21 02:55:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:55:00.110567 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:55:00.123314 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a427a2-9ea2-4068-b9b3-435040335713 service nova] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:55:00.128496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eadc3e155df4f5a9f40ae75ee27733f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:55:00.129134 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:00.129432 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:00.129701 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:00.139430 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:55:00.141036 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:55:00.151096 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4607/9198] 10.222.0.46 () {60 vars in 1384 bytes} [Sun Aug 21 02:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 02:55:05.864040 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a99a54-2ae0-4ccf-98c9-455ab8014339 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:05.864529 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a99a54-2ae0-4ccf-98c9-455ab8014339 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:05.864648 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a99a54-2ae0-4ccf-98c9-455ab8014339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:05.908684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-d0a99a54-2ae0-4ccf-98c9-455ab8014339 None None] MFA Rules not processed for user `887449bfd1b64d408d74e60f556b081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 02:55:05.909977 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-d0a99a54-2ae0-4ccf-98c9-455ab8014339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:55:05.917657 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4592/9199] 10.222.0.46 () {58 vars in 1062 bytes} [Sun Aug 21 02:55:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 02:55:05.924021 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:55:05.933625 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f62bf-635a-48e6-8335-395ca7aa20fb service swift] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:55:05.937552 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887449bfd1b64d408d74e60f556b081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:55:05.938147 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:05.938422 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:05.938698 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:06.003917 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:55:06.005423 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:55:06.015203 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4608/9200] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:55:09.334727 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a99a54-2ae0-4ccf-98c9-455ab8014339 None None] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:55:09.344876 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=28 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:55:09.352402 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a99a54-2ae0-4ccf-98c9-455ab8014339 None None] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:55:09.366898 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:55:09.367926 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:09.368213 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:09.368489 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:09.370361 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:55:09.385440 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:55:09.387222 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:55:09.401709 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4593/9201] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:55:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:55:12.434246 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:55:12.445545 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2d00-4095-4c88-9ee1-d49db7da3f48 service neutron] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:55:12.451789 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:55:12.452607 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:12.453109 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:12.453442 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] PATH_INFO: `/v3/users/b7733529dcc341e293d8af606a664c6f` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:12.454739 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7733529dcc341e293d8af606a664c6f)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:55:12.457125 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:55:12.525626 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7733529dcc341e293d8af606a664c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:12.543489 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7733529dcc341e293d8af606a664c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:12.544262 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7733529dcc341e293d8af606a664c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:12.554719 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7733529dcc341e293d8af606a664c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:12.555455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7733529dcc341e293d8af606a664c6f'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:12.580898 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4609/9202] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:55:12 2022] DELETE /identity/v3/users/b7733529dcc341e293d8af606a664c6f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:55:12.808491 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:55:12.821528 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18532-1606-4702-96c6-270d7387ee38 service placement] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:55:12.901644 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:55:12.902437 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:12.902698 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:12.903102 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] PATH_INFO: `/v3/projects/ada6671b46a84260bf51e80a6043e882` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:12.904438 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada6671b46a84260bf51e80a6043e882)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:55:12.906396 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:55:12.979165 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada6671b46a84260bf51e80a6043e882', 'request_id': 'req-73ab6066-eadd-466d-a3f1-6d6b7c371826'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:12.989001 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada6671b46a84260bf51e80a6043e882', 'request_id': 'req-73ab6066-eadd-466d-a3f1-6d6b7c371826'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:12.998209 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada6671b46a84260bf51e80a6043e882', 'request_id': 'req-73ab6066-eadd-466d-a3f1-6d6b7c371826'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.015557 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] The token cache is being invalidate because project ada6671b46a84260bf51e80a6043e882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:55:13.015852 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.016545 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.018119 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4594/9203] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:55:12 2022] DELETE /identity/v3/projects/ada6671b46a84260bf51e80a6043e882 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:55:13.023241 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:55:13.025361 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:55:13.034761 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:55:13.041754 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adb46e-f260-4f5f-8283-b33fe3f42cb0 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:55:13.117158 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:55:13.118319 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:13.118618 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:13.118885 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] PATH_INFO: `/v3/users/c2ea324770ca4de9b4adf872808b5086` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:13.120589 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ea324770ca4de9b4adf872808b5086)` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:55:13.122984 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:55:13.186679 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ea324770ca4de9b4adf872808b5086'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.200359 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ea324770ca4de9b4adf872808b5086'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.201016 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ea324770ca4de9b4adf872808b5086'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.209748 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ea324770ca4de9b4adf872808b5086'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.210486 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.notifications [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ea324770ca4de9b4adf872808b5086'} {{(pid=81886) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.233669 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4610/9204] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 02:55:13 2022] DELETE /identity/v3/users/c2ea324770ca4de9b4adf872808b5086 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:55:13.436084 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:55:13.437680 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:55:13.452536 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab6066-eadd-466d-a3f1-6d6b7c371826 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:55:13.523302 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3c40350199043a89e4162ff1c7c88f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e256165a7ff4427f88213eb7acbe8301', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:55:13.523943 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:55:13.524220 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:55:13.524484 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] PATH_INFO: `/v3/projects/4db83ce470814c44ba94d801754f65f8` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:55:13.525662 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db83ce470814c44ba94d801754f65f8)` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:55:13.527623 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:55:13.553422 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:55:13.584176 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db83ce470814c44ba94d801754f65f8', 'request_id': 'req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.590505 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db83ce470814c44ba94d801754f65f8', 'request_id': 'req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.596274 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db83ce470814c44ba94d801754f65f8', 'request_id': 'req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6'} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.610179 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] The token cache is being invalidate because project 4db83ce470814c44ba94d801754f65f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 02:55:13.610466 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.611095 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.notifications [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 02:55:13.612713 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4595/9205] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 02:55:13 2022] DELETE /identity/v3/projects/4db83ce470814c44ba94d801754f65f8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 02:55:23.228630 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:55:23.607085 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:58:43.194862 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:58:43.196498 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:58:43.311526 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4af35-027f-4a2a-9197-2c52e1e90649 admin admin] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:58:43.386018 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da8da2-804b-4ed6-9e23-851c54cc4da0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:58:43.386818 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da8da2-804b-4ed6-9e23-851c54cc4da0 service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:58:43.387137 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da8da2-804b-4ed6-9e23-851c54cc4da0 service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:58:43.387485 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da8da2-804b-4ed6-9e23-851c54cc4da0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:58:43.389401 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-c1da8da2-804b-4ed6-9e23-851c54cc4da0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:58:43.402242 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da8da2-804b-4ed6-9e23-851c54cc4da0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:58:43.404960 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da8da2-804b-4ed6-9e23-851c54cc4da0 service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:58:43.421174 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4611/9206] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:58:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:58:53.414228 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=76 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:59:16.548730 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Authenticating user token {{(pid=81885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 02:59:16.550548 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:59:16.596747 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dfdbc-b18d-4f7b-8f79-c9c4ed8699d6 admin admin] Validating token access rules against request {{(pid=81885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 02:59:16.603210 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ca5b6-4906-4d3c-83eb-39064079c73e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 02:59:16.603912 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca5b6-4906-4d3c-83eb-39064079c73e service placement] REQUEST_METHOD: `GET` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 02:59:16.604189 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca5b6-4906-4d3c-83eb-39064079c73e service placement] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 02:59:16.604460 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca5b6-4906-4d3c-83eb-39064079c73e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 02:59:16.606387 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-909ca5b6-4906-4d3c-83eb-39064079c73e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 02:59:16.618798 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ca5b6-4906-4d3c-83eb-39064079c73e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 02:59:16.620879 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ca5b6-4906-4d3c-83eb-39064079c73e service placement] RBAC: Authorization granted {{(pid=81885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 02:59:16.633800 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4596/9207] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 02:59:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 02:59:26.628494 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=17 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 03:01:18.562440 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c5502-d80d-4f96-9c68-34e32f8dc260 None None] REQUEST_METHOD: `POST` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 03:01:18.563087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c5502-d80d-4f96-9c68-34e32f8dc260 None None] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 03:01:18.563087 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c5502-d80d-4f96-9c68-34e32f8dc260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 03:01:18.657282 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.auth.core [None req-6b0c5502-d80d-4f96-9c68-34e32f8dc260 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81886) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 03:01:18.658849 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-6b0c5502-d80d-4f96-9c68-34e32f8dc260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 03:01:18.673477 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4612/9208] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Aug 21 03:01:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 03:01:18.689127 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae2f3-3ac7-48ca-9a5a-a5fbaef12320 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 03:01:18.689869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae2f3-3ac7-48ca-9a5a-a5fbaef12320 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 03:01:18.689869 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae2f3-3ac7-48ca-9a5a-a5fbaef12320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 03:01:18.721487 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-cf6ae2f3-3ac7-48ca-9a5a-a5fbaef12320 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 03:01:18.722999 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-cf6ae2f3-3ac7-48ca-9a5a-a5fbaef12320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 03:01:18.732693 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4597/9209] 10.222.0.46 () {58 vars in 1058 bytes} [Sun Aug 21 03:01:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 03:01:18.744941 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c5502-d80d-4f96-9c68-34e32f8dc260 None None] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 03:01:18.760810 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c5502-d80d-4f96-9c68-34e32f8dc260 None None] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 03:01:18.769310 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 03:01:18.769975 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 03:01:18.770254 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 03:01:18.770568 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 03:01:18.781910 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 03:01:18.783795 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 03:01:18.796914 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4613/9210] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 03:01:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 03:01:28.711883 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 03:01:28.791055 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=28 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 03:01:44.162942 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94acd8-0725-4121-9bba-8ec422375c61 None None] REQUEST_METHOD: `POST` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 03:01:44.163457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94acd8-0725-4121-9bba-8ec422375c61 None None] SCRIPT_NAME: `/identity` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 03:01:44.163457 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94acd8-0725-4121-9bba-8ec422375c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 03:01:44.189461 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.auth.core [None req-bd94acd8-0725-4121-9bba-8ec422375c61 None None] MFA Rules not processed for user `609c592713644ef587afdbe37af676e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 03:01:44.190684 n-d-master-1 devstack@keystone.service[81885]: DEBUG keystone.common.fernet_utils [None req-bd94acd8-0725-4121-9bba-8ec422375c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 03:01:44.202090 n-d-master-1 devstack@keystone.service[81885]: [pid: 81885|app: 0|req: 4598/9211] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Aug 21 03:01:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 03:01:44.218286 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] Authenticating user token {{(pid=81886) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 03:01:44.220571 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.fernet_utils [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81886) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 03:01:44.239329 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51312fb6-d6ee-4ca0-8ac5-738ce26275ae service placement] Validating token access rules against request {{(pid=81886) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 03:01:44.246823 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21ca6e-f950-4a37-b03a-36d233160e1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609c592713644ef587afdbe37af676e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cc8cf359884968a7d28733cf2489c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81886) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 03:01:44.247455 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21ca6e-f950-4a37-b03a-36d233160e1f service placement] REQUEST_METHOD: `GET` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 03:01:44.247734 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21ca6e-f950-4a37-b03a-36d233160e1f service placement] SCRIPT_NAME: `/identity` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 03:01:44.248006 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21ca6e-f950-4a37-b03a-36d233160e1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81886) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 03:01:44.257295 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21ca6e-f950-4a37-b03a-36d233160e1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 03:01:44.259496 n-d-master-1 devstack@keystone.service[81886]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21ca6e-f950-4a37-b03a-36d233160e1f service placement] RBAC: Authorization granted {{(pid=81886) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 03:01:44.270112 n-d-master-1 devstack@keystone.service[81886]: [pid: 81886|app: 0|req: 4614/9212] 10.222.0.46 () {60 vars in 1365 bytes} [Sun Aug 21 03:01:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 03:01:54.184020 n-d-master-1 devstack@keystone.service[81885]: DEBUG dbcounter [-] [81885] Writing DB stats keystone:SELECT=3 {{(pid=81885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 03:01:54.265801 n-d-master-1 devstack@keystone.service[81886]: DEBUG dbcounter [-] [81886] Writing DB stats keystone:SELECT=6 {{(pid=81886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}